robots.txt
==================================================
User-agent: FemtosearchBot disallow: /
User-agent: AhrefsBot disallow: /
User-agent: TurnitinBot Disallow: /
User-agent: BLEXBot Disallow: /
User-agent: MJ12bot Disallow: /
User-agent: PetalBot Disallow: /
User-agent: Amazonbot Disallow: /
User-agent: Applebot Disallow: /
User-agent: YandexCalendar Disallow: /
User-agent: YandexMobileBot Disallow: /
User-agent: dotbot Disallow: /
User-agent: AwarioRssBot User-agent: AwarioSmartBot Disallow: /
User-agent: Baiduspider Disallow: /
User-agent: SemrushBot Disallow: /
User-agent: PetalBot Disallow: /
User-agent: BomboraBot Disallow: /
User-agent: Buck Disallow: /
User-agent: BLEXBot Disallow: /
User-agent: SeekportBot Disallow: /
User-agent: TurnitinBot Disallow: /
User-agent: Paqlebot Disallow: /
User-agent: grapeshot Disallow: /
User-agent: Mail.RU_Bot Disallow: /
User-agent: GeedoBot Disallow: /
User-agent: FemtosearchBot Disallow: /
User-agent: serpstatbot Disallow: /
User-agent: Amazonbot Disallow: /
User-agent: CriteoBot/0.1 Disallow: /
User-agent: DataForSeoBot Disallow: /
User-agent: OpenindexSpider Disallow: /
User-agent: GPTBot Disallow: /
User-agent: Baiduspider User-agent: 360Spider User-agent: Yisouspider User-agent: PetalBot User-agent: Bytespider User-agent: Sogou web spider User-agent: Sogou inst spider Disallow: /
User-agent: proximic Disallow: /
User-agent: ias_crawler Disallow: /
User-agent: AwarioRssBot User-agent: AwarioSmartBot Disallow: /
User-agent: ClaudeBot Disallow: /
User-agent: CCBot Disallow: /
User-agent: bingbot Crawl-Delay:30
User-agent: Amazonbot Disallow: /
User-agent: ClaudeBot Disallow: / =======================================================
robots.txt
https://ahrefs.com/robot/index.php
user-agent: AhrefsBot
disallow: /
iptables -I INPUT 1 -m iprange --src-range 5.10.83.0-5.10.83.127 -j DROP
|
여행
윈도우서버 
