# Bot Protection Details This document lists the specific user agent strings that Zen uses to identify and block automated traffic. When a request matches any of these user agents, Zen will automatically flag it as bot traffic. ## AI Data Scrapers ``` AI2Bot anthropic-ai Applebot-Extended Brightbot Bytespider CCBot ChatGLM.Spider ClaudeBot cohere-training-data-crawler Diffbot Google-Extended GPTBot ImagesiftBot img2dataset Kangaroo Bot meta-externalagent omgili PanguBot SBIntuitionsBot Timpibot VelenPublicWebCrawler Webzio-Extended ``` ## Archivers ``` archive.org_bot Arquivo-web-crawler heritrix ia_archiver ia_archiver-web\.archive.org NiceCrawler ``` ## SEO Crawlers ``` AhrefsBot AhrefsSiteAudit Backlinkcrawler Barkrowler BLEXBot BrightEdge Crawler Cocolyzebot DataForSeoBot DomainStatsBot dotbot hypestat linkdexbot MJ12bot online-webceo-bot rogerbot Screaming Frog SEO Spider SemrushBot SenutoBot SenutoBot SeobilityBot Seodiver SEOkicks SEOlizer SEOlyzer serpstatbot sitebulb SiteCheckerBotCrawler Siteimprove\.com ZoomBot ``` ## Search Engines ``` 360Spider AlexandriaOrgBot AntBot Applebot Baiduspider bingbot coccocbot-web Daum DuckDuckBot DuckDuckGo-Favicons-Bot entireweb\.com Feedfetcher-Google GeedoBot Google Favicon Google-InspectionTool Googlebot GoogleOther HaoSouSpider Linguee Bot MojeekBot msnbot netEstate NE Crawler PetalBot Qwantbot Qwantify search\.marginalia\.nu seekport\.com SemanticScholarBot SeznamBot Sogou web spider Storebot-Google StractBot teoma TinEye yacybot Yahoo! Slurp Yandex Yeti YisouSpider ZumBot ``` ## AI Search Crawlers ``` Amazonbot Andibot Applebot-Extended Google-CloudVertexBot iaskspider OAI-SearchBot PerplexityBot PhindBot YouBot ``` ## AI Assistants ``` ChatGPT-User Claude-User Claude-Web cohere-ai DuckAssistBot GitHubCopilotChat Meta-ExternalFetcher MistralAI-User NovaAct Perplexity-User ``` ## Vulnerability Scanners ``` absinthe arachni Argus(-Scanner|Crawler|DataLeakChecker|Bot Argus(-Scanner|Crawler|DataLeakChecker|Bot BackDoorBot bsqlbf cgichk cisco-torch crimscanner DirBuster DominoHunter|domino hunter DotDotPwn feroxbuster FHScan Core Fuzz Faster U Fool gobuster Grendel-Scan Havij hydra l9explore lkxscan masscan Mysqloit Nessus Netsparker Nikto Nmap NSE Nmap Scripting Engine Nuclei OpenVAS OWASP Amass Paros ShadowSpray\.Kerb SQL Power Injector sqlmap sqlninja Teh Forest Lobster uil2pn w3af\.(sf\.net|sourceforge\.net|org webshag webvulnscan WPScan ZmEu ``` ## Headless Browsers ``` HeadlessChrome HeadlessEdg ``` ## Social Media Bots ``` Bluesky Cardyb facebookcatalog facebookexternalhit LinkedInBot Mastodon meta-externalagent meta-externalfetcher pinterest\.com.bot Pinterestbot redditbot TikTokSpider Twitterbot vkShare XING-contenttabreceiver ``` ## Data Harvesters ``` Email Extractor EmailCollector EmailSiphon EmailWolf ExtractorPro MailBait MailSweeper WebDataExtractor ``` ## Advertisement Bots ``` adbeat_bot adidxbot AdsBot-Google Google-Adwords Mediapartners (Googlebot) Mediapartners-Google ``` ## Messager Previews ``` Discordbot SkypeUriPreview Slackbot-LinkExpanding Snap URL Preview Service TelegramBot Viber WhatsApp ``` ## Monitoring Tools ``` Catchpoint pingbot\/|pingdom\.com UptimeRobot\/ ``` --- # Agent Instructions: Querying This Documentation If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question. Perform an HTTP GET request on the current page URL with the `ask` query parameter: ``` GET https://help.aikido.dev/zen-firewall/miscellaneous/bot-protection-details.md?ask= ``` The question should be specific, self-contained, and written in natural language. The response will contain a direct answer to the question and relevant excerpts and sources from the documentation. Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.