Bot Protection Details
This document lists the specific user agent strings that Zen uses to identify and block automated traffic. When a request matches any of these user agents, Zen will automatically flag it as bot traffic.
AI Data Scrapers
AI2Bot Applebot-Extended Bytespider CCBot ClaudeBot cohere-training-data-crawler Diffbot Google-Extended GPTBot Kangaroo Bot meta-externalagent anthropic-ai omgili PanguBot Webzio-Extended Timpibot img2dataset ImagesiftBot
Archivers
archive.org_bot Arquivo-web-crawler heritrix ia_archiver NiceCrawler
SEO Crawlers
AhrefsBot AhrefsSiteAudit Barkrowler BLEXBot BrightEdge Crawler Cocolyzebot DataForSeoBot DomainStatsBot dotbot hypestat linkdexbot MJ12bot online-webceo-bot Screaming Frog SEO Spider SemrushBot SenutoBot SeobilityBot SEOkicks SEOlizer serpstatbot SiteCheckerBotCrawler SenutoBot ZoomBot Seodiver SEOlyzer Backlinkcrawler rogerbot Siteimprove\.com
Search Engines
360Spider AlexandriaOrgBot Applebot Baiduspider bingbot coccocbot-web Daum DuckDuckBot DuckDuckGo-Favicons-Bot Feedfetcher-Google Google Favicon Googlebot GoogleOther HaoSouSpider MojeekBot msnbot PetalBot Qwantbot Qwantify SemanticScholarBot SeznamBot Sogou web spider teoma TinEye yacybot Yahoo! Slurp Yandex Yeti YisouSpider ZumBot AntBot Google-InspectionTool Storebot-Google entireweb\.com Linguee Bot netEstate NE Crawler seekport\.com StractBot search\.marginalia\.nu GeedoBot
AI Search Crawlers
Amazonbot Applebot-Extended OAI-SearchBot PerplexityBot YouBot Google-CloudVertexBot
AI Assistants
ChatGPT-User DuckAssistBot Meta-ExternalFetcher Claude-Web cohere-ai GitHubCopilotChat
Vulnerability Scanners
sqlmap WPScan feroxbuster masscan Fuzz Faster U Fool gobuster hydra absinthe arachni bsqlbf cisco-torch crimscanner DirBuster Grendel-Scan Mysqloit Nmap NSE Nmap Scripting Engine Nessus Netsparker Nikto Paros uil2pn SQL Power Injector webshag Teh Forest Lobster DotDotPwn Havij OpenVAS ZmEu DominoHunter|domino hunter FHScan Core w3af\.(sf\.net|sourceforge\.net|org cgichk webvulnscan sqlninja Argus(-Scanner|Crawler|DataLeakChecker|Bot ShadowSpray\.Kerb OWASP Amass Argus(-Scanner|Crawler|DataLeakChecker|Bot Nuclei BackDoorBot
Headless Browsers
HeadlessChrome HeadlessEdg
Social Media Bots
facebookexternalhit facebookcatalog meta-externalagent meta-externalfetcher Twitterbot Pinterestbot pinterest\.com.bot LinkedInBot XING-contenttabreceiver redditbot Mastodon Bluesky Cardyb vkShare
Data Harvesters
EmailCollector EmailSiphon EmailWolf ExtractorPro MailSweeper Email Extractor WebDataExtractor MailBait
Advertisement Bots
AdsBot-Google Mediapartners-Google Mediapartners \(Googlebot\) Google-Adwords adidxbot