Skip to main content
Miscellaneous
Bot Protection Details

Bot Protection Details

This document lists the specific user agent strings that Zen uses to identify and block automated traffic. When a request matches any of these user agents, Zen will automatically flag it as bot traffic.

AI Data Scrapers

AI2Bot
Applebot-Extended
Bytespider
CCBot
ClaudeBot
cohere-training-data-crawler
Diffbot
Google-Extended
GPTBot
Kangaroo Bot
meta-externalagent
anthropic-ai
omgili
PanguBot
Webzio-Extended
Timpibot
img2dataset
ImagesiftBot

Archivers

archive.org_bot
Arquivo-web-crawler
heritrix
ia_archiver
NiceCrawler

SEO Crawlers

AhrefsBot
AhrefsSiteAudit
Barkrowler
BLEXBot
BrightEdge Crawler
Cocolyzebot
DataForSeoBot
DomainStatsBot
dotbot
hypestat
linkdexbot
MJ12bot
online-webceo-bot
Screaming Frog SEO Spider
SemrushBot
SenutoBot
SeobilityBot
SEOkicks
SEOlizer
serpstatbot
SiteCheckerBotCrawler
SenutoBot
ZoomBot
Seodiver
SEOlyzer
Backlinkcrawler
rogerbot
Siteimprove\.com

Search Engines

360Spider
AlexandriaOrgBot
Applebot
Baiduspider
bingbot
coccocbot-web
Daum
DuckDuckBot
DuckDuckGo-Favicons-Bot
Feedfetcher-Google
Google Favicon
Googlebot
GoogleOther
HaoSouSpider
MojeekBot
msnbot
PetalBot
Qwantbot
Qwantify
SemanticScholarBot
SeznamBot
Sogou web spider
teoma
TinEye
yacybot
Yahoo! Slurp
Yandex
Yeti
YisouSpider
ZumBot
AntBot
Google-InspectionTool
Storebot-Google
entireweb\.com
Linguee Bot
netEstate NE Crawler
seekport\.com
StractBot
search\.marginalia\.nu
GeedoBot

AI Search Crawlers

Amazonbot
Applebot-Extended
OAI-SearchBot
PerplexityBot
YouBot
Google-CloudVertexBot

AI Assistants

ChatGPT-User
DuckAssistBot
Meta-ExternalFetcher
Claude-Web
cohere-ai
GitHubCopilotChat

Vulnerability Scanners

sqlmap
WPScan
feroxbuster
masscan
Fuzz Faster U Fool
gobuster
hydra
absinthe
arachni
bsqlbf
cisco-torch
crimscanner
DirBuster
Grendel-Scan
Mysqloit
Nmap NSE
Nmap Scripting Engine
Nessus
Netsparker
Nikto
Paros
uil2pn
SQL Power Injector
webshag
Teh Forest Lobster
DotDotPwn
Havij
OpenVAS
ZmEu
DominoHunter|domino hunter
FHScan Core
w3af\.(sf\.net|sourceforge\.net|org
cgichk
webvulnscan
sqlninja
Argus(-Scanner|Crawler|DataLeakChecker|Bot
ShadowSpray\.Kerb
OWASP Amass
Argus(-Scanner|Crawler|DataLeakChecker|Bot
Nuclei
BackDoorBot

Headless Browsers

HeadlessChrome
HeadlessEdg

Social Media Bots

facebookexternalhit
facebookcatalog
meta-externalagent
meta-externalfetcher
Twitterbot
Pinterestbot
pinterest\.com.bot
LinkedInBot
XING-contenttabreceiver
redditbot
Mastodon
Bluesky Cardyb
vkShare

Data Harvesters

EmailCollector
EmailSiphon
EmailWolf
ExtractorPro
MailSweeper
Email Extractor
WebDataExtractor
MailBait

Advertisement Bots

AdsBot-Google
Mediapartners-Google
Mediapartners \(Googlebot\)
Google-Adwords
adidxbot