Bot Protection Details

This document lists the specific user agent strings that Zen uses to identify and block automated traffic. When a request matches any of these user agents, Zen will automatically flag it as bot traffic.

AI Data Scrapers

AI2Bot
anthropic-ai
Applebot-Extended
Brightbot
Bytespider
CCBot
ChatGLM.Spider
ClaudeBot
cohere-training-data-crawler
Diffbot
Google-Extended
GPTBot
ImagesiftBot
img2dataset
Kangaroo Bot
meta-externalagent
omgili
PanguBot
SBIntuitionsBot
Timpibot
VelenPublicWebCrawler
Webzio-Extended

Archivers

archive.org_bot
Arquivo-web-crawler
heritrix
ia_archiver
ia_archiver-web\.archive.org
NiceCrawler

SEO Crawlers

AhrefsBot
AhrefsSiteAudit
Backlinkcrawler
Barkrowler
BLEXBot
BrightEdge Crawler
Cocolyzebot
DataForSeoBot
DomainStatsBot
dotbot
hypestat
linkdexbot
MJ12bot
online-webceo-bot
rogerbot
Screaming Frog SEO Spider
SemrushBot
SenutoBot
SenutoBot
SeobilityBot
Seodiver
SEOkicks
SEOlizer
SEOlyzer
serpstatbot
sitebulb
SiteCheckerBotCrawler
Siteimprove\.com
ZoomBot

Search Engines

360Spider
AlexandriaOrgBot
AntBot
Applebot
Baiduspider
bingbot
coccocbot-web
Daum
DuckDuckBot
DuckDuckGo-Favicons-Bot
entireweb\.com
Feedfetcher-Google
GeedoBot
Google Favicon
Google-InspectionTool
Googlebot
GoogleOther
HaoSouSpider
Linguee Bot
MojeekBot
msnbot
netEstate NE Crawler
PetalBot
Qwantbot
Qwantify
search\.marginalia\.nu
seekport\.com
SemanticScholarBot
SeznamBot
Sogou web spider
Storebot-Google
StractBot
teoma
TinEye
yacybot
Yahoo! Slurp
Yandex
Yeti
YisouSpider
ZumBot

AI Search Crawlers

Amazonbot
Andibot
Applebot-Extended
Google-CloudVertexBot
iaskspider
OAI-SearchBot
PerplexityBot
PhindBot
YouBot

AI Assistants

ChatGPT-User
Claude-User
Claude-Web
cohere-ai
DuckAssistBot
GitHubCopilotChat
Meta-ExternalFetcher
MistralAI-User
NovaAct
Perplexity-User

Vulnerability Scanners

absinthe
arachni
Argus(-Scanner|Crawler|DataLeakChecker|Bot
Argus(-Scanner|Crawler|DataLeakChecker|Bot
BackDoorBot
bsqlbf
cgichk
cisco-torch
crimscanner
DirBuster
DominoHunter|domino hunter
DotDotPwn
feroxbuster
FHScan Core
Fuzz Faster U Fool
gobuster
Grendel-Scan
Havij
hydra
l9explore
lkxscan
masscan
Mysqloit
Nessus
Netsparker
Nikto
Nmap NSE
Nmap Scripting Engine
Nuclei
OpenVAS
OWASP Amass
Paros
ShadowSpray\.Kerb
SQL Power Injector
sqlmap
sqlninja
Teh Forest Lobster
uil2pn
w3af\.(sf\.net|sourceforge\.net|org
webshag
webvulnscan
WPScan
ZmEu

Headless Browsers

HeadlessChrome
HeadlessEdg

Social Media Bots

Bluesky Cardyb
facebookcatalog
facebookexternalhit
LinkedInBot
Mastodon
meta-externalagent
meta-externalfetcher
pinterest\.com.bot
Pinterestbot
redditbot
TikTokSpider
Twitterbot
vkShare
XING-contenttabreceiver

Data Harvesters

Email Extractor
EmailCollector
EmailSiphon
EmailWolf
ExtractorPro
MailBait
MailSweeper
WebDataExtractor

Advertisement Bots

adbeat_bot
adidxbot
AdsBot-Google
Google-Adwords
Mediapartners (Googlebot)
Mediapartners-Google

Messager Previews

Discordbot
SkypeUriPreview
Slackbot-LinkExpanding
Snap URL Preview Service
TelegramBot
Viber
WhatsApp

Monitoring Tools

Catchpoint
pingbot\/|pingdom\.com
UptimeRobot\/