Bot name
Last detected
IPs known
admantx-eusy01/3.2
2025-10-19
1
admantx-ussy04/3.2
2024-11-28
3
AdsBot-Google
2026-11-05
135
AdsBot-Google-Mobile
2025-10-24
2
AdsTxtCrawlerTP/1.2
2025-05-07
1
AhrefsBot/7.0
2026-11-11
6777
aiHitBot/2.9
2025-10-07
2
alexa site audit/1.0
2026-11-02
14
AliyunSecBot
2026-08-11
274
Amazon-Advertising-ad-standards-bot/1.0
2026-11-08
4
AmazonAdBot/1.0
2026-01-04
22
Amazonbot/0.1
2026-11-11
1729
AnyEvent-HTTP/2.22
2025-03-03
1
AppEngine-Google
2026-10-20
86
Applebot/0.1
2026-11-11
5715
archive.org_bot
2026-11-03
28
AwarioBot/1.0
2026-11-08
16
AwarioSmartBot/1.0
2026-09-29
1
Baiduspider
2026-10-27
21
Baiduspider-render/2.0
2026-11-10
453
Baiduspider/2.0
2026-11-11
1085
Barkrowler/0.9
2026-11-10
134
bidswitchbot/1.0
2026-10-02
517
Bidtellect/0.0.0.0
2026-10-29
2
bingbot/2.0
2026-11-11
2022
BingPreview/1.0b
2026-10-30
106
BitSightBot/1.0
2026-11-10
615
BLEXBot/1.0
2025-12-03
43
Bloglines/3.1
2026-10-16
13
Bravebot/1.0
2026-11-09
281
Brightbot 1.0
2026-02-12
3
Bytespider
2026-11-11
9722
CATExplorador/1.0beta
2026-09-19
7
CensysInspect/1.1
2026-11-10
1480
Centro Ads.txt Crawler/1.0
2026-10-19
16
centurybot/1.0
2025-01-08
2
ChatGPT-User/1.0
2026-11-11
4061
CheckMarkNetwork/1.0
2026-11-08
101
Claude-User/1.0
2026-11-10
1595
ClaudeBot
2026-11-11
5646
ClaudeBot/1.0
2026-11-10
915
coccocbot-web/1.0
2026-11-10
144
Cocolyzebot/1.0
2026-05-18
1
companyspotter/2.0.0.0
2026-10-30
1
ContextAd Bot 1.0
2026-09-22
2
crawler_eb_germany_2.0
2026-10-03
10
CriteoBot/0.1
2026-11-11
139
DataForSeoBot/1.0
2026-11-01
23
Dataprovider.com
2026-11-06
294
Discordbot/2.0
2026-09-14
393
DnBCrawler-Analytics
2026-10-14
110
DomainCrawler/1.0
2025-08-15
1
DomainStatsBot/1.0
2026-11-07
3
Dormouse/1.0
2024-12-01
2
DuckAssistBot/1.1
2025-11-22
7
DuckDuckBot-Https/1.1
2026-04-04
24
DuckDuckBot/1.0
2026-11-10
69
DuckDuckBot/1.1
2026-11-10
52
DuckDuckGo-Favicons-Bot/1.0
2025-03-07
2
EmailWolf 1.00
2026-10-28
12
ev-crawler/1.0
2026-10-28
7
everyfeed-spider/2.0
2026-10-10
10
Example3/1.0
2026-11-01
39
facebookexternalhit/1.0
2025-12-17
5
facebookexternalhit/1.1
2026-11-11
5812
facebookscraper/1.0
2026-06-14
20
FAST-WebCrawler/3.8
2026-06-15
10
Feedfetcher-Google
2026-09-13
16
Gaisbot/3.0
2026-06-11
11
GeedoProductSearch
2025-12-03
27
GenomeCrawlerd/1.0
2026-01-28
129
Google-adstxt
2026-11-11
264
Google-Adwords-Instant
2025-03-03
2
Google-Apps-Script
2025-01-02
2
Google-Display-Ads-Bot
2026-11-09
84
Google-Read-Aloud
2026-11-10
419
Google-Safety
2026-07-04
4
Googlebot-Image/1.0
2026-11-10
563
Googlebot-Mobile/2.1
2026-11-10
39
Googlebot-News
2026-11-07
18
Googlebot-Video/1.0
2026-10-29
10
Googlebot/2.1
2026-11-11
11209
GoogleOther
2026-11-10
1112
GPTBot/1.0
2026-10-17
130
GPTBot/1.2
2026-09-14
797
Grammarly/1.0
2025-05-19
7
Gregarius/0.5.2
2026-09-13
13
Gulper Web Bot 0.2.4
2026-10-13
18
hstspreload-bot
2026-11-09
262
HTTP Banner Detection
2026-08-26
3
HuaweiCrawler
2026-10-13
26
IAS crawler
2026-11-11
1492
ias-or/3.3
2026-10-05
1238
ias-sync/3.3
2026-11-10
387
ias-va/3.3
2026-11-05
1161
iaskspider/1.0
2026-10-14
13
iaskspider/2.0
2026-10-14
19
Iframely/1.3.1
2026-06-27
36
ImagesiftBot
2025-07-24
223
INETDEX-BOT/2.0
2024-11-26
1
intelx.io_bot
2026-11-09
2
InternetMeasurement/1.0
2026-11-10
1119
keys-so-bot
2026-11-10
209
KhazandeBot/V2.6.2
2025-10-07
1
KStandBot/1.0
2026-08-15
1
KwHunter/2.0
2025-10-14
1
Leikibot/1.0
2026-10-02
5
LightspeedSystemsCrawler
2025-09-28
2
Linguee Bot
2026-01-18
16
LinkBloom/2.7.11
2025-10-15
6
LinkBloom/2.7.12
2025-10-29
2
LinkupBot/1.0
2026-10-12
6
Mail.RU_Bot/2.0
2025-03-17
19
Mail.RU_Bot/Favicons/2.0
2025-08-30
12
Mail.RU_Bot/Robots/2.0
2025-08-30
18
MBCrawler/1.0
2026-11-10
1
Mediapartners-Google
2026-11-11
4701
MegaIndex.ru/2.0
2024-11-30
1
meta-externalads/1.1
2026-10-14
3
meta-externalagent/1.1
2026-11-11
2570
meta-webindexer/1.1
2026-11-11
1619
Microsoft.Data.Mashup
2025-10-29
2
MicrosoftPreview/2.0
2025-05-05
4
MiniCrawler/1.0
2025-10-26
1
MistralAI-User/1.0
2026-10-10
170
MJ12bot/v1.4.8
2026-11-11
838
ModatScanner/1.0
2025-07-24
8
MojeekBot/0.11
2026-11-07
1
MS Search 6.0 Robot
2025-09-27
2
MsnBot-Media/1.0b
2025-12-17
2
msnbot-media/1.1
2026-06-18
9
MyCrawler/1.0
2024-11-23
2
NetcraftSurveyAgent/1.0
2026-11-10
778
netEstate NE Crawler
2025-07-17
1
Nicecrawler/1.1
2026-04-08
12
node-fetch/1.0
2026-11-06
16
Nutch-1.21-SNAPSHOT
2025-01-06
5
OAI-SearchBot/1.0
2026-11-11
1150
Pandalytics/2.0
2026-06-30
77
peer39_crawler/1.0
2026-10-18
26
PerplexityBot/1.0
2026-11-11
1182
Pinterestbot/1.0
2026-09-23
7
Pixalate.com/1.0
2026-08-05
45
probe-image-size/7.2.3
2026-04-22
10
Project-Resonance
2026-06-09
10
Protopage/3.0
2026-07-01
1
Quantcastbot/2.0
2026-10-31
1
Qwantbot-prod/1.0
2025-01-15
10
Qwantbot-prod577007/1.0
2025-01-15
9
Qwantbot-prod77007/1.0
2024-11-18
1
Qwantbot/1.0
2026-11-10
2728
Qwantbot/1.0_577007
2025-03-31
10
RecordedFuture Global Inventory Crawler
2026-11-10
9
robots-harvester/0.1
2025-10-30
1
S-Scanner/1.0
2025-11-17
3
ScraperBot/1.0
2026-04-06
40
Scrapy/1.7.4
2025-04-09
2
Scrapy/2.11.0
2025-12-04
1
Scrapy/2.11.2
2026-09-05
49
Scrapy/2.6.3
2025-05-19
2
Screaming Frog SEO Spider/17.1
2024-12-27
1
Screaming Frog SEO Spider/20.2
2025-05-02
5
Screaming Frog SEO Spider/20.3
2024-12-19
1
Screaming Frog SEO Spider/20.4
2024-11-14
1
Screaming Frog SEO Spider/21.3
2025-02-06
8
Screaming Frog SEO Spider/8.1
2026-06-15
15
search-engine-indexer/1.0
2025-08-21
3
SeekportBot
2026-11-02
68
SemrushBot-BA
2026-11-10
22
SemrushBot/6~bl
2026-09-27
1
SemrushBot/7~bl
2026-11-11
82
SeobilityBot
2026-09-12
4
serpstatbot/2.1
2026-10-22
42
SeznamBot/4.0
2026-11-11
269
Sidetrade indexer bot
2026-06-22
1
site-checker/1.0
2025-09-26
3
SiteCardBot/1.0
2025-10-23
1
SiteOne-Crawler/1.0.7
2024-11-25
1
Slackbot 1.0
2026-11-03
20
Slackbot-LinkExpanding 1.0
2026-11-03
25
Snap URL Preview Service
2026-11-10
161
SnoopSecInspect/1.1
2025-01-14
1
Sogou Push Spider/3.0
2026-10-12
19
Sogou web spider/3.0
2026-10-09
18
Sogou web spider/4.0
2026-11-09
294
startmebot/1.0
2026-11-07
419
StartpagePrivateImageProxy/2.0
2025-01-08
1
SuperBot/4.4.0.60
2026-06-15
17
SurdotlyBot/1.0
2026-11-09
12
t3versionsBot/1.0
2025-09-14
6
TelegramBot
2026-09-14
398
Timpibot/0.8
2025-03-24
7
Timpibot/0.9
2025-03-24
6
TinEye-bot/1.31
2024-11-30
1
Twitterbot/1.0
2026-11-03
406
VelenPublicWebCrawler/1.0
2026-10-21
68
VsuSearchSpider/1.0
2025-02-27
1
vuhuvRBT/2.0
2025-04-07
1
Website-info.net-Robot
2026-05-10
22
Websuse.de/1.0
2025-10-17
1
WebwikiBot/2.1
2025-09-14
2
WellKnownBot/0.1
2026-11-05
78
XaxisSemanticsClassifier/1.0
2025-10-28
1
Yahoo! Slurp
2026-10-15
55
Yahoo! Slurp China
2026-11-03
34
YandexBot/3.0
2026-10-24
1863
YandexFavicons/1.0
2026-10-10
291
YandexImages/3.0
2026-09-25
187
YandexMobileBot/3.0
2025-02-18
1
YandexNews/4.0
2026-10-12
17
YisouSpider
2026-10-18
69
YodaoBot/1.0
2026-08-06
12
ZaldamoSearchBot
2025-11-25
3
zgrab/0.x
2026-11-10
1887
ZoominfoBot
2026-11-09
151
