Bot name
Last detected
IPs known
admantx-eusy01/3.2
2025-10-19
1
admantx-ussy04/3.2
2024-11-28
15
AdsBot-Google
2025-11-11
105
AdsBot-Google-Mobile
2025-10-24
8
AdsTxtCrawler/1.0
2024-05-15
12
AdsTxtCrawler/1.0.2
2024-04-14
354
AdsTxtCrawlerTP/1.2
2025-05-07
2
AhrefsBot/7.0
2026-01-09
4919
aiHitBot/2.9
2025-10-07
3
alexa site audit/1.0
2025-11-25
10
AliyunSecBot
2026-01-06
266
Amazon-Advertising-ad-standards-bot/1.0
2026-01-09
4
AmazonAdBot/1.0
2026-01-04
159
Amazonbot/0.1
2026-01-09
874
AnyEvent-HTTP/2.22
2025-03-03
1
AppEngine-Google
2025-09-11
118
Applebot/0.1
2026-01-09
3467
Aranea Web-Crawled Corpora Project
2024-04-05
1
archive.org_bot
2025-11-19
21
AwarioBot/1.0
2026-01-08
19
AwarioSmartBot/1.0
2024-11-27
1
axios/0.21.4
2023-12-08
3
axios/0.27.2
2024-05-28
21
BacklinksbuildingBot/1.0
2024-02-26
4
Baiduspider
2025-12-27
18
Baiduspider-render/2.0
2026-01-09
305
Baiduspider/2.0
2026-01-09
414
Barkrowler/0.9
2026-01-08
226
bidswitchbot/1.0
2025-12-29
74
Bidtellect/0.0.0.0
2026-01-06
1
Bidtellect/0.0.1350.0
2023-12-15
1
Bidtellect/0.0.1351.0
2023-12-18
1
Bidtellect/0.0.1354.0
2024-01-16
1
Bidtellect/0.0.1359.0
2024-01-24
1
Bidtellect/0.0.1365.0
2024-02-09
1
Bidtellect/0.0.1368.0
2024-02-09
1
Bidtellect/0.0.1384.0
2024-02-25
1
Bidtellect/0.0.1388.0
2024-02-25
1
Bidtellect/0.0.1391.0
2024-03-04
1
Bidtellect/0.0.1395.0
2024-03-04
1
Bidtellect/0.0.1415.0
2024-03-08
1
Bidtellect/0.0.1416.0
2024-03-13
1
Bidtellect/0.0.1418.0
2024-03-28
1
Bidtellect/0.0.1434.0
2024-03-30
1
Bidtellect/0.0.1441.0
2024-04-05
1
Bidtellect/0.0.1444.0
2024-04-13
1
Bidtellect/0.0.1445.0
2024-04-13
1
Bidtellect/0.0.1450.0
2024-05-07
1
Bidtellect/0.0.1454.0
2024-05-08
1
Bidtellect/0.0.1458.0
2024-05-31
1
bingbot/2.0
2026-01-09
1682
BingPreview/1.0b
2026-01-08
63
Birdcrawlerbot/0.5
2024-06-12
1
BitSightBot/1.0
2026-01-08
196
BLEXBot/1.0
2025-12-03
52
Bloglines/3.1
2025-11-20
6
Bravebot/1.0
2025-01-16
6
Brightbot 1.0
2025-02-18
2
Bytespider
2026-01-09
18649
CATExplorador/1.0beta
2025-11-30
6
CensysInspect/1.1
2026-01-09
1038
Centro Ads.txt Crawler/1.0
2026-01-06
14
centuryb.o.t9
2024-04-30
1
centurybot/1.0
2025-01-08
2
ChatGLM-Spider/1.0
2024-08-07
2
ChatGPT-User/1.0
2026-01-09
1344
CheckMarkNetwork/1.0
2025-12-30
56
Claude-User/1.0
2025-08-20
7
ClaudeBot
2026-01-09
9250
ClaudeBot/1.0
2026-01-06
30
coccocbot-web/1.0
2025-04-10
144
Cocolyzebot/1.0
2025-12-23
5
companyspotter/2.0.0.0
2025-11-30
1
ContextAd Bot 1.0
2025-04-24
2
crawler_eb_germany_2.0
2025-12-25
11
Crawlson/1.0
2024-07-25
1
CriteoBot/0.1
2026-01-09
166
DataForSeoBot/1.0
2026-01-06
15
Dataprovider.com
2026-01-06
282
Discordbot/2.0
2025-12-20
3
DnBCrawler-Analytics
2026-01-08
109
DomainCrawler/1.0
2025-08-15
1
Domains Project/1.3.7
2024-10-06
2
DomainStatsBot/1.0
2026-01-01
5
Dormouse/1.0
2024-12-01
2
DTUScanner/1.1
2024-01-15
1
DuckAssistBot/1.1
2025-11-22
8
DuckDuckBot-Https/1.1
2025-12-09
44
DuckDuckBot/1.0
2025-04-06
25
DuckDuckBot/1.1
2026-01-09
10
DuckDuckGo-Favicons-Bot/1.0
2025-03-07
33
EdgeWatch/1.1
2024-01-14
1
EmailWolf 1.00
2025-11-12
7
ev-crawler/1.0
2026-01-04
5
everyfeed-spider/2.0
2025-02-07
3
Example3/1.0
2026-01-01
45
facebookexternalhit/1.0
2025-12-17
6
facebookexternalhit/1.1
2026-01-09
3860
facebookscraper/1.0
2026-01-06
10
FAST-WebCrawler/3.8
2025-07-12
5
Feedfetcher-Google
2026-01-05
9
Friendly testing bot
2024-04-28
1
Friendly_Crawler/2.0
2024-04-06
20
Friendly_Crawler/Nutch-1.20-SNAPSHOT
2024-04-19
39
FriendlyCrawler/1.0
2024-01-11
49
FriendlyCrawler/Nutch-1.20-SNAPSHOT
2024-03-28
140
Gabanzabot/1.1
2024-09-12
1
GeedoProductSearch
2025-12-03
27
GenomeCrawlerd/1.0
2026-01-08
140
Google-adstxt
2026-01-09
311
Google-Adwords-Instant
2025-03-03
5
Google-Apps-Script
2025-01-02
2
Google-Display-Ads-Bot
2026-01-05
76
Google-PageRenderer
2024-10-06
4
Google-Read-Aloud
2026-01-08
359
Google-Safety
2025-07-04
8
Googlebot-Image/1.0
2026-01-09
700
Googlebot-Mobile/2.1
2026-01-06
28
Googlebot-News
2025-12-07
9
Googlebot-Video/1.0
2025-11-08
6
Googlebot/2.1
2026-01-09
11383
GoogleOther
2026-01-08
817
GPTBot/1.0
2025-10-22
367
GPTBot/1.2
2025-11-10
946
Grammarly/1.0
2025-05-19
9
GrapeshotCrawler/2.0
2024-10-28
16
Gregarius/0.5.2
2025-12-17
10
Gulper Web Bot 0.2.4
2025-12-29
14
heritrix/3.3.0
2024-08-10
1
heritrix/3.4.0
2024-11-07
1
hstspreload-bot
2026-01-05
183
HTTP Banner Detection
2026-01-06
6
HuaweiCrawler
2025-11-21
7
IAB ATQ team adform robot
2024-03-24
1
IAS crawler
2025-12-12
1279
ias-ie/3.3
2026-01-07
314
ias-or/3.3
2026-01-09
1408
ias-sync/3.3
2026-01-04
61
ias-va/3.3
2026-01-09
1444
iaskspider/1.0
2025-11-18
25
iaskspider/2.0
2025-10-27
30
Iframely/1.3.1
2026-01-02
51
ImagesiftBot
2025-07-24
309
INETDEX-BOT/2.0
2024-11-26
1
intelx.io_bot
2025-12-28
1
InternetMeasurement/1.0
2026-01-09
970
keys-so-bot
2026-01-02
177
KhazandeBot/V2.6.2
2025-10-07
1
KStandBot/1.0
2025-11-14
3
KwHunter/2.0
2025-10-14
1
Leikibot/1.0
2025-10-20
7
LightspeedSystemsCrawler
2025-09-28
2
Linguee Bot
2025-12-10
15
LinkBloom/2.7.11
2025-10-15
6
LinkBloom/2.7.12
2025-10-29
2
linkdexbot/2.0
2024-02-27
5
LinkupBot/1.0
2025-10-07
1
Mail.RU_Bot/2.0
2025-03-17
45
Mail.RU_Bot/Favicons/2.0
2025-08-30
14
Mail.RU_Bot/Robots/2.0
2025-08-30
24
Maillocals Bot
2024-09-13
1
MarketingMiner v2.0
2024-07-06
1
masscan-ng/1.3
2024-03-07
2
masscan/1.3
2024-05-29
26
MBCrawler/1.0
2026-01-09
2
MediaMathbot/1.0
2024-09-26
3
Mediapartners-Google
2026-01-09
2948
MegaIndex.ru/2.0
2024-11-30
3
meta-externalads/1.1
2025-10-20
1
meta-externalagent/1.1
2026-01-09
919
meta-webindexer/1.1
2026-01-09
220
Microsoft.Data.Mashup
2025-10-29
3
MicrosoftPreview/2.0
2025-05-05
16
MiniCrawler/1.0
2025-10-26
1
MistralAI-User/1.0
2025-12-25
5
MJ12bot/v1.4.8
2026-01-09
869
ModatScanner/1.0
2025-07-24
8
MojeekBot/0.11
2026-01-07
1
MS Search 6.0 Robot
2025-09-27
2
MsnBot-Media/1.0b
2025-12-17
2
msnbot-media/1.1
2025-11-20
8
msnbot/0.11
2025-12-07
10
MyCrawler/1.0
2024-11-23
2
NetcraftSurveyAgent/1.0
2026-01-09
701
netEstate NE Crawler
2025-07-17
1
NetpeakCheckerBot/3.7
2024-01-22
2
Nicecrawler/1.1
2026-01-08
12
node-fetch/1.0
2025-08-19
23
Nutch-1.21-SNAPSHOT
2025-01-06
5
OAI-SearchBot/1.0
2026-01-09
919
Orbbot/1.1
2025-12-28
108
Pandalytics/1.0
2024-03-05
8
Pandalytics/2.0
2025-12-26
69
peer39_crawler/1.0
2026-01-05
26
PerplexityBot/1.0
2026-01-08
452
Pinterestbot/1.0
2026-01-07
5
Pixalate.com/1.0
2025-12-29
48
probe-image-size/7.2.3
2025-08-19
9
Project-Resonance
2025-03-13
6
Protopage/3.0
2026-01-02
1
Quantcastbot/2.0
2025-12-18
1
Qwantbot-prod/1.0
2025-01-15
13
Qwantbot-prod177007/1.0
2024-11-06
1
Qwantbot-prod19251/1.0
2024-08-12
1
Qwantbot-prod38503/1.0
2024-07-17
1
Qwantbot-prod577007/1.0
2025-01-15
9
Qwantbot-prod77007/1.0
2024-11-18
7
Qwantbot/1.0
2026-01-09
139
Qwantbot/1.0_577007
2025-03-31
10
Qwantify-dev/1.0
2024-03-13
8
Qwantify-dev3080/1.0
2023-11-30
1
Qwantify-int7700/1.0
2024-05-31
1
Qwantify-prod/1.0
2024-06-25
7
Qwantify-prod1839/1.0
2023-12-05
1
Qwantify-prod38503/1.0
2024-06-14
1
Qwantify-prod77007/1.0
2023-11-29
3
Qwantify/1.0
2024-02-12
16
RecordedFuture Global Inventory Crawler
2026-01-09
6
RedekenBot/0.1
2024-04-28
1
RepoLookoutBot/v1.1.0
2024-10-04
6
robots-harvester/0.1
2025-10-30
1
S-Scanner/1.0
2025-11-17
3
ScraperBot/1.0
2025-12-10
40
Scrapy/1.7.4
2025-04-09
2
Scrapy/2.11.0
2025-12-04
12
Scrapy/2.11.2
2025-04-27
49
Scrapy/2.6.3
2025-05-19
3
Scrapy/2.9.0
2024-03-27
1
Screaming Frog SEO Spider/12.6
2024-06-09
1
Screaming Frog SEO Spider/15.2
2024-03-31
1
Screaming Frog SEO Spider/17.1
2024-12-27
1
Screaming Frog SEO Spider/19.8
2024-04-30
3
Screaming Frog SEO Spider/20.1
2024-06-02
3
Screaming Frog SEO Spider/20.2
2025-05-02
20
Screaming Frog SEO Spider/20.3
2024-12-19
2
Screaming Frog SEO Spider/20.4
2024-11-14
1
Screaming Frog SEO Spider/21.3
2025-02-06
8
Screaming Frog SEO Spider/8.1
2025-11-21
7
search-engine-indexer/1.0
2025-08-21
4
SeekportBot
2026-01-08
109
SemanticScholarBot
2024-03-12
1
SemrushBot-BA
2026-01-09
35
SemrushBot/6~bl
2025-11-28
3
SemrushBot/7~bl
2026-01-09
82
SeobilityBot
2025-12-02
3
SEOlizer/1.2
2024-02-21
3
serpstatbot/2.1
2026-01-07
32
SeznamBot/4.0
2026-01-09
45
Sidetrade indexer bot
2026-01-09
1
SirdataBot
2025-07-18
268
site-checker/1.0
2025-09-26
3
SiteCardBot/1.0
2025-10-23
1
SiteCheckerBotCrawler/1.0
2024-11-02
1
SiteOne-Crawler/1.0.7
2024-11-25
1
Slackbot 1.0
2025-12-22
23
Slackbot-LinkExpanding 1.0
2025-12-22
28
Snap URL Preview Service
2026-01-02
266
Snap-URL-Preview
2024-05-28
4
SnoopSecInspect/1.1
2025-01-14
1
Sogou Push Spider/3.0
2026-01-02
29
Sogou web spider/3.0
2025-12-15
30
Sogou web spider/4.0
2025-12-08
4
startmebot/1.0
2026-01-08
440
StartpagePrivateImageProxy/2.0
2025-01-08
1
StractBot/0.1
2023-12-18
2
StractBot/0.2
2024-08-31
2
SuperBot/4.4.0.60
2025-12-20
10
SuperMegaHyperColossalMassiveGiganticAstronomicalMonstrousBot
2024-04-21
1
SurdotlyBot/1.0
2026-01-02
4
t3versionsBot/1.0
2025-09-14
6
tchelebi/1.0
2024-05-03
1
TenMillionDomainsBot/1.0
2024-10-27
1
Timpibot/0.8
2025-03-24
12
Timpibot/0.9
2025-03-24
11
TinEye-bot/1.31
2024-11-30
1
trafilatura/1.10.0
2024-06-20
2
trafilatura/1.11.0
2024-07-02
1
trafilatura/1.8.0
2024-04-03
1
trafilatura/1.9.0
2024-05-20
6
trendictionbot/0.5.0
2024-04-23
2
TTD-Content
2024-02-29
483
Twitterbot/1.0
2025-07-28
9
UCMore Crawler App
2024-03-04
1
ultimate_sitemap_parser/0.5
2024-03-28
1
URLSuMaBot / 1.0
2024-08-05
1
vebidoobot/1.0
2024-03-25
2
VelenPublicWebCrawler/1.0
2026-01-03
51
VsuSearchSpider/1.0
2025-02-27
3
vuhuvRBT/2.0
2025-04-07
1
weborama-fetcher
2024-06-25
6
Website-audit.be Crawler
2023-12-22
1
Website-info.net-Robot
2026-01-05
19
Websuse.de/1.0
2025-10-17
1
WebwikiBot/2.1
2025-09-14
2
WellKnownBot/0.1
2026-01-09
88
WireReaderBot/1.0
2024-04-10
1
woorankreview/2.0
2024-03-26
22
wordupsearchengine-1
2024-06-12
1
XaxisSemanticsClassifier/1.0
2025-10-28
1
Yahoo Ad monitoring
2024-10-20
3
Yahoo! Slurp
2025-12-17
54
Yahoo! Slurp China
2025-12-17
40
YandexBot/3.0
2026-01-09
1541
YandexFavicons/1.0
2026-01-08
282
YandexImages/3.0
2026-01-08
330
YandexMobileBot/3.0
2025-02-18
49
YandexNews/4.0
2025-12-04
10
YisouSpider
2026-01-03
28
YodaoBot/1.0
2025-10-13
26
ZaldamoSearchBot
2025-11-25
3
zgrab/0.x
2026-01-09
2161
Zombiebot/2.1
2024-04-15
2
ZoominfoBot
2025-12-31
286
