Bot name
Last detected
IPs known
admantx-adform/3.1
2022-07-18
1
admantx-eusyncbatch01/3.1
0
admantx-ussy03/3.2
2023-07-14
1
admantx-ussy04/3.2
2024-04-12
18
AdsBot-Google
2024-03-15
4
adscanner/1.0
2022-05-11
1
AdsTxtCrawler/1.0
2024-04-21
56
AdsTxtCrawler/1.0.2
2024-04-14
1507
AdsTxtCrawlerTP/1.2
2024-04-22
5
AhrefsBot/7.0
2024-04-25
616
aiHitBot/2.9
2024-04-15
3
Amazon-Advertising-ad-standards-bot/1.0
2024-04-25
2
AmazonAdBot/1.0
2024-04-25
222
Amazonbot/0.1
2024-04-25
4
anthropic-ai
2023-08-21
41
AnyEvent-HTTP/2.22
2024-03-30
1
AppEngine-Google
2024-04-22
47
Applebot/0.1
2024-04-25
2746
aragna.net_bot
2023-04-11
1
archive.org_bot
2024-03-30
12
AwarioBot/1.0
2024-04-09
12
AwarioRssBot/1.0
2023-05-05
1
Baiduspider
2024-04-07
11
Baiduspider-render/2.0
2024-04-24
423
Baiduspider/2.0
2024-04-24
402
Barkrowler/0.9
2024-04-24
284
bidswitchbot/1.0
2024-04-25
21
Bidtellect/0.0.1107.0
2023-01-09
0
Bidtellect/0.0.1125.0
2023-01-20
1
Bidtellect/0.0.1143.0
2023-02-06
1
Bidtellect/0.0.1157.0
2023-02-16
1
Bidtellect/0.0.1251.0
2023-05-25
1
Bidtellect/0.0.1259.0
2023-06-01
1
Bidtellect/0.0.1265.0
2023-06-25
1
Bidtellect/0.0.1273.0
2023-07-21
1
Bidtellect/0.0.1285.0
2023-08-08
1
Bidtellect/0.0.1290.0
2023-08-16
1
Bidtellect/0.0.1293.0
2023-08-17
1
Bidtellect/0.0.1296.0
2023-08-20
1
Bidtellect/0.0.1299.0
2023-08-28
1
Bidtellect/0.0.1307.0
2023-09-14
1
Bidtellect/0.0.1310.0
2023-09-21
1
Bidtellect/0.0.1311.0
2023-09-20
1
Bidtellect/0.0.1316.0
2023-10-26
1
Bigsearch.ca/Nutch-1.0-dev
0
bingbot/2.0
2024-04-25
2435
BingPreview/1.0b
2023-11-17
492
Birdcrawlerbot/0.5
2023-07-05
1
bitlybot/3.0
2023-02-03
1
BitSightBot/1.0
2024-04-24
35
BLEXBot/1.0
2024-04-24
46
Bloglines/3.1
2023-10-29
5
Brightbot 1.0
2023-09-28
1
BrightEdge Crawler/1.0
2023-10-17
3
Bytespider
2024-04-25
14572
CATExplorador/1.0beta
2024-04-21
9
CensysInspect/1.1
2024-04-25
347
Centro Ads.txt Crawler/1.0
2024-04-25
5
centuryb.o.t9
2023-10-18
2
certytags/1.0
2023-07-30
1
ChatGPT-User/1.0
2024-04-25
46
CheckMarkNetwork/1.0
2023-11-07
23
CloudFlare-AlwaysOnline/1.0
0
coccocbot-image/1.0
2022-07-17
36
coccocbot-web/1.0
2023-05-07
144
Cocolyzebot/1.0
2024-02-14
9
companyspotter/0.0.0.0
2022-09-17
0
companyspotter/0.1984.82.1324
0
companyspotter/1.0.0.0
2023-05-22
2
crawler_eb_germany_2.0
2024-04-12
10
Crawling at Home Project
0
Crawlson/1.0
2023-01-09
2
CriteoBot/0.1
2024-04-25
174
CyotekWebCopy/1.9
2022-12-09
0
DataForSeoBot/1.0
2024-04-24
12
Dataprovider.com
2024-04-25
222
Discordbot/2.0
2024-03-17
3
DnBCrawler-Analytics
2024-04-23
49
dns-crawler/1.4.10.dev6
0
dns-crawler/1.4.10.dev7
0
Domains Project/1.3.7
2023-01-11
1
DomainStatsBot/1.0
2024-04-11
4
DongleEmulatorBot/0.1
2023-07-25
5
DuckDuckBot-Https/1.1
2024-04-23
26
DuckDuckBot/1.1
2024-04-25
8
DuckDuckGo-Favicons-Bot/1.0
2024-04-23
21
E. Orliac, G. Fourestey/1.0
0
EdgeWatch/1.1
2024-01-14
1
EmailWolf 1.00
2024-02-06
2
ev-crawler/1.0
2024-04-24
7
Example3/1.0
2024-04-08
18
facebookexternalhit/1.0
2023-11-07
10
facebookexternalhit/1.1
2024-04-25
1163
facebookexternalhit/1.2
0
facebookscraper/1.0
2024-02-25
3
Feedfetcher-Google
2023-06-28
2
feedparser/6.0.10
2023-06-08
1
FemtosearchBot/1.0
2023-07-31
5
FindITAnswersbot/1.0
2023-05-02
1
FullStoryBot/1.0
2022-09-27
0
GigablastOpenSource/1.0
2022-12-21
4
Gluten Free Crawler/1.0
0
go-resty/2.7.0
2023-03-17
4
Google-adstxt
2024-04-25
447
Google-Adwords-Instant
2023-12-24
9
Google-Display-Ads-Bot
2024-04-23
60
Google-PageRenderer
2023-10-17
32
Google-Read-Aloud
2024-04-24
211
Googlebot-Image/1.0
2024-04-25
873
Googlebot-Mobile/2.1
2024-02-12
9
Googlebot-Video/1.0
2024-01-29
4
Googlebot/2.1
2024-04-25
8743
GoogleOther
2024-04-25
62
GPTBot/1.0
2024-04-24
156
Grammarly/1.0
2024-04-24
4
GrapeshotCrawler/2.0
2024-04-25
16
Graydon bot/1.0
2023-02-06
2
Gregarius/0.5.2
2024-01-16
3
Gulper Web Bot 0.2.4
2024-03-10
5
heritrix/3.3.0
2023-04-04
1
hstspreload-bot
2024-04-22
47
HTTP Banner Detection
2024-04-25
6
HubSpot Webcrawler
2022-12-29
6
IAS crawler
2024-03-22
336
ias-ie/3.3
2024-04-25
577
ias-ir/3.1
2023-03-23
333
ias-or/3.1
2023-03-23
180
ias-or/3.3
2024-04-25
292
ias-va/3.1
2023-03-23
388
ias-va/3.3
2024-04-24
679
Iframely/1.3.1
2024-03-11
33
INETDEX-BOT/1.5
2023-03-08
3
intelx.io_bot
2024-04-14
1
InternetMeasurement/1.0
2024-04-25
469
Keybot Translation-Search-Machine
2022-12-03
2
KomodiaBot/1.0
2022-07-02
6
KStandBot/1.0
2024-02-08
4
LightspeedSystemsCrawler
2024-02-19
5
Linespider/1.1
2023-07-25
39
linkdexbot/2.0
2024-02-27
5
LinkedInBot/1.0
2023-03-25
8
LivelapBot/0.2
2022-11-21
1
Lkx-TraversalHttpPlugin/0.0.1
0
looid.com Search Engine/0.1
0
Mail.RU_Bot/2.0
2024-04-17
93
Mail.RU_Bot/Fast/2.0
2023-05-09
1
Mail.RU_Bot/Favicons/2.0
2024-04-03
14
Mail.RU_Bot/Img/2.0
2023-04-10
6
Mail.RU_Bot/Robots/2.0
2024-04-03
26
MarketingMiner v2.0
2022-12-13
0
masscan-ng/1.3
2024-03-07
5
masscan/1.0
2024-04-23
30
masscan/1.3
2024-04-25
106
MBCrawler/1.0
2024-04-24
5
MediaMathbot/1.0
2024-04-23
112
Mediapartners-Google
2024-04-25
832
MegaIndex.ru/2.0
2023-12-21
14
Microsoft.Data.Mashup
2024-04-09
3
MicrosoftPreview/2.0
2024-04-19
20
MJ12bot/v1.2.4
2022-05-08
0
MJ12bot/v1.4.2
2022-12-15
0
MJ12bot/v1.4.8
2024-04-25
867
MojeekBot/0.10
2022-05-06
1
MojeekBot/0.11
2024-04-25
1
MonitorBacklinksWP
2022-06-27
1
msnbot-media/1.1
2024-04-04
7
MxToolbox/Beta7
2023-07-03
1
My Nutch Spider/Nutch-1.18
0
Neevabot/1.0
2023-05-31
2
NetcraftSurveyAgent/1.0
2024-04-04
190
netEstate NE Crawler
2024-04-02
1
NetpeakCheckerBot/3.6
2023-08-03
1
NetpeakCheckerBot/3.7
2024-01-22
7
Nicecrawler/1.1
2024-04-03
10
Nimbostratus-Bot/v1.3.2
0
node-fetch/1.0
2024-02-01
17
olbicobot/Nutch-1.15-SNAPSHOT
0
Orbbot/1.1
2024-04-19
112
Pandalytics/1.0
2024-03-05
58
PartyflockLinkChecker/0.3
0
peer39_crawler/1.0
2024-04-17
24
PhantomBot/1.0
2023-04-15
1
PickyBot/0.6.0
2023-08-04
3
Pinterestbot/1.0
2024-02-14
4
Pixalate.com/1.0
2024-04-24
99
pmoz.info ODP link checker
2023-09-16
1
Project-Resonance
2023-03-27
2
Protopage/3.0
2024-03-22
2
PublicationFinder-Crawler 2.0
2023-08-31
1
PulsePoint-Ads.txt-Crawler/1.1
2023-07-04
10
Quantcastbot/1.0
2023-02-28
1
Quantcastbot/2.0
2024-03-04
1
Qwantify-dev/1.0
2024-03-13
15
Qwantify-dev1002/1.0
2023-09-11
1
Qwantify-dev119/1.0
2023-07-26
1
Qwantify-dev150/1.0
2023-09-04
1
Qwantify-dev1540/1.0
2023-08-11
2
Qwantify-dev250/1.0
2023-09-11
1
Qwantify-dev302/1.0
2023-08-24
1
Qwantify-dev3079/1.0
2023-09-13
1
Qwantify-dev39/1.0
2023-09-12
1
Qwantify-dev502/1.0
2023-09-11
1
Qwantify-dev770/1.0
2023-08-10
1
Qwantify-prod/1.0
2024-04-24
22
Qwantify-prod1002/1.0
2023-08-30
2
Qwantify-prod2006/1.0
2023-08-31
18
Qwantify-prod2948/1.0
2023-09-03
2
Qwantify-prod3006/1.0
2023-09-07
5
Qwantify-prod3502/1.0
2023-09-11
2
Qwantify-prod3948/1.0
2023-09-08
5
Qwantify-prod7006/1.0
2023-08-31
4
Qwantify/1.0
2024-02-12
89
RepoLookoutBot/v1.1.0
2023-05-23
14
ReverseEngineeringBot/0.1
2023-02-20
3
RobotsTxtParser-VIPnytt/2.1
0
Scrapy/1.5.0
2022-09-11
1
Scrapy/1.7.3
2023-01-27
1
Scrapy/1.7.4
2022-10-05
0
Scrapy/2.5.1
2023-10-13
1
Scrapy/2.6.1
2023-03-30
1
Scrapy/2.6.2
2022-09-11
0
Scrapy/2.6.3
2024-03-28
3
Scrapy/2.7.1
2023-02-05
2
Scrapy/2.8.0
2023-04-20
1
Scrapy/2.9.0
2024-03-27
2
Screaming Frog SEO Spider/10.1
0
Screaming Frog SEO Spider/11.2
0
Screaming Frog SEO Spider/11.3
0
Screaming Frog SEO Spider/12.2
0
Screaming Frog SEO Spider/12.3
0
Screaming Frog SEO Spider/12.6
0
Screaming Frog SEO Spider/13.2
0
Screaming Frog SEO Spider/14.1
0
Screaming Frog SEO Spider/14.2
0
Screaming Frog SEO Spider/14.3
0
Screaming Frog SEO Spider/15.2
2024-03-31
1
Screaming Frog SEO Spider/16.2
0
Screaming Frog SEO Spider/16.3
0
Screaming Frog SEO Spider/16.4
0
Screaming Frog SEO Spider/16.5
0
Screaming Frog SEO Spider/16.7
2023-05-02
1
Screaming Frog SEO Spider/17.2
2023-03-20
1
Screaming Frog SEO Spider/18.1
2022-12-22
0
Screaming Frog SEO Spider/18.2
2023-03-07
2
Screaming Frog SEO Spider/18.5
2023-06-28
2
Screaming Frog SEO Spider/19.0
2024-01-06
3
Screaming Frog SEO Spider/19.1
2023-12-20
3
Screaming Frog SEO Spider/5.1
0
Screaming Frog SEO Spider/6.2
0
Screaming Frog SEO Spider/8.1
2023-05-29
4
Screaming Frog SEO Spider/9.4
2023-04-25
1
Seekport Crawler
2022-06-08
66
SeekportBot
2024-04-23
129
SemrushBot-BA
2024-04-24
23
SemrushBot/6~bl
2024-04-20
2
SemrushBot/7~bl
2024-04-25
161
SentrySearch/1.0.0
2023-09-28
1
SenutoBot/1.0
2023-04-24
4
SEO Scanner/1.2.4
2022-05-11
0
SeohrefsBot/1.0.0
2023-07-23
1
SEOlizer/1.1
2022-08-10
1
serpstatbot/2.1
2024-04-25
33
SERPtimizerBot
2024-01-02
1
SeznamBot/3.2
2023-03-22
96
SeznamBot/4.0
2024-04-25
36
SeznamBot/4.0-RC1
2023-05-17
260
Sidetrade indexer bot
2024-04-19
1
SirdataBot
2024-04-25
521
SiteCheckerBotCrawler/1.0
0
Slackbot 1.0
2024-04-11
14
Slackbot-LinkExpanding 1.0
2024-04-11
15
Snap URL Preview Service
2024-04-23
299
Sogou head spider/3.0
2022-10-20
0
Sogou web spider/4.0
2023-05-25
291
special_archiver/3.1.1
2022-09-19
7
startmebot/1.0
2024-04-25
584
StartpagePrivateImageProxy/2.0
2023-06-21
1
Startpagina-Linkchecker/1.0
2023-07-04
2
SurdotlyBot/1.0
2024-04-22
22
t3versionsBot/1.0
2024-04-09
6
TBI-HttpOpenPlugin/0.0.2
0
TBI-HttpOpenPlugin/0.1.0
0
tchelebi/1.0
2024-04-23
3
Thither.Direct Bot/0.0.1
0
Timpibot/0.8
2024-03-14
5
TinEye-bot/1.31
2023-07-28
1
TombaPublicWebCrawler/3.5
2022-06-01
0
trendictionbot/0.5.0
2024-04-23
6
TTD-Content
2024-02-29
2121
Twingly Recon-Klondike/1.0
2023-01-01
0
Twitterbot/1.0
2024-04-22
15
UniversalFeedParser/5.2.1
0
URLSuMaBot / 1.0
2023-09-05
1
VelenPublicWebCrawler/1.0
2024-04-24
47
VsuSearchSpider/1.0
2024-03-19
5
vuhuvBot/1.0
2022-12-16
1
webgains-bot
2023-12-06
3
weborama-fetcher
2023-06-27
18
webprosbot/2.0
2023-11-27
272
WebwikiBot/2.1
2024-03-31
3
WellKnownBot/0.1
2024-04-24
66
WhatStuffWhereBot
2022-09-20
0
woorankreview/2.0
2024-03-26
55
Wordupindexinfo1/0
2023-08-18
3
WP-URLDetails/6.1.1-alpha-54813
2022-12-23
0
Yahoo Ad monitoring
2023-06-21
4
Yahoo Link Preview
2023-04-23
1
Yahoo! Slurp
2024-03-09
25
Yahoo! Slurp China
2024-02-26
3
YahooMailProxy
2022-04-26
0
YandexAccessibilityBot/3.0
0
YandexBlogs/0.99
2023-08-16
1
YandexBot/3.0
2024-04-25
1814
YandexFavicons/1.0
2024-04-25
223
YandexImages/3.0
2024-04-24
599
YandexNews/4.0
2024-01-15
5
YisouSpider
2024-03-28
260
Yooo! Search Engine Bot BETA
2023-06-17
1
ZaldamoSearchBot
2023-10-18
1
zgrab/0.x
2024-04-25
1781
ZoominfoBot
2024-04-25
241