List of webbots

Download without IP addresses XML format JSON format CSV format

Download including IP addresses XML format JSON format CSV format

Bot name
Last detected
IPs known
 
2ip bot/1.1
2026-04-01
2
admantx-eusy01/3.2
2025-10-19
1
admantx-ussy04/3.2
2024-11-28
2
AdsBot-Google
2026-11-05
135
AdsBot-Google-Mobile
2025-10-24
2
AdsTxtCrawlerTP/1.2
2025-05-07
1
AhrefsBot/7.0
2026-11-17
6780
aiHitBot/2.9
2025-10-07
2
alexa site audit/1.0
2026-11-02
14
AliyunSecBot
2026-08-11
274
Amazon-Advertising-ad-standards-bot/1.0
2026-11-17
4
AmazonAdBot/1.0
2026-01-04
22
Amazonbot/0.1
2026-11-17
1732
AnyEvent-HTTP/2.22
2025-03-03
1
AppEngine-Google
2026-10-20
82
Applebot/0.1
2026-11-17
5867
archive.org_bot
2026-11-16
29
AwarioBot/1.0
2026-11-13
16
AwarioSmartBot/1.0
2026-09-29
1
axios/1.6.5
2025-03-14
1
axios/1.7.9
2025-08-13
2
Baiduspider
2026-10-27
21
Baiduspider-render/2.0
2026-11-17
453
Baiduspider/2.0
2026-11-17
1111
Barkrowler/0.9
2026-11-16
134
bidswitchbot/1.0
2026-10-02
517
Bidtellect/0.0.0.0
2026-11-14
2
bingbot/2.0
2026-11-17
2012
BingPreview/1.0b
2026-11-11
108
BitSightBot/1.0
2026-11-15
615
BLEXBot/1.0
2025-12-03
43
Bloglines/3.1
2026-10-16
13
Bot/1.0
2026-11-17
8393
Bravebot/1.0
2026-11-16
287
Brightbot 1.0
2026-02-12
3
BW/1.2
2026-06-20
11
Bytespider
2026-11-17
9702
CATExplorador/1.0beta
2026-11-13
7
CCBot/2.0
2026-11-16
538
CensysInspect/1.1
2026-11-16
1496
Centro Ads.txt Crawler/1.0
2026-10-19
16
centurybot/1.0
2025-01-08
2
ChatGPT-User/1.0
2026-11-17
4081
CheckMarkNetwork/1.0
2026-11-08
101
Claude-User/1.0
2026-11-16
1609
ClaudeBot
2026-11-17
5657
ClaudeBot/1.0
2026-11-11
915
coccocbot-web/1.0
2026-11-16
144
Cocolyzebot/1.0
2026-05-18
1
colly
2026-07-27
2
companyspotter/2.0.0.0
2026-10-30
1
ContextAd Bot 1.0
2026-09-22
2
crawler_eb_germany_2.0
2026-10-03
10
CriteoBot/0.1
2026-11-16
139
DataForSeoBot/1.0
2026-11-01
23
Dataprovider.com
2026-11-13
291
DataXu/1.0
2025-01-11
1
Discordbot/2.0
2026-09-14
393
DnBCrawler-Analytics
2026-10-14
105
DomainCrawler/1.0
2025-08-15
1
DomainStatsBot/1.0
2026-11-15
3
Dormouse/1.0
2024-12-01
2
DotBot/1.1
2026-07-19
54
DotBot/1.2
2026-11-17
18
DuckAssistBot/1.1
2025-11-22
7
DuckDuckBot-Https/1.1
2026-04-04
24
DuckDuckBot/1.0
2026-11-16
70
DuckDuckBot/1.1
2026-11-17
52
DuckDuckGo-Favicons-Bot/1.0
2025-03-07
2
Elisabot
2026-03-21
3
EmailWolf 1.00
2026-10-28
12
ev-crawler/1.0
2026-11-16
8
everyfeed-spider/2.0
2026-10-10
10
Exabot/3.0
2026-05-30
13
Example3/1.0
2026-11-16
39
facebookexternalhit/1.0
2025-12-17
5
facebookexternalhit/1.1
2026-11-17
5819
facebookscraper/1.0
2026-06-14
20
Facebot
2026-06-12
11
FAST-WebCrawler/3.8
2026-06-15
10
Feedfetcher-Google
2026-09-13
16
FirmoGraph
2026-11-15
1
Gaisbot/3.0
2026-06-11
11
GeedoProductSearch
2025-12-03
27
GenomeCrawlerd/1.0
2026-01-28
129
Google-adstxt
2026-11-17
260
Google-Adwords-Instant
2025-03-03
2
Google-Apps-Script
2025-01-02
2
Google-Display-Ads-Bot
2026-11-14
84
Google-Read-Aloud
2026-11-16
416
Google-Safety
2026-07-04
4
Googlebot
2026-07-29
157
Googlebot-Image/1.0
2026-11-16
560
Googlebot-Mobile/2.1
2026-11-10
38
Googlebot-News
2026-11-07
18
Googlebot-Video/1.0
2026-10-29
10
Googlebot/2.1
2026-11-17
11169
GoogleOther
2026-11-15
1108
got
2026-10-08
18
GPTBot/1.0
2026-10-17
124
GPTBot/1.2
2026-09-14
783
Grammarly/1.0
2025-05-19
6
Gregarius/0.5.2
2026-09-13
13
Gulper Web Bot 0.2.4
2026-10-13
18
HaloBot/1.0
2026-11-16
3
HawaiiBot
2025-08-03
60
howBot/1.0
2025-02-12
1
hstspreload-bot
2026-11-16
264
HTTP Banner Detection
2026-08-26
3
HuaweiCrawler
2026-10-13
26
IAS crawler
2026-11-17
1502
ias-au/3.3
2025-04-16
1
ias-ie/3.3
2026-11-14
10
ias-jp/3.3
2025-04-23
5
ias-or/3.3
2026-11-14
1223
ias-sg/3.3
2025-01-31
3
ias-sync/3.3
2026-11-16
396
ias-va/3.3
2026-11-13
1150
iaskspider/1.0
2026-10-14
12
iaskspider/2.0
2026-10-14
18
IDG/EU
2025-03-01
5
Iframely/1.3.1
2026-11-15
37
ImagesiftBot
2025-07-24
223
INETDEX-BOT/2.0
2024-11-26
1
intelx.io_bot
2026-11-09
2
InternetMeasurement/1.0
2026-11-17
1120
keys-so-bot
2026-11-14
211
KhazandeBot/V2.6.2
2025-10-07
1
KOCMOHABT
2026-10-21
21
KStandBot/1.0
2026-11-16
1
KwHunter/2.0
2025-10-14
1
l9scan
2026-10-31
35
Leikibot/1.0
2026-10-02
5
LightspeedSystemsCrawler
2025-09-28
2
Linguee Bot
2026-01-18
16
LinkBloom/2.7.11
2025-10-15
6
LinkBloom/2.7.12
2025-10-29
2
LinkupBot/1.0
2026-10-12
6
Mail.RU_Bot/2.0
2025-03-17
19
Mail.RU_Bot/Favicons/2.0
2025-08-30
12
Mail.RU_Bot/Robots/2.0
2025-08-30
18
MBCrawler/1.0
2026-11-17
1
Mediapartners-Google
2026-11-17
4707
MegaIndex.ru/2.0
2024-11-30
1
meta-externalads/1.1
2026-10-14
3
meta-externalagent/1.1
2026-11-17
2580
meta-webindexer/1.1
2026-11-17
1624
Microsoft.Data.Mashup
2025-10-29
2
MicrosoftPreview/2.0
2025-05-05
4
MiniCrawler/1.0
2025-10-26
1
MistralAI-User/1.0
2026-10-10
170
MixrankBot
2026-08-26
7
MJ12bot/v1.4.8
2026-11-16
842
ModatScanner/1.0
2025-07-24
7
MojeekBot/0.11
2026-11-17
1
MS Search 6.0 Robot
2025-09-27
2
MSIECrawler
2025-10-07
1
MsnBot-Media/1.0b
2025-12-17
2
msnbot-media/1.1
2026-06-18
9
msnbot/0.11
2026-09-11
7
msnbot/1.0
2026-11-01
25
msnbot/1.1
2026-06-14
19
MyCrawler/1.0
2024-11-23
2
NetcraftSurveyAgent/1.0
2026-11-16
780
netEstate NE Crawler
2025-07-17
1
Nicecrawler/1.1
2026-04-08
12
node-fetch/1.0
2026-11-06
16
Nutch-1.21-SNAPSHOT
2025-01-06
5
OAI-SearchBot/1.0
2026-11-17
1155
Orbbot/1.1
2026-11-15
97
Owler
2026-09-26
25
Pandalytics/2.0
2026-06-30
77
panscient
2026-10-04
29
peer39_crawler/1.0
2026-11-11
26
PerplexityBot/1.0
2026-11-17
1182
PetalBot
2026-11-17
1544
Pinterestbot/1.0
2026-09-23
7
Pixalate.com/1.0
2026-08-05
44
probe-image-size/7.2.3
2026-04-22
10
Project-Resonance
2026-06-09
10
Protopage/3.0
2026-07-01
1
proximic
2026-11-15
3496
Quantcastbot/2.0
2026-10-31
1
Qwantbot-prod/1.0
2025-01-15
10
Qwantbot-prod577007/1.0
2025-01-15
9
Qwantbot-prod77007/1.0
2024-11-18
1
Qwantbot/1.0
2026-11-16
2728
Qwantbot/1.0_577007
2025-03-31
10
RDNS-bot
2024-12-02
2
RecordedFuture Global Inventory Crawler
2026-11-17
9
robots-harvester/0.1
2025-10-30
1
S-Scanner/1.0
2025-11-17
3
ScraperBot/1.0
2026-04-06
40
Scrapy/1.7.4
2025-04-09
2
Scrapy/2.11.0
2025-12-04
1
Scrapy/2.11.2
2026-09-05
49
Scrapy/2.6.3
2025-05-19
2
Screaming Frog SEO Spider/17.1
2024-12-27
1
Screaming Frog SEO Spider/20.2
2025-05-02
5
Screaming Frog SEO Spider/20.3
2024-12-19
1
Screaming Frog SEO Spider/21.3
2025-02-06
8
Screaming Frog SEO Spider/8.1
2026-06-15
15
search-engine-indexer/1.0
2025-08-21
3
SEBot-WA
2026-11-02
10
SeekportBot
2026-11-02
68
SemrushBot
2026-11-15
5
SemrushBot-BA
2026-11-11
22
SemrushBot/6~bl
2026-09-27
1
SemrushBot/7~bl
2026-11-17
76
SeobilityBot
2026-09-12
4
SEOkicks
2026-10-25
5
SEOlyt/1.0
2025-03-20
1
serpstatbot/2.1
2026-10-22
42
SeznamBot/4.0
2026-11-17
275
Sidetrade indexer bot
2026-06-22
1
SirdataBot
2026-09-12
27
site-checker/1.0
2025-09-26
3
SiteCardBot/1.0
2025-10-23
1
SiteOne-Crawler/1.0.7
2024-11-25
1
Slackbot 1.0
2026-11-03
20
Slackbot-LinkExpanding 1.0
2026-11-03
25
SMTBot/1.0
2025-09-27
1
Snap URL Preview Service
2026-11-10
157
SnoopSecInspect/1.1
2025-01-14
1
Sogou Push Spider/3.0
2026-10-12
17
Sogou web spider/3.0
2026-10-09
17
Sogou web spider/4.0
2026-11-16
298
Sosospider+
2025-01-16
1
startmebot/1.0
2026-11-16
415
StartpagePrivateImageProxy/2.0
2025-01-08
1
SuperBot/4.4.0.60
2026-06-15
17
SurdotlyBot/1.0
2026-11-09
12
t3versionsBot/1.0
2025-09-14
6
TelegramBot
2026-09-14
397
Timpibot/0.8
2025-03-24
7
Timpibot/0.9
2025-03-24
6
TinEye-bot/1.31
2024-11-30
1
Turnitin
2026-11-15
4
TurnitinBot
2026-06-15
6
Twitterbot/1.0
2026-11-03
406
uipbot/1.0
2026-03-17
1
VelenPublicWebCrawler/1.0
2026-10-21
68
Verity/1.1
2026-08-07
25
VsuSearchSpider/1.0
2025-02-27
1
vuhuvRBT/2.0
2025-04-07
1
Website-info.net-Robot
2026-05-10
22
Websuse.de/1.0
2025-10-17
1
WebwikiBot/2.1
2025-09-14
2
WebZIP/3.5
2026-05-17
11
WellKnownBot/0.1
2026-11-16
78
Who.is Bot
2026-11-13
2
wpbot/1.2
2025-02-12
65
WSBot/0.1
2026-05-29
3
XaxisSemanticsClassifier/1.0
2025-10-28
1
yacybot
2025-11-05
2
Yahoo! Slurp
2026-10-15
55
Yahoo! Slurp China
2026-11-03
32
YaK/1.0
2026-11-13
8
YandexBot/3.0
2026-10-24
1859
YandexFavicons/1.0
2026-10-10
287
YandexImages/3.0
2026-09-25
187
YandexMobileBot/3.0
2025-02-18
1
YandexNews/4.0
2026-10-12
17
Yeti/1.1
2026-06-02
1
YisouSpider
2026-10-18
69
YodaoBot/1.0
2026-08-06
12
ZaldamoSearchBot
2025-11-25
3
zgrab/0.x
2026-11-16
1888
zgrab/2.0
2025-03-18
1
ZoomBot
2025-01-11
1
ZoominfoBot
2026-11-09
149