List of webbots

Download without IP addresses XML format JSON format CSV format

Download including IP addresses XML format JSON format CSV format

Bot name
Last detected
IPs known
 
2ip bot/1.1
2026-04-01
2
admantx-eusy01/3.2
2025-10-19
1
admantx-ussy04/3.2
2024-11-28
2
AdsBot-Google
2026-11-05
135
AdsBot-Google-Mobile
2025-10-24
2
AdsTxtCrawlerTP/1.2
2025-05-07
1
AhrefsBot/7.0
2026-11-16
6780
aiHitBot/2.9
2025-10-07
2
alexa site audit/1.0
2026-11-02
14
AliyunSecBot
2026-08-11
274
Amazon-Advertising-ad-standards-bot/1.0
2026-11-16
4
AmazonAdBot/1.0
2026-01-04
22
Amazonbot/0.1
2026-11-16
1731
AnyEvent-HTTP/2.22
2025-03-03
1
AppEngine-Google
2026-10-20
86
Applebot/0.1
2026-11-16
5860
archive.org_bot
2026-11-16
29
AwarioBot/1.0
2026-11-13
16
AwarioSmartBot/1.0
2026-09-29
1
axios/1.6.5
2025-03-14
1
axios/1.7.9
2025-08-13
2
Baiduspider
2026-10-27
21
Baiduspider-render/2.0
2026-11-16
453
Baiduspider/2.0
2026-11-16
1109
Barkrowler/0.9
2026-11-16
134
bidswitchbot/1.0
2026-10-02
517
Bidtellect/0.0.0.0
2026-11-14
2
bingbot/2.0
2026-11-16
2012
BingPreview/1.0b
2026-11-11
108
BitSightBot/1.0
2026-11-15
615
BLEXBot/1.0
2025-12-03
43
Bloglines/3.1
2026-10-16
13
Bot/1.0
2026-11-16
8378
Bravebot/1.0
2026-11-16
286
Brightbot 1.0
2026-02-12
3
BW/1.2
2026-06-20
11
Bytespider
2026-11-16
9710
CATExplorador/1.0beta
2026-11-13
7
CCBot/2.0
2026-11-16
537
CensysInspect/1.1
2026-11-16
1496
Centro Ads.txt Crawler/1.0
2026-10-19
16
centurybot/1.0
2025-01-08
2
ChatGPT-User/1.0
2026-11-16
4080
CheckMarkNetwork/1.0
2026-11-08
101
Claude-User/1.0
2026-11-16
1608
ClaudeBot
2026-11-16
5655
ClaudeBot/1.0
2026-11-11
915
coccocbot-web/1.0
2026-11-16
144
Cocolyzebot/1.0
2026-05-18
1
colly
2026-07-27
2
companyspotter/2.0.0.0
2026-10-30
1
ContextAd Bot 1.0
2026-09-22
2
crawler_eb_germany_2.0
2026-10-03
10
CriteoBot/0.1
2026-11-16
139
DataForSeoBot/1.0
2026-11-01
23
Dataprovider.com
2026-11-13
291
DataXu/1.0
2025-01-11
1
Discordbot/2.0
2026-09-14
393
DnBCrawler-Analytics
2026-10-14
105
DomainCrawler/1.0
2025-08-15
1
DomainStatsBot/1.0
2026-11-15
3
Dormouse/1.0
2024-12-01
2
DotBot/1.1
2026-07-19
54
DotBot/1.2
2026-11-16
18
DuckAssistBot/1.1
2025-11-22
7
DuckDuckBot-Https/1.1
2026-04-04
24
DuckDuckBot/1.0
2026-11-14
69
DuckDuckBot/1.1
2026-11-16
52
DuckDuckGo-Favicons-Bot/1.0
2025-03-07
2
Elisabot
2026-03-21
3
EmailWolf 1.00
2026-10-28
12
ev-crawler/1.0
2026-11-16
8
everyfeed-spider/2.0
2026-10-10
10
Exabot/3.0
2026-05-30
13
Example3/1.0
2026-11-16
39
facebookexternalhit/1.0
2025-12-17
5
facebookexternalhit/1.1
2026-11-16
5828
facebookscraper/1.0
2026-06-14
20
Facebot
2026-06-12
11
FAST-WebCrawler/3.8
2026-06-15
10
Feedfetcher-Google
2026-09-13
16
FirmoGraph
2026-11-15
1
Gaisbot/3.0
2026-06-11
11
GeedoProductSearch
2025-12-03
27
GenomeCrawlerd/1.0
2026-01-28
129
Google-adstxt
2026-11-16
260
Google-Adwords-Instant
2025-03-03
2
Google-Apps-Script
2025-01-02
2
Google-Display-Ads-Bot
2026-11-14
84
Google-Read-Aloud
2026-11-16
416
Google-Safety
2026-07-04
4
Googlebot
2026-07-29
157
Googlebot-Image/1.0
2026-11-16
560
Googlebot-Mobile/2.1
2026-11-10
38
Googlebot-News
2026-11-07
18
Googlebot-Video/1.0
2026-10-29
10
Googlebot/2.1
2026-11-16
11167
GoogleOther
2026-11-15
1110
got
2026-10-08
18
GPTBot/1.0
2026-10-17
124
GPTBot/1.2
2026-09-14
783
Grammarly/1.0
2025-05-19
6
Gregarius/0.5.2
2026-09-13
13
Gulper Web Bot 0.2.4
2026-10-13
18
HaloBot/1.0
2026-11-16
3
HawaiiBot
2025-08-03
60
howBot/1.0
2025-02-12
1
hstspreload-bot
2026-11-16
264
HTTP Banner Detection
2026-08-26
3
HuaweiCrawler
2026-10-13
26
IAS crawler
2026-11-16
1501
ias-au/3.3
2025-04-16
1
ias-ie/3.3
2026-11-14
10
ias-jp/3.3
2025-04-23
5
ias-or/3.3
2026-11-14
1226
ias-sg/3.3
2025-01-31
3
ias-sync/3.3
2026-11-15
395
ias-va/3.3
2026-11-13
1152
iaskspider/1.0
2026-10-14
12
iaskspider/2.0
2026-10-14
18
IDG/EU
2025-03-01
5
Iframely/1.3.1
2026-11-15
37
ImagesiftBot
2025-07-24
223
INETDEX-BOT/2.0
2024-11-26
1
intelx.io_bot
2026-11-09
2
InternetMeasurement/1.0
2026-11-16
1121
keys-so-bot
2026-11-14
211
KhazandeBot/V2.6.2
2025-10-07
1
KOCMOHABT
2026-10-21
21
KStandBot/1.0
2026-11-16
1
KwHunter/2.0
2025-10-14
1
l9scan
2026-10-31
35
Leikibot/1.0
2026-10-02
5
LightspeedSystemsCrawler
2025-09-28
2
Linguee Bot
2026-01-18
16
LinkBloom/2.7.11
2025-10-15
6
LinkBloom/2.7.12
2025-10-29
2
LinkupBot/1.0
2026-10-12
6
Mail.RU_Bot/2.0
2025-03-17
19
Mail.RU_Bot/Favicons/2.0
2025-08-30
12
Mail.RU_Bot/Robots/2.0
2025-08-30
18
MBCrawler/1.0
2026-11-16
1
Mediapartners-Google
2026-11-16
4707
MegaIndex.ru/2.0
2024-11-30
1
meta-externalads/1.1
2026-10-14
3
meta-externalagent/1.1
2026-11-16
2580
meta-webindexer/1.1
2026-11-16
1624
Microsoft.Data.Mashup
2025-10-29
2
MicrosoftPreview/2.0
2025-05-05
4
MiniCrawler/1.0
2025-10-26
1
MistralAI-User/1.0
2026-10-10
170
MixrankBot
2026-08-26
7
MJ12bot/v1.4.8
2026-11-16
842
ModatScanner/1.0
2025-07-24
7
MojeekBot/0.11
2026-11-15
1
MS Search 6.0 Robot
2025-09-27
2
MSIECrawler
2025-10-07
1
MsnBot-Media/1.0b
2025-12-17
2
msnbot-media/1.1
2026-06-18
9
msnbot/0.11
2026-09-11
7
msnbot/1.0
2026-11-01
25
msnbot/1.1
2026-06-14
19
MyCrawler/1.0
2024-11-23
2
NetcraftSurveyAgent/1.0
2026-11-16
780
netEstate NE Crawler
2025-07-17
1
Nicecrawler/1.1
2026-04-08
12
node-fetch/1.0
2026-11-06
16
Nutch-1.21-SNAPSHOT
2025-01-06
5
OAI-SearchBot/1.0
2026-11-16
1154
Orbbot/1.1
2026-11-15
97
Owler
2026-09-26
25
Pandalytics/2.0
2026-06-30
77
panscient
2026-10-04
29
peer39_crawler/1.0
2026-11-11
26
PerplexityBot/1.0
2026-11-16
1182
PetalBot
2026-11-16
1545
Pinterestbot/1.0
2026-09-23
7
Pixalate.com/1.0
2026-08-05
44
probe-image-size/7.2.3
2026-04-22
10
Project-Resonance
2026-06-09
10
Protopage/3.0
2026-07-01
1
proximic
2026-11-15
3510
Quantcastbot/2.0
2026-10-31
1
Qwantbot-prod/1.0
2025-01-15
10
Qwantbot-prod577007/1.0
2025-01-15
9
Qwantbot-prod77007/1.0
2024-11-18
1
Qwantbot/1.0
2026-11-16
2728
Qwantbot/1.0_577007
2025-03-31
10
RDNS-bot
2024-12-02
2
RecordedFuture Global Inventory Crawler
2026-11-15
9
robots-harvester/0.1
2025-10-30
1
S-Scanner/1.0
2025-11-17
3
ScraperBot/1.0
2026-04-06
40
Scrapy/1.7.4
2025-04-09
2
Scrapy/2.11.0
2025-12-04
1
Scrapy/2.11.2
2026-09-05
49
Scrapy/2.6.3
2025-05-19
2
Screaming Frog SEO Spider/17.1
2024-12-27
1
Screaming Frog SEO Spider/20.2
2025-05-02
5
Screaming Frog SEO Spider/20.3
2024-12-19
1
Screaming Frog SEO Spider/21.3
2025-02-06
8
Screaming Frog SEO Spider/8.1
2026-06-15
15
search-engine-indexer/1.0
2025-08-21
3
SEBot-WA
2026-11-02
10
SeekportBot
2026-11-02
68
SemrushBot
2026-11-15
5
SemrushBot-BA
2026-11-11
22
SemrushBot/6~bl
2026-09-27
1
SemrushBot/7~bl
2026-11-16
76
SeobilityBot
2026-09-12
4
SEOkicks
2026-10-25
5
SEOlyt/1.0
2025-03-20
1
serpstatbot/2.1
2026-10-22
42
SeznamBot/4.0
2026-11-16
275
Sidetrade indexer bot
2026-06-22
1
SirdataBot
2026-09-12
27
site-checker/1.0
2025-09-26
3
SiteCardBot/1.0
2025-10-23
1
SiteOne-Crawler/1.0.7
2024-11-25
1
Slackbot 1.0
2026-11-03
20
Slackbot-LinkExpanding 1.0
2026-11-03
25
SMTBot/1.0
2025-09-27
1
Snap URL Preview Service
2026-11-10
158
SnoopSecInspect/1.1
2025-01-14
1
Sogou Push Spider/3.0
2026-10-12
17
Sogou web spider/3.0
2026-10-09
17
Sogou web spider/4.0
2026-11-16
298
Sosospider+
2025-01-16
1
startmebot/1.0
2026-11-15
416
StartpagePrivateImageProxy/2.0
2025-01-08
1
SuperBot/4.4.0.60
2026-06-15
17
SurdotlyBot/1.0
2026-11-09
12
t3versionsBot/1.0
2025-09-14
6
TelegramBot
2026-09-14
397
Timpibot/0.8
2025-03-24
7
Timpibot/0.9
2025-03-24
6
TinEye-bot/1.31
2024-11-30
1
Turnitin
2026-11-15
4
TurnitinBot
2026-06-15
6
Twitterbot/1.0
2026-11-03
406
uipbot/1.0
2026-03-17
1
VelenPublicWebCrawler/1.0
2026-10-21
68
Verity/1.1
2026-08-07
27
VsuSearchSpider/1.0
2025-02-27
1
vuhuvRBT/2.0
2025-04-07
1
Website-info.net-Robot
2026-05-10
22
Websuse.de/1.0
2025-10-17
1
WebwikiBot/2.1
2025-09-14
2
WebZIP/3.5
2026-05-17
11
WellKnownBot/0.1
2026-11-16
78
Who.is Bot
2026-11-13
2
wpbot/1.2
2025-02-12
65
WSBot/0.1
2026-05-29
3
XaxisSemanticsClassifier/1.0
2025-10-28
1
yacybot
2025-11-05
2
Yahoo! Slurp
2026-10-15
55
Yahoo! Slurp China
2026-11-03
32
YaK/1.0
2026-11-13
8
YandexBot/3.0
2026-10-24
1862
YandexFavicons/1.0
2026-10-10
289
YandexImages/3.0
2026-09-25
187
YandexMobileBot/3.0
2025-02-18
1
YandexNews/4.0
2026-10-12
17
Yeti/1.1
2026-06-02
1
YisouSpider
2026-10-18
69
YodaoBot/1.0
2026-08-06
12
ZaldamoSearchBot
2025-11-25
3
zgrab/0.x
2026-11-16
1889
zgrab/2.0
2025-03-18
1
ZoomBot
2025-01-11
1
ZoominfoBot
2026-11-09
151