List of webbots

Download without IP addresses XML format JSON format CSV format

Download including IP addresses XML format JSON format CSV format

Bot name
Last detected
IPs known
 
2ip bot/1.1
2026-04-01
2
admantx-eusy01/3.2
2025-10-19
1
admantx-ussy04/3.2
2024-11-28
2
AdsBot-Google
2026-11-05
135
AdsBot-Google-Mobile
2025-10-24
2
AdsTxtCrawlerTP/1.2
2025-05-07
1
AhrefsBot/7.0
2026-11-16
6779
aiHitBot/2.9
2025-10-07
2
alexa site audit/1.0
2026-11-02
14
AliyunSecBot
2026-08-11
274
Amazon-Advertising-ad-standards-bot/1.0
2026-11-16
4
AmazonAdBot/1.0
2026-01-04
22
Amazonbot/0.1
2026-11-16
1730
AnyEvent-HTTP/2.22
2025-03-03
1
AppEngine-Google
2026-10-20
86
Applebot/0.1
2026-11-16
5856
archive.org_bot
2026-11-16
29
AwarioBot/1.0
2026-11-13
16
AwarioSmartBot/1.0
2026-09-29
1
axios/1.6.5
2025-03-14
1
axios/1.7.9
2025-08-13
2
Baiduspider
2026-10-27
21
Baiduspider-render/2.0
2026-11-16
453
Baiduspider/2.0
2026-11-16
1108
Barkrowler/0.9
2026-11-14
134
bidswitchbot/1.0
2026-10-02
517
Bidtellect/0.0.0.0
2026-11-14
2
bingbot/2.0
2026-11-16
2011
BingPreview/1.0b
2026-11-11
108
BitSightBot/1.0
2026-11-15
615
BLEXBot/1.0
2025-12-03
43
Bloglines/3.1
2026-10-16
13
Bot/1.0
2026-11-16
8364
Bravebot/1.0
2026-11-16
285
Brightbot 1.0
2026-02-12
3
BW/1.2
2026-06-20
11
Bytespider
2026-11-16
9709
CATExplorador/1.0beta
2026-11-13
7
CCBot/2.0
2026-11-16
536
CensysInspect/1.1
2026-11-16
1493
Centro Ads.txt Crawler/1.0
2026-10-19
16
centurybot/1.0
2025-01-08
2
ChatGPT-User/1.0
2026-11-16
4078
CheckMarkNetwork/1.0
2026-11-08
101
Claude-User/1.0
2026-11-16
1605
ClaudeBot
2026-11-16
5653
ClaudeBot/1.0
2026-11-11
915
coccocbot-web/1.0
2026-11-16
144
Cocolyzebot/1.0
2026-05-18
1
colly
2026-07-27
2
companyspotter/2.0.0.0
2026-10-30
1
ContextAd Bot 1.0
2026-09-22
2
crawler_eb_germany_2.0
2026-10-03
10
CriteoBot/0.1
2026-11-16
139
DataForSeoBot/1.0
2026-11-01
23
Dataprovider.com
2026-11-13
291
DataXu/1.0
2025-01-11
1
Discordbot/2.0
2026-09-14
393
DnBCrawler-Analytics
2026-10-14
105
DomainCrawler/1.0
2025-08-15
1
DomainStatsBot/1.0
2026-11-15
3
Dormouse/1.0
2024-12-01
2
DotBot/1.1
2026-07-19
54
DotBot/1.2
2026-11-16
18
DuckAssistBot/1.1
2025-11-22
7
DuckDuckBot-Https/1.1
2026-04-04
24
DuckDuckBot/1.0
2026-11-14
69
DuckDuckBot/1.1
2026-11-16
52
DuckDuckGo-Favicons-Bot/1.0
2025-03-07
2
Elisabot
2026-03-21
3
EmailWolf 1.00
2026-10-28
12
ev-crawler/1.0
2026-10-28
7
everyfeed-spider/2.0
2026-10-10
10
Exabot/3.0
2026-05-30
13
Example3/1.0
2026-11-01
39
facebookexternalhit/1.0
2025-12-17
5
facebookexternalhit/1.1
2026-11-16
5825
facebookscraper/1.0
2026-06-14
20
Facebot
2026-06-12
11
FAST-WebCrawler/3.8
2026-06-15
10
Feedfetcher-Google
2026-09-13
16
FirmoGraph
2026-11-15
1
Gaisbot/3.0
2026-06-11
11
GeedoProductSearch
2025-12-03
27
GenomeCrawlerd/1.0
2026-01-28
129
Google-adstxt
2026-11-16
260
Google-Adwords-Instant
2025-03-03
2
Google-Apps-Script
2025-01-02
2
Google-Display-Ads-Bot
2026-11-14
84
Google-Read-Aloud
2026-11-16
416
Google-Safety
2026-07-04
4
Googlebot
2026-07-29
157
Googlebot-Image/1.0
2026-11-16
560
Googlebot-Mobile/2.1
2026-11-10
38
Googlebot-News
2026-11-07
18
Googlebot-Video/1.0
2026-10-29
10
Googlebot/2.1
2026-11-16
11160
GoogleOther
2026-11-15
1110
got
2026-10-08
18
GPTBot/1.0
2026-10-17
124
GPTBot/1.2
2026-09-14
783
Grammarly/1.0
2025-05-19
6
Gregarius/0.5.2
2026-09-13
13
Gulper Web Bot 0.2.4
2026-10-13
18
HaloBot/1.0
2026-11-16
3
HawaiiBot
2025-08-03
60
howBot/1.0
2025-02-12
1
hstspreload-bot
2026-11-09
261
HTTP Banner Detection
2026-08-26
3
HuaweiCrawler
2026-10-13
26
IAS crawler
2026-11-16
1500
ias-au/3.3
2025-04-16
1
ias-ie/3.3
2026-11-14
10
ias-jp/3.3
2025-04-23
5
ias-or/3.3
2026-11-14
1226
ias-sg/3.3
2025-01-31
3
ias-sync/3.3
2026-11-15
394
ias-va/3.3
2026-11-13
1152
iaskspider/1.0
2026-10-14
12
iaskspider/2.0
2026-10-14
18
IDG/EU
2025-03-01
5
Iframely/1.3.1
2026-11-15
37
ImagesiftBot
2025-07-24
223
INETDEX-BOT/2.0
2024-11-26
1
intelx.io_bot
2026-11-09
2
InternetMeasurement/1.0
2026-11-16
1121
keys-so-bot
2026-11-14
211
KhazandeBot/V2.6.2
2025-10-07
1
KOCMOHABT
2026-10-21
21
KStandBot/1.0
2026-11-16
1
KwHunter/2.0
2025-10-14
1
l9scan
2026-10-31
35
Leikibot/1.0
2026-10-02
5
LightspeedSystemsCrawler
2025-09-28
2
Linguee Bot
2026-01-18
16
LinkBloom/2.7.11
2025-10-15
6
LinkBloom/2.7.12
2025-10-29
2
LinkupBot/1.0
2026-10-12
6
Mail.RU_Bot/2.0
2025-03-17
19
Mail.RU_Bot/Favicons/2.0
2025-08-30
12
Mail.RU_Bot/Robots/2.0
2025-08-30
18
MBCrawler/1.0
2026-11-16
1
Mediapartners-Google
2026-11-16
4707
MegaIndex.ru/2.0
2024-11-30
1
meta-externalads/1.1
2026-10-14
3
meta-externalagent/1.1
2026-11-16
2578
meta-webindexer/1.1
2026-11-16
1621
Microsoft.Data.Mashup
2025-10-29
2
MicrosoftPreview/2.0
2025-05-05
4
MiniCrawler/1.0
2025-10-26
1
MistralAI-User/1.0
2026-10-10
170
MixrankBot
2026-08-26
7
MJ12bot/v1.4.8
2026-11-16
842
ModatScanner/1.0
2025-07-24
7
MojeekBot/0.11
2026-11-15
1
MS Search 6.0 Robot
2025-09-27
2
MSIECrawler
2025-10-07
1
MsnBot-Media/1.0b
2025-12-17
2
msnbot-media/1.1
2026-06-18
9
msnbot/0.11
2026-09-11
7
msnbot/1.0
2026-11-01
25
msnbot/1.1
2026-06-14
19
MyCrawler/1.0
2024-11-23
2
NetcraftSurveyAgent/1.0
2026-11-16
780
netEstate NE Crawler
2025-07-17
1
Nicecrawler/1.1
2026-04-08
12
node-fetch/1.0
2026-11-06
16
Nutch-1.21-SNAPSHOT
2025-01-06
5
OAI-SearchBot/1.0
2026-11-16
1153
Orbbot/1.1
2026-11-15
97
Owler
2026-09-26
25
Pandalytics/2.0
2026-06-30
77
panscient
2026-10-04
29
peer39_crawler/1.0
2026-11-11
26
PerplexityBot/1.0
2026-11-16
1181
PetalBot
2026-11-16
1545
Pinterestbot/1.0
2026-09-23
7
Pixalate.com/1.0
2026-08-05
44
probe-image-size/7.2.3
2026-04-22
10
Project-Resonance
2026-06-09
10
Protopage/3.0
2026-07-01
1
proximic
2026-11-15
3509
Quantcastbot/2.0
2026-10-31
1
Qwantbot-prod/1.0
2025-01-15
10
Qwantbot-prod577007/1.0
2025-01-15
9
Qwantbot-prod77007/1.0
2024-11-18
1
Qwantbot/1.0
2026-11-15
2728
Qwantbot/1.0_577007
2025-03-31
10
RDNS-bot
2024-12-02
2
RecordedFuture Global Inventory Crawler
2026-11-15
9
robots-harvester/0.1
2025-10-30
1
S-Scanner/1.0
2025-11-17
3
ScraperBot/1.0
2026-04-06
40
Scrapy/1.7.4
2025-04-09
2
Scrapy/2.11.0
2025-12-04
1
Scrapy/2.11.2
2026-09-05
49
Scrapy/2.6.3
2025-05-19
2
Screaming Frog SEO Spider/17.1
2024-12-27
1
Screaming Frog SEO Spider/20.2
2025-05-02
5
Screaming Frog SEO Spider/20.3
2024-12-19
1
Screaming Frog SEO Spider/21.3
2025-02-06
8
Screaming Frog SEO Spider/8.1
2026-06-15
15
search-engine-indexer/1.0
2025-08-21
3
SEBot-WA
2026-11-02
10
SeekportBot
2026-11-02
68
SemrushBot
2026-11-15
5
SemrushBot-BA
2026-11-11
22
SemrushBot/6~bl
2026-09-27
1
SemrushBot/7~bl
2026-11-16
76
SeobilityBot
2026-09-12
4
SEOkicks
2026-10-25
5
SEOlyt/1.0
2025-03-20
1
serpstatbot/2.1
2026-10-22
42
SeznamBot/4.0
2026-11-16
273
Sidetrade indexer bot
2026-06-22
1
SirdataBot
2026-09-12
27
site-checker/1.0
2025-09-26
3
SiteCardBot/1.0
2025-10-23
1
SiteOne-Crawler/1.0.7
2024-11-25
1
Slackbot 1.0
2026-11-03
20
Slackbot-LinkExpanding 1.0
2026-11-03
25
SMTBot/1.0
2025-09-27
1
Snap URL Preview Service
2026-11-10
158
SnoopSecInspect/1.1
2025-01-14
1
Sogou Push Spider/3.0
2026-10-12
17
Sogou web spider/3.0
2026-10-09
17
Sogou web spider/4.0
2026-11-16
298
Sosospider+
2025-01-16
1
startmebot/1.0
2026-11-15
416
StartpagePrivateImageProxy/2.0
2025-01-08
1
SuperBot/4.4.0.60
2026-06-15
17
SurdotlyBot/1.0
2026-11-09
12
t3versionsBot/1.0
2025-09-14
6
TelegramBot
2026-09-14
397
Timpibot/0.8
2025-03-24
7
Timpibot/0.9
2025-03-24
6
TinEye-bot/1.31
2024-11-30
1
Turnitin
2026-11-15
4
TurnitinBot
2026-06-15
6
Twitterbot/1.0
2026-11-03
406
uipbot/1.0
2026-03-17
1
VelenPublicWebCrawler/1.0
2026-10-21
68
Verity/1.1
2026-08-07
27
VsuSearchSpider/1.0
2025-02-27
1
vuhuvRBT/2.0
2025-04-07
1
Website-info.net-Robot
2026-05-10
22
Websuse.de/1.0
2025-10-17
1
WebwikiBot/2.1
2025-09-14
2
WebZIP/3.5
2026-05-17
11
WellKnownBot/0.1
2026-11-16
78
Who.is Bot
2026-11-13
2
wpbot/1.2
2025-02-12
65
WSBot/0.1
2026-05-29
3
XaxisSemanticsClassifier/1.0
2025-10-28
1
yacybot
2025-11-05
2
Yahoo! Slurp
2026-10-15
55
Yahoo! Slurp China
2026-11-03
32
YaK/1.0
2026-11-13
8
YandexBot/3.0
2026-10-24
1862
YandexFavicons/1.0
2026-10-10
289
YandexImages/3.0
2026-09-25
187
YandexMobileBot/3.0
2025-02-18
1
YandexNews/4.0
2026-10-12
17
Yeti/1.1
2026-06-02
1
YisouSpider
2026-10-18
69
YodaoBot/1.0
2026-08-06
12
ZaldamoSearchBot
2025-11-25
3
zgrab/0.x
2026-11-16
1888
zgrab/2.0
2025-03-18
1
ZoomBot
2025-01-11
1
ZoominfoBot
2026-11-09
151