Dave's Brain

Crawlers

Crawlers in the last week

CrawlerVisits
BLEXBot/1.0204
SeznamBot/3.2118
YandexBot/3.0111
bingbot/2.0108
DotBot/1.1101
MJ12bot/v1.4.796
Cliqzbot/2.092
MJ12bot/v1.4.878
Yahoo! Slurp76
Googlebot/2.164
ia_archiver57
proximic56
istellabot/t.1.1342
AhrefsBot/5.241
Windows NT 10.0; WOW6434
GrapeshotCrawler/2.031
SemrushBot/1.2~bl30
Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)30
coccocbot-web/1.026
Qwantify/2.4w24
Windows NT 5.1; rv:6.0.222
Clickagy Intelligence Bot v221
Baiduspider/2.020
MaxPointCrawler/Nutch-1.10 (maxpoint.crawler at maxpointinteractive dot com)19
Linux x86_6418
Win6418
BUbiNG (+http://law.di.unimi.it/BUbiNG.html)16
archive.org_bot16
Yeti/1.113
-12
WOW649
PiplBot (+http://www.pipl.com/bot/)9
MBCrawler/1.0 (https://monitorbacklinks.com)8
U8
CCBot/2.0 (http://commoncrawl.org/faq/)5
SiteExplorer/1.1b5
X11; Linux x86_644
Steeler/3.54
compatible; ExtLinksBot/1.5 +https://extlinks.com/Bot.html4
SEOkicks-Robot4
linkdexbot/2.04
Nutch Master Test/Nutch-1.13-SNAPSHOT3
Macintosh; Intel Mac OS X 10_10_13
MSIE 9.03
Windows NT 6.1; WOW643
MSIE 10.02
Twitterbot/1.02
Go-http-client/1.12
Windows NT 5.1; rv:6.02
ltx71 - (http://ltx71.com/)2
Mozilla/5.0/Firefox/42.0 - nbertaupete95(at)gmail.com2
yoozBot-2.22
spbot/5.0.32
Windows NT 6.12
Dataprovider.com2
GarlikCrawler/1.2 (http://garlik.com/, crawler@garlik.com)2
Intel Mac OS X 10.92
oBot/2.3.12
SurdotlyBot/1.01
Macintosh; Intel Mac OS X 10_11_41
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2883.95 Safari/537.36/Nutch-1.131
Intel Mac OS X 10.111
compatible; archive.org_bot +http://www.archive.org/details/archive.org_bot1
Macintosh; Intel Mac OS X 10_13_01
Uptimebot/1.01
Ubuntu1
Macintosh; Intel Mac OS X 10_11_61
Macintosh; Intel Mac OS X 10_9_31
Macintosh; Intel Mac OS X 10_9_21
Macintosh; Intel Mac OS X 10_9_51
Windows NT 6.1; rv:40.01
Quick-Crawler (+https://www.scrapinghub.com/)1
Findxbot/1.01
Windows1
Macintosh; Intel Mac OS X 10_13_11
nutch-1.4/Nutch-1.41
linkdexbot/2.21
Macintosh; Intel Mac OS X 10_12_61
Hatena::Fetcher/0.01 (master) Furl/3.061
SafeDNSBot (https://www.safedns.com/searchbot)1
MSIE 8.01
MegaIndex.ru/2.01
Python-urllib/1.171
G-i-g-a-b-o-t1
compatible; ips-agent1
Wotbox/2.01 (+http://www.wotbox.com/bot/)1
Intel Mac OS X 10.121
SMTBot/1.01

Copyright © 2008-2017, dave - Code samples on Dave's Brain is licensed under the Creative Commons Attribution 2.5 License. However other material, including English text has all rights reserved.