Crawlers

Crawlers in the week ending 2019-nov-15
CrawlerVisits
SemrushBot/6~bl1119
DotBot/1.1931
MJ12bot/v1.4.8456
Sogou web spider/4.0328
Googlebot/2.1295
bingbot/2.0241
AhrefsBot/6.1221
coccocbot-image/1.0209
YandexBot/3.0201
coccocbot-web/1.0199
BLEXBot/1.0196
ZoominfoBot 180
proximic175
The Knowledge AI137
AppleWebKit/537.36 Chrome/48.0.2564.116 Safari/537.36135
SeznamBot/3.2119
SemrushBot/1.0~bm100
GrapeshotCrawler/2.0100
msnbot/2.0b 98
bidswitchbot/1.082
Scrapy/1.5.1 81
AppleWebKit/600.2.5 Version/8.0.2 Safari/600.2.5 80
Scrapy/1.5.2 69
MaxPointCrawler/Nutch-1.14 51
ia_archiver50
Gecko/20100101 Firefox/60.047
Clickagy Intelligence Bot v234
AdsrvrBot28
panscient.com27
YisouSpider27
360Spider22
contxbot/1.022
AppleWebKit/537.36 Chrome/77.0.3865.120 Safari/537.3619
Gecko/20100101 Firefox/48.018
iSec_Bot/2.016
Gecko/20100101 Firefox/70.016
CCBot/2.0 16
TTD-Content14
oBot/2.3.113
AppleWebKit/537.36 Chrome/77.0.3865.90 Safari/537.3613
Daum/4.112
SEOkicks12
MixnodeCache/1.811
MSIE 7.011
ltx71 - 11
AppleWebKit/537.36 Chrome/49.0.2623.75 Safari/537.36 OPR/36.0.2130.3210
Gecko/20100101 Firefox/28.010
SemrushBot-BA10
AppleWebKit/537.36 Chrome/78.0.3904.97 Safari/537.369
IAS crawler 8
pilicanbot/Nutch-1.16 8
Twitterbot/1.08
Go-http-client/1.18
Linux x86_647
Googlebot 7
python-requests/2.22.07
Gecko/20100101 Firefox/59.06
Gowikibot/1.06
Gecko/20100101 Firefox/52.06
Gecko/20100101 Firefox/69.06
Gecko/20100101 Firefox/10.0.25
SurdotlyBot/1.05
yacybot 5
GarlikCrawler/1.2 5
Gecko/20100101 Firefox/34.05
AppleWebKit/537.36 Chrome/75.0.3770.142 Safari/537.365
ips-agent5
MSIE 6.04
evc-batch/2.04
Qwantify/Bleriot/1.14
DuckDuckBot-Https/1.14
DomainStatsBot/1.0 4
linkdexbot/2.04
MBCrawler/1.0 4
SemrushBot-SA/0.974
AppleWebKit/537.36 Chrome/78.0.3904.87 Safari/537.364
AppleWebKit/537.36 Chrome/78.0.3904.70 Safari/537.364
AppleWebKit/537.36 Chrome/34.0.1847.131 Safari/537.364
special_archiver/3.1.1 3
AppleWebKit/537.36 Chrome/46.0.2490.80 Safari/537.363
codewhy-spider/codewhy-1.03
bumb.ly/0.01 3
Gecko/20100101 Firefox/29.03
AppleWebKit/537.36 Chrome/50.0.2661.102 Safari/537.363
tracemyfile/1.03
Pinterestbot/1.03
Seekport Crawler2
AppleWebKit/537.75.14 Version/7.0.3 Safari/537.75.142
Python-urllib/3.72
AppleWebKit/537.36 Chrome/49.0.2623.105 Safari/537.362
Gecko/20100101 Firefox/21.02
TurnitinBot 2
AppleWebKit/537.36 Chrome/73.0.3683.86 Safari/537.362
Yeti/1.12
Gecko/20100101 Firefox/71.02
Screaming Frog SEO Spider/11.32
Seeker v.1 2
Clarabot/1.42
AppleWebKit/537.36 Chrome/72.0.3582.0 Safari/537.362
TinEye-bot/1.312
MSIE 9.02
MegaIndex.ru/2.02
ichiro/3.0 1
Dataprovider.com1
AppleWebKit/537.36 Chrome/43.0.8641.1686 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/53.0.3973.1144 Mobile Safari/537.361
Screaming Frog SEO Spider/12.21
SeznamBot/3.2-test11
AppleWebKit/537.36 Chrome/51.0.7367.1009 Mobile Safari/537.361
Python-urllib/3.61
p40Bot1
Gecko/20100101 Firefox/38.0 1
AppleWebKit/537.36 Chrome/41.0.3944.1517 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/74.0.3694.0 Safari/537.36 Chrome-Lighthouse1
aiHitBot/2.91
Gecko/20070728 Firefox/52.7.31
axios/0.17.11
AppleWebKit/537.36 Chrome/77.0.3865.75 Safari/537.361
Gecko/20100101 Firefox/58.01
MSIE 10.01
AppleWebKit/537.36 Chrome/63.0.3239.108 Safari/537.361
Prlog/1.01
AppleWebKit/537.36 Chrome/36.0.1985.125 Safari/537.361
Steeler/3.51
SerendeputyBot/0.8.6 1
StatusMachine/1.01
AppleWebKit/537.36 Version/4.0 Chrome/77.0.3865.116 Mobile Safari/537.36 DuckDuckGo/51
Wotbox/2.01 1
AppleWebKit/537.36 Chrome/72.0.3626.121 Safari/537.36 1
Gecko/20100101 Firefox/33.01
AppleWebKit/537.36 Chrome/51.0.8016.1013 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/52.0.7520.1091 Mobile Safari/537.361
compatible1
AppleWebKit/537.36 Chrome/66.0.3359.139 Safari/537.361
AppleWebKit/537.36 Chrome/72.0.3626.96 Safari/537.361
AppleWebKit/537.36 Chrome/60.0.7159.1821 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/59.0.7306.1987 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/45.0.9974.1032 Mobile Safari/537.361
Gecko/20170101 Firefox/67.01
Gecko/20100101 Firefox/32.01
MSIE 5.011
CheckMarkNetwork/1.0 1
AppleWebKit/537.36 Chrome/56.0.2924.87 Safari/537.361
MSIE 8.01
SJUUPBot 1
AppleWebKit/537.36 Chrome/60.0.7248.1234 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/44.0.8293.1148 Mobile Safari/537.361
MojeekBot/0.71
AppleWebKit/537.36 Chrome/61.0.3163.91 Safari/537.361
MojeekBot/0.61
AppleWebKit/600.1.25 Version/8.0 Safari/600.1.251
OutclicksBot/4 1
AppleWebKit/537.36 Chrome/59.0.1856.1889 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/57.0.6526.1390 Mobile Safari/537.361
Gecko/20100101 Firefox/45.01
Gecko/20100101 Firefox/55.01
AppleWebKit/537.36 Chrome/76.0.3809.132 Safari/537.361
Yahoo! Slurp1
AppleWebKit/537.36 Chrome/75.0.3770.100 Safari/537.361
AppleWebKit/537.36 Chrome/42.0.2032.1580 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/40.0.6712.1863 Mobile Safari/537.361
SEMrushBot1
Pandalytics/1.0 1
curl/7.58.01
AppleWebKit/537.36 Chrome/74.0.3729.169 Safari/537.361
AppleWebKit/537.36 Chrome/39.0.2453.1134 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/76.0.3809.132 Safari/537.36 OPR/63.0.3368.1071
Gecko/20100101 Firefox/63.01
Gecko/20100101 Firefox/68.01
Gecko/20100401 Firefox/52.5.01
GigablastOpenSource/1.01
eContext/1.0 1
Gecko/20100101 Firefox/62.01
MagiBot/1.0.01
AppleWebKit/537.36 Chrome/74.0.3694.0 Mobile Safari/537.36 Chrome-Lighthouse1
Keyfactor.com1