Crawlers

Crawlers in the week ending 2019-sep-13
CrawlerVisits
serpstatbot/1.0 2236
SemrushBot/6~bl760
MJ12bot/v1.4.8604
DotBot/1.1478
Sogou web spider/4.0297
SemrushBot/3~bl225
coccocbot-image/1.0223
YandexBot/3.0186
Googlebot/2.1184
proximic181
bingbot/2.0177
BLEXBot/1.0155
coccocbot-web/1.0151
AhrefsBot/6.1132
SeznamBot/3.2129
The Knowledge AI104
SemrushBot/1.0~bm89
GrapeshotCrawler/2.085
Scrapy/1.5.2 79
Scrapy/1.5.1 72
AppleWebKit/600.2.5 Version/8.0.2 Safari/600.2.5 52
Clickagy Intelligence Bot v251
ia_archiver51
Linux x86_6441
MaxPointCrawler/Nutch-1.10 41
Gecko/20100101 Firefox/10.0.229
iSec_Bot/2.026
ltx71 - 25
Daum/4.122
bidswitchbot/1.021
AdsrvrBot19
AppleWebKit/537.36 Chrome/76.0.3809.100 Safari/537.3618
Baiduspider/2.016
360Spider15
YisouSpider15
CCBot/2.0 15
AppleWebKit/537.36 Chrome/45.0.2454.93 Safari/537.3614
AppleWebKit/537.36 Chrome/76.0.3809.132 Safari/537.3613
SEOkicks12
oBot/2.3.110
MojeekBot/0.69
Steeler/3.58
MSIE 7.08
Go-http-client/1.18
Gecko/20100101 Firefox/68.08
contxbot/1.08
AppleWebKit/537.36 Chrome/46.0.2490.80 Safari/537.367
Gecko/20100101 Firefox/60.07
AppleWebKit/537.36 Chrome/34.0.1847.131 Safari/537.367
Gecko/20070725 Firefox/2.0.0.66
Gecko/20100101 Firefox/69.06
AppleWebKit/605.1.15 Version/12.1.1 Safari/605.1.156
pilicanbot/Nutch-1.15 6
tracemyfile/1.06
Gecko/20100101 Firefox/6.0.26
MBCrawler/1.0 6
AppleWebKit/537.36 Chrome/59.0.3071.114 Safari/537.366
special_archiver/3.1.1 6
PleskBot6
Dataprovider.com5
SemrushBot-BA5
Twitterbot/1.05
Opera/9.80 Presto/2.12.388 Version/12.184
MaxPointCrawler/Nutch-1.14 4
linkdexbot/2.04
DuckDuckBot-Https/1.14
SemrushBot-SA/0.974
AppleWebKit/537.36 Chrome/38.0.2125.111 Safari/537.364
looid.com Search Engine/0.14
IAS crawler 4
CheckMarkNetwork/1.0 3
AppleWebKit/537.36 Chrome/36.0.1985.125 Safari/537.363
DomainStatsBot/1.0 3
AppleWebKit/537.36 Chrome/74.0.3694.0 Safari/537.36 Chrome-Lighthouse3
MSIE 8.03
AppleWebKit/537.75.14 Version/7.0.3 Safari/537.75.143
SafeDNSBot 3
AppleWebKit/537.36 Chrome/73.0.3683.86 Safari/537.363
TurnitinBot 3
AppleWebKit/537.36 Chrome/60.0.3112.113 Safari/537.36/Nutch-1.133
MSIE 10.03
AppleWebKit/537.36 Chrome/69.0.3497.100 Safari/537.363
Riddler 2
AppleWebKit/537.36 Chrome/66.0.3359.139 Safari/537.362
Gecko/20100101 Firefox/38.02
Pinterestbot/1.02
python-requests/2.22.02
Googlebot 2
Yeti/1.12
TinEye-bot/1.312
Gecko/20100101 Firefox/52.02
Gecko/20100101 Firefox/67.02
Python-urllib/3.72
Seekport Crawler2
evc-batch/2.02
Gecko/20100101 Firefox/28.02
MegaIndex.ru/2.02
Gecko/20100101 Firefox/70.02
Mappy/1.02
Seeker v.1 2
AppleWebKit/537.36 Chrome/34.0.1847.137 Safari/537.362
python-requests/2.18.42
Prlog/1.02
Hatena::Fetcher/0.01 Furl/3.131
Screaming Frog SEO Spider/11.31
AppleWebKit/537.36 Chrome/48.0.2564.116 Safari/537.361
EcoSearch 1
MixnodeCache/1.81
AppleWebKit/537.36 Chrome/75.0.3770.80 Safari/537.361
Screaming Frog SEO Spider/9.41
AppleWebKit/528.16 Version/4.0 Safari/528.161
Gecko/20100101 Firefox/21.01
AppleWebKit/537.36 Chrome/72.0.3626.109 Safari/537.361
SerendeputyBot/0.8.6 1
Gecko/20100101 Firefox/47.01
AppleWebKit/537.36 Chrome/63.0.3239.108 Safari/537.361
AppleWebKit/537.36 Chrome/74.0.3729.169 Safari/537.361
CipaCrawler/3.0 1
Gecko/20100101 Firefox/29.01
Wotbox/2.01 1
Opera 8.511
AppleWebKit/537.36 Chrome/48.0.2564.109 Safari/537.361
GarlikCrawler/1.2 1
AppleWebKit/537.36 Chrome/50.0.2661.102 Safari/537.361
AppleWebKit/537.36 Chrome/68.0.3440.106 Safari/537.361
MSIE 5.011
AppleWebKit/537.36 Chrome/58.0.3029.110 Safari/537.36 SE 2.X MetaSr 1.01
archive.org_bot 1
MSIE 6.01
AppleWebKit/537.36 Chrome/64.0.3282.140 Safari/537.361
Web Explorer 21
Qwantify/Bleriot/1.11
compatible MSIE 6.00 Windows NT 5.1 SV11
AppleWebKit/537.36 Chrome/75.0.3770.142 Safari/537.36 OPR/62.0.3331.1161
Gecko/20100101 Firefox/59.01
AppleWebKit/537.36 Chrome/75.0.3770.100 Safari/537.361
yacybot 1
Y!J-ASR/1.0 crawler 1
Gecko/20100101 Firefox/57.01
AppleWebKit/537.36 Ubuntu Chromium/76.0.3809.100 Chrome/76.0.3809.100 Safari/537.361
MagiBot/1.0.01
MSIE 9.01
AppleWebKit/537.36 Ubuntu Chromium/75.0.3770.90 Chrome/75.0.3770.90 Safari/537.361
AppleWebKit/537.36 Chrome/74.0.3729.157 Safari/537.361
AppleWebKit/537.36 1