Crawlers

Crawlers in the week ending 2019-dec-06
CrawlerVisits
SemrushBot/6~bl1253
MJ12bot/v1.4.8614
GrapeshotCrawler/2.0392
Sogou web spider/4.0313
Googlebot/2.1301
BLEXBot/1.0254
coccocbot-image/1.0229
AhrefsBot/6.1220
bingbot/2.0217
coccocbot-web/1.0199
DotBot/1.1188
The Knowledge AI180
ZoominfoBot 172
YandexBot/3.0170
SeznamBot/3.2158
proximic129
msnbot/2.0b 125
SemrushBot/1.0~bm96
AppleWebKit/600.2.5 Version/8.0.2 Safari/600.2.5 77
Scrapy/1.5.1 70
Scrapy/1.5.2 69
bidswitchbot/1.068
AppleWebKit/537.36 Chrome/48.0.2564.116 Safari/537.3660
Cliqzbot/3.060
MaxPointCrawler/Nutch-1.14 40
ia_archiver35
Clickagy Intelligence Bot v232
MBCrawler/1.0 28
Linux x86_6428
Gecko/20100101 Firefox/60.024
CCBot/2.0 23
SemrushBot-BA22
360Spider21
YisouSpider21
Gecko/20100101 Firefox/70.020
iSec_Bot/2.020
AppleWebKit/537.36 Chrome/78.0.3904.97 Safari/537.3618
TTD-Content17
SEOkicks16
AppleWebKit/537.36 Chrome/49.0.2623.75 Safari/537.36 OPR/36.0.2130.3215
bumb.ly/0.01 13
AppleWebKit/537.36 Chrome/78.0.3904.108 Safari/537.3613
contxbot/1.013
MixnodeCache/1.812
oBot/2.3.112
Googlebot 11
ltx71 - 10
pilicanbot/Nutch-1.16 8
MSIE 10.07
Daum/4.17
+centuryb.o.t9[at]gmail.com6
Steeler/3.56
serpstatbot/1.0 6
Gecko/20100101 Firefox/28.06
AppleWebKit/537.36 Chrome/77.0.3865.90 Safari/537.366
IAS crawler 6
special_archiver/3.1.1 6
python-requests/2.22.06
Gecko/20100101 Firefox/59.06
Gecko/20100101 Firefox/52.06
Twitterbot/1.05
AppleWebKit/537.36 Chrome/55.0.2883.95 Safari/537.365
AppleWebKit/537.36 Chrome/34.0.1847.131 Safari/537.365
Screaming Frog SEO Spider/12.25
TurnitinBot 5
AppleWebKit/537.36 Chrome/72.0.3626.121 Safari/537.365
linkdexbot/2.04
Python-urllib/3.74
SemrushBot-SA/0.974
Gowikibot/1.04
AppleWebKit/537.36 Chrome/60.0.3112.113 Safari/537.36/Nutch-1.134
AppleWebKit/537.36 Chrome/78.0.3904.87 Safari/537.364
MojeekBot/0.74
Qwantify/Bleriot/1.14
Gecko/20100101 Firefox/34.04
evc-batch/2.04
DomainStatsBot/1.0 4
codewhy-spider/codewhy-1.04
Gecko/20100101 Firefox/68.03
MSIE 9.03
AppleWebKit/537.36 Chrome/34.0.1847.137 Safari/537.363
GarlikCrawler/1.2 3
Screaming Frog SEO Spider/12.33
Yeti/1.13
Clarabot/1.43
MSIE 6.03
ips-agent3
Seeker v.1 3
Gecko/20100101 Firefox/10.0.23
AppleWebKit/537.36 Chrome/77.0.3865.120 Safari/537.363
AppleWebKit/537.36 Chrome/68.0.3440.75 Safari/537.36 3
yacybot 3
Pinterestbot/1.03
tracemyfile/1.03
SeznamBot/3.2-test13
Dataprovider.com3
AppleWebKit/537.36 Chrome/50.0.2661.102 Safari/537.362
ICC-Crawler/2.0 2
AppleWebKit/537.36 Chrome/58.0.3029.110 Safari/537.36 SE 2.X MetaSr 1.02
AppleWebKit/537.36 Chrome/66.0.3359.139 Safari/537.362
Gecko/20100101 Firefox/29.02
Go-http-client/1.12
Seekport Crawler2
HTTrack 3.0x2
MegaIndex.ru/2.02
Gecko/20100101 Firefox/55.02
AppleWebKit/537.36 Chrome/73.0.3683.86 Safari/537.362
CheckMarkNetwork/1.0 2
AppleWebKit/537.36 Chrome/40.0.2214.85 Safari/537.362
AppleWebKit/537.36 Chrome/78.0.3904.70 Safari/537.362
Mappy/1.02
Gecko/20100101 Firefox/47.02
Web Explorer 22
Gecko/20100101 Firefox/62.02
AppleWebKit/537.36 Chrome/38.0.2125.111 Safari/537.362
SurdotlyBot/1.02
Gecko/20100101 Firefox/21.02
AppleWebKit/537.36 Chrome/48.0.1893.1588 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/44.0.7237.1666 Mobile Safari/537.361
MSIE 8.01
AppleWebKit/537.36 Chrome/50.0.6955.1111 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/43.0.5480.1103 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/52.0.7520.1091 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/77.0.3865.120 Safari/537.36 OPR/64.0.3417.92 1
AppleWebKit/537.36 Chrome/42.0.2781.1780 Mobile Safari/537.361
codewhy-spider/codewhy.net-\xe7\xa8\x8b\xe5\xba\x8f\xe5\x91\x98\xe7\x9a\x84\xe7\xb2\xbe\xe5\x87\x86\xe6\x90\x9c\xe7\xb4\xa2\xe5\xbc\x95\xe6\x93\x8e1
AppleWebKit/537.36 Chrome/52.0.3851.1300 Mobile Safari/537.361
Yahoo! Slurp1
AppleWebKit/537.36 Chrome/71.0.3578.80 Safari/537.361
AppleWebKit/537.36 Chrome/48.0.7057.1153 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/45.0.7701.1193 Mobile Safari/537.361
Gecko/20100101 Firefox/38.0 1
AppleWebKit/537.36 Chrome/55.0.6175.1444 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/40.0.2025.1262 Mobile Safari/537.361
Gecko/20100101 Firefox/71.01
AppleWebKit/537.36 Chrome/43.0.4256.1165 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/72.0.3582.0 Safari/537.361
AppleWebKit/537.36 Chrome/42.0.1332.1489 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/71.0.3578.98 Safari/537.361
AppleWebKit/537.36 Chrome/72.0.3626.109 Safari/537.361
AppleWebKit/537.36 Chrome/54.0.5202.1013 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/40.0.6783.1264 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/51.0.6571.1677 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/74.0.3694.0 Mobile Safari/537.36 Chrome-Lighthouse1
AppleWebKit/537.36 Chrome/43.0.1496.1081 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/43.0.4871.1192 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/47.0.9351.1918 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/72.0.3626.121 Safari/537.36 1
AppleWebKit/537.36 Chrome/74.0.3694.0 Safari/537.36 Chrome-Lighthouse1
AppleWebKit/537.36 Chrome/39.0.2657.1039 Mobile Safari/537.361
aiHitBot/2.91
AppleWebKit/537.36 Chrome/45.0.9725.1927 Mobile Safari/537.361
Gecko/20100101 Firefox/63.01
AppleWebKit/537.36 Chrome/74.0.3729.131 Safari/537.361
AppleWebKit/537.36 Chrome/60.0.3441.1420 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/41.0.2852.1817 Mobile Safari/537.361
Wotbox/2.01 1
AppleWebKit/600.1.25 Version/8.0 Safari/600.1.251
AppleWebKit/537.36 Chrome/46.0.2490.80 Safari/537.361
AppleWebKit/537.36 Chrome/64.0.3282.140 Safari/537.361
AppleWebKit/537.36 Chrome/39.0.6190.1341 Mobile Safari/537.361
Prlog/1.01
AppleWebKit/537.36 Chrome/63.0.3239.108 Safari/537.361
MSIE 5.011
panscient.com1
AppleWebKit/537.36 Chrome/51.0.8016.1013 Mobile Safari/537.361
DuckDuckBot-Https/1.11
Gecko/20100101 Firefox/44.01
AppleWebKit/537.36 Chrome/39.0.6150.1754 Mobile Safari/537.361
AppleWebKit/537.75.14 Version/7.0.3 Safari/537.75.141
Hatena::Fetcher/0.01 Furl/3.131
Python-urllib/3.61
AppleWebKit/537.36 Chrome/61.0.3163.91 Safari/537.361
AppleWebKit/537.36 Chrome/53.0.3973.1144 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/43.0.8641.1686 Mobile Safari/537.361
Gecko/20100101 Firefox/69.01
GetIntent Crawler 1
ichiro/3.0 1
AppleWebKit/537.36 Chrome/41.0.3944.1517 Mobile Safari/537.361
p40Bot1
AppleWebKit/537.36 Chrome/69.0.3497.100 Safari/537.361
AppleWebKit/537.36 Chrome/75.0.3770.142 Safari/537.361
AppleWebKit/537.36 Chrome/41.0.7329.1497 Mobile Safari/537.361
Gecko/20100101 Firefox/32.01
AppleWebKit/537.36 Chrome/60.0.7159.1821 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/59.0.7306.1987 Mobile Safari/537.361
Gecko/20100101 Firefox/39.01
AppleWebKit/537.36 Chrome/41.0.4446.1972 Mobile Safari/537.361
YaK/1.01
AppleWebKit/537.36 Chrome/48.0.7362.1624 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/48.0.8277.1111 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/48.0.2876.1136 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/72.0.3626.96 Safari/537.361
AppleWebKit/537.36 Chrome/45.0.9974.1032 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/57.0.6526.1390 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/56.0.2924.87 Safari/537.361
MojeekBot/0.61
AppleWebKit/537.36 Chrome/44.0.8293.1148 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/59.0.1856.1889 Mobile Safari/537.361
OutclicksBot/4 1
Gecko/20170101 Firefox/67.01
SJUUPBot 1
Screaming Frog SEO Spider/11.31
AppleWebKit/537.36 Chrome/60.0.7248.1234 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/40.0.8232.1647 Mobile Safari/537.361