Crawlers

Crawlers in the week ending 2020-jan-24
CrawlerVisits
SemrushBot/6~bl921
MJ12bot/v1.4.8693
Googlebot/2.1319
AhrefsBot/6.1274
coccocbot-image/1.0237
bingbot/2.0209
coccocbot-web/1.0188
ZoominfoBot 175
The Knowledge AI161
YandexBot/3.0157
SeznamBot/3.2138
Sogou web spider/4.0131
proximic104
GrapeshotCrawler/2.096
istellabot/t.1.1394
AppleWebKit/600.2.5 Version/8.0.2 Safari/600.2.5 91
msnbot/2.0b 88
DotBot/1.187
BLEXBot/1.086
Scrapy/1.5.1 71
bidswitchbot/1.064
SemrushBot/1.0~bm57
ia_archiver41
Linux x86_6440
SemrushBot-BM/1.039
ltx71 - 33
SEOkicks30
AppleWebKit/537.36 Chrome/79.0.3945.88 Safari/537.3627
Clickagy Intelligence Bot v224
MaxPointCrawler/Nutch-1.14 21
bumb.ly/0.01 21
AppleWebKit/537.36 Chrome/55.0.2883.95 Safari/537.3619
AppleWebKit/537.36 Chrome/48.0.2564.116 Safari/537.3619
python-requests/2.22.018
Go-http-client/1.117
Scrapy/1.5.2 16
Gecko/20100101 Firefox/72.015
AppleWebKit/537.36 Chrome/72.0.3626.121 Safari/537.3615
Steeler/3.514
SemrushBot-BA14
TurnitinBot 14
Gecko/20100101 Firefox/71.013
oBot/2.3.112
CCBot/2.0 12
Daum/4.110
AppleWebKit/537.36 Chrome/46.0.2490.80 Safari/537.3610
MixnodeCache/1.810
iSec_Bot/2.010
Gecko/20100101 Firefox/68.010
AppleWebKit/537.36 Chrome/79.0.3945.117 Safari/537.3610
contxbot/1.09
MBCrawler/1.0 8
OPPO A33 Build/LMY47V8
Twitterbot/1.07
Googlebot 7
Cliqzbot/3.07
OSPScraper 6
Gecko/20100101 Firefox/59.06
AppleWebKit/537.36 Chrome/49.0.2623.75 Safari/537.36 OPR/36.0.2130.325
Gecko/20100101 Firefox/60.05
Gecko/2008061015 Firefox/3.05
AppleWebKit/537.36 Chrome/79.0.3945.79 Safari/537.365
tracemyfile/1.04
SemrushBot-SA/0.974
linkdexbot/2.04
Nutch Master Test/Dolphin-0.1-Beta4
Bytespider4
Pandalytics/1.0 4
MSIE 9.04
AppleWebKit/537.36 Chrome/34.0.1847.137 Safari/537.364
Clarabot/1.43
AppleWebKit/537.36 Chrome/50.0.2661.102 Safari/537.363
Dataprovider.com3
Pinterestbot/1.03
Yeti/1.13
AppleWebKit/537.36 Chrome/34.0.1847.131 Safari/537.363
Gecko/20100101 Firefox/29.03
SemanticJuice 3
Screaming Frog SEO Spider/12.43
Barkrowler/0.9 3
MSIE 8.03
AppleWebKit/537.75.14 Version/7.0.3 Safari/537.75.143
+centuryb.o.t9[at]gmail.com3
Gecko/20100101 Firefox/34.03
YaK/1.03
Seekport Crawler3
MSIE 7.03
Python-urllib/3.72
Hatena::Fetcher/0.01 Furl/3.132
AppleWebKit/537.36 Chrome/78.0.3904.97 Safari/537.362
GarlikCrawler/1.2 2
AppleWebKit/537.36 Chrome/78.0.3904.108 Safari/537.362
oBot/2.3.22
Gecko/20100101 Firefox/28.02
Qwantify/Bleriot/1.12
IAS crawler 2
AppleWebKit/537.36 Version/4.0 Chrome/53.0.2785.49 Mobile MQQBrowser/6.2 TBS/043602 Safari/537.36 MicroMessenger/6.5.16.1120 NetType/WIFI Language/zh_CN2
Web Explorer2
yacybot 2
Gecko/20100101 Firefox/45.02
Gecko/20100101 Firefox/44.02
AppleWebKit/537.36 Chrome/74.0.3729.169 Safari/537.362
Gecko/20100101 Firefox/10.02
AppleWebKit/537.36 Chrome/63.0.3239.108 Safari/537.362
YisouSpider2
MegaIndex.ru/2.02
AppleWebKit/537.36 Chrome/63.0.3239.84 Safari/537.362
AppleWebKit/537.36 Chrome/56.0.2924.87 Safari/537.362
AppleWebKit/537.36 Chrome/59.0.8295.1511 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/57.0.6452.1881 Mobile Safari/537.361
MSIE 6.01
Gecko/20100101 Firefox/61.01
AppleWebKit/537.36 Chrome/56.0.3486.1482 Mobile Safari/537.361
MojeekBot/0.71
AppleWebKit/537.36 Chrome/47.0.6809.1554 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/54.0.6386.1489 Mobile Safari/537.361
SeznamBot/3.2-test11
AppleWebKit/537.36 Chrome/58.0.4525.1524 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/55.0.3651.1641 Mobile Safari/537.361
Gecko/20100101 Firefox/52.01
AppleWebKit/537.36 Chrome/60.0.5780.1933 Mobile Safari/537.361
MSIE 10.01
AppleWebKit/537.36 Chrome/58.0.8499.1207 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/60.0.8859.1480 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/40.0.8295.1225 Mobile Safari/537.361
MNSC/1.01
AppleWebKit/537.36 Chrome/47.0.1738.1390 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/49.0.2623.105 Safari/537.361
Gecko/20100101 Firefox/58.01
psbot/0.1 1
AppleWebKit/537.36 Chrome/41.0.4066.1268 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/51.0.2376.1926 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/39.0.2887.1321 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/66.0.3359.139 Safari/537.361
AppleWebKit/537.36 Chrome/56.0.9834.1408 Mobile Safari/537.361
Gecko/20100101 Firefox/57.01
AppleWebKit/537.36 Chrome/55.0.2883.87 Safari/537.361
Gecko/20100101 Firefox/55.01
AppleWebKit/537.36 Chrome/59.0.7968.1530 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/47.0.6514.1504 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/56.0.3768.1476 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/58.0.3755.1886 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/44.0.5031.1267 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/64.0.3282.140 Safari/537.361
MSIE 5.011
AppleWebKit/537.36 Chrome/56.0.1031.1948 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/39.0.2882.1206 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/42.0.8726.1035 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/46.0.7304.1381 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/42.0.8746.1885 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/55.0.4678.1006 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/51.0.4693.1307 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/44.0.4471.1693 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/49.0.7214.1966 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/45.0.7950.1049 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/47.0.8803.1047 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/40.0.6005.1493 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/51.0.3092.1206 Mobile Safari/537.361
aiHitBot/2.91
Gecko/20100101 Firefox/48.01
AppleWebKit/537.36 Chrome/60.0.2638.1170 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/43.0.1659.1455 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/55.0.5366.1067 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/60.0.8177.1421 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/81.0.4006.0 Safari/537.361
Gecko/20100101 Firefox/21.01
ips-agent1
AppleWebKit/537.36 Chrome/51.0.2704.84 Safari/537.361
AppleWebKit/537.36 Chrome/78.0.3904.99 Safari/537.36 Vivaldi/2.9.1705.411
vuhuvBot/1.01
AppleWebKit/537.36 Chrome/47.0.8314.1660 Mobile Safari/537.361
Y!J-ASR/1.0 crawler 1
AppleWebKit/537.36 Chrome/45.0.7213.1223 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/57.0.8505.1557 Mobile Safari/537.361
CipaCrawler/3.0 1
AppleWebKit/537.36 Chrome/42.0.2571.1207 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/43.0.5997.1721 Mobile Safari/537.361
TTD-Content1
AppleWebKit/537.36 Chrome/56.0.6881.1404 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/60.0.9175.1528 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/68.0.3440.106 Safari/537.361
AppleWebKit/603.9 Chrome/52.0.2609.113 Mobile Safari/600.21
AppleWebKit/537.36 Chrome/59.0.6161.1079 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/58.0.8588.1002 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/56.0.3777.1437 Mobile Safari/537.361
EcoSearch 1
AppleWebKit/537.36 Chrome/49.0.4520.1988 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/54.0.2159.1962 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/50.0.7405.1915 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/43.0.9871.1562 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/54.0.7693.1335 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/56.0.1170.1941 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/50.0.5147.1755 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/58.0.1334.1257 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/57.0.1631.1465 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/35.0.1916.114 Safari/537.361
AppleWebKit/537.36 Chrome/42.0.3853.1858 Mobile Safari/537.361
Keybot Translation-Search-Machine1
AppleWebKit/537.36 Chrome/41.0.1506.1524 Mobile Safari/537.361
Prlog/1.01
AppleWebKit/537.36 Chrome/57.0.7914.1478 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/43.0.2344.1002 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/51.0.7809.1356 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/39.0.6307.1213 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/44.0.1116.1936 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/51.0.7258.1788 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/41.0.6077.1828 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/59.0.7427.1616 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/54.0.4890.1494 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/57.0.6746.1847 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/57.0.3954.1130 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/53.0.4272.1979 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/46.0.3473.1215 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/44.0.1322.1333 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/55.0.6726.1411 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/60.0.8221.1456 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/44.0.8833.1665 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/53.0.6541.1245 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/51.0.5271.1546 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/40.0.8868.1122 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/52.0.7115.1571 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/48.0.8712.1528 Mobile Safari/537.361
SeobilityBot 1
AppleWebKit/537.36 Chrome/57.0.7479.1774 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/53.0.8568.1623 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/58.0.8937.1905 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/53.0.3309.1314 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/68.0.3440.75 Safari/537.36 1
AppleWebKit/537.36 Chrome/39.0.6161.1324 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/45.0.7337.1416 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/55.0.5783.1391 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/46.0.8293.1831 Mobile Safari/537.361
Gecko/20130401 Firefox/64.81
AppleWebKit/537.36 Chrome/47.0.7518.1592 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/55.0.8611.1556 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/46.0.8142.1318 Mobile Safari/537.361
SerendeputyBot/0.8.6 1
AppleWebKit/537.36 Chrome/81.0.4003.0 Safari/537.36 Edg/81.0.381.01
AppleWebKit/537.36 Chrome/60.0.3125.1981 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/53.0.5519.999 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/47.0.5433.1863 Mobile Safari/537.361
Wget/1.19.4 1
AppleWebKit/537.36 Chrome/46.0.9169.1051 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/47.0.1526.1242 Mobile Safari/537.361
DomainStatsBot/1.0 1
AppleWebKit/537.36 Chrome/60.0.9492.1525 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/57.0.6083.1966 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/44.0.6276.1089 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/55.0.2801.1379 Mobile Safari/537.361
Gecko/20100101 Firefox/70.01
AppleWebKit/537.36 Chrome/59.0.7090.1146 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/79.0.3945.130 Safari/537.361
AppleWebKit/537.36 Chrome/52.0.2683.1196 Mobile Safari/537.361
AppleWebKit/537.36 Mobile Safari/537.36 1
AppleWebKit/537.36 Chrome/42.0.2311.135 Safari/537.36 Edge/12.102401
AppleWebKit/537.36 Chrome/45.0.5228.1948 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/73.0.3683.103 Safari/537.361
Screaming Frog SEO Spider/12.01
AppleWebKit/537.36 Chrome/59.0.5260.1591 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/54.0.9146.1401 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/55.0.2627.1313 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/50.0.3462.1639 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/54.0.8775.1958 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/50.0.5026.1757 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/57.0.2926.1356 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/45.0.3198.1554 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/57.0.6587.1011 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/51.0.5197.1961 Mobile Safari/537.361