Crawlers

Crawlers in the week ending 2020-feb-21
CrawlerVisits
SemrushBot/6~bl696
MJ12bot/v1.4.8611
Googlebot/2.1332
AhrefsBot/6.1264
bingbot/2.0224
coccocbot-image/1.0207
YandexBot/3.0205
coccocbot-web/1.0195
ZoominfoBot 188
BLEXBot/1.0163
SeznamBot/3.2143
proximic130
The Knowledge AI125
Sogou web spider/4.0103
GrapeshotCrawler/2.091
AppleWebKit/600.2.5 Version/8.0.2 Safari/600.2.5 89
DotBot/1.184
Linux x86_6474
bidswitchbot/1.070
msnbot/2.0b 66
Barkrowler/0.9 54
ia_archiver47
SemrushBot-BM/1.046
ltx71 - 36
SearchAtlas.com SEO Crawler33
MaxPointCrawler/Nutch-1.14 30
SEOkicks26
AppleWebKit/537.36 Chrome/79.0.3945.130 Safari/537.3626
SemrushBot/1.0~bm26
SemrushBot26
Scrapy/1.5.1 25
AppleWebKit/537.36 Chrome/49.0.2623.75 Safari/537.36 OPR/36.0.2130.3225
CCBot/2.0 25
python-requests/2.22.024
Mozilla/5.022
TTD-Content19
Cliqzbot/3.019
oBot/2.3.118
istellabot/t.1.1316
AppleWebKit/537.36 Chrome/48.0.2564.116 Safari/537.3616
iSec_Bot/2.016
Daum/4.115
SemrushBot-BA15
IAS crawler 14
Gecko/20100101 Firefox/68.014
Clickagy Intelligence Bot v214
pilicanbot/Nutch-1.16 13
Gecko/20100101 Firefox/10.0.210
MixnodeCache/1.810
MBCrawler/1.0 10
OPPO A33 Build/LMY47V9
Yeti/1.19
yacybot 9
AppleWebKit/537.36 Chrome/79.0.3945.117 Safari/537.368
Gecko/20100101 Firefox/59.08
AppleWebKit/537.36 Chrome/79.0.3945.88 Safari/537.367
GarlikCrawler/1.2 7
Gecko/20100101 Firefox/48.07
Steeler/3.56
Gecko/20100101 Firefox/28.06
evc-batch/2.06
Scrapy/1.5.2 6
MSIE 7.06
serpstatbot/1.0 5
Gowikibot/1.05
Dataprovider.com5
contxbot/1.05
MSIE 9.05
SemrushBot-SA/0.975
Gecko/20100101 Firefox/72.05
AppleWebKit/537.36 Chrome/80.0.3987.87 Safari/537.365
Seekport Crawler4
AppleWebKit/537.36 Chrome/34.0.1847.131 Safari/537.364
AppleWebKit/537.36 Chrome/68.0.3440.75 Safari/537.36 4
Gecko/20100101 Firefox/52.04
AppleWebKit/537.36 Chrome/58.0.3029.110 Safari/537.36 SE 2.X MetaSr 1.04
AppleWebKit/537.36 Chrome/72.0.3626.121 Safari/537.364
YisouSpider4
Gecko/20070725 Firefox/2.0.0.64
Gecko/20100101 Firefox/60.04
Twitterbot/1.04
AppleWebKit/537.36 Chrome/80.0.3987.106 Safari/537.364
linkdexbot/2.04
DomainStatsBot/1.0 4
MSIE 8.04
MegaIndex.ru/2.04
Pinterestbot/1.04
HTTrack 3.0x3
Gecko/20100101 Firefox/29.03
MSIE 10.03
AppleWebKit/600.1.25 Version/8.0 Safari/600.1.253
Gecko/20100101 Firefox/34.03
AppleWebKit/537.36 Mobile Safari/537.36 3
Googlebot 3
tracemyfile/1.03
Gecko/20100101 Firefox/44.03
AppleWebKit/537.36 Chrome/80.0.3987.100 Safari/537.363
TurnitinBot 3
zh-CN3
Clarabot/1.43
Web Explorer2
AppleWebKit/537.36 Chrome/34.0.1847.137 Safari/537.362
Gecko/20100101 Firefox/21.02
MojeekBot/0.72
Gecko/20100101 Firefox/50.02
Gigabot 2
SeznamBot/3.2-test12
AppleWebKit/537.36 Chrome/78.0.3904.108 Safari/537.362
AppleWebKit/537.36 Chrome/67.0.3396.87 Safari/537.362
Python-urllib/3.72
CheckMarkNetwork/1.0 2
niocBot2
AppleWebKit/537.36 Version/4.0 Chrome/53.0.2785.49 Mobile MQQBrowser/6.2 TBS/043602 Safari/537.36 MicroMessenger/6.5.16.1120 NetType/WIFI Language/zh_CN2
AppleWebKit/537.36 Chrome/74.0.3729.169 Safari/537.362
ips-agent2
AppleWebKit/537.75.14 Version/7.0.3 Safari/537.75.142
AppleWebKit/537.36 Chrome/49.0.2623.105 Safari/537.362
AppleWebKit/537.36 Chrome/68.0.3440.106 Safari/537.362
MSIE 6.02
AppleWebKit/537.36 Chrome/69.0.3497.100 Safari/537.362
Seeker v.1 2
Gecko/20100101 Firefox/61.02
Qwantify/Bleriot/1.12
Elisabot2
oBot/2.3.22
AppleWebKit/537.36 Chrome/40.0.1361.1277 Mobile Safari/537.361
Gecko/20100101 Firefox/38.01
AppleWebKit/601.4.4 Version/9.0.3 Safari/601.4.41
Go-http-client/1.11
AppleWebKit/537.36 Chrome/50.0.6996.1192 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/80.0.3987.66 Safari/537.361
AppleWebKit/537.36 Chrome/48.0.3656.1727 Mobile Safari/537.361
Gecko/20100101 Firefox/69.01
AppleWebKit/537.36 Chrome/46.0.2725.1822 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/61.0.3163.91 Safari/537.361
AppleWebKit/537.36 Chrome/44.0.2454.1093 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/56.0.4359.1587 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/39.0.8740.1430 Mobile Safari/537.361
aiHitBot/2.91
Gecko/20100101 Firefox/55.01
AppleWebKit/537.36 Chrome/54.0.9768.1090 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/51.0.8238.1308 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/57.0.6611.1068 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/52.0.4823.1974 Mobile Safari/537.361
facebookexternalhit/1.1 1
AppleWebKit/537.36 Chrome/39.0.5498.1345 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/57.0.9883.1118 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/46.0.2811.1657 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/53.0.5776.1298 Mobile Safari/537.361
Screaming Frog SEO Spider/9.21
AppleWebKit/537.36 Chrome/47.0.4183.1793 Mobile Safari/537.361
AppleWebKit/528.16 Version/4.0 Safari/528.161
AppleWebKit/537.36 Chrome/57.0.9007.1353 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/43.0.9554.1194 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/51.0.3808.1836 Mobile Safari/537.361
Gecko/20100101 Firefox/49.01
finbot1
AppleWebKit/533.18.1 Version/5.0.2 Safari/533.18.51
AppleWebKit/537.36 Chrome/41.0.2180.1878 Mobile Safari/537.361
Python-urllib/3.61
CowBot/1.01
SiteSucker/2.4.61
SeobilityBot 1
AppleWebKit/537.36 Chrome/48.0.2564.109 Safari/537.361
AppleWebKit/537.51.1 Version/7.0 Mobile/11A465 Safari/9537.531
Screaming Frog SEO Spider/12.41
Hatena::Fetcher/0.01 Furl/3.131
AppleWebKit/537.36 Chrome/41.0.6497.1705 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/49.0.5135.1344 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/51.0.4093.1761 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/57.0.2122.1180 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/41.0.2228.0 Safari/537.361
AppleWebKit/537.36 Chrome/39.0.5854.1662 Mobile Safari/537.361
DuckDuckBot-Https/1.11
AppleWebKit/537.36 Chrome/45.0.4368.1397 Mobile Safari/537.361
Gecko/20100101 Firefox/33.01
AppleWebKit/537.36 Chrome/44.0.5456.1987 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/58.0.2861.1296 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/59.0.7799.1806 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/39.0.7522.1601 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/54.0.3829.1446 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/50.0.9291.1890 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/57.0.6587.1011 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/50.0.5026.1757 Mobile Safari/537.361
SemanticJuice 1
AppleWebKit/537.36 Chrome/54.0.8775.1958 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/45.0.3198.1554 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/57.0.2926.1356 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/59.0.7090.1146 Mobile Safari/537.361
Screaming Frog SEO Spider/12.01
AppleWebKit/537.36 Chrome/59.0.5260.1591 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/54.0.9146.1401 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/55.0.2627.1313 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/47.0.7518.1592 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/78.0.3904.97 Safari/537.361
AppleWebKit/537.36 Chrome/55.0.8611.1556 Mobile Safari/537.361
AppleWebKit/603.9 Chrome/52.0.2609.113 Mobile Safari/600.21
Gecko/20130401 Firefox/64.81
AppleWebKit/537.36 Chrome/50.0.3462.1639 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/44.0.6276.1089 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/57.0.6083.1966 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/55.0.2801.1379 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/52.0.2683.1196 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/60.0.9175.1528 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/43.0.5997.1721 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/42.0.2571.1207 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/45.0.7213.1223 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/56.0.6881.1404 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/60.0.8177.1421 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/60.0.2638.1170 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/43.0.1659.1455 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/55.0.5366.1067 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/57.0.8505.1557 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/57.0.2464.1400 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/63.0.3239.108 Safari/537.361
Gecko/20100101 Firefox/57.01
Gecko/20100101 Firefox/45.01
Gecko/20100101 Firefox/58.01
AppleWebKit/537.36 Chrome/54.0.3876.1604 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/55.0.1654.1942 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/48.0.1006.1747 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/50.0.9285.1426 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/46.0.8293.1831 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/55.0.5783.1391 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/55.0.7907.1568 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/53.0.5965.1913 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/40.0.2214.85 Safari/537.361
Gecko/20100101 Firefox/44.0\tFirefox Generic1
AppleWebKit/537.36 Chrome/48.0.8208.1843 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/41.0.2997.1771 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/60.0.8315.1340 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/48.0.7244.1197 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/48.0.8109.1232 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/50.0.8750.1664 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/60.0.4780.1599 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/46.0.7245.1770 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/52.0.7906.1757 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/51.0.2467.1426 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/52.0.7604.1984 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/56.0.5028.1105 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/60.0.4958.1692 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/56.0.3978.1950 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/39.0.2575.1105 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/51.0.6786.1713 Mobile Safari/537.361
Mediatoolkitbot 1
AppleWebKit/537.36 Chrome/46.0.6110.1193 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/60.0.7931.1136 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/54.0.7305.1723 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/43.0.3025.1353 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/57.0.6791.1265 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/60.0.8173.1904 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/53.0.3309.1314 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/45.0.3445.1493 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/59.0.2857.1254 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/55.0.3028.1825 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/46.0.4283.1434 Mobile Safari/537.361
CipaCrawler/3.0 1
AppleWebKit/537.36 Chrome/50.0.2661.102 Safari/537.361
SerendeputyBot/0.8.6 1
Screaming Frog SEO Spider/12.61
AppleWebKit/537.36 Chrome/52.0.3048.1945 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/36.0.1985.125 Safari/537.361
AppleWebKit/537.36 Chrome/41.0.5883.1784 Mobile Safari/537.361
AppleWebKit/537.36 Chrome/40.0.2214.115 Safari/537.361
MagiBot/1.0.01