Crawlers

Crawlers in the week ending 2020-oct-23
CrawlerVisits
SemrushBot/6~bl166
bingbot/2.0116
MJ12bot/v1.4.8113
DotBot/1.196
PetalBot75
SeznamBot/3.254
Googlebot/2.147
AhrefsBot/6.141
proximic23
GrapeshotCrawler/2.022
The Knowledge AI22
YandexBot/3.021
Adsbot/3.114
Linux x86_6414
AppleWebKit/605.1.15 Version/13.1.1 Safari/605.1.15 13
Gecko/20100101 Firefox/48.013
SemrushBot-BA12
SemrushBot-BM/1.012
CCBot/2.0 9
Barkrowler/0.99
python-requests/2.24.08
AppleWebKit/537.36 Chrome/84.0.4147.105 Safari/537.366
360Spider5
AppleWebKit/537.36 Chrome/86.0.4240.75 Safari/537.365
AppleWebKit/537.36 Mobile Safari/537.36 5
AppleWebKit/537.36 Chrome/55.0.2883.95 Safari/537.365
Sogou web spider/4.05
AppleWebKit/537.36 Chrome/49.0.2623.75 Safari/537.36 OPR/36.0.2130.325
ltx71 - 4
Gecko/20100101 Firefox/10.0.24
Clickagy Intelligence Bot v24
oBot/2.3.13
AppleWebKit/537.36 Chrome/46.0.2490.80 Safari/537.362
Gecko/20100101 Firefox/72.02
MaxPointCrawler/Nutch-1.14 2
MBCrawler/1.0 2
AppleWebKit/537.36 Chrome/48.0.2564.116 Safari/537.362
AppleWebKit/537.75.14 Version/7.0.3 Safari/537.75.142
MixnodeCache/1.82
ia_archiver2
BLEXBot/1.02
linkdexbot/2.02
Gecko/20100101 Firefox/77.01
AppleWebKit/537.36 Chrome/86.0.4240.80 Safari/537.361
Qwantify/2.4w1
AppleWebKit/537.36 Chrome/41.0.2228.0 Safari/537.361
AppleWebKit/601.1 CriOS/74.0.3729.157 Mobile/13B143 Safari/601.1.461
UCBrowser8.4.0.159/70/3521
Yahoo! Slurp1
Go-http-client/1.11
TTD-Content1
woorankreview/2.01
DuckDuckBot-Https/1.11
AppleWebKit/537.36 Chrome/79.0.3883.1211
evc-batch/2.01
MegaIndex.ru/2.01
AppleWebKit/537.36 Chrome/50.0.2661.102 Safari/537.361
python-requests/2.23.01
AppleWebKit/537.36 Chrome/40.0.2214.115 Safari/537.361
AppleWebKit/537.36 Chrome/84.0.4143.7 Mobile Safari/537.36 Chrome-Lighthouse1
Screaming Frog SEO Spider/13.21
AppleWebKit/537.36 Chrome/84.0.4147.89 Safari/537.36 1
YisouSpider1
Gecko/20100101 Firefox/81.01
Gecko/20100101 Firefox/29.01