Crawlers

Crawlers in the week ending 2021-jan-15
CrawlerVisits
MJ12bot/v1.4.8200
SemrushBot/7~bl134
DotBot/1.1130
bingbot/2.083
PetalBot63
SeznamBot/3.246
proximic45
Googlebot/2.144
AhrefsBot/6.140
BLEXBot/1.038
The Knowledge AI24
GrapeshotCrawler/2.019
AppleWebKit/605.1.15 Version/13.1.1 Safari/605.1.15 14
SemrushBot-BM/1.011
ltx71 - 10
Barkrowler/0.910
Clickagy Intelligence Bot v29
YandexBot/3.08
Adsbot/3.18
CCBot/2.0 7
YisouSpider6
Linux x86_644
AppleWebKit/537.36 Chrome/55.0.2883.95 Safari/537.364
MaxPointCrawler/Nutch-1.14 3
SemrushBot-BA3
AppleWebKit/537.36 Chrome/87.0.4280.88 Safari/537.363
TTD-Content3
AppleWebKit/537.36 Chrome/87.0.4280.141 Safari/537.362
MixnodeCache/1.82
linkdexbot/2.02
Apache-HttpClient/4.5.12 2
WhizeBot 2
Qwantify/2.4w2
oBot/2.3.12
Scrapy/2.3.0 2
AppleWebKit/537.36 Chrome/48.0.2564.116 Safari/537.362
Gecko/20100101 Firefox/78.01
DuckDuckBot-Https/1.11
AppleWebKit/537.36 Chrome/87.0.4280.66 Safari/537.361
Seekport Crawler1
Web Explorer1
AppleWebKit/537.36 Chrome/74.0.3694.0 Safari/537.36 Chrome-Lighthouse1
zoombot 1
AppleWebKit/537.36 Chrome/50.0.2661.102 Safari/537.361
AppleWebKit/537.36 Chrome/51.0.2704.79 Safari/537.36 Edge/14.143931
DomainStatsBot/1.0 1
Dataprovider.com1
SafeDNSBot 1
AppleWebKit/537.36 Chrome/41.0.2227.1 Safari/537.361
AppleWebKit/537.36 Chrome/85.0.4183.83 Safari/537.361
evc-batch/2.01
SurdotlyBot/1.01
Gecko/20100101 Firefox/52.01
AppleWebKit/600.1.25 Version/8.0 Safari/600.1.251
python-requests/2.25.01
Gecko/20100101 Firefox/84.01
Gecko/20100101 Firefox/72.01
Go-http-client/1.11
yacybot 1