Crawlers

Crawlers in the week ending 2021-oct-15
CrawlerVisits
bingbot/2.0144
DotBot/1.2120
SemrushBot/7~bl119
PetalBot98
MJ12bot/v1.4.894
AhrefsBot/7.092
Linux x86_6483
Googlebot/2.164
CriteoBot/0.1 56
proximic38
GrapeshotCrawler/2.036
YandexBot/3.029
AppleWebKit/605.1.15 Version/13.1.1 Safari/605.1.15 28
SemrushBot-BA25
SemrushBot-BM/1.024
SeznamBot/3.218
Qwantify/2.4w14
The Knowledge AI14
Neevabot/1.012
AppleWebKit/537.36 Chrome/92.0.4515.159 Safari/537.3610
DataForSeoBot/1.010
Barkrowler/0.910
Apache-HttpClient/4.5.12 8
SEOkicks6
AppleWebKit/537.36 Mobile Safari/537.36 6
YisouSpider6
Clickagy Intelligence Bot v26
CCBot/2.0 5
InfoTigerBot/1.95
linkdexbot/2.04
AppleWebKit/537.36 Chrome/48.0.2564.116 Safari/537.364
ltx71 - 4
BLEXBot/1.04
contxbot/1.04
AmazonAdBot/1.04
fluid/0.03
Go-http-client/1.12
ips-agent2
clark-crawler2/Nutch-1.19-SNAPSHOT2
Turnitin 2
AppleWebKit/537.36 Chrome/84.0.4147.89 Safari/537.36 2
AppleWebKit/537.36 Chrome/50.0.2661.102 Safari/537.362
AppleWebKit/537.36 Chrome/91.0.4472.114 Safari/537.362
AppleWebKit/537.36 Chrome/88.0.4324.146 Safari/537.362
AppleWebKit/537.36 Chrome/81.0.4044.138 Mobile Safari/537.362
webgains-bot 2
Gecko/20100101 Firefox/93.02
AppleWebKit/537.36 Chrome/63.0.3239.84 Safari/537.362
MSIE 9.02
Gecko/20100101 Firefox/50.02
AppleWebKit/537.36 Chrome/94.0.4606.61 Safari/537.362
special_archiver/3.1.1 2
AppleWebKit/537.36 Chrome/55.0.2883.87 Safari/537.361
MojeekBot/0.101
Gecko/20100101 Firefox/92.01
MaxPointCrawler/Nutch-1.17 1
AppleWebKit/537.36 Chrome/91.0.4472.77 Safari/537.361
Gecko/20100101 Firefox/91.01
AppleWebKit/537.36 Chrome/87.0.4280.66 Safari/537.361
Grover/Grover-1.18 1
Dataprovider.com1
- nbertaupete95gmail.com1
AppleWebKit/537.36 Chrome/56.0.2924.87 Safari/537.361
archive.org_bot 1
evc-batch/2.01
AppleWebKit/537.36 Chrome/94.0.4606.71 Safari/537.361
Twitterbot/1.01
Gecko/20100101 Firefox/59.01