Crawlers

Crawlers in the week ending 2021-sep-24
CrawlerVisits
SemrushBot/7~bl124
bingbot/2.0122
MJ12bot/v1.4.8107
PetalBot104
AhrefsBot/7.097
Linux x86_6475
Googlebot/2.160
BLEXBot/1.050
CriteoBot/0.1 43
YandexBot/3.041
GrapeshotCrawler/2.034
proximic32
AppleWebKit/605.1.15 Version/13.1.1 Safari/605.1.15 31
AppleWebKit/537.36 Chrome/92.0.4515.159 Safari/537.3627
SemrushBot-BM/1.024
clark-crawler2/Nutch-1.19-SNAPSHOT24
CCBot/2.0 21
SemrushBot-BA20
The Knowledge AI18
SeznamBot/3.218
Neevabot/1.016
Qwantify/2.4w12
AppleWebKit/537.36 Chrome/48.0.2564.116 Safari/537.3610
Barkrowler/0.910
Clickagy Intelligence Bot v29
Apache-HttpClient/4.5.12 8
YisouSpider6
DataForSeoBot/1.06
SEOkicks6
MaxPointCrawler/Nutch-1.17 5
panscient.com5
AppleWebKit/537.36 Chrome/91.0.4472.114 Safari/537.364
DotBot/1.24
linkdexbot/2.04
AmazonAdBot/1.04
ltx71 - 3
AppleWebKit/537.36 Chrome/93.0.4577.82 Safari/537.363
Sogou web spider/4.03
fluid/0.03
Gecko/20100101 Firefox/82.02
AppleWebKit/600.1.25 Version/8.0 Safari/600.1.252
tes-cocrawler/0.1.16.dev2+g1e593fc.d20210918 2
InfoTigerBot/1.92
AppleWebKit/537.36 Chrome/88.0.4324.146 Safari/537.362
Pandalytics/1.0 2
Gecko/20100101 Firefox/92.02
WebDataStats/1.02
AppleWebKit/537.36 Chrome/41.0.2226.0 Safari/537.362
AppleWebKit/537.36 Chrome/91.0.4472.77 Safari/537.361
Gecko/20100101 Firefox/59.01
search.marginalia.nu1
Python-urllib/3.71
evc-batch/2.01
Grover/Grover-1.18 1
AppleWebKit/537.36 Mobile Safari/537.36 1
AppleWebKit/537.36 Chrome/93.0.4577.63 Safari/537.361
Gecko/20100101 Firefox/68.01
MojeekBot/0.101
AppleWebKit/537.36 Chrome/80.0.3987.132 Safari/537.361