Crawlers

Crawlers in the week ending 2020-sep-25
CrawlerVisits
bingbot/2.0136
SemrushBot/6~bl135
MJ12bot/v1.4.891
PetalBot78
Googlebot/2.146
AhrefsBot/6.143
BLEXBot/1.039
SeznamBot/3.234
YandexBot/3.032
GrapeshotCrawler/2.016
proximic16
CCBot/2.0 15
Scrapy/1.5.1 14
Barkrowler/0.913
AppleWebKit/537.36 Chrome/84.0.4147.105 Safari/537.3610
SemrushBot/1.0~bm9
The Knowledge AI9
Scrapy/1.5.2 7
AppleWebKit/605.1.15 Version/13.1.1 Safari/605.1.15 7
Adsbot/3.17
Sogou web spider/4.05
SemrushBot-BA5
Clickagy Intelligence Bot v25
Gowikibot/1.04
AppleWebKit/537.36 Chrome/55.0.2883.95 Safari/537.364
ltx71 - 4
ia_archiver4
360Spider4
SemrushBot-BM/1.03
Linux x86_643
MixnodeCache/1.83
linkdexbot/2.02
oBot/2.3.12
panscient.com2
Go-http-client/1.12
DotBot/1.12
PageThing.com2
AppleWebKit/537.36 Chrome/48.0.2564.116 Safari/537.362
Gecko/20100101 Firefox/48.02
python-requests/2.24.01
AppleWebKit/537.36 Chrome/40.0.2214.115 Safari/537.361
DuckDuckBot-Https/1.11
TTD-Content1
AppleWebKit/537.36 Chrome/79.0.3883.1211
Python-urllib/3.71
YisouSpider1
Gecko/20100101 Firefox/72.01
Quetextbot/2.1 1
- nbertaupete95gmail.com1
AppleWebKit/537.36 Chrome/63.0.3239.84 Safari/537.361
AppleWebKit/537.36 Chrome/80.0.3987.122 Safari/537.361
Yeti/1.11
AppleWebKit/605.1.15 Version/13.0.5 Safari/605.1.151
AppleWebKit/537.36 Chrome/41.0.2225.0 Safari/537.361
Screaming Frog SEO Spider/11.31
AppleWebKit/537.36 Chrome/35.0.1916.114 Safari/537.361
AppleWebKit/537.36 Mobile Safari/537.36 1
Gecko/20100101 Firefox/59.01