Crawlers

Crawlers in the week ending 2020-may-29
CrawlerVisits
SemrushBot/6~bl434
AppleWebKit/537.36 Mobile Safari/537.36 264
MJ12bot/v1.4.8245
Googlebot/2.1193
bingbot/2.0162
YandexBot/3.0147
AhrefsBot/6.1144
coccocbot-image/1.0105
ZoominfoBot 97
SeznamBot/3.276
proximic63
The Knowledge AI62
coccocbot-web/1.061
Scrapy/1.5.1 58
GrapeshotCrawler/2.044
Linux x86_6442
AppleWebKit/600.2.5 Version/8.0.2 Safari/600.2.5 39
SemrushBot/1.0~bm36
MauiBot 32
Barkrowler/0.9 32
DotBot/1.127
Sogou web spider/4.024
Gecko/20100101 Firefox/48.023
Scrapy/1.5.2 19
CCBot/2.0 18
bidswitchbot/1.018
AppleWebKit/537.36 Chrome/81.0.4044.138 Safari/537.3617
SemrushBot-BA14
AppleWebKit/537.36 Chrome/72.0.3626.121 Safari/537.3612
YisouSpider11
oBot/2.3.110
Go-http-client/1.19
iSec_Bot/2.08
MBCrawler/1.0 8
TTD-Content8
AppleWebKit/537.36 Chrome/46.0.2490.80 Safari/537.367
Cliqzbot/3.07
Yeti/1.16
SEOkicks6
DomCopBot 6
AppleWebKit/537.36 Chrome/48.0.2564.116 Safari/537.366
AppleWebKit/537.36 Chrome/83.0.4103.61 Safari/537.365
360Spider5
HTTrack 3.0x4
MixnodeCache/1.84
TurnitinBot 4
Pinterestbot/1.04
Gecko/20100101 Firefox/68.04
Twitterbot/1.04
ltx71 - 4
ia_archiver4
Gecko/20100101 Firefox/76.04
DuckDuckBot-Https/1.13
BorneoBot/0.9.1 3
YaK/1.03
AppleWebKit/537.36 Chrome/78.0.3904.97 Safari/537.363
evc-batch/2.02
Googlebot 2
netEstate NE Crawler 2
Gecko/20070725 Firefox/2.0.0.62
python-requests/2.22.02
yacybot 2
GarlikCrawler/1.2 2
MaxPointCrawler/Nutch-1.14 2
DomainStatsBot/1.0 2
Apache-HttpClient/4.5.8 2
DF Bot 1.02
linkdexbot/2.02
AppleWebKit/537.36 Chrome/78.0.3904.70 Safari/537.362
BLEXBot/1.02
Gecko/20100101 Firefox/28.02
Gecko/20100101 Firefox/59.02
ips-agent2
Gecko/20100101 Firefox/75.02
AppleWebKit/537.36 Chrome/79.0.3945.88 Safari/537.362
Mozilla/5.02
Gecko/20100101 Firefox/62.01
AppleWebKit/537.36 Chrome/72.0.3626.109 Safari/537.361
Seekport Crawler1
AppleWebKit/537.36 Chrome/81.0.4044.129 Safari/537.361
AppleWebKit/537.36 Chrome/60.0.3112.113 Safari/537.361
AppleWebKit/605.1.15 Version/13.0.5 Safari/605.1.151
Scrapy/1.5.0 1
SemrushBot-SA/0.971
AppleWebKit/537.36 Chrome/50.0.2661.102 Safari/537.361
AppleWebKit/537.36 Chrome/34.0.1847.137 Safari/537.361
Yahoo! Slurp1
Gecko/20100101 Firefox/73.01
Gecko/20100101 Firefox/21.01
AppleWebKit/533.18.1 Version/5.0.2 Safari/533.18.51
MojeekBot/0.71
CheckMarkNetwork/1.0 1
Gecko/20100101 Firefox/29.01
AppleWebKit/537.36 Chrome/48.0.2564.116 UBrowser/5.6.14087.902 Safari/537.361
AppleWebKit/537.36 Chrome/79.0.3883.1211
AppleWebKit/537.36 Chrome/68.0.3440.75 Safari/537.36 1
MSIE 5.011
AppleWebKit/537.36 Chrome/69.0.3497.100 Safari/537.361
aiHitBot/2.91
MSIE 8.01
Gecko/20100101 Firefox/47.01
AppleWebKit/537.36 Chrome/40.0.2214.115 Safari/537.361
AppleWebKit/537.36 Chrome/80.0.3987.122 Safari/537.361
archive.org_bot 1
special_archiver/3.1.1 1
Gecko/20100101 Firefox/41.01
Cincraw/1.01
BorneoBot/0.7.1 1
Scrapy/1.8.0 1
Linguee Bot 1
Clickagy Intelligence Bot v21
Hatena::Fetcher/0.01 Furl/3.131