Crawlers

Crawlers in the week ending 2024-jul-20
CrawlerVisits
MJ12bot/v1.4.8205
AppleWebKit/537.36 192
Owler 158
AhrefsBot/7.0144
DotBot/1.2114
Googlebot/2.185
SemrushBot/7~bl84
Go-http-client/1.179
CriteoBot/0.1 62
coccocbot-image/1.052
YandexBot/3.044
coccocbot-web/1.044
PetalBot40
GrapeshotCrawler/2.038
AppleWebKit/537.36 Chrome/116.0.1938.76 Safari/537.3631
AppleWebKit/537.36 Mobile Safari/537.36 29
SemrushBot-BA28
Linux x86_6427
AppleWebKit/605.1.15 Version/17.4 Safari/605.1.15 26
AdsTxtCrawlerTP/1.224
AppleWebKit/537.36 Chrome/48.0.2564.116 Safari/537.3622
facebookexternalhit/1.1 20
AppleWebKit/600.2.5 Version/8.0.2 Safari/600.2.5 17
zoombot 16
AppleWebKit Chrome Safari16
Googlebot )15
AppleWebKit/537.36 Chrome/119.0.0.0 Safari/537.3613
SeznamBot/4.013
AppleWebKit/537.36 Chrome/80.0.3987.149 Safari/537.3612
Clickagy Intelligence Bot v28
DataForSeoBot/1.08
fluid/0.07
MediaMathbot/1.06
DnBCrawler-Analytics6
AmazonAdBot/1.06
BLEXBot/1.06
YisouSpider6
AppleWebKit/537.36 Chrome/103.0.5060.134 Safari/537.364
CCBot/2.0 4
AppleWebKit/537.36 Chrome/94.0.4590.2 Mobile Safari/537.36 Chrome-Lighthouse4
IonCrawl 4
AwarioBot/1.04
Python/3.12 aiohttp/3.9.34
AppleWebKit/537.36 Chrome/115.0.0.0 Safari/537.364
WellKnownBot/0.14
ImagesiftBot4
wpbot/1.14
Gecko/20100101 Firefox/71.03
Gecko/20100101 Firefox/116.03
yacybot 3
IAS Crawler 3
AppleWebKit/537.36 Chrome/126.0.0.0 Safari/537.363
AppleWebKit/537.36 Chrome/73.0.3111.61 Safari/537.36 Core/1.70.3722.400 QQBrowser/10.5.3739.4002
Sogou web spider/4.02
AppleWebKit/537.36 Chrome/49.0.3578.160 Safari/537.362
AppleWebKit/537.36 Chrome/120.0.0.0 Safari/537.362
keys-so-bot2
DomainStatsBot/1.0 2
AppleWebKit/537.36 Chrome/65.0.3395.136 Safari/537.36 LBBROWSER2
MSIE 7.02
AppleWebKit/537.36 Chrome/92.0.4380.153 Safari/537.36 OPR/63.0.3368.432
AppleWebKit/537.36 Chrome/90.0.4433.68 Safari/537.36 Edge/18.183622
AppleWebKit/537.36 Chrome/53.0.4405.47 Safari/537.36 LBBROWSER2
AppleWebKit/537.36 Chrome/55.0.3061.125 Safari/537.36 Core/1.70.3722.400 QQBrowser/10.5.3739.4002
AppleWebKit/537.36 Chrome/79.0.3945.88 Safari/537.362
AppleWebKit/537.36 Chrome/67.0.2642.126 Safari/537.36 LBBROWSER2
Gecko/20100101 Firefox/39.02
Gecko/20100101 Firefox/1232
AppleWebKit/537.36 Chrome/68.0.3384.40 Safari/537.362
AppleWebKit/537.36 Chrome/84.0.2613.34 Safari/537.36 Core/1.70.3722.400 QQBrowser/10.5.3739.4002
VelenPublicWebCrawler/1.02
AppleWebKit/537.36 Chrome/108.0.0.0 Safari/537.36 Edg/108.0.1462.422
AppleWebKit/537.36 Chrome/126.0.0.0 Safari/537.36 PTST/240709.1525062
AppleWebKit/537.36 Chrome/66.0.3875.29 Safari/537.36 LBBROWSER2
AppleWebKit/537.36 HeadlessChrome/126.0.0.0 Safari/537.362
AppleWebKit/537.36 Chrome/76.0.2677.77 UBrowser/6.2.3964.2 Safari/537.362
AppleWebKit/537.36 Chrome/76.0.3577.30 Safari/537.36 SE 2.X MetaSr 1.02
AppleWebKit/537.36 Chrome/61.0.4217.104 Safari/537.36 SE 2.X MetaSr 1.02
AppleWebKit/605.1.15 Version/15.6.6 Safari/605.1.12
Pandalytics/2.0 2
AppleWebKit/537.36 Chrome/47.0.4416.67 Safari/537.36 OPR/63.0.3368.432
AppleWebKit/537.36 Chrome/69.0.3497.100 Safari/537.362
AppleWebKit/537.36 Chrome/52.0.3021.40 Safari/537.36 QIHU 360SE2
AppleWebKit/537.36 Chrome/53.0.4375.138 Safari/537.36 Edge/18.183622
AppleWebKit/537.36 Chrome/105.0.5195.52 Safari/537.362
AppleWebKit/537.36 Chrome/76.0.2632.92 Safari/537.362
AppleWebKit/537.36 Chrome/91.0.4122.142 Safari/537.36 Edge/18.183622
AppleWebKit/537.36 Chrome/109.0.0.0 Safari/537.31
- nbertaupete95gmail.com1
Barkrowler/0.91
SirdataBot 1
AppleWebKit/537.36 Chrome/83.0.3235.149 Safari/537.36 QIHU 360EE1
Claude-Web/1.0 1
AppleWebKit/537.36 Chrome/55.0.4128.45 Safari/537.36 LBBROWSER1
python-asks/3.0.01
AppleWebKit/534.57.2 Version/5.1.7 Safari/534.57.21
AppleWebKit/537.36 Chrome/76.0.3211.96 Safari/537.36 QIHU 360SE1
AppleWebKit/537.36 Chrome/51.0.4472.86 Safari/537.36 QIHU 360EE1
AppleWebKit/537.36 Chrome/75.0.2836.43 Safari/537.361
ev-crawler/1.01
AppleWebKit/537.36 Chrome/82.0.4099.83 Safari/537.36 Edge/18.183621
AppleWebKit/537.36 Chrome/57.0.4084.69 Safari/537.36 LBBROWSER1
AppleWebKit/537.36 Chrome/123.0.0.0 Safari/537.361
Mozilla/5.01
AppleWebKit/537.36 Chrome/91.0.4018.106 Safari/537.36 QIHU 360SE1
Dataprovider.com1
AppleWebKit/537.36 Chrome/116.0.0.0 Safari/537.361
Web Explorer1
MojeekBot/0.111
AppleWebKit/537.36 Chrome/83.0.4103.97 Safari/537.361
AppleWebKit/605.1.15 Version/16.6 Safari/605.1.11
AppleWebKit/537.36 Chrome/102.0.0.0 Safari/537.361
AppleWebKit/537.36 Chrome/65.0.2841.65 Safari/537.36 QIHU 360SE1
AppleWebKit/537.36 Chrome/120.0.0.0 Safari/537.36 Edg/120.0.0.1
AppleWebKit/537.36 Chrome/74.0.3851.130 Safari/537.36 SE 2.X MetaSr 1.01
AppleWebKit/537.36 Chrome/84.0.4498.66 Safari/537.36 QIHU 360EE1
AppleWebKit/537.36 Chrome/103.0.5060.53 Safari/537.361
AppleWebKit/537.36 Chrome/78.0.3954.75 Safari/537.361
AppleWebKit/537.36 Chrome/83.0.3968.140 Safari/537.36 Edge/18.183621
meta-externalagent/1.1 1
AppleWebKit/537.36 Chrome/55.0.2883.87 Safari/537.361
Twitterbot/1.01
AppleWebKit/537.36 Chrome/112.0.0.0 Safari/537.36 Edg/112.0.1722.341
AppleWebKit/537.36 Chrome/75.0.2675.49 UBrowser/6.2.3964.2 Safari/537.361