| Crawler | | Visits |
|---|
| BLEXBot/1.0 | | 265 |
| DotBot/1.1 | | 130 |
| YandexBot/3.0 | | 114 |
| bingbot/2.0 | | 113 |
| MJ12bot/v1.4.8 | | 105 |
| Yahoo! Slurp | | 73 |
| MJ12bot/v1.4.7 | | 72 |
| Googlebot/2.1 | | 61 |
| istellabot/t.1.13 | | 60 |
| Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07) | | 59 |
| Windows NT 10.0; WOW64 | | 56 |
| proximic | | 54 |
| Cliqzbot/2.0 | | 54 |
| ia_archiver | | 51 |
| Linux x86_64 | | 46 |
| SeznamBot/3.2 | | 46 |
| AhrefsBot/5.2 | | 43 |
| Qwantify/2.4w | | 41 |
| SemrushBot/1.2~bl | | 36 |
| coccocbot-web/1.0 | | 35 |
| GrapeshotCrawler/2.0 | | 33 |
| - | | 30 |
| archive.org_bot | | 22 |
| Windows NT 5.1; rv:6.0.2 | | 21 |
| Barkrowler experimental crawler - 0.4.7 | | 16 |
| BUbiNG (+http://law.di.unimi.it/BUbiNG.html) | | 12 |
| Windows NT 6.1; WOW64 | | 11 |
| Clickagy Intelligence Bot v2 | | 11 |
| +PiplBot | | 10 |
| Win64 | | 9 |
| Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2883.95 Safari/537.36/Nutch-1.13 | | 9 |
| U | | 8 |
| Barkrowler/0.5.1 (experimenting / debugging - sorry for your logs ) http://www.exensa.com/crawl - admin@exensa.com -- based on BuBiNG | | 8 |
| CCBot/2.0 (http://commoncrawl.org/faq/) | | 8 |
| MaxPointCrawler/Nutch-1.10 (maxpoint.crawler at maxpointinteractive dot com) | | 8 |
| SiteExplorer/1.1b | | 8 |
| WOW64 | | 7 |
| compatible; ExtLinksBot/1.5 +https://extlinks.com/Bot.html | | 6 |
| ltx71 - (http://ltx71.com/) | | 6 |
| Yeti/1.1 | | 6 |
| Steeler/3.5 | | 6 |
| linkdexbot/2.0 | | 5 |
| X11; Linux x86_64 | | 5 |
| Barkrowler/0.5.1 (experimenting / debugging - sorry for your logs ) www.exensa.com/crawl - admin@exensa.com -- based on BUBing | | 4 |
| compatible; archive.org_bot +http://www.archive.org/details/archive.org_bot | | 4 |
| SEOkicks-Robot | | 4 |
| IAS crawler (ias_crawler; http://integralads.com/site-indexing-policy/) | | 3 |
| Intel Mac OS X 10.9 | | 3 |
| Dataprovider.com | | 3 |
| GetIntent Crawler (http://getintent.com/bot.html) | | 3 |
| MSIE 9.0 | | 3 |
| spbot/5.0.3 | | 3 |
| Nutch Master Test/Nutch-1.13-SNAPSHOT | | 3 |
| Python-urllib/1.17 | | 2 |
| yoozBot-2.2 | | 2 |
| Exabot/3.0 | | 2 |
| SafeDNSBot (https://www.safedns.com/searchbot) | | 2 |
| GarlikCrawler/1.2 (http://garlik.com/, crawler@garlik.com) | | 2 |
| oBot/2.3.1 | | 2 |
| ssearch_bot (sSearch Crawler; http://www.semantissimo.de) | | 1 |
| SurdotlyBot/1.0 | | 1 |
| Macintosh; Intel Mac OS X 10_9_3 | | 1 |
| Macintosh; Intel Mac OS X 10_11_6 | | 1 |
| MSIE 8.0 | | 1 |
| Konqueror/3.3 | | 1 |
| Contacts-Crawler/0.2 (+http://www.scrapinghub.com) | | 1 |
| Windows NT 6.1; rv:34.0 | | 1 |
| MSIE 7.0 | | 1 |
| Wotbox/2.01 (+http://www.wotbox.com/bot/) | | 1 |
| Nutch/Nutch-2.3.1 | | 1 |
| VenusCrawler/Nutch-1.12 (crawler@mycompany.com) | | 1 |
| MSIE 10.0 | | 1 |
| linkdexbot/2.2 | | 1 |
| compatible | | 1 |
| Windows NT 6.1; rv:38.0 | | 1 |
| Macintosh; Intel Mac OS X 10_11_4 | | 1 |
| Windows NT 6.1; rv:28.0 | | 1 |
| Macintosh; Intel Mac OS X 10_12_6 | | 1 |
| Barkrowler/0.4.8 (experimenting / debugging - sorry for your logs ) www.exensa.com/crawl - admin@exensa.com -- based on BUBing | | 1 |
| Ubuntu | | 1 |
| compatible; ips-agent | | 1 |
| Findxbot/1.0 | | 1 |
| Windows NT 6.3; WOW64 | | 1 |
| panscient.com | | 1 |
| G-i-g-a-b-o-t | | 1 |
| FemtosearchBot/1.0 | | 1 |
| CipaCrawler/3.0 (info@domaincrawler.com; http://www.domaincrawler.com/davekb.com) | | 1 |
