| 131 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 149720+757 | 1.05 GB | 31 Dec 2006 - 23:49 |
| Yahoo Slurp | 130922+16017 | 643.85 MB | 31 Dec 2006 - 23:45 |
| MSNBot | 122522+9009 | 1.11 GB | 31 Dec 2006 - 23:54 |
| LinkChecker | 64676+15 | 1.20 GB | 15 Dec 2006 - 12:19 |
| Yahoo-MMCrawler | 40287+147 | 120.34 MB | 31 Dec 2006 - 23:43 |
| Ask | 35025+1052 | 322.81 MB | 31 Dec 2006 - 04:42 |
| psbot | 23899+990 | 154.57 MB | 31 Dec 2006 - 20:20 |
| MSNBot-media | 20410+470 | 487.51 MB | 29 Dec 2006 - 11:05 |
| Unknown robot (identified by 'spider') | 13169+15 | 56.55 MB | 28 Dec 2006 - 17:28 |
| HTTrack off-line browser | 12968+4 | 288.55 MB | 28 Oct 2006 - 10:45 |
| MSIECrawler | 12026+356 | 1.76 MB | 05 Dec 2006 - 11:10 |
| ConveraCrawler | 5388+28 | 24.92 MB | 29 Dec 2006 - 04:18 |
| noxtrumbot | 4677+16 | 34.61 MB | 08 Dec 2006 - 15:29 |
| ichiro | 4376+63 | 103.66 MB | 24 Dec 2006 - 23:50 |
| Unknown robot (identified by 'robot') | 4358+56 | 31.67 MB | 31 Dec 2006 - 15:32 |
| Turn It In | 4117+25 | 28.78 MB | 11 Dec 2006 - 01:19 |
| GigaBot | 2304+1767 | 16.29 MB | 28 Dec 2006 - 06:07 |
| InternetSeer | 3331 | 101.89 KB | 31 Dec 2006 - 22:24 |
| ConveraMultiMediaCrawler | 2820+80 | 122.35 MB | 25 Dec 2006 - 23:33 |
| SBIder | 1318+1030 | 13.25 MB | 31 Dec 2006 - 23:53 |
| BecomeBot | 1796+366 | 12.91 MB | 31 Dec 2006 - 16:43 |
| Alexa (IA Archiver) | 1863+199 | 41.09 MB | 31 Dec 2006 - 19:05 |
| OmniExplorer Bot | 1559+8 | 11.15 MB | 19 Mar 2006 - 21:39 |
| Voyager | 1339+115 | 9.21 MB | 19 Dec 2006 - 17:06 |
| LinkWalker | 1150+5 | 6.06 MB | 30 Dec 2006 - 06:28 |
| Custo | 1097 | 11.41 MB | 28 Dec 2006 - 16:28 |
| Unknown robot (identified by 'crawl') | 989+42 | 26.43 MB | 31 Dec 2006 - 22:21 |
| whatUseek Winona | 997+1 | 32.15 MB | 09 Aug 2006 - 20:01 |
| Unknown robot (identified by hit on 'robots.txt') | 0+894 | 12.82 KB | 31 Dec 2006 - 15:43 |
| WebCollage | 879 | 19.99 MB | 29 Dec 2006 - 09:22 |
| IRLbot | 853+11 | 6.77 MB | 19 Aug 2006 - 06:43 |
| Yahoo! Slurp China | 415+375 | 2.86 MB | 30 Dec 2006 - 11:44 |
| MJ12bot | 686+34 | 5.17 MB | 27 Nov 2006 - 13:59 |
| Unknown robot (identified by 'bot/' or 'bot-') | 394+230 | 4.56 MB | 29 Dec 2006 - 09:22 |
| ZyBorg | 559+31 | 5.29 MB | 31 Dec 2006 - 02:39 |
| Java (Often spam bot) | 515+4 | 13.91 MB | 16 Dec 2006 - 09:55 |
| Exabot | 418+90 | 2.69 MB | 31 Dec 2006 - 02:09 |
| TencentTraveler | 503 | 5.37 MB | 11 Dec 2006 - 19:21 |
| Findlinks | 362+123 | 2.95 MB | 31 Dec 2006 - 16:52 |
| Girafabot | 383+62 | 1.67 MB | 08 Dec 2006 - 02:12 |
| Walhello appie | 217+187 | 1.51 MB | 27 Dec 2006 - 04:16 |
| Shim-Crawler | 371+14 | 2.73 MB | 01 Nov 2006 - 10:36 |
| Cursor | 308 | 3.03 MB | 21 Dec 2006 - 21:10 |
| Accoona-AI-Agent | 294+1 | 2.10 MB | 25 Nov 2006 - 09:51 |
| Scooter | 1+276 | 6.87 KB | 30 Dec 2006 - 00:18 |
| NutchCVS | 144+102 | 994.23 KB | 29 Dec 2006 - 21:57 |
| Nutch | 158+79 | 1.36 MB | 29 Dec 2006 - 21:09 |
| Speedy Spider | 158+69 | 1005.24 KB | 11 Nov 2006 - 06:44 |
| nicebot | 178+4 | 2.72 MB | 29 Dec 2006 - 12:49 |
| NG 2.x (Exalead) | 132+27 | 1.42 MB | 30 Dec 2006 - 06:30 |
| BaiDuSpider | 129+22 | 439.49 KB | 30 Dec 2006 - 03:08 |
| Wells Search | 142 | 2.10 MB | 21 Dec 2006 - 09:59 |
| lwp-trivial | 3+138 | 22.02 KB | 15 Sep 2006 - 13:52 |
| Google AdSense | 138+1 | 1.11 MB | 19 Nov 2006 - 01:30 |
| larbin | 72+30 | 1.69 MB | 10 Nov 2006 - 13:04 |
| sogou spider | 69+32 | 560.16 KB | 31 Dec 2006 - 07:43 |
| Cerberian Drtrs | 100 | 1.04 MB | 23 Mar 2006 - 03:54 |
| aipbot | 83+9 | 868.53 KB | 31 Oct 2006 - 15:22 |
| IBM Almaden Research Center WebFountain™ | 62+29 | 421.94 KB | 02 Oct 2006 - 23:59 |
| StackRambler | 21+55 | 92.09 KB | 10 Dec 2006 - 18:09 |
| Voila | 31+31 | 164.52 KB | 28 Dec 2006 - 19:36 |
| Fast-Webcrawler | 61 | 1.00 MB | 13 Mar 2006 - 01:00 |
| SurveyBot | 9+52 | 30.49 KB | 31 Dec 2006 - 11:31 |
| Python-urllib | 60 | 2.76 MB | 31 Dec 2006 - 07:50 |
| NimbleCrawler | 41+16 | 431.52 KB | 08 Dec 2006 - 21:33 |
| UP.Browser | 56 | 893.30 KB | 17 Nov 2006 - 12:23 |
| snap.com beta crawler | 35+4 | 261.41 KB | 26 Jan 2006 - 01:57 |
| Missigua_Locator | 38 | 532.82 KB | 14 Oct 2006 - 14:53 |
| Lycos | 16+16 | 388.95 KB | 08 Feb 2006 - 14:40 |
| Microsoft URL Control | 31 | 442.60 KB | 04 Dec 2006 - 18:46 |
| CFNetwork | 31 | 1.44 MB | 25 Dec 2006 - 13:58 |
| WordPress | 28 | 1.75 MB | 03 Jul 2006 - 20:15 |
| The web archive (IA Archiver) | 5+22 | 661 Bytes | 10 Nov 2006 - 19:50 |
| PHP version tracker | 25 | 0 | 18 Dec 2006 - 21:16 |
| Sensis Web Crawler | 13+10 | 40.89 KB | 30 Dec 2006 - 15:19 |
| Geniebot | 11+10 | 130.32 KB | 02 Jul 2006 - 17:29 |
| FavOrg | 21 | 174.32 KB | 11 Dec 2006 - 18:23 |
| BBot | 18+2 | 250.75 KB | 23 Dec 2006 - 23:30 |
| ASpider (Associative Spider) | 13+6 | 92.61 KB | 14 Jul 2006 - 04:59 |
| Jakarta commons-httpclient | 18+1 | 119.64 KB | 20 Nov 2006 - 04:52 |
| Netcraft | 18 | 0 | 06 Dec 2006 - 23:15 |
| NASA Search | 15 | 348.87 KB | 29 Nov 2006 - 07:39 |
| NPBot | 12+1 | 78.71 KB | 16 Aug 2006 - 07:58 |
| Ingrid | 11+2 | 78.25 KB | 02 Sep 2006 - 01:34 |
| Yandex bot | 4+6 | 12.63 KB | 30 Nov 2006 - 10:26 |
| Zeus Webster Pro | 6+4 | 28.70 KB | 29 Nov 2006 - 05:01 |
| MSRBOT | 5+5 | 29.84 KB | 15 Oct 2006 - 14:57 |
| miniRank | 6+3 | 21.24 KB | 08 Dec 2006 - 11:42 |
| DataFountains/DMOZ Downloader | 5+4 | 35.23 KB | 25 Aug 2006 - 21:09 |
| sproose crawler | 4+4 | 18.58 KB | 13 May 2006 - 16:35 |
| Xenu Link Sleuth | 7 | 13.82 KB | 24 Oct 2006 - 08:47 |
| Web Downloader | 6 | 349.41 KB | 09 Sep 2006 - 11:17 |
| Krugle | 3+3 | 14.57 KB | 05 Dec 2006 - 06:27 |
| updated | 3+3 | 16.42 KB | 20 Jun 2006 - 17:38 |
| mnoGoSearch search engine software | 6 | 38.31 KB | 26 Oct 2006 - 00:10 |
| BitTorrent Bot | 3+2 | 20.73 KB | 06 May 2006 - 05:26 |
| NetSprint | 5 | 37.20 KB | 26 Sep 2006 - 10:03 |
| Cfetch | 4 | 0 | 24 Sep 2006 - 21:59 |
| Pompos | 2+2 | 8.98 KB | 06 Aug 2006 - 09:00 |
| Holmes | 1+3 | 3.34 KB | 30 Nov 2006 - 18:22 |
| Seekbot | 2+2 | 13.54 KB | 24 Oct 2006 - 15:42 |
| GoForIt.com | 2+2 | 9.29 KB | 14 Jun 2006 - 19:33 |
| HooWWWer | 2+2 | 9.29 KB | 03 Oct 2006 - 15:27 |
| FAST Enterprise Crawler | 3+1 | 62.39 KB | 04 Feb 2006 - 08:24 |
| Digger | 3 | 11.67 KB | 20 Aug 2006 - 23:37 |
| Robozilla | 3 | 15.97 KB | 14 Aug 2006 - 16:32 |
| PyQuery | 3 | 45.61 KB | 09 Dec 2006 - 13:24 |
| YahooSeeker Yahoo! Blog crawler | 3 | 20.97 KB | 12 May 2006 - 08:05 |
| Gaisbot | 2+1 | 14.10 KB | 26 Jul 2006 - 08:05 |
| virus_detector | 1+1 | 6.91 KB | 17 Jan 2006 - 15:01 |
| plinki | 1+1 | 4.65 KB | 11 Jan 2006 - 04:02 |
| Vagabondo | 1+1 | 17.80 KB | 19 Mar 2006 - 02:33 |
| boitho.com-dc | 1+1 | 7.02 KB | 11 May 2006 - 13:49 |
| SynooBot | 1+1 | 4.65 KB | 30 Mar 2006 - 09:25 |
| ExactSeek Crawler | 1+1 | 7.65 KB | 30 Jun 2006 - 11:33 |
| KnowItAll | 1+1 | 8.78 KB | 06 Jul 2006 - 02:55 |
| RufusBot Rufus Web Miner | 1+1 | 14.24 KB | 30 Jan 2006 - 10:24 |
| Heritrix | 1+1 | 17.81 KB | 22 Sep 2006 - 00:49 |
| Yahoo! Mindset | 2 | 34.60 KB | 06 May 2006 - 23:27 |
| lmspider | 1+1 | 6.91 KB | 10 Jan 2006 - 14:04 |
| DoCoMo | 1 | 21.55 KB | 16 Nov 2006 - 10:17 |
| SpiderMan | 1 | 6.90 KB | 26 Apr 2006 - 01:24 |
| STEROID Download | 1 | 7.01 KB | 10 May 2006 - 23:06 |
| lwp-request | 1 | 6.70 KB | 30 Aug 2006 - 03:47 |
| HTMLParser | 1 | 10.65 KB | 18 Sep 2006 - 13:26 |
| BSpider | 1 | 3.40 KB | 25 Dec 2006 - 13:57 |
| Feedfetcher-Google | 1 | 6.74 KB | 04 Sep 2006 - 13:19 |
| WebReaper | 0+1 | 14 Bytes | 25 Jan 2006 - 11:44 |
| WebFilter | 0+1 | 15 Bytes | 09 Aug 2006 - 16:10 |
| arks | 0+1 | 14 Bytes | 06 Jun 2006 - 20:59 |
| VORTEX | 1 | 4.63 KB | 03 Jan 2006 - 17:42 |