|
Робот |
Хиты |
| 1 |
Yandex Robot |
645 173 |
| 2 |
Googlebot |
44 926 |
| 3 |
AhrefsBot |
30 787 |
| 4 |
Bing Robot |
18 394 |
| 5 |
MJ12bot |
13 599 |
| 6 |
Mozilla/5.0 (compatible; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots) |
13 179 |
| 7 |
Ezooms Robot |
11 196 |
| 8 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots) |
4 337 |
| 9 |
WebMeUp Crawler |
2 702 |
| 10 |
Google Preview Robot |
720 |
| 11 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Img/2.0; +http://go.mail.ru/help/robots) |
607 |
| 12 |
WebLog Expert |
459 |
| 13 |
Mozilla/5.0 (compatible; Nigma.ru/3.0; crawler@nigma.ru) |
339 |
| 14 |
Bing Preview Robot |
291 |
| 15 |
Powermarks |
251 |
| 16 |
ip-web-crawler.com |
111 |
| 17 |
FaceBook Crawler |
83 |
| 18 |
meanpathbot |
66 |
| 19 |
SurveyBot |
60 |
| 20 |
Netcraft Spider |
54 |
| 21 |
SemrushBot |
44 |
| 22 |
Mozilla/5.0 (compatible; oBot/2.3.1; +http://filterdb.iss.net/crawler/) |
43 |
| 23 |
Alexa Robot |
30 |
| 24 |
Twitterbot |
24 |
| 25 |
Mozilla/5.0 (compatible; CompSpyBot/1.0; +http://www.compspy.com/spider.html) |
23 |
| 26 |
Trendiction-Bot |
22 |
| 27 |
ScreenerBot Crawler Beta 2.0 (+http://www.ScreenerBot.com) |
22 |
| 28 |
COMODOSpider/Nutch-1.2 |
21 |
| 29 |
Baidu Spider |
16 |
| 30 |
Perl LWP |
14 |
| 31 |
spyder/Nutch-2.1 (just another internet crawler; http://www.paloaltonetworks.com/products/features/url-filtering. html; ghalevy@paloaltonetworks.com) |
14 |
| 32 |
PagesInventory (robot http://www.pagesinvenotry.com) |
12 |
| 33 |
MSIE Crawler |
12 |
| 34 |
Mozilla/5.0 (compatible; BIXOCRAWLER; +http://wiki.github.com/bixo/bixo/bixocrawler; bixo-dev@yahoogroups.com) |
12 |
| 35 |
PagesInventory (robot +http://www.pagesinventory.com) |
12 |
| 36 |
Mozilla/5.0 (compatible; Mozilla/5.0 (Windows NT 5.0; rv:21.0) Gecko/20100101 Firefox/21.0; +http://wiki.github.com/bixo/bixo/bixocrawler; bixo-dev@yahoogroups.com) |
4 |
| 37 |
Mozilla/5.0 (compatible; GrapeshotCrawler/2.0; +http://www.grapeshot.co.uk/crawler.php) |
2 |
| 38 |
Mozilla/5.0 (compatible; Mozilla/5.0; +http://wiki.github.com/bixo/bixo/bixocrawler; bixo-dev@yahoogroups.com) |
2 |
| 39 |
AdnormCrawler www.adnorm.com/crawler |
2 |
| 40 |
Checkbot |
2 |
| 41 |
Archive.org Robot |
2 |
| 42 |
Nutch/Nutch-2.0 (Nutch Crawler) |
2 |
| 43 |
Rogerbot |
2 |
| 44 |
Mozilla/5.0 (compatible; Mozilla; +http://wiki.github.com/bixo/bixo/bixocrawler; bixo-dev@yahoogroups.com) |
2 |
| 45 |
Mozilla/5.0 (compatible; NetSeer crawler/2.0; +http://www.netseer.com/crawler.html; crawler@netseer.com) |
2 |
| 46 |
crawler4j (http://code.google.com/p/crawler4j/) |
1 |
| 47 |
visaduhoc.info Crawler |
1 |
| 48 |
WebTarantula.com Crawler |
1 |
| 49 |
Sproose Crawler |
1 |
| 50 |
Yahoo! Slurp |
1 |
|
Итого |
787 682 |
|
Всего |
787 684 |
