|
Робот |
Хиты |
| 1 |
Bing Robot |
151 395 |
| 2 |
Yandex Robot |
121 321 |
| 3 |
DotBot |
71 796 |
| 4 |
Googlebot |
67 268 |
| 5 |
SemrushBot |
63 585 |
| 6 |
AhrefsBot |
55 053 |
| 7 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots) |
30 014 |
| 8 |
MJ12bot |
20 884 |
| 9 |
Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +http://megaindex.com/crawler) |
11 587 |
| 10 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Img/2.0; +http://go.mail.ru/help/robots) |
8 806 |
| 11 |
Mozilla/5.0 (compatible; Barkrowler/0.9; +https://babbar.tech/crawler) |
2 203 |
| 12 |
pimeyes.com crawler |
1 596 |
| 13 |
Mozilla/5.0 (compatible; SEOkicks; +https://www.seokicks.de/robot.html) |
1 402 |
| 14 |
MauiBot (crawler.feedback+wc@gmail.com) |
1 349 |
| 15 |
WebMeUp Crawler |
1 322 |
| 16 |
Bing Preview Robot |
1 123 |
| 17 |
netEstate NE Crawler (+http://www.website-datenbank.de/) |
1 020 |
| 18 |
Mozilla/5.0 (compatible; LinkpadBot/2.3; +http://linkpad.org/robot/) |
784 |
| 19 |
FaceBook Crawler |
305 |
| 20 |
Perl LWP |
181 |
| 21 |
Powermarks |
127 |
| 22 |
MSIE Crawler |
96 |
| 23 |
LightspeedSystemsCrawler Mozilla/5.0 (Windows; U; MSIE 9.0; Windows NT 9.0; en-US) |
89 |
| 24 |
Alexa Robot |
46 |
| 25 |
Baidu Spider |
42 |
| 26 |
Twitterbot |
40 |
| 27 |
Netcraft Spider |
38 |
| 28 |
Xenu's Link Sleuth |
37 |
| 29 |
Archive.org Robot |
21 |
| 30 |
Mozilla/5.0 (Windows NT 6.1; Win64; x64; +http://www.komodia.com/newwiki/index.php/URL_server_crawler) KomodiaBot/1.0 |
19 |
| 31 |
Spider2.0 |
17 |
| 32 |
Mozilla/5.0 (compatible; Seekport Crawler; http://seekport.com/ |
16 |
| 33 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Favicons/2.0; +https://help.mail.ru/webmaster/indexing/robots) |
14 |
| 34 |
SeznamBot |
12 |
| 35 |
CheckMarkNetwork/1.0 (+http://www.checkmarknetwork.com/spider.html) |
9 |
| 36 |
Mozilla/5.0 (compatible; VelenPublicWebCrawler/1.0; +https://velen.io) |
9 |
| 37 |
Dy robot 1.0 |
4 |
| 38 |
Screaming Frog SEO Spider/11.0 |
4 |
| 39 |
Mozilla/5.0 (compatible; proximic; +http://www.proximic.com/info/spider.php) |
4 |
| 40 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Fast/2.0; +https://help.mail.ru/webmaster/indexing/robots) |
3 |
| 41 |
Mozilla/5.0 (compatible; adscanner/)/1.0 (Mozilla/5.0 (compatible; seoscanners.net/1.0; +spider@seoscanners.net); http://seoscanners.net; spider@seoscanners.net) |
3 |
| 42 |
Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.121 Safari/537.36 (compatible; PagePeeker/3.0; +https://pagepeeker.com/robots/) |
3 |
| 43 |
Mozilla/5.0 (compatible; oBot/2.3.1; +http://www.xforce-security.com/crawler/) |
3 |
| 44 |
e.ventures Investment Crawler (eventures.vc) |
2 |
| 45 |
Anonymous Coward/1.0 (A StormCrawler-based crawler; http://someorganization.com/; someone@someorganization.com) |
2 |
| 46 |
Google AdSense Robot |
2 |
| 47 |
Mozilla/5.0 (compatible; TestBot/0.1; +In_the_test_phase,_if_the_spider_brings_you_trouble, _please_add_our_IP_to_the_blacklist._Thank_you.) |
2 |
| 48 |
Google Feedfetcher |
1 |
| 49 |
Mozilla/5.0 (compatible; adscanner/)/1.0 (http://seocompany.store; spider@seocompany.store) |
1 |
| 50 |
PageThing.com Crawler |
1 |
|
Итого |
613 661 |
|
Всего |
613 663 |
