|
Робот |
Хиты |
| 1 |
Yandex Robot |
75 106 |
| 2 |
Bing Robot |
68 309 |
| 3 |
Googlebot |
48 561 |
| 4 |
DotBot |
46 042 |
| 5 |
AhrefsBot |
43 018 |
| 6 |
SemrushBot |
39 142 |
| 7 |
MJ12bot |
16 315 |
| 8 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots) |
15 253 |
| 9 |
Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +http://megaindex.com/crawler) |
8 751 |
| 10 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Img/2.0; +http://go.mail.ru/help/robots) |
8 555 |
| 11 |
Alexa Robot |
6 760 |
| 12 |
Bing Preview Robot |
3 569 |
| 13 |
Baidu Spider |
554 |
| 14 |
Exabot |
143 |
| 15 |
FaceBook Crawler |
139 |
| 16 |
TinEye Crawler |
127 |
| 17 |
Mozilla/5.0 (compatible; SEOkicks; +https://www.seokicks.de/robot.html) |
115 |
| 18 |
LightspeedSystemsCrawler Mozilla/5.0 (Windows; U; MSIE 9.0; Windows NT 9.0; en-US) |
106 |
| 19 |
Perl LWP |
100 |
| 20 |
Xenu's Link Sleuth |
86 |
| 21 |
MSIE Crawler |
42 |
| 22 |
Mozilla/5.0 (Windows NT 6.1; Win64; x64; +http://www.komodia.com/newwiki/index.php/URL_server_crawler) KomodiaBot/1.0 |
39 |
| 23 |
CheckMarkNetwork/1.0 (+http://www.checkmarknetwork.com/spider.html) |
30 |
| 24 |
Netcraft Spider |
28 |
| 25 |
Powermarks |
25 |
| 26 |
Virusdie crawler/3.0 |
22 |
| 27 |
Twitterbot |
20 |
| 28 |
Archive.org Robot |
17 |
| 29 |
(info@domaincrawler.com; http://www.domaincrawler.com/xn--b1amfsx.xn--p1ai) |
16 |
| 30 |
SimplePie |
14 |
| 31 |
Mozilla/5.0 (compatible; VelenPublicWebCrawler/1.0; +https://velen.io) |
13 |
| 32 |
SeznamBot |
10 |
| 33 |
Spider2.0 |
8 |
| 34 |
Mozilla/5.0 (compatible; FastCrawler/4.9; +https://www.fastface.eu/bot.html) |
7 |
| 35 |
Mozilla/5.0 (compatible; oBot/2.3.1; +http://filterdb.iss.net/crawler/) |
6 |
| 36 |
Data Crawler |
6 |
| 37 |
HubSpot Links Crawler 2.0 http://www.hubspot.com/ |
5 |
| 38 |
Mozilla/5.0 (compatible; bnf.fr_bot; +https://www.bnf.fr/fr/capture-de-votre-site-web-par-le-robot-de-la-bnf) |
5 |
| 39 |
CipaCrawler/3.0 (info@domaincrawler.com; http://www.domaincrawler.com/xn--b1amfsx.xn--p1ai) |
4 |
| 40 |
Mozilla/5.0 (compatible; oBot/2.3.1; http://www.xforce-security.com/crawler/) |
4 |
| 41 |
(info@domaincrawler.com; http://www.domaincrawler.com/aviacity.net) |
2 |
| 42 |
VelenPublicWebCrawler (velen.io) |
2 |
| 43 |
Google AdSense Robot |
2 |
| 44 |
everyfeed-spider/2.0 (http://www.everyfeed.com) |
1 |
| 45 |
Mozilla/5.0 (compatible; adscanner/)/1.1 (http://seocompany.store; spider@seocompany.store) |
1 |
| 46 |
Mozilla/5.0 (compatible; adscanner/)/1.0 (Mozilla/5.0 (compatible; seoscanners.net/1.0; +spider@seoscanners.net); http://seoscanners.net; spider@seoscanners.net) |
1 |
|
Всего |
381 081 |
