|
Робот |
Хиты |
| 1 |
DotBot |
11 999 |
| 2 |
AhrefsBot |
5 890 |
| 3 |
Yandex Robot |
5 581 |
| 4 |
SemrushBot |
4 152 |
| 5 |
Googlebot |
3 785 |
| 6 |
Mozilla/5.0 (compatible; Barkrowler/0.9; +https://babbar.tech/crawler) |
3 179 |
| 7 |
Bing Robot |
1 776 |
| 8 |
MJ12bot |
1 567 |
| 9 |
Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; spider-feedback@bytedance.com) |
208 |
| 10 |
meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler) |
193 |
| 11 |
WebLog Expert |
63 |
| 12 |
WebMeUp Crawler |
58 |
| 13 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Robots/2.0; +https://help.mail.ru/webmaster/indexing/robots) |
50 |
| 14 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Fast/2.0; +https://help.mail.ru/webmaster/indexing/robots) |
39 |
| 15 |
'Mozilla/5.0 (compatible; GenomeCrawlerd/1.0; +https://www.nokia.com/genomecrawler)' |
37 |
| 16 |
Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; TikTokSpider; ttspider-feedback@tiktok.com) |
31 |
| 17 |
Bing Preview Robot |
29 |
| 18 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Favicons/2.0; +https://help.mail.ru/webmaster/indexing/robots) |
16 |
| 19 |
FaceBook Crawler |
14 |
| 20 |
Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; https://zhanzhang.toutiao.com/) |
7 |
| 21 |
CheckMarkNetwork/1.0 (+http://www.checkmarknetwork.com/spider.html) |
6 |
| 22 |
Twitterbot |
5 |
| 23 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +https://help.mail.ru/webmaster/indexing/robots) |
4 |
| 24 |
Perl LWP |
3 |
| 25 |
Netcraft Spider |
3 |
| 26 |
Baidu Spider |
2 |
| 27 |
Mozilla/5.0 (compatible; VelenPublicWebCrawler/1.0; +https://velen.io) |
2 |
| 28 |
SeznamBot |
2 |
| 29 |
Xenu's Link Sleuth |
1 |
| 30 |
Yahoo! Slurp |
1 |
| 31 |
Archive.org Robot |
1 |
| 32 |
WebZIP/3.5 (http://www.spidersoft.com) |
1 |
| 33 |
VKRobotRB |
1 |
| 34 |
Spider_Bot/3.0 |
1 |
| 35 |
LinkedIn Robot |
1 |
| 36 |
Mozilla/5.0 ( Macintosh; Intel Mac OS X 10_10_1 ) AppleWebKit/600.2.5 ( KHTML, like Gecko ) Version/8.0.2 Safari/600.2.5 ( compatible; CloudServerMarketSpider/1.0; +http://cloudservermarket.com/spider.html ) |
1 |
|
Всего |
38 709 |
