|
Робот |
Хиты |
| 1 |
AhrefsBot |
210 230 |
| 2 |
DotBot |
134 384 |
| 3 |
Yandex Robot |
77 877 |
| 4 |
Mozilla/5.0 (compatible; Barkrowler/0.9; +https://babbar.tech/crawler) |
66 185 |
| 5 |
Googlebot |
57 610 |
| 6 |
SemrushBot |
43 346 |
| 7 |
WebMeUp Crawler |
36 636 |
| 8 |
MJ12bot |
34 923 |
| 9 |
Bing Robot |
24 082 |
| 10 |
meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler) |
12 074 |
| 11 |
Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; spider-feedback@bytedance.com) |
2 439 |
| 12 |
netEstate NE Crawler (+http://www.website-datenbank.de/) |
2 036 |
| 13 |
WebLog Expert |
1 525 |
| 14 |
Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; https://zhanzhang.toutiao.com/) |
868 |
| 15 |
Baidu Spider |
623 |
| 16 |
FaceBook Crawler |
381 |
| 17 |
Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; TikTokSpider; ttspider-feedback@tiktok.com) |
293 |
| 18 |
'Mozilla/5.0 (compatible; GenomeCrawlerd/1.0; +https://www.nokia.com/genomecrawler)' |
276 |
| 19 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Robots/2.0; +https://help.mail.ru/webmaster/indexing/robots) |
254 |
| 20 |
Bing Preview Robot |
228 |
| 21 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Fast/2.0; +https://help.mail.ru/webmaster/indexing/robots) |
190 |
| 22 |
TinEye Crawler |
131 |
| 23 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Favicons/2.0; +https://help.mail.ru/webmaster/indexing/robots) |
84 |
| 24 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +https://help.mail.ru/webmaster/indexing/robots) |
67 |
| 25 |
Mozilla/5.0 (Windows NT 6.1; Win64; x64; +http://url-classification.io/wiki/index.php?title= URL_server_crawler) KStandBot/1.0 |
59 |
| 26 |
Mozilla/5.0 (compatible; crawler) |
48 |
| 27 |
Netcraft Spider |
41 |
| 28 |
Mozilla/5.0 (compatible; SERankingBacklinksBot/1.0; +https://seranking.com/backlinks-crawler) |
40 |
| 29 |
Twitterbot |
37 |
| 30 |
CheckMarkNetwork/1.0 (+http://www.checkmarknetwork.com/spider.html) |
36 |
| 31 |
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.3; robots.txt; +https://openai.com/searchbot |
32 |
| 32 |
'Mozilla/5.0 (compatible; GenomeCrawlerd/1.0; https://www.nokia.com/genomecrawler)' |
26 |
| 33 |
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.0; robots.txt; +https://openai.com/searchbot |
26 |
| 34 |
Google AdWords Robot |
22 |
| 35 |
LinkedIn Robot |
21 |
| 36 |
Archive.org Robot |
18 |
| 37 |
Perl LWP |
17 |
| 38 |
Mozilla/5.0 (compatible; VelenPublicWebCrawler/1.0; +https://velen.io) |
16 |
| 39 |
SeznamBot |
16 |
| 40 |
DnBCrawler-Analytics |
13 |
| 41 |
Spider_Bot/3.0 |
4 |
| 42 |
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Nicecrawler/1.1; +http://www.nicecrawler.com/) Chrome/90.0.4430.97 Safari/537.36 |
4 |
| 43 |
|
3 |
| 44 |
MSIE Crawler |
3 |
| 45 |
Yahoo! Slurp |
3 |
| 46 |
everyfeed-spider/2.0 (http://www.everyfeed.com) |
3 |
| 47 |
TestCrawler/Nutch-1.22-SNAPSHOT |
2 |
| 48 |
WebZIP/3.5 (http://www.spidersoft.com) |
2 |
| 49 |
Turnitin Robot |
2 |
| 50 |
Gaislab Robot |
2 |
|
Итого |
707 238 |
|
Всего |
707 266 |
