Модуль Bots and Crawlers OnLine OC 3.x

Flesh

Созидатель (II)
Сообщения
3
Симпатии
0
Баллы
25
58f8c8d768a5c-resize-710x380.jpg

Адаптированый модуль под ОС 3.х

Гугл перевод:

Модуль отображает активность ботов на сайте в отчете «Онлайн-клиенты» (отображается вместо «Гости»).
Отслеживаемые боты настраиваются в стандартных настройках магазина на вкладке «Параметры» после настроек «Онлайн-клиенты» (подстроки из UserAgent, разделенные знаком «|»).
Очень полезно для анализа текущих посетителей.
Боты появятся не сразу, а при следующем посещении сайта.

WARNING!!!
Ставте для начала на тестовом сайте так как может поломать сайт(идет инициализация изменений через ocmod)

После установки модификаторов и очистки кеша все же войдите в настройки магазина, проверьте строку имен ботов в конфигурации И СОХРАНИТЕ ИХ!
При сохранении настроек магазина вы создаете необходимые поля и записи в базе данных для корректной работы!




Продажник: https://www.opencart.com/index.php?route=marketplace/extension/info&extension_id=30538

Скрытое содержимое. Вам нужно войти или зарегистрироваться.
 
Так ссылка на модуль для второй версии Opencart
 
Ссылка да, в хайде под 3 верию
 
Вот расширеный список ботов, можете скопировать и вставить в настройках:
uptimebot|Monibot|NIXStatsbot|DotBot|monitoring360bot|ClaudeBot|OnlineOrNotcom-bot|GoogleCloudMonitoring|monitorbacklinkscombot|GotSiteMonitor|WatchMouse|Irokezczmonitoring|UptimeRobot|WebGazer|Uptimia|WEDOSOnLinemonitoring|cron-joborg|MxToolboxbot|Fakebot|SiteUptimecom|SemanticScholarBot|FeedBurner|Blogtrottr|MJ12bot|YahooJAPAN|RankurBot|Amazonbot|AdminLabs|montastic-monitor|coccocbot|omgilibot|Applebot|AhrefsBot|PetalBot|SentiBot|Specificfeeds|ByteDancecrawler|HeadlessChrome|Cronless|Feedpressocrawler|YouBot|VelenPublicWebCrawler|Barkrowler|Site24x7|SenutoBot|RSSingBot|FirmoGraph|DataForSeobot|s4a|GoogleReadAloud|FacebookBot|Spider|ZoomInfobot|sogouspider|getthitcom|Slackbot|SeekportCrawler|Expanse|censysiocrawler|headlinebot|Chatworkcrawler|WireReaderBot|Prometheusbot|InternetMeasurement|GoogleAdSense|NaverBot|HelloWorld|KStandBot|Google-Shopping|TestCertificateInfo|YisouSpider|YandexWebmaster|BrightEdgeCrawler|linkdexbot|Tweakersbot|Feedspotbot|ChatGPT-User|SkypeUriPreview|DuckDuckBot|Google-Ads|BLEXBot|Baiduspider|LinkedInBot|ChromePrivacyPreservingPrefetchProxy|LeakIXbot|Magellan|Netcraftcrawler|masscan|SEBot-WA|FlipboardBot|TelegramBot|Pinterestbot|Chrome-Lighthouse|impendoom-bot|Iframely|tchelebi|Hatena|Google-Safety|360Spider|kakaocrawler|Alexabot|DataproviderSpider|ALittleClient|SafeDNSBot|IPIPNETcrawler|linkfluence|Cincraw|Diffbot|CSIRTCZcrawler|Grammarly|BitSightBot|EFFcrawler|Twitterbot|2iprubot|RavenCrawler|OpenWebSearcheucrawler|IONOSbot|MojeekBot|serpstatbot|wpbot|yacybot|CCBot|Awariocrawler|SpazioDatibot|Protopage|SISTRIXOptimizer|ImagesiftBot|SurdotlyBot|FCCNcrawler|RyteBot|Feedfetcher-Google|ZoomBot|Prerender|NsToolsBot|BuiltWithcrawler|Tenablecrawler|Nmap|YandexBot|XMCObot|Wikipediacrawler|OpenVAS|WhatsMyIPorg|fluid|Splash|deepcrawl|nvdorz|Monsidobot|YetiBOT|Googlebot|TurnitinBot|startmebot|Ezoiccrawler|WordPresscombots|MailRubot|Scrapy|Nicecrawler|virustotal|GoogleAssociationService|Discordbot|SEOkicks-Robot|TinEye|CERTPolskacrawler|Pocketbot|MetaInspector|Mattermost-Bot|FriendlyCrawler|nbertaupete95|PDF24crawler|Qwantify|AutoconfigTestfromUSTC|LightspeedSystemsCrawler|GPTBot|HubSpotCrawler|SCAN|PhxBot|ips-agent|DomainStatsBot|keys-so-bot|HappyWing|TextRazorcrawler|semaltbot|PagePeeker|GulperBot|CrissyFieldbot|GoogleAppsScript|Odin|COMSYScrawler|Photon|MediaWikicrawler|URLSuMaBot|blukbot|Notionbot|Deskyobot|DnBCrawler|DFBot|intelxio-bot|WebwikiBot|ISSCyberRiskCrawler|Zombiebot|MegaIndex|SiteScoreBot|BDBot|WellKnownBot|archiveorg|bitlybot|mindUpBot|YandexMetrica|harsilbot|Orbbot|hyScoreiocrawler|imgproxy|Netpeakbot|letsencryptbot|EdgeCrawler|Daumoa|updowniobot|Elementorbot|SeoSiteCheckup|Timpibot|Adbeatbot|OdklBot|SummalyBot|Dmbot|trentwilesbot|Wordup-1|Foregenixcrawler|GDNPcrawler|NetShelterContentScan|SMTBot|CriticalPathCSSGenerator|AsanaCrawler|CastFeedValidator|feederco|FAST-WebCrawler|WikipediaCitoid|netEstateCrawler|domainsbot|t3versionsBot|Yahoo|ArchiveTeamcrawler|Wappalyzer|wheresitupcom|TestLocally|GeedoBot|SKBKonturbot|MixrankBot|woobot|SERPtimizerBot|SEOlizer|Paqlebot|Ecovadisbot|line-poker|PowerMapperCrawler|Siteimprovecombot|GoogleStoreBot|Riddlerbot|Check-Host|FeedImageAudit|MergadoBot|Isitup|PrintFriendlycom|Pingdomcombot|GTmetrix|WPScan|WhatWeb|unmaskparasites|EdgeWatch|Zoomcrawler|Miniflux|SnapBot|DowntimeDetector|img2dataset|DomCopBot|ContentKing|HeadlessEdge|WebMeasure|Cocolyzebot|iubenda-radar|webgains-bot|PleskBot|EMDASHbot|LivelapBot|AGAKIDSBOT|rogerbot|webprosbot|Dawapbot|centurybot9|Hlidamtorobot|StractBot|BrandProtectbot|Panscientcrawler|sideraibot|TheKnowledgeAI|PhantomJsCloudcom|gregcrawler|SwisscowsCrawler|PricedroneShoppingBot|DingTalkBot|thesis-research-bot|SpiderLing|TactiScout|fidget-spinner-bot|FuseonBot|my-tiny-bot|AntBot|allOrigins|botify|friendly-spider|CirrusExplorer|test-bot|MADBbot|newspaper|Gabanzabot|CheckMarkNetwork|RssReaderBot|mobileslbot|LinkTiger|RainBot|lolbot|JobBot|Gigabot|aiHitBot|oBot|GrapeshotCrawler|TorusBot|Sosospider|anthropicbot|Miniatureio|SEMrushBot|SSLLabs|XoviBot|WGETbot|Wheregoesbot|removebg|UASlinkChecker|HetrixToolscrawler|TinyTestBot|Seobility|downnotifiercommonitoring|ds-robot|FreeWebMonitoringSiteChecker|Brightbot|jaddjabot|SecurityHeaders|Implcit:AdsTxt-Scrapr|PulnoBot|github-camo|redditbot|ChimeUnfurlAgent|bneescrawler|Google-InspectionTool|Schema-Markup-Validator|TermlyBot|Usercentrics|Exabot|TinyTestBoty|UCSBbot|Birdcrawlerbot|GoogleDocs|NodePing|Chirp|Testomatobot|Trokambot|ClickagyIntelligenceBot|MorningscoreBot|SiteCheckerBot|wowLinkCrawler|hCardValidator|ImageOptim|Apercitebot|Netvibescrawler|hstspreloadorgbot|PixalateCrawler|GoogleAMPcrawler|historious|wmtipscom|XMLSitemapsGenerator|WebSniffer|cg-eye|LinkValetOnline|kazbtbot|REDbot|GAChecker|WPSec|Datakudobot|ERIPP|httpcheck|Opengraphiobot|KeyCDNbot|ImageFetcher|OnlineDomainTools|Urlcheckr|MB-SiteCrawler|BrokenLinkCheckcom|deadlinkchecker|agentslug|HostTracker|internetVistamonitor|ServiceUptimerobot|websitepulsebot|nomore404comrobot|Embedly|LinkPreview|CrawlyProjectCrawler|EasyBibcrawler|Bad-Neighborhood|Proxyscotch|Ezgif|startpagebot|RSiteAuditor|luiscarvalho|MoonBot|PyWebCopyBot|CookieInformationScanner|TurconeBot|OrgProbe|GoogleRot|ScamadviserExternalHit|lunabot|NutchSpider|JobboerseBot|UnshortenIt|LastModBot|alyzecombot|RobotsChecker|Pagespeed|badbot|Wordupindexinfo1|Secragonbot|ClosureCompilerService|LogRocketbot|awincomcrawler|boithocombot|FemtosearchBot|Moatbot|QuoraBot|Matrixorgcrawler|researchxoftheweb|Bidtellect|Linespider|NextcloudCrawler|Jooblebot|goodbot|SuperMonitoring|Paesslerbot|OhDearcrawler|webarchivcz|ADmantXcrawler|SirdataBot|HeartRailsBot|Feedwind|Feedbin|Checkmarxbot|Uptime-Kuma|PingAdminRu|MonToolsCom|dlvrit|QBOT|BSbot|Scribdbot|SeznamBot|StactBot|cyberscaniobot|AccompanyBot|ProSitemapsGenerator|Google-Lens|aragnanetcrawler|StructuredDataMarkupHelper|screeenly-bot|Indiwtf|MJBot|CommaFeed|ResearchBot|adstxtlabcomCrawler|Yellowbrandprotectionbot|theoldreadercom|Neevabot|PoliteCrawl|Elisabot|PaperLiBot|trendictionbot|Mediatoolkitbot|proximic|CriteoBot|ivre-masscan|semantic-visionscomcrawler|Storm-crawler|Easy-Thumb|NeticleCrawler|AmazonCloudWatch|BrandVerity|GozleBot|bingbot|Docoloc|Feedly|FindITAnswersbot|PickyBot|LCC|hosterstatsnewgtld|GoogleYoutube|GlobalGoalsDirectoryBot|CloudServerMarketSpider|URIBOT|PrivateBot|AspireWebCrawler|inetdexbot|DreamHostbot|PhantomBot|certytags|domaincodexcombot|SuperBot|Siteliner|GoogleSites|RedHuntLabsbot|Bimbot|VsuSearchSpider|VerticalLeapbot|sempitechbot|Licornecrawler|dcrawl|KeerthiBot|Zeno|BUbiNG|drawio|uMBot|SauceNAO|iqdb|KDBot|FindberryBot|freefind|PANDORAbot|CLARINbot|AteniumBot|InfoTigerBot|Cloudinary|FASTbot|SERankingbot|DigitalPebblebot|ShortPixelcomcrawler|AmazonCloudWatch|AmazonAdBot|AmazonProductDiscovery|Amazonbot|YandexBot|YandexImages|YandexVideo|YandexMedia|YandexMobileBot|YandexMetrika|YandexDirect|YandexFavicons|YandexWebmaster|YandexBlogs|YandexPagechecker|YandexImageResizer|YandexNews|YandexNewslinks|YandexCatalog|YandexAntivirus|YandexZakladki|YandexSitelinks|YandexVertis|Yandex|Googlebot|Googlebot-News|Googlebot-Image|Googlebot-Video|Googlebot-Mobile|Mediapartners-Google|AdsBot-Google|google|rambler|mail.ru|aport|lycos|yahoo|bingbot|bing|facebook|twitter|MSNBot-NewsBlogs|msnbot-news|MSNBot-Products|MSNBot-Media|msnbot|tpprfbot|searchmetricsbot|sistrix|exabot|cmscrawler|mj12bot|semrush|phantom|ahrefs|ezooms|searchbot|solomono|blex|archive|teoma|scooter|webalta|bond|accoona|baiduspider|eltaIndexer|gamespy|mihalism|omniExplorer-bot|ooyyo|w3c-validator|w3c-css-validator|findlinks|indy|httrack|clshttp|archiver|loader|email|nikto|miner|python|winhttp|perl|curl|libwww|wget|harvest|scan|grab|extract|casper|cmsworldmap|diavol|flicky|jakarta|kmccrew|purebot|comodo|feedfinder|planetwork|bot|spider|crawler|spy|search|slurp|ia-archiver|1M7bot|AAABot|AccompanyBot|AdBot|AdsrvrBot|AdsTxtCrawler|AdsTxtCrawlerTP|AlexionResearchBot|ALittleClient|AntBot|AnyBot|aranhabot|AreamCrawler|AteniumBot|AutoconfigTest|USTC|autoemailspider|badbot|BananaBot|bbot|BDBot|Bender|Bimbot|BorneoBot|Bot|brands-bot|brands-bot-logo|browserClientA|BSbot|centurybot9|CF-UCUserAgent|chimebot|ChimeUnfurlAgent|clark-crawler|CLcrawler|CrawlBot|CrawlyProjectCrawler|CXK_Bot|DAutoBot|DaveCrawler|DFBot|Dmbot|DnBCrawler|DownloaderChrome|ds-robot|Elisabot|Fakebot|fake_bot|FAST-WebCrawler|fidget-spinner-bot|FlfBaldrBot|friendly-spider|Fuze_Bot|g2crawler|GlobalGoalsDirectoryBot|GoodBot|ресурсgoogle|GoogleRot|gregcrawler|Grover|gschaidbot|HappyWing|HeadlessChrome|HeadlessEdge|HelloWorld|AdsTxt-Scrapr|Infobot|ISSCyberRiskCrawler|jaddjabot|jurgendata|KauaiBot|KauaiSlowBot|KeerthiBot|keys-so-bot|LanaiBot|linabot|lolbot|loli_spider|lunabot|Magellan|MauiBot|MetadataScraper|MJBot|Monibot|MoonBot|MyNutchSpider|my-tiny-bot|MyBot|nbertaupete95|газета|Nicecrawler|NiueBot|NutchSpider|nvdorz|OgScrper|Orbbot|p40Bot|PhantomBot|PhxBot|polarisbotnet|polite-crawler|PoliteCrawl|PopScreenBot|PrivateBot|QBOT|RainBot|RelyBot|ResearchBot|researchxoftheweb|RssReaderBot|RW_Crawler|ScamadviserExternalHit|SCAN|sc_bot|SEBot-WA|sempi.techbot|seolyt|seoscanners.netbot|SnapURLPreviewService|Spider|StactBot|Storm-crawler|SummalyBot|SuperBot|tes-cocrawler|TestCertificateInfo|test-bot|TestBot|TheKnowledgeAI|Theophrastus|thesis-research-bot|ThinkChaos|TinyBotTestUA|TinyTestBot|TinyTestBoty|TMMCrawler|TprAdsTxtCrawler|TrendsmapResolver|Trokambot|TSpider|Unknownbot|ViberBot|VsuSearchSpider|web-crawler|WebBot|WebCrawler|WebRankSpider|websusebot|WhatStuffWhereBot|Wordup-1|Wordupindexinfo1|WorksOgCrawler|wpbot|XTCBOTNET|YFF35|YunSecurityBot|Zephuli-Bot
 
Вот расширеный список ботов, можете скопировать и вставить в настройках:
uptimebot|Monibot|NIXStatsbot|DotBot|monitoring360bot|ClaudeBot|OnlineOrNotcom-bot|GoogleCloudMonitoring|monitorbacklinkscombot|GotSiteMonitor|WatchMouse|Irokezczmonitoring|UptimeRobot|WebGazer|Uptimia|WEDOSOnLinemonitoring|cron-joborg|MxToolboxbot|Fakebot|SiteUptimecom|SemanticScholarBot|FeedBurner|Blogtrottr|MJ12bot|YahooJAPAN|RankurBot|Amazonbot|AdminLabs|montastic-monitor|coccocbot|omgilibot|Applebot|AhrefsBot|PetalBot|SentiBot|Specificfeeds|ByteDancecrawler|HeadlessChrome|Cronless|Feedpressocrawler|YouBot|VelenPublicWebCrawler|Barkrowler|Site24x7|SenutoBot|RSSingBot|FirmoGraph|DataForSeobot|s4a|GoogleReadAloud|FacebookBot|Spider|ZoomInfobot|sogouspider|getthitcom|Slackbot|SeekportCrawler|Expanse|censysiocrawler|headlinebot|Chatworkcrawler|WireReaderBot|Prometheusbot|InternetMeasurement|GoogleAdSense|NaverBot|HelloWorld|KStandBot|Google-Shopping|TestCertificateInfo|YisouSpider|YandexWebmaster|BrightEdgeCrawler|linkdexbot|Tweakersbot|Feedspotbot|ChatGPT-User|SkypeUriPreview|DuckDuckBot|Google-Ads|BLEXBot|Baiduspider|LinkedInBot|ChromePrivacyPreservingPrefetchProxy|LeakIXbot|Magellan|Netcraftcrawler|masscan|SEBot-WA|FlipboardBot|TelegramBot|Pinterestbot|Chrome-Lighthouse|impendoom-bot|Iframely|tchelebi|Hatena|Google-Safety|360Spider|kakaocrawler|Alexabot|DataproviderSpider|ALittleClient|SafeDNSBot|IPIPNETcrawler|linkfluence|Cincraw|Diffbot|CSIRTCZcrawler|Grammarly|BitSightBot|EFFcrawler|Twitterbot|2iprubot|RavenCrawler|OpenWebSearcheucrawler|IONOSbot|MojeekBot|serpstatbot|wpbot|yacybot|CCBot|Awariocrawler|SpazioDatibot|Protopage|SISTRIXOptimizer|ImagesiftBot|SurdotlyBot|FCCNcrawler|RyteBot|Feedfetcher-Google|ZoomBot|Prerender|NsToolsBot|BuiltWithcrawler|Tenablecrawler|Nmap|YandexBot|XMCObot|Wikipediacrawler|OpenVAS|WhatsMyIPorg|fluid|Splash|deepcrawl|nvdorz|Monsidobot|YetiBOT|Googlebot|TurnitinBot|startmebot|Ezoiccrawler|WordPresscombots|MailRubot|Scrapy|Nicecrawler|virustotal|GoogleAssociationService|Discordbot|SEOkicks-Robot|TinEye|CERTPolskacrawler|Pocketbot|MetaInspector|Mattermost-Bot|FriendlyCrawler|nbertaupete95|PDF24crawler|Qwantify|AutoconfigTestfromUSTC|LightspeedSystemsCrawler|GPTBot|HubSpotCrawler|SCAN|PhxBot|ips-agent|DomainStatsBot|keys-so-bot|HappyWing|TextRazorcrawler|semaltbot|PagePeeker|GulperBot|CrissyFieldbot|GoogleAppsScript|Odin|COMSYScrawler|Photon|MediaWikicrawler|URLSuMaBot|blukbot|Notionbot|Deskyobot|DnBCrawler|DFBot|intelxio-bot|WebwikiBot|ISSCyberRiskCrawler|Zombiebot|MegaIndex|SiteScoreBot|BDBot|WellKnownBot|archiveorg|bitlybot|mindUpBot|YandexMetrica|harsilbot|Orbbot|hyScoreiocrawler|imgproxy|Netpeakbot|letsencryptbot|EdgeCrawler|Daumoa|updowniobot|Elementorbot|SeoSiteCheckup|Timpibot|Adbeatbot|OdklBot|SummalyBot|Dmbot|trentwilesbot|Wordup-1|Foregenixcrawler|GDNPcrawler|NetShelterContentScan|SMTBot|CriticalPathCSSGenerator|AsanaCrawler|CastFeedValidator|feederco|FAST-WebCrawler|WikipediaCitoid|netEstateCrawler|domainsbot|t3versionsBot|Yahoo|ArchiveTeamcrawler|Wappalyzer|wheresitupcom|TestLocally|GeedoBot|SKBKonturbot|MixrankBot|woobot|SERPtimizerBot|SEOlizer|Paqlebot|Ecovadisbot|line-poker|PowerMapperCrawler|Siteimprovecombot|GoogleStoreBot|Riddlerbot|Check-Host|FeedImageAudit|MergadoBot|Isitup|PrintFriendlycom|Pingdomcombot|GTmetrix|WPScan|WhatWeb|unmaskparasites|EdgeWatch|Zoomcrawler|Miniflux|SnapBot|DowntimeDetector|img2dataset|DomCopBot|ContentKing|HeadlessEdge|WebMeasure|Cocolyzebot|iubenda-radar|webgains-bot|PleskBot|EMDASHbot|LivelapBot|AGAKIDSBOT|rogerbot|webprosbot|Dawapbot|centurybot9|Hlidamtorobot|StractBot|BrandProtectbot|Panscientcrawler|sideraibot|TheKnowledgeAI|PhantomJsCloudcom|gregcrawler|SwisscowsCrawler|PricedroneShoppingBot|DingTalkBot|thesis-research-bot|SpiderLing|TactiScout|fidget-spinner-bot|FuseonBot|my-tiny-bot|AntBot|allOrigins|botify|friendly-spider|CirrusExplorer|test-bot|MADBbot|newspaper|Gabanzabot|CheckMarkNetwork|RssReaderBot|mobileslbot|LinkTiger|RainBot|lolbot|JobBot|Gigabot|aiHitBot|oBot|GrapeshotCrawler|TorusBot|Sosospider|anthropicbot|Miniatureio|SEMrushBot|SSLLabs|XoviBot|WGETbot|Wheregoesbot|removebg|UASlinkChecker|HetrixToolscrawler|TinyTestBot|Seobility|downnotifiercommonitoring|ds-robot|FreeWebMonitoringSiteChecker|Brightbot|jaddjabot|SecurityHeaders|Implcit:AdsTxt-Scrapr|PulnoBot|github-camo|redditbot|ChimeUnfurlAgent|bneescrawler|Google-InspectionTool|Schema-Markup-Validator|TermlyBot|Usercentrics|Exabot|TinyTestBoty|UCSBbot|Birdcrawlerbot|GoogleDocs|NodePing|Chirp|Testomatobot|Trokambot|ClickagyIntelligenceBot|MorningscoreBot|SiteCheckerBot|wowLinkCrawler|hCardValidator|ImageOptim|Apercitebot|Netvibescrawler|hstspreloadorgbot|PixalateCrawler|GoogleAMPcrawler|historious|wmtipscom|XMLSitemapsGenerator|WebSniffer|cg-eye|LinkValetOnline|kazbtbot|REDbot|GAChecker|WPSec|Datakudobot|ERIPP|httpcheck|Opengraphiobot|KeyCDNbot|ImageFetcher|OnlineDomainTools|Urlcheckr|MB-SiteCrawler|BrokenLinkCheckcom|deadlinkchecker|agentslug|HostTracker|internetVistamonitor|ServiceUptimerobot|websitepulsebot|nomore404comrobot|Embedly|LinkPreview|CrawlyProjectCrawler|EasyBibcrawler|Bad-Neighborhood|Proxyscotch|Ezgif|startpagebot|RSiteAuditor|luiscarvalho|MoonBot|PyWebCopyBot|CookieInformationScanner|TurconeBot|OrgProbe|GoogleRot|ScamadviserExternalHit|lunabot|NutchSpider|JobboerseBot|UnshortenIt|LastModBot|alyzecombot|RobotsChecker|Pagespeed|badbot|Wordupindexinfo1|Secragonbot|ClosureCompilerService|LogRocketbot|awincomcrawler|boithocombot|FemtosearchBot|Moatbot|QuoraBot|Matrixorgcrawler|researchxoftheweb|Bidtellect|Linespider|NextcloudCrawler|Jooblebot|goodbot|SuperMonitoring|Paesslerbot|OhDearcrawler|webarchivcz|ADmantXcrawler|SirdataBot|HeartRailsBot|Feedwind|Feedbin|Checkmarxbot|Uptime-Kuma|PingAdminRu|MonToolsCom|dlvrit|QBOT|BSbot|Scribdbot|SeznamBot|StactBot|cyberscaniobot|AccompanyBot|ProSitemapsGenerator|Google-Lens|aragnanetcrawler|StructuredDataMarkupHelper|screeenly-bot|Indiwtf|MJBot|CommaFeed|ResearchBot|adstxtlabcomCrawler|Yellowbrandprotectionbot|theoldreadercom|Neevabot|PoliteCrawl|Elisabot|PaperLiBot|trendictionbot|Mediatoolkitbot|proximic|CriteoBot|ivre-masscan|semantic-visionscomcrawler|Storm-crawler|Easy-Thumb|NeticleCrawler|AmazonCloudWatch|BrandVerity|GozleBot|bingbot|Docoloc|Feedly|FindITAnswersbot|PickyBot|LCC|hosterstatsnewgtld|GoogleYoutube|GlobalGoalsDirectoryBot|CloudServerMarketSpider|URIBOT|PrivateBot|AspireWebCrawler|inetdexbot|DreamHostbot|PhantomBot|certytags|domaincodexcombot|SuperBot|Siteliner|GoogleSites|RedHuntLabsbot|Bimbot|VsuSearchSpider|VerticalLeapbot|sempitechbot|Licornecrawler|dcrawl|KeerthiBot|Zeno|BUbiNG|drawio|uMBot|SauceNAO|iqdb|KDBot|FindberryBot|freefind|PANDORAbot|CLARINbot|AteniumBot|InfoTigerBot|Cloudinary|FASTbot|SERankingbot|DigitalPebblebot|ShortPixelcomcrawler|AmazonCloudWatch|AmazonAdBot|AmazonProductDiscovery|Amazonbot|YandexBot|YandexImages|YandexVideo|YandexMedia|YandexMobileBot|YandexMetrika|YandexDirect|YandexFavicons|YandexWebmaster|YandexBlogs|YandexPagechecker|YandexImageResizer|YandexNews|YandexNewslinks|YandexCatalog|YandexAntivirus|YandexZakladki|YandexSitelinks|YandexVertis|Yandex|Googlebot|Googlebot-News|Googlebot-Image|Googlebot-Video|Googlebot-Mobile|Mediapartners-Google|AdsBot-Google|google|rambler|mail.ru|aport|lycos|yahoo|bingbot|bing|facebook|twitter|MSNBot-NewsBlogs|msnbot-news|MSNBot-Products|MSNBot-Media|msnbot|tpprfbot|searchmetricsbot|sistrix|exabot|cmscrawler|mj12bot|semrush|phantom|ahrefs|ezooms|searchbot|solomono|blex|archive|teoma|scooter|webalta|bond|accoona|baiduspider|eltaIndexer|gamespy|mihalism|omniExplorer-bot|ooyyo|w3c-validator|w3c-css-validator|findlinks|indy|httrack|clshttp|archiver|loader|email|nikto|miner|python|winhttp|perl|curl|libwww|wget|harvest|scan|grab|extract|casper|cmsworldmap|diavol|flicky|jakarta|kmccrew|purebot|comodo|feedfinder|planetwork|bot|spider|crawler|spy|search|slurp|ia-archiver|1M7bot|AAABot|AccompanyBot|AdBot|AdsrvrBot|AdsTxtCrawler|AdsTxtCrawlerTP|AlexionResearchBot|ALittleClient|AntBot|AnyBot|aranhabot|AreamCrawler|AteniumBot|AutoconfigTest|USTC|autoemailspider|badbot|BananaBot|bbot|BDBot|Bender|Bimbot|BorneoBot|Bot|brands-bot|brands-bot-logo|browserClientA|BSbot|centurybot9|CF-UCUserAgent|chimebot|ChimeUnfurlAgent|clark-crawler|CLcrawler|CrawlBot|CrawlyProjectCrawler|CXK_Bot|DAutoBot|DaveCrawler|DFBot|Dmbot|DnBCrawler|DownloaderChrome|ds-robot|Elisabot|Fakebot|fake_bot|FAST-WebCrawler|fidget-spinner-bot|FlfBaldrBot|friendly-spider|Fuze_Bot|g2crawler|GlobalGoalsDirectoryBot|GoodBot|ресурсgoogle|GoogleRot|gregcrawler|Grover|gschaidbot|HappyWing|HeadlessChrome|HeadlessEdge|HelloWorld|AdsTxt-Scrapr|Infobot|ISSCyberRiskCrawler|jaddjabot|jurgendata|KauaiBot|KauaiSlowBot|KeerthiBot|keys-so-bot|LanaiBot|linabot|lolbot|loli_spider|lunabot|Magellan|MauiBot|MetadataScraper|MJBot|Monibot|MoonBot|MyNutchSpider|my-tiny-bot|MyBot|nbertaupete95|газета|Nicecrawler|NiueBot|NutchSpider|nvdorz|OgScrper|Orbbot|p40Bot|PhantomBot|PhxBot|polarisbotnet|polite-crawler|PoliteCrawl|PopScreenBot|PrivateBot|QBOT|RainBot|RelyBot|ResearchBot|researchxoftheweb|RssReaderBot|RW_Crawler|ScamadviserExternalHit|SCAN|sc_bot|SEBot-WA|sempi.techbot|seolyt|seoscanners.netbot|SnapURLPreviewService|Spider|StactBot|Storm-crawler|SummalyBot|SuperBot|tes-cocrawler|TestCertificateInfo|test-bot|TestBot|TheKnowledgeAI|Theophrastus|thesis-research-bot|ThinkChaos|TinyBotTestUA|TinyTestBot|TinyTestBoty|TMMCrawler|TprAdsTxtCrawler|TrendsmapResolver|Trokambot|TSpider|Unknownbot|ViberBot|VsuSearchSpider|web-crawler|WebBot|WebCrawler|WebRankSpider|websusebot|WhatStuffWhereBot|Wordup-1|Wordupindexinfo1|WorksOgCrawler|wpbot|XTCBOTNET|YFF35|YunSecurityBot|Zephuli-Bot
facebookexternalhit|aiohttp
Вот еще 2 бота фэйсбука, ох они меня и замучали, очень мощные, иноды сайта улаживали за 4 часа...
 
Назад
Верх