# ================================================== # Ultra-Aggressive Google-Trusted Robots.txt # Domain Target: https://www.macroseed.com.ar/ # Strategy: Max Crawl Budget & Anti-AI Reconnaissance # ================================================== # 1. PRIORITY FULL ACCESS (GOOGLE FLEET & BING) User-agent: Googlebot Allow: / User-agent: Googlebot-Image Allow: / User-agent: Googlebot-News Allow: / User-agent: Googlebot-Video Allow: / User-agent: Google-InspectionTool Allow: / User-agent: GoogleOther Allow: / User-agent: GoogleOther-Image Allow: / User-agent: GoogleOther-Video Allow: / User-agent: Storebot-Google Allow: / User-agent: AdsBot-Google Allow: / User-agent: Mediapartners-Google Allow: / User-agent: Bingbot Allow: / # 2. CRAWL BUDGET & BACKEND DIRECTORY OPTIMIZATION User-agent: * Disallow: /admin/ Disallow: /api/ Disallow: /config/ Disallow: /includes/ Disallow: /login/ Disallow: /private/ Disallow: /*?* Allow: / # 3. ADVANCED AI SCRAPERS & DATA MINING BLOCKLIST User-agent: GPTBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: Google-Extended Disallow: / User-agent: CCBot Disallow: / User-agent: Anthropic-ai Disallow: / User-agent: ClaudeBot Disallow: / User-agent: Claude-Web Disallow: / User-agent: PerplexityBot Disallow: / User-agent: Cohere-ai Disallow: / User-agent: Omgilibot Disallow: / User-agent: Meta-ExternalAgent Disallow: / User-agent: Timpibot Disallow: / # 4. SEO COMPETITOR RECONNAISSANCE BLOCKLIST User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: SemrushBot-SA Disallow: / User-agent: DotBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: PetalBot Disallow: / User-agent: DataForSEOBot Disallow: / User-agent: SerpstatBot Disallow: / # 5. SITEMAP LOCATION Sitemap: https://www.macroseed.com.ar/site.xml