# ===== Crawler AI: ricerca e citazioni ===== User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: GPTBot User-agent: ClaudeBot User-agent: Claude-SearchBot User-agent: Claude-User User-agent: anthropic-ai User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Google-Extended User-agent: CCBot Allow: /search/label/ Disallow: /search? Disallow: /feeds/ Disallow: /share-widget # ===== Bot SEO che consumano risorse ===== User-agent: SemrushBot User-agent: MJ12bot User-agent: DotBot User-agent: BLEXBot User-agent: DataForSeoBot User-agent: PetalBot Disallow: / # ===== Tutti gli altri ===== User-agent: * Allow: /search/label/ Disallow: /search? Disallow: /feeds/ Disallow: /share-widget Sitemap: https://www.gedix.info/sitemap.xml?page=1 Sitemap: https://www.gedix.info/sitemap-pages.xml Sitemap: https://www.gedix.info/sitemap.xml?page=2 Sitemap: https://www.gedix.info/sitemap.xml?page=3