Sitemap: https://jdwel.com/sitemap_index.xml # Global rules User-Agent: * Disallow: /?s=* Disallow: /match/ Disallow: /matches/ # Search Engines User-agent: Googlebot User-agent: Googlebot-Mobile User-agent: Googlebot-Image User-agent: Googlebot-News User-agent: Googlebot-Video User-agent: bingbot User-agent: Applebot User-agent: slurp User-agent: yandex User-agent: baiduspider Allow: /match/ Allow: /matches/ # SEO Tools User-agent: AhrefsBot User-agent: AhrefsSiteAudit User-agent: BLEXBot User-agent: DataForSeoBot User-agent: Caliperbot User-agent: DotBot User-agent: HubSpot User-agent: MJ12bot User-agent: rogerbot User-agent: SemrushBot Disallow: /wp-json/ Crawl-Delay: 10