User-agent: GPTBot Disallow: / User-agent: MauiBot (crawler.feedback+wc@gmail.com) Disallow: / User-agent: MauiBot (crawler.feedback+dc@gmail.com) Disallow: / User-agent: MegaIndex.ru Disallow: / User-agent: Semrushbot-SA Disallow: / User-agent: HTTrack Disallow: / User-agent: * Crawl-delay: 120 Disallow: /publications/search-publications/ # Do not delete /Sitefinity. Never any reason to allow indexing here Disallow: /Sitefinity/ # The same goes for sandbox Disallow: /sandbox # Also disallow searches. We already have it set to "noindex", but keep getting googlebot hits Disallow: /search-results Disallow: /publications/search-publications Sitemap: https://www.aiaa.org/sitemap/sitemap-index.xml