# robots.txt for maxspeedbox.com User-agent: * Allow: / User-agent: Googlebot Allow: / # Allow all crawlers access to most content Disallow: /pre-shrink-images/ # Prevent crawling of non-public pages if they exist Disallow: /admin/ Disallow: /private/ Disallow: /drafts/ # Sitemap locations Sitemap: https://maxspeedbox.com/sitemap.xml