Robots.txt checker
Enter a website and we'll fetch its robots.txt, then flag anything that could hide the site from Google or from AI assistants.
Enter a website and we'll fetch its robots.txt, then flag anything that could hide the site from Google or from AI assistants.