GP Web Labs

Robots.txt checker

Enter a website and we'll fetch its robots.txt, then flag anything that could hide the site from Google or from AI assistants.