Robots.txt Generator
Create a basic robots.txt file without forgetting the sitemap line or blocking the wrong folders by accident.
Generate robots.txt
User-agent: * Allow: / Sitemap: https://00090004.buzz/sitemap.xml
How to use it
- Choose the user-agent you want to target, usually
*. - Add only the paths you truly want to disallow.
- Include a sitemap URL to help discovery.
- Upload the file to the site root as
/robots.txt.