Robots.txt Generator

Generate robots.txt file

🔒 This tool runs fully in your browser. No files or data are uploaded.

How to Use

  1. Configure user-agent (default: * for all bots)
  2. Choose whether to allow or disallow pages
  3. Add specific paths to allow or disallow (optional)
  4. Add sitemap URL (optional)
  5. Click "Generate robots.txt" and copy the result

FAQ

  • What is robots.txt?
    robots.txt is a file that tells search engine crawlers which pages or files they can or cannot access on your website.
Disclaimer: Place the generated robots.txt file in your website's root directory. Make sure to test it before deploying.