Robots.txt Generator

Generate robots.txt files with an intuitive editor. Use templates, add common bots and paths, and download your file.

TemplatesCommon BotsDownload

Rules

Common Bots

Googlebot Bingbot GPTBot Slurp DuckDuckBot

Common Paths

/admin/ /api/ /private/ /wp-admin/ /login/ /tmp/

Allow

Crawl Delay (seconds, optional)

Sitemaps

Templates

robots.txt

User-agent: *
Allow: /