Robots Generator.

Control how Google and other bots crawl your site. Secure sensitive folders.

Crawler Rules

User Agent

Disallow Paths (Private)

/admin/ /login/ /tmp/ /private/ *.php files /cgi-bin/

Sitemap URL (Optional)

Crawl Delay

📄 robots.txt