Robots.txt Generator

Control how search engines crawl your site.

Global Settings

Default Access (User-agent: *)

Allow AllDisallow All

Crawl Delay (seconds)Note: Not all bots support crawl-delay.

Sitemap URL

Bot Permissions

Googlebot

Bingbot

robots.txt Preview