Robots.txt Generator

Build a clean robots.txt file with sitemap support, crawl-delay, and custom allow/disallow rules. Download and upload to your site root in minutes.

Advertisement

Daily uses: 0 / 10 free Upgrade for unlimited →

Quick presets

User-agent

Crawl-delay (seconds, optional)

Allow rules (one per line)

Disallow rules (one per line)

Sitemap URL

⚡

You've used 10 free runs today

Upgrade to Pro for unlimited generation and no ads.

Upgrade to Pro – $9/mo

Resets at midnight · Cancel anytime

Advertisement

How to use this tool

Select a preset or fill in the fields manually.
Add your sitemap URL so Google can find it automatically.
Add Disallow rules for pages you don't want indexed (admin, login, etc.).
Click Generate robots.txt, copy it, and save it as robots.txt in your site root folder.

What should you disallow?

Always block/admin/, /wp-admin/, /login/, /cart/, /checkout/, /account/

Usually block/search/, /?s=, /tag/, /author/, duplicate parameter pages

Never blockYour main content pages, product pages, blog posts, CSS and JS files

Advertisement