← All toolsMarketing›SEO & Organic
Robots.txt Generator
Create a robots.txt file for your site: allow or block crawlers, disallow folders, block AI training bots and add your sitemap.
Tip from Tink: robots.txt stops crawling, not indexing — use noindex for that.
User-agent: * Disallow: /admin Disallow: /cart Sitemap: https://example.com/sitemap.xml
Advertisement
How to use the Robots.txt Generator
- Choose to allow or block all crawlers.
- List folders to keep out and your sitemap URL.
- Copy robots.txt.
Everything runs in your browser. Nothing you enter is uploaded.