Free Online Robots.txt Generator
Create a valid robots.txt file to control how search engines crawl your site.
Upload the file to the root of your domain so it is available at /robots.txt.
Blocking a page here does not guarantee it will disappear from search results.
About the Robots.txt Generator
Free robots.txt generator. Allow or block search engine bots, add a sitemap, and download a valid robots.txt file.
How to use this tool
Use the controls above to enter your values, choose your options, and view the result. The tool updates as you work, and the result can be copied or downloaded where supported.
Frequently asked questions
Is this tool free?
Yes. Every tool on ImGenerate is free to use and does not require an account.
Is my data safe?
Tools that run entirely in the browser keep your data on your device. Any server-backed lookup is noted in the tool and only sends the information needed for the result.