Generators · Free tool
Robots.txt generator
Build a robots.txt with your sitemap, blocked folders and clear choices for AI training and AI search crawlers.
What it checks
Robots.txt Generator: what you get
- Sitemap line
- Blocked folders
- AI training vs AI search crawler choices, explained
Real checks, no invented numbers
Everything in the result comes from your live page or from Google’s own APIs. We never make up authority, traffic or ranking figures.
Safe and private
We only read publicly available pages. Results are stored privately and shared only through your report link.
Built by an SEO team
The same checks our team uses for clients in the USA, Canada and Australia.
Frequently asked questions
Where does robots.txt go?
At the root of your domain: https://yourdomain.com/robots.txt.
Want our team to fix it for you?
Get a clear plan and a written quote from the Forelskets seo services team.
