Sitemap & Robots.txt Generator
Build a sitemap.xml from a URL list or by crawling your site, and generate a robots.txt file in seconds.
Two ways to build a sitemap
- Paste a list of URLs and get a valid sitemap.xml instantly.
- Enter your homepage and we crawl internal links a few levels deep, then build the sitemap for you.
Robots.txt made simple
Choose which crawlers the rules apply to, list paths to allow or block, add your sitemap URL, and copy the finished file. Remember to upload it to the root of your site.
Good to know
The crawler respects your robots.txt and stays on one domain. The number of pages it discovers depends on your plan, and the result tells you when it stopped early.
Frequently asked questions
Where should I put sitemap.xml?
At the root of your site, for example example.com/sitemap.xml. Then submit it in Google Search Console.
Does the crawler find every page?
It follows internal links, so pages that nothing links to will not be found. Add those manually with the URL list mode.
What does Disallow in robots.txt do?
It asks crawlers not to fetch matching paths. It is not a security tool, and blocked URLs can still appear in search if other sites link to them.