Free tools / Sitemap generator
XML sitemap generator: crawl your site and download sitemap.xml
Our sitemap generator crawls up to 40 pages of your site, starting at the homepage, and builds a sitemap.xml you can download. Each page is listed with its status and canonical. Pages marked noindex, pages that do not answer 200 and pages whose canonical points elsewhere are flagged and left out.
We read robots.txt before anything else and follow it, then read up to 40 pages on the same website within ten seconds and 48 requests, following links from your homepage. A page over 1.5 MB is skipped rather than read in part. HTTPS websites are supported; other addresses are refused.
No email is needed; runs are limited per network and per day, and by the site's daily allowance.
We do not save your website, company name, page content or result. We keep daily totals and hashed network counters to enforce limits. A shared result stays in its link, not on our server.
What we check and why
Status
A sitemap should list pages that answer 200. Redirects, errors and pages we could not read are listed with the reason and left out.
Canonical
Each page should name itself as canonical, or name none. A page whose canonical points to another address is a duplicate, so we leave it out; the address it points to goes in when we read it and it qualifies.
noindex
A robots meta tag or X-Robots-Tag header with noindex asks search engines to keep the page out of results, so listing it in a sitemap sends a mixed signal. We leave it out and say where the noindex is.
A fixed limit
We stop at 40 pages so the check stays fast and repeatable. When more links remain, the result says how many, and a larger site should build its sitemap from its own list of pages.
Questions
Where do I put sitemap.xml?
At the root of your domain, such as https://yourcompany.com/sitemap.xml, served as XML. Then add a line to robots.txt that reads Sitemap: followed by the full address, so every crawler that reads robots.txt can find it.
Why is a page missing from my sitemap?
Either we did not reach it within 40 pages, or it failed a check: it returned an error, redirected, carried noindex or named another canonical. The table gives the reason for each page we read.
Should I add lastmod dates?
Add a date when it records a real change to the page. A date that changes on every visit, as many server headers do, says nothing about the page, so our draft leaves lastmod out. Add it from your own records of when each page changed.
Want the fix made for you?
Answer Repair completes one agreed source-backed page or fix. Choose Live or Handoff before payment. Due 48 elapsed hours after Ready. Full refund on request within 30 days of delivery.
When you want us to do the work, every offer and its published price is on our offers page. More free checks: the ChatGPT Business Hub readiness check, the robots.txt tester and the AI access checker, or see all free tools. Read next: Which site-structure basics still matter? and ChatGPT Business Hub explainer: sitemap.