OG ScopeOG Scope
Free sitemap generator, up to 20,000 pages

XML Sitemap Generator

Crawl a site and download sitemap.xml, with images, a sitemap index for large sites, and a report of broken links, redirects, and noindex pages.

Crawl and sitemap options
Crawl
Sitemap file

These apply to the files right away, including after a crawl.

Sitemap index and sections

Sitemap index and sections

All URLs go into sitemap.xml. Past 50,000 URLs or 50 MB, numbered files are written and sitemap.xml becomes the index that lists them.

How it works

Paste the home page, let the crawler follow the links, and download the files. An account saves nothing.

  1. Step 1

    Enter the home page

    Paste a public URL. The crawler follows redirects to the final host, then reads robots.txt and any sitemap it lists.

  2. Step 2

    Follow the links

    Each HTML page is fetched, its links on the same host are queued, and the status, title, canonical, and robots tags are recorded.

  3. Step 3

    Review what was found

    See every URL with its status and the reason it is in or out, plus broken links, redirects, noindex pages, and duplicate titles.

  4. Step 4

    Download the files

    Get sitemap.xml, or an index with one file per section, plus a text and HTML sitemap and a CSV crawl report.

What this sitemap generator does

This XML sitemap generator starts at the URL you enter, follows the links it finds on the same host, and records each page. A page goes into the sitemap when it answers with a 2xx status and is not marked noindex or canonicalized to another URL. Everything else is listed with the reason it was left out, so the crawl doubles as a quick site audit.

It is a free sitemap generator that crawls up to 20,000 pages, with no account. By default a crawl stops at 500 pages or 2 clicks from the start page. Raise Stop after and set Max depth to No limit for a larger site. Small sites finish in seconds. A crawl of thousands of pages can take an hour or more, and the progress panel shows how far it has got. The files can be downloaded at any time, even mid-crawl.

A laptop showing a home page card branching into four page cards, with an arrow to an XML file icon.

Create a sitemap in four steps

  1. Enter the home page and open the options if you want limits, exclusions, or a slower speed.
  2. Start the crawl. robots.txt is read first, and the site's current sitemap if it has one.
  3. Check the Issues tab for broken links, redirects, and pages left out on purpose.
  4. Download sitemap.xml, upload it to the root of the site, and submit it.

What goes into sitemap.xml

Each url entry has a loc. A lastmod date is added when the page publishes a modified time in article:modified_time, og:updated_time, or dateModified, or when the server sends a Last-Modified header. Google says it uses lastmod when the value is consistently accurate, so no date is invented when neither source has one.

priority and changefreq are off by default, because Google documents that it ignores both. They can be turned on for other search engines or tools that read them. Priority is set from click depth: 1.00 for the start page, then 0.80, 0.64, and so on.

<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"
        xmlns:image="http://www.google.com/schemas/sitemap-image/1.1">
  <url>
    <loc>https://www.example.com/field-notes</loc>
    <lastmod>2026-10-28</lastmod>
    <image:image>
      <image:loc>https://www.example.com/images/notes.jpg</image:loc>
    </image:image>
  </url>
</urlset>

Image sitemap tags

With images turned on, each page lists the images in its HTML as image:image entries, which makes the file an image sitemap as well. Only image:loc is written. Google stopped using the caption, title, license, and location tags of the image extension, so they are left out.

Large sites and the sitemap index

The sitemap protocol allows 50,000 URLs and 50 MB uncompressed per file. When a crawl finds more, the generator writes sitemap-1.xml, sitemap-2.xml, and so on, and sitemap.xml becomes the sitemap index that lists them. Submit the index, and the search engine reads the files inside it. The index can also be named sitemap_index.xml.

Split a sitemap into sections

A site does not have to reach 50,000 URLs to use an index. Under Sitemap index and sections, the sitemap index generator can give each part of the site its own file:

<?xml version="1.0" encoding="UTF-8"?>
<sitemapindex xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
  <sitemap><loc>https://www.example.com/sitemap-main.xml</loc></sitemap>
  <sitemap><loc>https://www.example.com/sitemap-blog.xml</loc></sitemap>
  <sitemap><loc>https://www.example.com/sitemap-tools.xml</loc></sitemap>
</sitemapindex>

A section that passes 50,000 URLs is split again into numbered files, such as sitemap-blog-1.xml. Each index entry carries the newest lastmod of the pages in that file. In Google Search Console, the Sitemaps report lists every file in an index on its own, and the Page indexing report can be filtered by sitemap, which shows which section of the site has indexing problems.

All files, including a sitemap.txt list, an HTML sitemap page grouped by folder, and a CSV crawl report, can be downloaded one by one or together as a ZIP.

robots.txt, sitemap location, and submission

Upload the files to the root of the site. The protocol limits a sitemap to URLs in its own folder and below, so the root covers the whole host. Then add a robots.txt sitemap line, which lets any crawler find the file without being told:

Sitemap: https://www.example.com/sitemap.xml

Submit the same address in Google Search Console and Bing Webmaster Tools. The generator shows the exact line for your host once the files are ready. After the upload, the sitemap validator reads the live file and confirms it matches the protocol.

What the crawl checks along the way

Limits of the crawl

Frequently asked questions

Is there a page limit?
A crawl covers up to 20,000 pages. By default it stops after 500 pages and 2 clicks from the start page, so a first run finishes quickly. Set Stop after to 1,000, 5,000, 10,000, 15,000, or 20,000 pages, and Max depth to a larger number or No limit, to crawl more of the site. Splitting the sitemap into sections gives each part of the site its own file under one sitemap index.
How long does a large site take?
It depends on how fast the site answers. The progress panel shows pages per minute. The crawl runs from your browser tab, so keep the tab open. The files can be downloaded at any time, even while the crawl is still running, and cover the pages found so far.
Why is a page missing from the sitemap?
Either no crawled page links to it, or it was left out: a redirect, an error status, a noindex tag, a canonical that points elsewhere, a robots.txt rule, a query string, the depth limit, or the page limit under Stop after. The Pages tab gives the reason for every URL. Turning on the current sitemap option also checks pages that are only listed there.
Can I split the sitemap into blog, tools, and category files?
Yes. Open the options and set Split into to Sections by folder or Sections from my rules. sitemap.xml then becomes a sitemap index that lists one file per section, such as sitemap-main.xml, sitemap-blog.xml, and sitemap-tools.xml. Rules like freelancing: /category/freelancing/ give each category its own file. The setting applies right away, even after the crawl.
What if the site has no sitemap yet?
The crawl works the same way, because pages are found by following links from the start page. When robots.txt lists no sitemap, the generator tries /sitemap.xml, /sitemap_index.xml, and /wp-sitemap.xml. If none of them has URLs, the progress panel says so and the crawl carries on. The file it produces can be uploaded as the site's first sitemap.
Does the crawler run JavaScript?
No. It reads links from the HTML each page returns. Links that only appear after a script runs are not found by following links, but they are still checked when they are listed in the site's current sitemap.
Should I add priority and changefreq?
Google documents that it ignores both values, so they are off by default. lastmod is on, and is only written when the page or the server gives a date.
Which robots.txt rules does it follow?
The crawler identifies itself as OGScopeBot. It follows the rules in a robots.txt group for OGScopeBot when one exists, and the * group otherwise, including Crawl-delay. You can turn this off for a site you own.
Is the crawl saved?
No. Each page is fetched by the OG Scope server and the result goes straight back to your browser. The URL list and the files exist only in this tab until you download them.