Extract URLs from any XML sitemap

Find a site's sitemaps from robots.txt and list their URLs with last-modified dates. Handles sitemap indexes and gzip.

Try . Free, no account needed.

Need this at scale?

The same lookup is one API call at 2 credits / request (one credit is $0.0003 to $0.001 depending on volume), with failed requests free.

cURL

curl "https://api.gridlode.com/v1/url/sitemap?url=https%3A%2F%2Fwww.sitemaps.org%2F" \
  -H "Authorization: Bearer $GRIDLODE_KEY"

What if a site has no sitemap?

We check robots.txt and the usual /sitemap.xml locations. If none exist, use the link extractor to discover pages.