Skip to content
Gridlode
Docs · Reference

Sitemap Parser

GET /v1/url/sitemap2 credits / requestcache 360 min

Every page URL listed in a website's XML sitemaps, with last-modified date, change frequency and priority. Give a sitemap URL, or just a domain and the sitemaps are found through robots.txt or the usual locations. Follows sitemap index files, reads gzip (.xml.gz) and plain-text sitemaps, and fetches up to 20 sitemap files per call. Not charged when no sitemap is found.

Query parameters

url
string · required
A sitemap URL (XML, .xml.gz or .txt), or a site root/domain to discover its sitemaps.
limit
integer
Maximum number of page URLs to return.
Default: 1000
max_files
integer
Maximum number of sitemap files to fetch (index files count).
Default: 5
max_age
integer
Accept a cached answer up to this many seconds old, billed at 50%.

Response data fields

    Example

    curl "https://api.gridlode.com/v1/url/sitemap?url=https%3A%2F%2Fwww.sitemaps.org%2Fsitemap.xml&limit=100" \
  -H "Authorization: Bearer $GRIDLODE_KEY"

    Try it without code on the Sitemap Parser API page.