Skip to content
Gridlode
LiveWeb pages and crawling2 credits / request

Sitemap Parser API

Every page URL listed in a website's XML sitemaps, with last-modified date, change frequency and priority. Give a sitemap URL, or just a domain and the sitemaps are found through robots.txt or the usual locations. Follows sitemap index files, reads gzip (.xml.gz) and plain-text sitemaps, and fetches up to 20 sitemap files per call. Not charged when no sitemap is found.

GEThttps://api.gridlode.com/v1/url/sitemap
Get an API keyReference docs

Try it live

Try . Free, no account needed.

Parameters

NameTypeDescription
urlrequiredstringA sitemap URL (XML, .xml.gz or .txt), or a site root/domain to discover its sitemaps.
limitintegerMaximum number of page URLs to return.
Default: 1000
max_filesintegerMaximum number of sitemap files to fetch (index files count).
Default: 5
max_ageintegerAccept a cached answer up to this many seconds old, billed at 50%. Default 0 (always fresh).

Response fields

    Code

    curl "https://api.gridlode.com/v1/url/sitemap?url=https%3A%2F%2Fwww.sitemaps.org%2Fsitemap.xml&limit=100" \
  -H "Authorization: Bearer $GRIDLODE_KEY"
    2 credits per request
    One credit is $0.001 on the smallest pack, from $0.0003 on enterprise plans.
    Half price for cached data
    Cached for up to 6 h. Pass max_age to use it.
    Failed requests are free
    Blocks, timeouts and target errors never cost credits.

    Market reference: TabAPI Sitemap Extractor: 2 credits ($2.00/1k).

    Questions

    Part of these solutions
    How much does the Sitemap Parser API cost?

    2 credits per request. One credit costs $0.001 on the smallest pack and as little as $0.0003 on enterprise plans. Cached answers cost half and failed calls are free.

    Web pages and crawling

    Related APIs in this category

    All 13 in Web pages and crawling · 13 live
    Live

    URL to Markdown

    The main content of a web page as clean Markdown (boilerplate, navigation and ads removed) with title, description, author, publish date and language

    1 credit / requestTry freeDocs
    Live

    Website Crawler (Markdown for RAG)

    Crawl a website from a start URL (and optionally its XML sitemap) and get every page back as clean Markdown with title, description, language, word…

    1 credit / pageDocs
    Live

    Screenshot

    A screenshot of any public web page, rendered in real Chrome with JavaScript

    2 credits / requestTry freeDocs
    Live

    Page HTML

    The raw HTML of any public web page with final URL, status code, redirect chain and key headers

    1 credit / requestTry freeDocs
    Live

    Broken Link Checker

    Crawl a website and check every internal and external link for 404s, server errors, timeouts and redirect chains

    1 credit / pageTry freeDocs