How to Extract Clean Content From Any Website Sitemap
Ever needed to inventory every page on a website? Extract clean text content for AI training? Or audit meta tags across an entire domain?
I built a Sitemap Content Extractor that does exactly this — feed it a sitemap.xml URL and it crawls every page, extracting structured content.
What It Does
Parses sitemap indexes — follows nested sitemaps recursively
Handles gzip sitemaps —.xml.gzfiles work out of the box
Extracts full content — clean article text using trafilatura
Captures metadata — title, meta description, meta keywords, H1 headings
Word counts — for every page
URL filtering — include/exclude patterns via regex
How to Use It
You can run it directly on
No registration needed — just paste a sitemap URL and hit run.
What would you use a sitemap extractor for? Let me know in the comments!
SOCIAL SHARE CARD GENERATOR