Skip to content
ScreenshotDude

Use cases · Content API

What teams build with the Content API

Clean HTML, Markdown, links and metadata power search, AI and monitoring pipelines.

Use case 01

RAG & knowledge-base ingestion

Feed clean, main-content Markdown into your vector database instead of noisy HTML.

The challenge

Raw HTML is full of navigation, cookie notices and scripts that waste tokens and pollute embeddings.

How it works

Request Markdown with Defuddle enabled, keep only the fields you need, then chunk and embed. Use the sitemap output to discover every page to ingest.

  • include_markdown=true
  • use_defuddle=true
  • fields=data.markdown,data.metadata.title
curl -G "https://api.screenshotdude.com/v1/content" \
  --data-urlencode "url=https://docs.example/getting-started" \
  -d include_markdown=true -d use_defuddle=true \
  -d fields=data.markdown,data.metadata.title \
  -H "x-api-key: $SCREENSHOTDUDE_API_KEY"
Use case 02

SEO audits

Check titles, descriptions, canonicals, Open Graph tags and structured data across a whole site.

The challenge

SEO tags are often injected client-side, so simple HTTP fetchers report false negatives.

How it works

The Content API reads metadata from the rendered page, including schema.org JSON-LD, so audits reflect what search engines and social networks see.

  • data.metadata
  • schemaOrg
  • canonical
  • lang
curl -G "https://api.screenshotdude.com/v1/content" \
  --data-urlencode "url=https://shop.example/product/42" \
  -d fields=data.metadata \
  -H "x-api-key: $SCREENSHOTDUDE_API_KEY"
Use case 03

Price & change monitoring

Track prices, stock and copy changes on product pages over time.

The challenge

E-commerce pages render prices with JavaScript and often block basic scrapers.

How it works

Fetch Markdown on a schedule with stealth mode and a regional proxy, diff it against the previous run and alert on changes.

  • include_markdown=true
  • stealth=true
  • proxy
  • block_resources=image,media,font
curl -G "https://api.screenshotdude.com/v1/content" \
  --data-urlencode "url=https://store.example/item/123" \
  -d include_markdown=true -d stealth=true \
  -d block_resources=image,media,font \
  --data-urlencode "proxy=http://user:pass@fr.proxy.example:8080" \
  -H "x-api-key: $SCREENSHOTDUDE_API_KEY"
Use case 05

News & content aggregation

Aggregate articles from many publishers into a consistent format.

The challenge

Every publisher uses a different layout, and paywall or consent overlays get in the way.

How it works

Defuddle extracts the article body as Markdown; metadata gives you the title, author, image and language to build cards.

  • use_defuddle=true
  • remove_cookie_banners=true
  • metadata.author
  • metadata.ogImage
curl -G "https://api.screenshotdude.com/v1/content" \
  --data-urlencode "url=https://news.example/2026/11/story" \
  -d include_markdown=true -d use_defuddle=true \
  -d remove_cookie_banners=true \
  -H "x-api-key: $SCREENSHOTDUDE_API_KEY"
Use case 06

Site migrations

Inventory every URL and its content before moving to a new CMS.

The challenge

Old CMSs rarely export clean content, and you need a full URL list for redirects.

How it works

Pull the sitemap once, then extract HTML and Markdown for each URL asynchronously with a webhook to avoid timeouts.

  • include_sitemap=true
  • include_html=true
  • is_async=true
  • webhook_url
curl -G "https://api.screenshotdude.com/v1/content" \
  --data-urlencode "url=https://legacy.example" \
  -d include_sitemap=true -d fields=data.sitemap \
  -H "x-api-key: $SCREENSHOTDUDE_API_KEY"
Explore the Content API

Start capturing in minutes

Create a free account and get 100 free screenshots every month. No credit card required.

Start for free See pricing