/ writing / media

Substack is 2M newsletters. Read them like a database.

2026-09-04 · cynix · 3 min read

Substack hosts over 2 million newsletters, and the most-used competitor actor on the store has pulled north of 95,000 runs — the demand is proven. The public archive endpoint serves any publication's posts without an API key.

The Substack Newsletter Scraper reads that endpoint and returns rich, clean post rows.

{ "publication": "everything", "maxPosts": 20 }

Each row carries the title, subtitle, body, author, publish date, audience, and both the canonical and shareable URLs:

{
  "publication": "everything",
  "post_id": "180254272",
  "title": "How large language models view our world",
  "subtitle": "“What's really interesting about neural networks is the way that they operate is a lot like human intuition”",
  "published_at": "2025-11-29T16:00:23Z",
  "audience": "everyone",
  "url": "https://bigthinkmedia.substack.com/cp/180254272"
}

Why this over the website

You can't diff a newsletter's back-catalogue by hand, or keep a research corpus current. Point it at a publication, pull up to N recent posts, and you have a structured feed you can search, embed, or feed into an LLM — no pagination fiddling.

Use it for

Competitor / trend monitoring across a niche's newsletters, building a reading corpus, sentiment or topic analysis on an industry, or archiving a publication you follow. The subtitle + body give you substance, not just headlines.

Try it: Substack Newsletter Scraper on Apify — keyless post feed.