Extract discussion threads and comments from any URL via Diffbot's Discussion API, paid per call over MPP.
What it does
This endpoint provides access to Diffbot's Discussion extraction API through the Locus MPP (Micropayment Protocol) gateway. Given a URL pointing to a discussion page (forum thread, comment section, review page, etc.), it returns structured data about the discussion including individual posts, authors, timestamps, and threading information.
The `/diffbot/discussion` endpoint is one of nine Diffbot extraction endpoints available on this MPP service. It accepts a POST request with a JSON body containing the target URL and optional parameters such as custom fields, timeout, pagination control (`paging`, `maxPages`), and whether to extract nested discussion threads. Each call costs 4,200 base units of pathUSD (approximately $0.0042) settled via the Tempo method on the Tempo L2 network.
Note that the probe did not receive a 402 challenge when hitting this specific endpoint with HEAD/GET — the endpoint expects POST requests per the OpenAPI spec. The root domain returns 404 by design, directing callers to the skill file. Response schema details are not documented in the OpenAPI spec, but Diffbot's own documentation at docs.diffbot.com describes the Discussion API output format in detail.
Capabilities
Use cases
- —Extracting structured comment threads from news articles or blog posts
- —Scraping forum discussions for sentiment analysis or research
- —Monitoring product review threads across multiple pages
- —Building datasets of user-generated discussion content for NLP tasks
- —Aggregating community feedback from discussion boards
Fit
Best for
- —Agents needing structured discussion/comment data from arbitrary URLs
- —Pay-per-call web extraction without managing API keys directly
- —Multi-page forum thread extraction with automatic pagination
Not for
- —Bulk crawling thousands of pages (per-call pricing adds up)
- —Extracting non-discussion content types (use sibling endpoints like /diffbot/article or /diffbot/product instead)
Quick start
curl -X POST https://diffbot.mpp.paywithlocus.com/diffbot/discussion \
-H "Content-Type: application/json" \
-d '{"url": "https://example.com/forum/thread/12345"}'Example
Request
{
"url": "https://example.com/forum/thread/12345",
"paging": true,
"timeout": 30000,
"maxPages": 5
}Endpoint
Quality
OpenAPI spec is present with clear request schema and pricing info, but no response schema is documented. The probe did not capture a 402 challenge (endpoint expects POST, probe used HEAD/GET). No crawl content was retrievable beyond 404 error pages. Diffbot is a well-known service, but the MPP wrapper docs are thin.
Warnings
- —Probe did not receive a 402 MPP challenge — endpoint requires POST method, which was not probed
- —No response schema documented in the OpenAPI spec
- —All crawled pages returned 404; no additional documentation available from the gateway itself
- —Currency address 0x20c000000000000000000000b9537d11c60e8b50 assumed to be pathUSD with 6 decimals based on Tempo method context — price ~$0.0042 per call
Citations
- —The endpoint is documented in the OpenAPI spec as POST /diffbot/discussion with charge intent, Tempo method, amount 4200https://diffbot.mpp.paywithlocus.com
- —Diffbot API reference is available at docs.diffbot.comhttps://docs.diffbot.com
- —LLM-oriented docs are referenced at https://beta.paywithlocus.com/mpp/diffbot.mdhttps://beta.paywithlocus.com/mpp/diffbot.md