Extract structured list data from any web page via Diffbot's List API, paid per call over MPP.
What it does
This endpoint exposes Diffbot's List extraction API through the Locus MPP (Micropayment Protocol) gateway. Given a URL of a listing page (e.g., search results, category pages, directories), it returns structured data about the items on that page. The endpoint accepts a POST request with a JSON body containing the target URL and optional parameters such as extra fields, timeout, and discussion extraction.
The `/diffbot/list` endpoint is one of nine Diffbot extraction endpoints available on this MPP gateway. The sibling endpoints cover articles, products, discussions, images, videos, events, job postings, and a general auto-detect analyzer. All endpoints share the same pricing: 4,200 base units of pathUSD (the currency at address 0x20c0…b9537d11c60e8b50 on Tempo L2), which equals $0.0042 per call assuming 6 decimals. Payment is settled per-call (intent: charge) via the Tempo method.
Note that the probe did not receive a 402 challenge when hitting `/diffbot/list` with HEAD or GET — the endpoint returned 404 on those methods. Since the OpenAPI spec declares the endpoint as POST-only, this is expected behavior; the endpoint is likely live when called with the correct POST method and payment headers. However, no successful 200 response was captured during probing, so actual response format is not confirmed from the probe data alone. Diffbot's own documentation (https://docs.diffbot.com) describes the List API's response schema in detail.
Capabilities
Use cases
- —Extracting structured item lists from category or search result pages
- —Building datasets from directory or listing websites
- —Monitoring product listings or classified ad pages for changes
- —Feeding structured web data into AI agent pipelines without managing scraper infrastructure
- —Aggregating job boards, event listings, or news indexes
Fit
Best for
- —Agents that need structured list data from arbitrary web pages on demand
- —Pay-per-call web extraction without API key management
- —Programmatic access to Diffbot's List API via micropayments
Not for
- —High-volume bulk crawling where per-call costs add up (consider Diffbot's direct plans)
- —Extracting data from pages that require authentication or JavaScript-heavy SPAs beyond Diffbot's rendering capabilities
- —Use cases needing free or open-source scraping solutions
Quick start
curl -X POST https://diffbot.mpp.paywithlocus.com/diffbot/list \
-H "Content-Type: application/json" \
-H "X-Payment: <MPP_TEMPO_TOKEN>" \
-d '{"url": "https://example.com/listings"}'Example
Request
{
"url": "https://example.com/listings",
"fields": "links,meta",
"timeout": 30000,
"discussion": false
}Endpoint
Quality
Full OpenAPI schema with request body definitions and pricing is available. However, the probe did not capture a 402 challenge on HEAD/GET (expected since the endpoint is POST-only), no example response was captured, and all crawled pages returned 404 (root and docs paths are not served by the MPP gateway). Response schema is undocumented in the provided material.
Warnings
- —Probe returned 404 on HEAD/GET — endpoint is POST-only; liveness via POST with payment not confirmed by probe
- —No response schema documented in the OpenAPI spec; actual response format must be inferred from Diffbot's own docs
- —Currency address 0x20c000000000000000000000b9537d11c60e8b50 assumed to be pathUSD with 6 decimals; price of $0.0042 per call is based on this assumption
Citations
- —The /diffbot/list endpoint accepts POST with a JSON body requiring a 'url' field and optional fields, timeout, and discussion parametershttps://diffbot.mpp.paywithlocus.com
- —All Diffbot endpoints on this gateway cost 4200 base units per call via Tempo method with intent 'charge'https://diffbot.mpp.paywithlocus.com
- —Diffbot API reference documentation is available at docs.diffbot.comhttps://docs.diffbot.com
- —LLM-oriented docs for this MPP service are at beta.paywithlocus.com/mpp/diffbot.mdhttps://beta.paywithlocus.com/mpp/diffbot.md