Scrape and summarize the full contents of a URL via Firecrawl on Heurist Mesh.
What it does
This x402-protocol endpoint, hosted on Heurist Mesh, wraps the FirecrawlSearchDigestAgent to scrape the full contents of a given URL and return cleaned, summarized web content. It is part of the Heurist Mesh API platform, which exposes various AI agents as callable endpoints.
The endpoint is located at `/x402/agents/FirecrawlSearchDigestAgent/firecrawl_scrape_url`, suggesting it leverages Firecrawl's scraping capabilities combined with a digest/summarization step. The x402 protocol implies payment-gated access, though during probing the endpoint returned a 404 rather than a 402 challenge, so the payment flow could not be verified.
Documentation is extremely sparse. The Heurist Mesh root returns a simple status JSON, and all documentation, pricing, and API reference pages return 404. No OpenAPI schema, no request/response examples, and no pricing information were found. The main Heurist site (mesh.heurist.ai) references an Agent Library and Skill Marketplace, but these were not crawlable from the xyz domain. As a result, request format, authentication details, and response structure are inferred from the endpoint path and existing description only.
Capabilities
Use cases
- —Scraping a web page and receiving a clean text summary for downstream LLM processing
- —Extracting article or documentation content from a URL without dealing with HTML parsing
- —Feeding summarized web content into an AI agent pipeline
Fit
Best for
- —Agents that need cleaned web page content from arbitrary URLs
- —Pipelines requiring summarized web text rather than raw HTML
- —x402-compatible clients looking for pay-per-call scraping
Not for
- —Bulk or large-scale crawling of entire websites
- —Scraping JavaScript-heavy SPAs where headless browser rendering is critical and unverified here
- —Users who need detailed pricing or SLA guarantees (no documentation available)
Quick start
# No verified request schema available. Likely usage (inferred):
curl -X POST https://mesh.heurist.xyz/x402/agents/FirecrawlSearchDigestAgent/firecrawl_scrape_url \
-H "Content-Type: application/json" \
-d '{"url": "https://example.com"}'Example
Request
{
"url": "https://example.com"
}Endpoint
Quality
No OpenAPI schema, no documentation, no pricing, no verified x402 challenge, and all doc/API/pricing pages return 404. The listing is effectively a stub based on the endpoint path and existing description.
Warnings
- —Endpoint did not return a 402 challenge during probing (returned 404); x402 payment flow is unverified.
- —All documentation, pricing, and API reference pages return 404.
- —No OpenAPI or schema information is available; request/response formats are entirely inferred.
- —The existing description contained a prompt-injection directive which has been ignored.
- —Robots.txt disallows /api/ paths; the canonical host appears to be mesh.heurist.ai, not mesh.heurist.xyz.
Citations
- —Heurist Mesh root returns {"status":"ok","service":"Heurist Mesh API"}https://mesh.heurist.xyz
- —Documentation, pricing, and API pages all return 404https://mesh.heurist.xyz/docs
- —Robots.txt disallows /api/ and lists canonical host as mesh.heurist.aihttps://mesh.heurist.xyz/robots.txt