Bluefield
Web scraping API for developers
Bluefield is a web scraping API that fetches any public URL and returns clean markdown, HTML, structured JSON, or screenshots through a single REST endpoint.
What is a web scraping API?
A web scraping API turns URLs into machine readable content over HTTP so your application never runs its own headless browser fleet.
- Scrape
- Fetch one URL and return extracted content in your chosen format.
- Crawl
- Discover and scrape many pages on a site asynchronously.
- Watch mode
- Subscribe to a URL and receive a webhook when meaningful content changes.
Bluefield capabilities
| Capability | Detail |
|---|---|
| POST /scrape | Markdown, HTML, links, screenshot, structured JSON, changeTracking |
| POST /map | Discover URLs via robots.txt and sitemaps |
| POST /crawl | Async BFS crawl with per page billing |
| POST /search | Web search with optional full page extraction |
| Attestation | Signed, verifiable captures on every live fetch. |
Frequently asked questions
- How is Bluefield different from building your own scraper?
- Bluefield handles rendering, extraction, bot resistance, and output formatting. You call one API instead of operating browsers and parsers.
- What formats does the scrape endpoint return?
- Markdown, HTML, plain text, links, PNG screenshots, and structured JSON against your schema.
- Is there a free tier?
- Yes. 1,000 credits per month with no credit card required.