Webcrawler API
Webcrawler API · Developer tools
Website crawling into clean markdown for AI, with JavaScript rendering
The client pastes their API key from Webcrawler API's settings. We store it encrypted.
Tested against Webcrawler API's live API.
Building with Webcrawler API? The docs have setup steps and code for every tool.
Open the Webcrawler API docsTools
Your agent calls any endpoint of Webcrawler API's API with the request tool, with the client's access attached.
Base URL for request
https://api.webcrawlerapi.com
request
HTTPS ANY /v1/clients/{clientId}/webcrawler-api/{path}
Any endpoint of Webcrawler API's own API, with the client's access attached.
- servicestringrequired
- This service: webcrawler-api
- methodstringrequired
- GET, POST, PUT, PATCH or DELETE
- pathstringrequired
- The path under https://api.webcrawlerapi.com
- queryobjectoptional
- Query parameters
- bodyobjectoptional
- A JSON body
Over MCP every tool also takes client_id, from list_clients. Over HTTPS send it as clientId to https://api.operate.as/v1.
What the client approves
- Use the Webcrawler API key you paste, with only the access you gave that key
Get started
Send your next client one link
Add a client, select the services, copy the link. You'll get an email the moment their access is ready. Start free, no card required. Paid plans are one flat monthly price, and a busy month never takes your agents offline.