ScrAPI
Created 5 months ago
MCP server for using ScrAPI to scrape web pages.
What is ScrAPI?
Web scraping using [ScrAPI](https://scrapi.tech). Extract website content that is difficult to access because of bot detection, captchas or even geolocation restrictions.
Documentation
Tools
scrape_url_html- Use a URL to scrape a website using the ScrAPI service and retrieve the result as HTML. Use this for scraping website content that is difficult to access because of bot detection, captchas or even geolocation restrictions. The result will be in HTML which is preferable if advanced parsing is required.
- Input:
url(string) - Returns: HTML content of the URL
scrape_url_markdown- Use a URL to scrape a website using the ScrAPI service and retrieve the result as Markdown. Use this for scraping website content that is difficult to access because of bot detection, captchas or even geolocation restrictions. The result will be in Markdown which is preferable if the text content of the webpage is important and not the structural information of the page.
- Input:
url(string) - Returns: Markdown content of the URL
Setup## API Key (optional)
Optionally get an API key from the ScrAPI website. Without an API key you will be limited to one concurrent call and twenty free calls per day with minimal queuing capabilities.
Cloud Server
The ScrAPI MCP Server is also available in the cloud over SSE at https://api.scrapi.dev/sse. Cloud MCP servers are not widely supported yet but you can access this directly from your own custom clients or use MCP Inspector to test it. There is currently no facility to pass through your API key when connecting to the cloud MCP server.
Usage with Claude Desktop
Add the following to your claude_desktop_config.json:
Docker
{ "mcpServers": { "scrapi": { "command": "docker", "args": [ "run", "-i", "--rm", "-e", "SCRAPI_API_KEY", "deventerprisesoftware/scrapi-mcp" ], "env": { "SCRAPI_API_KEY": "" } } } }
NPX
{ "mcpServers": { "scrapi": { "command": "npx", "args": [ "-y", "@deventerprisesoftware/scrapi-mcp" ], "env": { "SCRAPI_API_KEY": "" } } } }
Build
Docker build:
docker build -t deventerprisesoftware/scrapi-mcp -f Dockerfile .
Server Config
{
"mcpServers": {
"scrapi-server": {
"command": "npx",
"args": [
"scrapi"
]
}
}
}