Command Palette

Search for a command to run...

UnylyUnyly
Browse all

Crawl

FreeUnpublished

AI-powered web crawler — self-hosted Firecrawl alternative. Crawl, extract, render JS, search. CLI + MCP + REST API + Dashboard.

andreihasna2by andreihasna2
GitHubEmbed

About

AI-powered web crawler — self-hosted Firecrawl alternative. Crawl, extract, render JS, search. CLI + MCP + REST API + Dashboard.

Install Crawl in Claude Desktop, Claude Code & Cursor

Recommended · one command, every IDE
unyly install crawl

Installs into Claude Desktop, Claude Code, Cursor & VS Code — handles npx, uvx and build-from-source repos for you.

First time? Get the CLI: curl -fsSL https://unyly.org/install | sh

Or configure manually

Run in your terminal:

claude mcp add crawl --env EXA_API_KEY="" --env HASNA_CRAWL_AWS_REGION="" --env HASNA_CRAWL_DATABASE_URL="" --env HASNA_CRAWL_S3_BUCKET="" --env HASNA_CRAWL_S3_PREFIX="" --env MCP_HTTP="" -- npx -y @hasna/crawl

Step-by-step: how to install Crawl

Install Crawl in Claude DesktopInstall Crawl in Claude CodeInstall Crawl in CursorInstall Crawl in VS Code

FAQ

Is Crawl MCP free?

Yes, Crawl MCP is free — one-click install via Unyly at no cost.

Does Crawl need an API key?

Yes, it requires environment variables: EXA_API_KEY, HASNA_CRAWL_AWS_REGION, HASNA_CRAWL_DATABASE_URL, HASNA_CRAWL_S3_BUCKET, HASNA_CRAWL_S3_PREFIX, MCP_HTTP. Unyly injects them into the config during install.

Is Crawl hosted or self-hosted?

Self-hosted: the server runs locally on your machine via the install command above.

How do I install Crawl in Claude Desktop, Claude Code or Cursor?

Open Crawl on unyly.org, pick your client tab (Claude Desktop, Claude Code, Cursor) and press Install — the config is generated automatically, no JSON editing.

Changes

Versions and requested access over time.

  • New version published
  • New version published
  • New version published

Related MCPs

Playwright

Browser automation, scraping, screenshots

Microsoftby Microsoft

Puppeteer

Browser automation and web scraping.

modelcontextprotocolby modelcontextprotocol

Garmin Connect

An MCP server for Garmin Connect that provides access to fitness activities, health statistics, and sleep data by routing requests through a headless browser to

etweisbergby etweisberg

Higgsfield Unlimited

MCP server for Higgsfield AI that enables unlimited-mode image, video, audio generation, uploads, and job management via multiple parallel accounts, using brows

nukIeerby nukIeer

opentabs-dev/opentabs

Plugin-based server and Chrome extension that gives AI agents access to web apps through your authenticated browser session, with a plugin SDK.

opentabs-devby opentabs-dev

hlydecker/ucsc-genome-mcp

Interact with the UCSC Genome Browser API to find genomes, chromosomes and more.

hlydeckerby hlydecker

34892002/bilibili-mcp-js

Search Bilibili content, with LangChain integration examples.

34892002by 34892002

achiya-automation/safari-mcp

Native Safari browser automation without a Chrome dependency.

achiya-automationby achiya-automation

agent-infra/mcp-server-browser

Browser automation using Puppeteer, supporting local and remote browser connections.

bytedanceby bytedance

aparajithn/agent-scraper-mcp

Web scraping: clean content extraction, CSS-selector scraping, Playwright screenshots, link and metadata extraction, and Google search.

aparajithnby aparajithn

Compare Crawl with

CrawlvsPlaywrightCrawlvsPuppeteerCrawlvsGarmin ConnectCrawlvsHiggsfield UnlimitedCrawlvsopentabs-dev/opentabsCrawlvshlydecker/ucsc-genome-mcpCrawlvs34892002/bilibili-mcp-jsCrawlvsachiya-automation/safari-mcpCrawlvsagent-infra/mcp-server-browserCrawlvsaparajithn/agent-scraper-mcp

Not sure what to pick?

Find your stack in 60 seconds

Author?

Embed badge for your README

Browse similar

All browse MCPs