# firecrawl
> Scrape, crawl, search, and extract web data as LLM-ready content

## Summary
CLI for scraping, crawling, searching, and extracting web data into LLM-ready formats — supports AI agent mode, MCP integration, and multiple output formats.

## Capabilities
- Scrape individual webpages into Markdown, HTML, JSON, or screenshots
- Crawl entire domains systematically
- Web search with optional content scraping
- Map and discover all URLs on a website
- AI agent mode for autonomous natural language extraction
- JavaScript rendering with wait-for options
- Batch processing of multiple URLs
- MCP server integration for AI coding assistants
- Include/exclude tag filtering

## When to Use
- You need to scrape web content for LLM consumption
- You want to crawl a website and extract structured data
- You need web search results with full page content
- You want AI-powered autonomous data extraction

## When NOT to Use
- You need to scrape without an API key or internet access
- You only need simple HTTP requests (use curl)

## Key Flags
- `-f, --format`: Output format: markdown, html, json, links, images, screenshot, summary
- `--include-tags`: Only include specific HTML tags
- `--exclude-tags`: Exclude specific HTML tags
- `--wait-for`: Wait for JS rendering (milliseconds or CSS selector)
- `--limit`: Maximum number of pages to crawl

## Usage Patterns
### Scrape a page as Markdown
```
firecrawl scrape https://example.com -f markdown
```
Extract page content as clean Markdown

### Search the web
```
firecrawl search "best CLI tools 2026" --scrape
```
Search and optionally scrape the result pages

### Map a site
```
firecrawl map https://example.com
```
Discover all URLs on a website

### AI agent extraction
```
firecrawl agent "find all pricing plans on this site" --url https://example.com
```
Autonomous AI-powered data extraction

## Input / Output
- **stdout**: Extracted content in Markdown, HTML, JSON, or other formats

## Installation
- **npm**: `npm install -g firecrawl-cli`
- **npx**: `npx -y firecrawl-cli@latest init --all --browser`

## Related Tools
- [slacrawl](/tools/slacrawl) (complementary): Slack-specific data extraction to SQLite

---
Source: https://littlescripts.sh/tools/firecrawl-cli