Firecrawl
Firecrawl automates web crawling and data extraction, enabling organizations to gather content, index sites, and gain insights from online sources at scale
What agents can do
Actions7
Cancel a crawl job
Cancels an active or queued web crawl job using its id; attempting to cancel completed, failed, or previously canceled jobs will not change their state.
Crawl
Initiates a firecrawl web crawl from a given url, applying various filtering and content extraction rules, and polls until the job is complete; ensure the url is accessible and any regex patterns for…
Extract
Extracts structured data from web pages by initiating an extraction job and polling for completion; requires a natural language `prompt` or a json `schema` (one must be provided).
Get the status of a crawl job
Retrieves the current status, progress, and details of a web crawl job, using the job id obtained when the crawl was initiated.
Map multiple urls based on options
Maps a website by discovering urls from a starting base url, with options to customize the crawl via search query, subdomain inclusion, sitemap handling, and result limits; search effectiveness is…
Scrape
Scrapes a publicly accessible url, optionally performing pre-scrape browser actions or extracting structured json using an llm, to retrieve content in specified formats.
Search
Performs a web search for a query, scrapes content from the top search results using firecrawl, and returns details in specified formats.
How it connects
You paste an API key from Firecrawl on a page Composio hosts, so the key never passes through Definable.
Keep the connection to yourself or share it with your workspace. Any action that writes or sends can wait for your approval.
More in Web Scraping & Browser
Agenty
web scraping & browser
Agenty is a web scraping and automation platform that enables users to extract data, monitor changes, and automate browser tasks without coding.
Browser Use
web scraping & browser
Browser Use Cloud provides hosted browser agents, managed browser sessions, workspaces, profiles, and integrations for automating web tasks.
Apify
web scraping & browser
Apify is a platform for building, deploying, and managing web scraping and automation tools, known as Actors.
Anakin
web scraping & browser
Anakin provides web scraping, crawling, search, browser automation, monitoring, and pre-built website actions for AI agents.
Hyperbrowser
web scraping & browser
Hyperbrowser is a next-generation platform empowering AI agents and enabling effortless, scalable browser automation.
TinyFish
web scraping & browser
TinyFish provides web automation, live search, content extraction, research, browser sessions, reusable browser profiles, and run management through native REST APIs.