REST API
Start crawls, check status, and retrieve results via a simple REST API. Compatible with any language or platform.
Crawler Cloud
Coming Soon
Section titled “Coming Soon”Crawler Cloud is a hosted crawling API that brings the power of crawler.sh to the cloud. Schedule crawls, receive results via webhooks, and manage everything through a dashboard - no infrastructure to manage.
Planned Features
Section titled “Planned Features”Scheduled Crawls
Set up recurring crawls on a schedule - daily, weekly, or custom intervals. Track changes over time.
Webhooks
Receive real-time notifications when crawls complete. Integrate with your existing pipelines.
Dashboard
Monitor crawl jobs, browse results, and manage your account through a web dashboard.
Stay Updated
Section titled “Stay Updated”We’re actively developing Crawler Cloud. Sign up for our newsletter on the crawler.sh homepage to get notified when it launches.