Desktop & CLI

Download crawler.sh

Desktop app or command-line tool. Free to use - crawl up to 50 pages with no account required, or 400 when signed in.

Both the CLI and the desktop app share the same Rust-powered crawling engine. The desktop app gives you a visual dashboard with live crawl progress, SEO issue charts, and one-click exports. The CLI is built for automation, scripting, and CI/CD pipelines. Choose the interface that fits your workflow, or use both - one subscription covers everything.

macOS

Universal binary for Apple Silicon & Intel

Linux

x86_64 & ARM64 - .deb package

Windows

A native Windows desktop build is in progress. In the meantime, the Linux CLI binary runs cleanly under WSL2 and gives you the full crawl, export, and SEO command set on Windows today.

Install the CLI

Prefer the command line? Install with a single command - works on macOS (Apple Silicon and Intel) and Linux (x86_64 and ARM64). The installer detects your platform automatically and places the binary in your PATH.

curl -fsSL https://install.crawler.sh | sh

Requires macOS 12+ or a modern Linux distribution. The CLI binary is a single static executable with no dependencies.

System requirements

macOS: macOS 12 Monterey or later, Apple Silicon or Intel. The desktop app and CLI ship as a universal binary, so the same download works on both architectures.
Linux: a recent x86_64 or ARM64 distribution with glibc 2.31+ (Ubuntu 20.04, Debian 11, Fedora 35, and newer). The CLI is a single static executable and the desktop app ships as a .deb package.
Disk and memory: roughly 80 MB of disk for the desktop app, under 20 MB for the CLI. Memory use scales with crawl size and concurrency, but typical crawls of a few thousand pages stay well under 1 GB.
Network: outbound HTTP(S) access to the sites you crawl. No background telemetry is sent and crawl data never leaves your machine.

First run

1. Install. Run the CLI installer above or open the desktop installer and drag the app into Applications.
2. Sign in (optional). You can crawl up to 50 pages per session without an account. Signing in raises the free limit to 400 pages and links the CLI and desktop app to the same plan.
3. Run a crawl. Try crawler crawl https://your-site.com from the terminal, or paste a URL into the desktop app. The first crawl writes a .crawl file to your working directory that you can inspect, export, or feed into the SEO command.