Installation Guide for CLI & Desktop App
CLI Installation
Section titled “CLI Installation”curl -fsSL https://install.crawler.sh | shDownloads the correct binary for your platform (macOS ARM64 or x64) and installs it to ~/.crawler/bin/. The script automatically adds this directory to your PATH in your shell config files (.zshrc, .bashrc, etc.).
Restart your shell or run:
export PATH="$HOME/.crawler/bin:$PATH"CRAWLER_INSTALL_DIR=/opt/crawler curl -fsSL https://install.crawler.sh | shSet CRAWLER_INSTALL_DIR to install to a custom location instead of ~/.crawler.
Verify installation
Section titled “Verify installation”crawler --helpYou should see the available subcommands: crawl, info, export, and seo.
CLI Uninstall
Section titled “CLI Uninstall”-
Remove the binary and install directory
Section titled “Remove the binary and install directory”rm -rf ~/.crawlerIf you used a custom install directory, remove that instead.
-
Clean up PATH entries
Section titled “Clean up PATH entries”Remove the
# crawler.shblock from your shell config files:~/.zshrc~/.bashrc~/.bash_profile~/.profile~/.config/fish/config.fish(if using fish)
Each file will have a block like:
# crawler.shexport PATH="$HOME/.crawler/bin:$PATH"Delete those lines, then restart your shell.
Desktop App
Section titled “Desktop App”Download the macOS desktop app (universal binary for ARM64 + Intel):
To uninstall, drag Crawler from your Applications folder to the Trash.
System Requirements
Section titled “System Requirements”- macOS - Apple Silicon (M1/M2/M3/M4) or Intel
Next Steps
Section titled “Next Steps”- Crawler CLI - command-line workflows, examples, and tutorials
- Crawler Desktop - dashboard walkthrough and features