Crawler LogoCrawler.sh

Privacy Policy

Last updated: January 14, 2025

We value your privacy and are committed to protecting your personal information. This policy explains what data we collect, how we use it, and what rights you have.

What We Collect

Crawler runs locally on your machine. Your crawl data, results, and exported files never leave your computer unless you explicitly share them.

If you create an account or subscribe to Pro, we collect:

  • Email address - used for authentication (one-time login codes) and service-related communication such as subscription confirmations.
  • Subscription status - used to determine your tier and page limits.
  • Authentication tokens - stored locally on your device in ~/.crawler/auth.json (CLI) or browser storage (desktop app). These tokens are used to verify your identity with our API.

We do not collect browsing history, crawl targets, crawl results, or any content extracted from websites you crawl.

How We Use Your Data

Your email address and account information are used exclusively to:

  • Authenticate your identity when you sign in
  • Manage your subscription and enforce tier-based page limits
  • Send transactional emails (login codes, subscription receipts)

We do not send marketing emails unless you explicitly opt in through our newsletter signup. We do not sell, rent, or share your personal data with third parties for advertising or marketing purposes.

Third-Party Services

We use the following services to operate crawler.sh:

  • Authentication and API - our API processes login requests and manages account data.
  • Payment processing - subscription payments are handled by a third-party payment processor. We do not store credit card numbers or payment details on our servers.

Data Retention

Account data is retained for as long as your account is active. If you delete your account, we remove your email address and associated records from our systems. Crawl data is stored locally on your machine and is never uploaded to our servers.

Data Security

We use encryption in transit (HTTPS/TLS) for all communication between your device and our API. Authentication tokens are generated with secure random values and expire after a set period.

GDPR Compliance

If you are located in the EU, you have the right to access, update, or delete your personal data at any time. To make a request, contact us at support@crawler.sh. We process data in accordance with the GDPR and only retain it as long as necessary for the services you use. We will respond to data requests within 30 days.

Cookies

Our website uses essential cookies to enable basic functionality like login sessions and user preferences. We do not use third-party tracking cookies or advertising pixels. Analytics, if any, are privacy-respecting and do not track individual users across sites.

Children’s Privacy

Crawler.sh is not directed at children under 13. We do not knowingly collect personal information from children. If you believe a child has provided us with personal data, please contact us and we will delete it.

Changes to This Policy

We may update this privacy policy from time to time. When we make changes, we will update the “last updated” date at the top of this page. We encourage you to review this policy periodically.

Contact

For any questions or concerns about your data or this privacy policy, contact us at support@crawler.sh.