Press & Media
crawler.sh has been recognized by leading tech communities and publications. Here is where we have been featured.
About crawler.sh
crawler.sh is a fast, Rust-built web crawler and SEO auditing tool that runs entirely on your own machine. It ships as a command-line interface for automation and CI pipelines, and as a desktop app with a visual dashboard, live crawl progress, SEO issue charts, and one-click exports to JSON, sitemap XML, and clean Markdown. The free tier crawls up to 400 pages per session for signed-in users and the $99 per year Pro plan raises that to 10,000 pages and unlocks the Content Archive export. crawler.sh is built and maintained by Mehmet Kose.
Boilerplate (short)
crawler.sh is a local-first web crawler and SEO auditor for developers, technical SEOs, and content teams. Available as a command-line tool and a desktop app for macOS and Linux, it crawls up to 10,000 pages per session, renders JavaScript, and exports results as NDJSON, JSON, sitemap XML, or Markdown.
Boilerplate (long)
crawler.sh is a local-first web crawler and SEO auditing tool built in Rust. It ships in two forms: a command-line interface designed for automation, CI pipelines, and shell workflows, and a desktop app with a visual dashboard that shows live crawl progress, status code distributions, redirect chains, broken outgoing links, content freshness signals, and a full SEO issue breakdown across more than twenty checks. Both surfaces share the same crawling engine and produce the same NDJSON output, so results are portable between the two and easy to diff over time. Pages can be exported as JSON, W3C-compliant sitemap XML, or clean Markdown for downstream use in retrieval pipelines, LLM context, or content audits. Because every crawl runs on the user's own machine, no page content, target URL, or report is transmitted to a third party. The product is free for crawls up to 400 pages per session for signed-in users, and the $99 per year Pro plan raises the cap to 10,000 pages and unlocks the Content Archive Markdown export. crawler.sh is built and maintained by Mehmet Kose, with the source available on the roadmap and changelog pages of the project website.
Founder
crawler.sh is designed and built by Mehmet Kose, an independent software developer. He is available for written interviews, podcast appearances, and quotes on technical SEO, local-first tooling, web crawling at scale, and the trade-offs between hosted and on-device developer tools. Email info@crawler.sh to arrange an interview or request a higher-resolution headshot.
Brand Assets
Download our logos for use in press coverage, articles, and partner materials. Please use the logos as provided and do not alter, rotate, or recolor them.
App Icon (512px)
App icon - 512x512 PNG
Click to download
Icon (SVG)
Scalable vector icon with gradient
Click to download
Icon
Standalone icon mark
Click to download
Icon (dark)
Icon for light backgrounds
Click to download
Icon (light)
Icon for dark backgrounds
Click to download
Brand Colors
Our color palette is built around deep teal and green tones, reflecting reliability and precision.
Primary Dark
#0E423E
Primary brand color - used in logo and key elements
Foreground
#111111
Text and wordmark color
Accent Green
#6ECE5A
Accent color used for highlights and interactive elements
Background
#FFFFFF
Light mode background
Dark Background
#1A2E2C
Dark mode background
Usage guidelines
- Use the logos as provided. Do not alter, rotate, recolor, or apply effects to any of the brand assets.
- Refer to the product as "crawler.sh" in lowercase, with the dot. Avoid stylized variations like "Crawler SH" or "CrawlerSH".
- When attribution is helpful, link back to https://crawler.sh so readers can find the project.
- For interview requests, founder quotes, or higher-resolution assets, email info@crawler.sh and we will get back within one business day.
Press Inquiries
For press inquiries, interviews, or media requests, reach out to us directly.
info@crawler.sh