duplicate descriptions

Pages sharing the same meta description compete for clicks in search results

What it is

crawler.sh flags duplicate meta descriptions when multiple pages share the exact same <meta name="description"> content. Pages are grouped by their canonical URL before comparison. This is check #16 in the SEO analysis.

Why it matters for SEO

Duplicate descriptions indicate a lack of page-level optimization:

  • Identical snippets - When multiple pages show the same description in search results, users can’t distinguish between them.
  • Template remnants - Duplicate descriptions often signal that pages are using a site-wide default instead of page-specific copy.
  • Missed differentiation - Each page has unique content worth summarizing. A shared description fails to communicate what makes each page valuable.

Why it matters for AEO

AI answer engines evaluate page uniqueness when selecting sources. If multiple pages on your site have the same description, the AI may treat them as near-duplicates and only cite one. Unique descriptions help AI systems understand the distinct purpose of each page.

Note: Like duplicate title detection, crawler.sh groups pages by canonical URL before checking for duplicate descriptions. Canonicalized variants of the same page won’t trigger false positives.

How to fix it

Write a unique description for each page that summarizes its specific content:

Common causes:

  • CMS templates using the same default meta description
  • Auto-generated pages (filters, pagination) inheriting the parent description
  • Forgotten placeholder descriptions

Guidelines:

  • Each page should have a description unique to its content
  • Focus on what makes each page different
  • Audit template-generated pages for missing overrides

What crawler.sh reports

In the CLI, duplicate descriptions appear under the “Duplicate descriptions” section of crawler seo output, showing the shared description and all affected URLs. In the desktop app, they appear in the SEO Issues card.

Crawler.sh - Free Local AEO & SEO Spider and a Markdown content extractor | Product Hunt