- Most duplicate content is technical, from URL variants, filters and parameters.
- Pick one preferred URL, then use redirects or canonical tags to consolidate.
- Rewrite pages that are similar by choice, such as city or product variants.
- Copied content from other sites is a different problem needing original writing.
What counts as duplicate content and why it matters
Duplicate content means substantial blocks of text that appear on more than one address, either inside your own site or across different sites. Inside a site it is usually accidental: the same page reachable with and without www, with a trailing slash and without, with tracking parameters, or through several category paths. Google can usually work out which version to show, but it may choose differently from you.
The cost is rarely a penalty. It is dilution. Links and signals spread across copies, crawl time is spent on pages that add nothing, and the wrong version can end up ranking. Deliberate scraping and mass copying to manipulate rankings is another matter, and can attract action under Google's spam policies. Check the current guidelines if you are in doubt.
Common sources and the usual remedy
Match the cause you find to the cleanest fix.
Source of duplication | Typical example | Preferred fix |
|---|---|---|
Protocol and host variants | http, https, www, non-www | 301 redirect to one version |
Trailing slash or case differences | /page and /page/ | Redirect and keep internal links consistent |
URL parameters and filters | ?sort=price, ?utm_source | Canonical tag to the clean URL |
Print or session versions | /page?print=1 | Canonical or block where suitable |
Product variants | Same item in many colours | Canonical or one page with variant options |
Syndicated or copied articles | Same post on another site | Canonical to original or rewrite |
Near-identical city or service pages | Same text with place swapped | Rewrite with real local detail |
A repair process you can follow
Work through these in order so you fix causes, not just symptoms.
- Find the duplicatesUse a crawler such as Screaming Frog or a site audit tool, and compare with the Pages report in Search Console. Look for repeated titles, matching body text and the status labelled duplicate, Google chose different canonical.
- Group them by causeSort into technical variants, near-identical pages made on purpose, and content copied from elsewhere. Each group needs a different fix.
- Choose the preferred URLPick the address you want ranked: usually the cleanest, best linked and most useful. Record the decision.
- Apply the right signalUse a 301 redirect when the old address should disappear, a canonical tag when it must stay accessible, and a rewrite when both pages deserve to exist.
- Clean up internal links and the sitemapLink only to the preferred URL and list only preferred URLs in your sitemap. Our lesson on sitemaps explains this.
- Recheck after recrawlInspect the URLs in Search Console and confirm Google now agrees on the canonical.
Choosing between redirect, canonical and rewrite
These three tools solve different problems.
301 redirect
Sends users and crawlers to a new address permanently. Use it when the duplicate has no reason to exist, such as an old URL after a restructure.
Canonical tag
Tells search engines which version you prefer while leaving both reachable. Good for filters, parameters and print versions. It is a hint, not a command.
Rewrite or merge
Needed when separate pages overlap in meaning. Combine thin pages into one strong page or make each distinct with unique information.
Noindex
Keeps a page out of search results while it stays accessible. Useful for internal search pages and thin utility pages, but do not combine it with canonicals carelessly.
Parameter handling
Keep tracking and sorting parameters out of internal links. Avoid creating new addresses when a filter is applied unless the page has real search value.
Robots.txt
Blocks crawling, not indexing by itself, and stops Google from seeing your canonical. Use it with care and not as a duplicate fix.
When similar pages are on purpose
Not all overlap is a fault. Product pages for sizes, location pages for branches and service pages for different audiences will share some wording. The test is whether each page has enough unique, useful content to justify existing. A branch page with its own address, team, opening hours, map and local FAQs is fine. A branch page that only changes the city name is not.
If you cannot add real differences, merge the pages into one and use sections or filters. This is often better for users too, since a visitor does not want to compare five near-identical pages. When in doubt, ask whether you would be happy for a customer to land on either page and whether Google could tell them apart.
Where pages must stay near-identical, as with a printable version or a paid-campaign landing page, use a canonical tag or noindex so the working page is the one that appears in search.
Duplicates on WordPress, WooCommerce and Shopify sites
Platforms create their own versions. WordPress can produce tag, category, author and date archives that repeat post excerpts. WooCommerce and Shopify often generate product addresses under several collections as well as the main product address. A good SEO plugin or theme setting will set canonicals, but check that it is configured and that it is not pointing every page to the home page by mistake.
Store owners should also watch for manufacturer descriptions reused by dozens of resellers. Rewriting those in your own words, with buyer questions and real details, gives Google a reason to prefer your page. Our ecommerce SEO services cover large catalogues where this becomes a major job.
Mistakes that make duplication worse
Avoid these when cleaning up.
- Canonicalising to an unrelated pageA canonical should point to a near-identical page. Otherwise Google ignores it.
- Redirect chainsOld to older to new wastes crawl and slows users. Point each old address straight to the final one.
- Blocking duplicates in robots.txtGoogle cannot read a canonical on a page it cannot crawl.
- Leaving internal links to the duplicateYour own links signal the wrong preference. Update them.
- Spinning text with softwareAutomated rewriting creates low-quality pages. Write original copy or merge the pages.
- Duplicating service pages per city with no local detailThis is the most common self-made duplication among local businesses in Pakistan and elsewhere.
Where this fits in your wider SEO work
Duplicate cleanup is part of technical hygiene, alongside crawl errors, speed and structured data. Read what technical SEO is for the rest of that list, and keyword cannibalization if your issue is two different pages chasing one phrase rather than identical copies.
If your site is large or you suspect hidden problems, our technical SEO services include a full crawl and a prioritised fix list. You can also contact us with your site address. Teams working from Lahore for clients in the UK, USA or UAE usually share findings in a simple spreadsheet so your developer can act on them straight away.

