About Services Tools Blog Contact us

Duplicate Catalogue Copy Report

Scans live product and search-result text for repeated paragraphs and bad lengths, and attaches a suggested unique version for review.

  • Data Merge & Cleaning
  • Footwear retail
  • Scheduled worker
  • Productised
  • Cloud
  • 2025

The problem

The same sentences and over-long search-result summaries spread across many products. The only check was a report that someone had to remember to run again, so the problem grew between runs.

What it does

A scheduled job lists each repeated paragraph with the products that share it and its character count. Text outside the length limit is listed beside it. Each match gets a suggested unique version, so the cleanup is a review and not a rewrite.

Outcomes

  • Repeated paragraphs are listed with every style that uses them.
  • Over-long meta lines are counted.
  • Accepting a suggestion removes that style from the list.
  • The report can be re-run after edits.

Simplified mockup

Interactive preview with sample data. Nothing is sent to a server.

Duplicate copy Run 18

Styles in scan
15
Sharing block A
4
Meta over 160
2
Last scan
3 days ago
Block A · 90 characters · 4 styles

Cushioned footbed and a grippy outsole for the school run, in a shape that lasts the term.

Fifteen descriptions
StyleKindCopyCharsFinding
Kite strap Product Cushioned footbed and a grippy outsole for the school run, in a shape that lasts the term. 90
Harbour penny Product Cushioned footbed and a grippy outsole for the school run, in a shape that lasts the term. 90
Moss gusset Product Cushioned footbed and a grippy outsole for the school run, in a shape that lasts the term. 90
Pebble court Product Cushioned footbed and a grippy outsole for the school run, in a shape that lasts the term. 90
Reed derby Product Plain derby in oak leather with a round toe and a stitched welt. 64 Unique
Holt chelsea Product Chelsea boot with elastic sides and a pull tab, in black calf. 62 Unique
Bramble sandal Product Sandal with two buckles and a cork footbed for warm terms. 58 Unique
Cinder mule Product Backless mule in taupe suede with a low block heel. 51 Unique
Fern brogue Product Brogue with a wingtip seam and a leather sole, in burgundy. 59 Unique
Quay boat Meta The quay boat shoe has a grippy sole, a cushioned footbed and a leather lining, made for wet weekends and the walk to school in the rain, with half sizes across a narrow and a wide fitting. 189 Over 160
Clover ballet Meta Clover ballet is a soft pump with an elastic throat and a slim sole, sold with spare ribbons and a note on which width suits a narrow heel and which size to order next term. 173 Over 160
Copper t-bar Meta Copper t-bar in polished leather, with one instep strap and a low heel, for smart school days and weekend visits. 113 In limit
Wren chukka Meta Wren chukka in sand suede with two eyelets, a crepe sole and a padded collar. 77 In limit
Candle plimsoll Meta Candle plimsoll with a vulcanised sole and a cotton lining, for indoor games and dry yards. 91 In limit
Puddle loafer Meta Puddle loafer in navy leather with a saddle seam and a leather sock. 68 In limit

Meta length

Limit 160
Quay boat 189

The quay boat shoe has a grippy sole, a cushioned footbed and a leather lining, made for wet weekends and the walk to school in the rain, with half sizes across a narrow and a wide fitting.

Suggested 90 Quay boat shoe with a grippy sole and a cushioned footbed, in half sizes for wet weekends.

Clover ballet 173

Clover ballet is a soft pump with an elastic throat and a slim sole, sold with spare ribbons and a note on which width suits a narrow heel and which size to order next term.

Suggested 71 Soft ballet pump with an elastic throat, spare ribbons and a slim sole.

Inside the limit
StyleMetaChars
Copper t-bar Copper t-bar in polished leather, with one instep strap and a low heel, for smart school days and weekend visits. 113
Wren chukka Wren chukka in sand suede with two eyelets, a crepe sole and a padded collar. 77
Candle plimsoll Candle plimsoll with a vulcanised sole and a cotton lining, for indoor games and dry yards. 91
Puddle loafer Puddle loafer in navy leather with a saddle seam and a leather sock. 68

Accepted suggestions

Dropped from a shared block
StyleReplacementWhen
Reed derby Plain derby in oak leather with a round toe and a stitched welt. 2 Oct
Holt chelsea Chelsea boot with elastic sides and a pull tab, in black calf. 9 Sep
Fern brogue Brogue with a wingtip seam and a leather sole, in burgundy. 28 Aug
Over-long metas cleared, last eight weeks

How it works

  1. Scan live product descriptions and search-result summaries.
  2. Group products that share the same paragraph.
  3. Flag summaries that are too long or too short.
  4. Attach a suggested unique sentence to each match.
  5. Run again after the catalogue changes and drop products that were accepted.

Pipeline

flowchart LR
  A[Catalogue] --> B[Scan]
  B --> C[Duplicates]
  B --> D[Length]
  C --> E[Suggest]
  E --> F[Review]
  F --> G[Rerun]