About Services Tools Blog Contact us

High-street Shoe Shop Discovery

Searches town by town for family and school shoe shops, checks each result, and adds the shops it can verify to the directory.

  • Web Scraping & Crawling
  • Footwear retail
  • Pipeline
  • Productised
  • Local/private
  • 2025

The problem

A new directory starts with no retailers, so its nearby-shop pages are empty. Family and school shoe shops are not on one official list. Filling them in meant searching each town, opening each result and typing the name, address and phone by hand.

What it does

You give it a list of places. For each place it searches the web for family and school shoe shops, opens each result and asks Anthropic Claude to pull out a tidy shop record. Records that pass the check are added, with address and contact where the page has them. It was an early way to fill the shop list, was later joined by a broader map import, and still runs as a top-up where the map data is thin.

Outcomes

  • An empty directory gains real shop entries from a list of towns.
  • Address and phone are captured when the page has them.
  • Shops already stored are not added twice.

Simplified mockup

Interactive preview with sample data. Nothing is sent to a server.

Place list

Places in this batch
8
Already done
1
Brackmere yesterday
Next place
Reedmouth
family and school shoes
Towns
Reedmouth is next. The other six are still queued.
PlaceCountyProgress
ReedmouthSuffolkNext
HalebrookNorthumberlandQueued
KilnfordGloucestershireQueued
BrackhavenDevonQueued
Quarry EndCounty DurhamQueued
LowfenDevonQueued
BrackmereNorth YorkshireDone, 1 new
MillcourtCarmarthenshireQueued

Shop table

Insert writes the two Reedmouth shops that passed. A second pass on the same town must add nothing.

Already stored
ShopPlacePhoneStatus
Malt Kiln Shoes8 Malt Kiln Lane
Brackmere, AA9 2XX
01632 960 019Stored yesterday
This insert
Waiting to insert the verified pair.
Second pass
Run again after the insert to prove duplicates are skipped.

Structured check

Reedmouth · 3 pages opened

Each opened page becomes a shop record. A fashion chain with no children’s fitting fails the check.

FieldPinkney Yard FittingEast Green ShoesHigh Street Fashion Co
PlaceReedmouthReedmouthReedmouth
Address12 Pinkney Street4 East GreenMarket Place, incomplete
PostcodeAA9 1XXAA9 1XXNot on the page
Phone01632 960 01401632 960 208Not on the page
School shoesYesYesNo
Children’s fittingYesYesNo
DecisionKeepKeepReject

How it works

  1. Read a list of towns or places.
  2. Search the web for family and school shoe shops in each place.
  3. Open each result and ask Anthropic Claude for a tidy shop record.
  4. Keep records that pass the check.
  5. Add new shops and skip ones already stored.

Pipeline

flowchart LR
  A[Place list] --> B[Web search]
  B --> C[Open result]
  C --> D[Structured shop]
  D --> E[Verify]
  E --> F[Insert shop]