Searches town by town for family and school shoe shops, checks each result, and adds the shops it can verify to the directory.
Web Scraping & Crawling
Footwear retail
Pipeline
Productised
Local/private
2025
The problem
A new directory starts with no retailers, so its nearby-shop pages are empty. Family and school shoe shops are not on one official list. Filling them in meant searching each town, opening each result and typing the name, address and phone by hand.
What it does
You give it a list of places. For each place it searches the web for family and school shoe shops, opens each result and asks Anthropic Claude to pull out a tidy shop record. Records that pass the check are added, with address and contact where the page has them. It was an early way to fill the shop list, was later joined by a broader map import, and still runs as a top-up where the map data is thin.
Outcomes
An empty directory gains real shop entries from a list of towns.
Address and phone are captured when the page has them.
Shops already stored are not added twice.
Simplified mockup
Interactive preview with sample data. Nothing is sent to a server.
Place list
Places in this batch
8
Already done
1
Brackmere yesterday
Next place
Reedmouth
family and school shoes
Towns
Reedmouth is next. The other six are still queued.
Place
County
Progress
Reedmouth
Suffolk
Next
Halebrook
Northumberland
Queued
Kilnford
Gloucestershire
Queued
Brackhaven
Devon
Queued
Quarry End
County Durham
Queued
Lowfen
Devon
Queued
Brackmere
North Yorkshire
Done, 1 new
Millcourt
Carmarthenshire
Queued
Pinkney Yard Fitting
Verified
12 Pinkney Street Reedmouth AA9 1XX
01632 960 014
Children’s fitting room and school shoes.
East Green Shoes
Verified
4 East Green Reedmouth AA9 1XX
01632 960 208
Family shop. Measures in the store.
High Street Fashion Co
Rejected
Market Place Reedmouth No full address
No phone on the page
Fashion chain. No children’s fitting.
Shop table
Insert writes the two Reedmouth shops that passed. A second pass on the same town must add nothing.
Already stored
Shop
Place
Phone
Status
Malt Kiln Shoes
8 Malt Kiln Lane Brackmere, AA9 2XX
01632 960 019
Stored yesterday
This insert
Waiting to insert the verified pair.
Added from Reedmouth Done, 2 new
Shop
Address
Phone
Status
Pinkney Yard Fitting
12 Pinkney Street Reedmouth, AA9 1XX
01632 960 014
New
East Green Shoes
4 East Green Reedmouth, AA9 1XX
01632 960 208
New
Second pass
Run again after the insert to prove duplicates are skipped.
0 new, 2 already stored
Pinkney Yard Fitting and East Green Shoes are already in the shop table. High Street Fashion Co stays rejected. Reedmouth is not written a second time.
Structured check
Reedmouth · 3 pages opened
Each opened page becomes a shop record. A fashion chain with no children’s fitting fails the check.
Field
Pinkney Yard Fitting
East Green Shoes
High Street Fashion Co
Place
Reedmouth
Reedmouth
Reedmouth
Address
12 Pinkney Street
4 East Green
Market Place, incomplete
Postcode
AA9 1XX
AA9 1XX
Not on the page
Phone
01632 960 014
01632 960 208
Not on the page
School shoes
Yes
Yes
No
Children’s fitting
Yes
Yes
No
Decision
Keep
Keep
Reject
How it works
Read a list of towns or places.
Search the web for family and school shoe shops in each place.
Open each result and ask Anthropic Claude for a tidy shop record.
Keep records that pass the check.
Add new shops and skip ones already stored.
Pipeline
flowchart LR
A[Place list] --> B[Web search]
B --> C[Open result]
C --> D[Structured shop]
D --> E[Verify]
E --> F[Insert shop]