About Services Tools Blog Contact us

Handwritten Specification Reader

Reads a photographed handwritten fit sheet for a footwear style into labelled fields, including which yes or no box was circled.

  • Document Understanding & OCR
  • Footwear retail
  • Pipeline
  • Productised
  • Local/private
  • 2025

The problem

Buyers still fill in a paper fit sheet for each style. Retyping the date, materials, fastening, width and circled yes or no boxes holds up the product record. A misread tick is hard to spot afterwards.

What it does

Once an image is recognised as a document, a local Ollama vision model (LLaVA) transcribes it against the blank form. The instructions list the expected lines, so the answer follows the sheet. The text is kept with the original file location, so the product photos that follow can be filed against it.

Outcomes

  • Paper fit sheets become a field list without retyping.
  • Yes and no boxes are written out as words, so no tick is ambiguous.
  • The product photos that follow stay tied to the right sheet.
  • A failed read stops the batch, so no blank style is filed.

Simplified mockup

Interactive preview with sample data. Nothing is sent to a server.

Handwritten Specification Reader

Intake sheet
Photographed fit sheet for style Harrow Court, repairable circled yes

Two documents in today’s intake. The blank form is the shape of the answer.

Read

A local vision model follows the printed lines. A circle becomes the word yes or no. A smeared line stops the photographs that follow.

Two sheets are waiting

Photographs that follow the sheet

HW-1842 Harrow Court 3 filed

Labelled from the clear read. Width G, repairable yes, tan full grain.

Tan lace shoe, side view, on a light ground
Lateral
Brown commando sole, tread facing the camera
Sole
Tan leather swatch tagged HW-1842, width G
Swatch
HW-1847 Mill Lane held

Width line unreadable, so these frames stay in the hold folder and are not filed against a style.

Navy lace shoe, side view, held back from filing
Lateral · held
Dark rubber cup sole, held back from filing
Sole · held
Navy suede swatch tagged HW-1847, held back from filing
Swatch · held

Read queue

Sheets read this week
Recent sheets
SheetStyleWidthRepairablePhotosStatus
HW-1842Harrow CourtGyes3filed
HW-1847Mill Laneunreadableno0held
HW-1838Priory DerbyFyes3filed
HW-1831Quay BootGyes5filed
HW-1822Chapel LoaferEyes2thin read
HW-1816blank style0failed

How it works

  1. Label each image as a document or a product photograph.
  2. Send document images to the local vision model, with the blank form as the shape of the answer.
  3. List the lines in the instructions, from date and name through materials, fastening, width and weight.
  4. Write circled yes or no options out as words.
  5. Keep the text with the file location and use it as the label for the photographs that follow.
  6. Flag a weak or failed read and leave those photographs unfiled.

Pipeline

flowchart LR
  A["Sheet photo"] --> B["Confirm document"]
  B --> C["LLaVA on Ollama"]
  C --> D["Field list"]
  D --> E{"Readable?"}
  E -->|Yes| F["Label following photos"]
  E -->|No| G["Hold and warn"]

Output