How we built it.
We tried to replace a purpose-built document model with an off-the-shelf one. Four days, more than 5,300 benchmark pages and 272 experiments. Most of our ideas failed, and the biggest surprise came at the very end. Here is everything that happened.
- Chapter 1
The bet
Leave the model untouched and build the layer around it, so every new model is a free upgrade.
- Chapter 2
We measured before we built
Plain Haiku was already level with Reducto on reading. That changed everything that came next.
- Chapter 3
Our first layer made the model worse
Reading every page twice and refereeing scored below one plain read, at nine times the price.
- Chapter 4
We stopped trusting our own numbers
Cost was overstated four times, the AI judge misread numbers, and small samples flattered us.
- Chapter 5
272 ideas, and most of them failed
What the model does not give you: layout, forms, checks and citations. 75 ideas were dropped outright.
- Chapter 6
Meanwhile, making it usable in real work
Citations, confidence, long contracts, handwriting and large schemas, built from what teams ask for.
- Chapter 7
Then the full benchmarks overturned our results
On all 1,000 tables our lead disappeared. Only the complete benchmarks count.
- Chapter 8
Where we landed
Ahead on reading, level on tables and forms, behind on layout and speed, at half the price.