What to measure before you launch an agent
Separate task success, mistakes, time and cost before you build a leaderboard.
Alex Vale ↗
THE PUBLICATION
Field notes, not hype.
Ideas for building AI
that earns its place in the workflow.
Give agents a clear stopping point
Completion should be observable, and retries should have limits.
Noor Stone ↗
Compare models on the same work
Keep inputs and evaluation consistent when choosing a model.
Noor Stone ↗