Skip to content
Wajo
← All Fieldnotes

Category

Research

How we measure agent capability: evaluation environments, benchmarks, and what they reveal.

Latest in Research

2 posts

Trust rate against task completion, each system shown by its logo. Fo sits top right at 71% completion and 94% trust. Muse and Instinct were not measured and are placed by judgment.
Research8 min read

Trust and Task Completion in the World of Consumer AI Agents

Assistants that act can let their users down in two ways: doing what the user never agreed to, or giving up on errands that get hard. We built an evaluation that scores both on the same runs, and used it to measure Fo against three base models and two open-source assistants, OpenClaw and Hermes.

Wajo team
A pixel-art street scene split down the middle. On the left a warm, ordinary high street of shops; on the right the same street redrawn as a blue blueprint, its shopfronts renamed as software files. Fo stands on the dividing line between them.
Research7 min read

The Simulated World Where Agents Act

Wajo builds Action Agents — agents that guarantee outcomes, not just tokens. Agents acting in the physical world can't be graded on text alone. So we built a world where they take real action: real accounts, synthetic websites, simulated voice callers on a foreign voice stack. Fo, one of our products, hillclimbs in it.