Umbra
The benchmark for cognitive simulation
Survey benchmarks check the answers synthetic people give. Umbra checks what they do: choices, response times, mood, confidence, whether one person stays the same across tasks, and whether many add up to a population. Nine tasks on public data, scored against free baselines, a language model and the human ceiling, with our own model under the same rules.
Dan Andrei · October 2026 · Benchmark, v0.1