# Choosing among many options benchmark · Kai — Hanzo AI

> Accuracy at each number of listed options, every option scored, the same cases put to both models.

[Benchmarks](https://hanzo.ai/benchmarks) / [Kai](https://hanzo.ai/benchmarks?product=Kai#all) / Choosing among many options

Kai · Capability

# Choosing among many options

Accuracy at each number of listed options, every option scored, the same cases put to both models.

## Latest

[94.3%Accuracy · kai-1.4 · c1856a77 · 4 optionsJev 90.5% · Win · Oct 16, 2026 · Hanzo-measured](#history)

[92.0%Accuracy · kai-1.4 · c1856a77 · 16 optionsJev 85.3% · Win · Oct 16, 2026 · Hanzo-measured](#history)

[88.0%Accuracy · kai-1.4 · c1856a77 · 77 optionsJev 84.3% · Win · Oct 16, 2026 · Hanzo-measured](#history)

## History

3 results, newest first. Superseded runs stay, so a revision's progress can be read.

Measured

Subject

Metric

Value

Baseline

Result

Status

Oct 16, 2026

kai-1.4 · c1856a77 · 4 options

Accuracy

94.3%

Jev 90.5%

Win

Live · Hanzo-measured

Oct 16, 2026

kai-1.4 · c1856a77 · 16 options

Accuracy

92.0%

Jev 85.3%

Win

Live · Hanzo-measured

Oct 16, 2026

kai-1.4 · c1856a77 · 77 options

Accuracy

88.0%

Jev 84.3%

Win

Live · Hanzo-measured

## Conditions

choice sizes: 4, 16, 77every option scoredJev: typesafe/jev-1.13, measured Sep 27, 2026

## Hardware

CPU F32-Q8_0 on evo

## Source

[research run cap.cardinality-cases-kai-1.4.c1856a77-kai](https://api.hanzo.ai/v1/research/runs?org=hanzo&id=cap.cardinality-cases-kai-1.4.c1856a77-kai)

## Reproduce

`bench cap --harness . --who kai,jev --kai # in hanzoai/benchmarks/decision`

## More Kai benchmarks

[AG News](https://hanzo.ai/benchmarks/kai-ag-news) · [DAIR Emotion](https://hanzo.ai/benchmarks/kai-dair-emotion) · [Banking77](https://hanzo.ai/benchmarks/kai-banking77) · [Support triage](https://hanzo.ai/benchmarks/kai-support-triage) · [Email spam](https://hanzo.ai/benchmarks/kai-email-spam) · [Phishing](https://hanzo.ai/benchmarks/kai-phishing) · [Toxicity](https://hanzo.ai/benchmarks/kai-toxicity) · [RAG relevance](https://hanzo.ai/benchmarks/kai-rag-relevance) · [Model routing](https://hanzo.ai/benchmarks/kai-model-routing) · [Typed decisions](https://hanzo.ai/benchmarks/kai-typed-decisions) · [MASSIVE](https://hanzo.ai/benchmarks/kai-massive) · [Latency of one decision](https://hanzo.ai/benchmarks/kai-latency)

[Every result for Choosing among many options on the shelf](https://hanzo.ai/benchmarks?q=Choosing%20among%20many%20options#all) · [How these are measured](https://hanzo.ai/benchmarks#methods)