System One Bench

Head to head

Decider V1.2 vs Solar Decide Flash

Decider V1.2 scores 84.6 and Solar Decide Flash 63.6 on the System One Index. Decider V1.2 is more accurate on 16 of 16 text datasets, Solar Decide Flash on 0. Same cases, same request, same scorer.

Overall

Decider V1.2Solar Decide Flash
System One Index84.663.6
English82.061.3
Arabic86.966.5
Vision Index83.8–
Calibration error0.7%14.4%
Median latency178 ms586 ms
Cost per 1,000 calls$0.007$0.042

Text datasets, accuracy

Decider V1.2Solar Decide Flash
AG News English91.586.0
SST-2 English95.590.5
SST-5 English60.044.5
DAIR Emotion English60.054.5
Banking77 English88.01.0
BoolQ English91.586.0
XNLI English English94.065.3
Typed decisions English75.162.5
XNLI French French90.061.3
XNLI Arabic Arabic90.052.0
MASSIVE scenario Arabic79.046.0
MASSIVE intent Arabic91.063.0
OSACT4 offensive Arabic95.084.5
Tweet sentiment Arabic75.565.5
MIRACL rerank Arabic86.571.5
MIRACL pairwise Arabic91.583.0

Image datasets, accuracy

Decider V1.2Solar Decide Flash
SST-2, as an image94.5–
Arabic sentiment, as an image57.0–
Oxford-IIIT Pet85.5–
VQAv2 yes/no86.5–
CountBench95.5–

Model pages: Decider V1.2 · Solar Decide Flash. Latency for API models is the median per call through OpenRouter, timed from a cloud server with 8 calls in flight.