System One Bench

Head to head

Span-02 vs Solar Decide Flash

Span-02 scores 79.5 and Solar Decide Flash 63.6 on the System One Index. Span-02 is more accurate on 16 of 16 text datasets, Solar Decide Flash on 0. Same cases, same request, same scorer.

Overall

Span-02Solar Decide Flash
System One Index79.563.6
English77.961.3
Arabic82.366.5
Vision Index86.1–
Calibration error10.5%14.4%
Median latency204 ms586 ms
Cost per 1,000 calls$0.005$0.042

Text datasets, accuracy

Span-02Solar Decide Flash
AG News English86.586.0
SST-2 English95.590.5
SST-5 English57.544.5
DAIR Emotion English56.054.5
Banking77 English82.01.0
BoolQ English90.086.0
XNLI English English83.365.3
Typed decisions English72.162.5
XNLI French French73.361.3
XNLI Arabic Arabic66.052.0
MASSIVE scenario Arabic71.046.0
MASSIVE intent Arabic86.063.0
OSACT4 offensive Arabic97.084.5
Tweet sentiment Arabic76.065.5
MIRACL rerank Arabic88.571.5
MIRACL pairwise Arabic91.583.0

Image datasets, accuracy

Span-02Solar Decide Flash
SST-2, as an image92.5–
Arabic sentiment, as an image70.0–
Oxford-IIIT Pet92.5–
VQAv2 yes/no87.0–
CountBench88.5–

Model pages: Span-02 · Solar Decide Flash. Latency for API models is the median per call through OpenRouter, timed from a cloud server with 8 calls in flight.