System One Bench

Head to head

Drex v1.5 vs Solar Decide Flash

Drex v1.5 scores 77.6 and Solar Decide Flash 63.6 on the System One Index. Drex v1.5 is more accurate on 14 of 16 text datasets, Solar Decide Flash on 2. Same cases, same request, same scorer.

Overall

Drex v1.5Solar Decide Flash
System One Index77.663.6
English77.661.3
Arabic77.066.5
Vision Index––
Calibration error10.8%14.4%
Median latency198 ms586 ms
Cost per 1,000 calls$0.010$0.042

Text datasets, accuracy

Drex v1.5Solar Decide Flash
AG News English90.086.0
SST-2 English94.590.5
SST-5 English53.544.5
DAIR Emotion English53.554.5
Banking77 English87.01.0
BoolQ English89.086.0
XNLI English English88.765.3
Typed decisions English64.862.5
XNLI French French82.061.3
XNLI Arabic Arabic74.052.0
MASSIVE scenario Arabic58.546.0
MASSIVE intent Arabic77.563.0
OSACT4 offensive Arabic90.584.5
Tweet sentiment Arabic63.565.5
MIRACL rerank Arabic89.071.5
MIRACL pairwise Arabic86.083.0

Model pages: Drex v1.5 · Solar Decide Flash. Latency for API models is the median per call through OpenRouter, timed from one machine.