System One Bench

Head to head

Drex v2.0 vs Solar Decide Flash

Drex v2.0 scores 78.6 and Solar Decide Flash 63.6 on the System One Index. Drex v2.0 is more accurate on 16 of 16 text datasets, Solar Decide Flash on 0. Same cases, same request, same scorer.

Overall

Drex v2.0Solar Decide Flash
System One Index78.663.6
English77.861.3
Arabic79.666.5
Vision Index––
Calibration error1.5%14.4%
Median latency294 ms586 ms
Cost per 1,000 calls$0.015$0.042

Text datasets, accuracy

Drex v2.0Solar Decide Flash
AG News English88.086.0
SST-2 English94.090.5
SST-5 English56.044.5
DAIR Emotion English55.554.5
Banking77 English80.51.0
BoolQ English92.586.0
XNLI English English87.365.3
Typed decisions English68.762.5
XNLI French French77.361.3
XNLI Arabic Arabic71.352.0
MASSIVE scenario Arabic63.546.0
MASSIVE intent Arabic82.563.0
OSACT4 offensive Arabic94.584.5
Tweet sentiment Arabic69.565.5
MIRACL rerank Arabic87.071.5
MIRACL pairwise Arabic89.083.0

Model pages: Drex v2.0 · Solar Decide Flash. Latency for API models is the median per call through OpenRouter, timed from a cloud server with 8 calls in flight.