System One Bench

Head to head

Kev 0.8B vs Drex Max

Kev 0.8B scores 63.6 and Drex Max 84.1 on the System One Index. Kev 0.8B is more accurate on 1 of 16 text datasets, Drex Max on 15. Same cases, same request, same scorer.

Overall

Kev 0.8BDrex Max
System One Index63.684.1
English71.082.8
Arabic54.984.5
Vision Index––
Calibration error4.3%6.2%
Median latency–277 ms
Cost per 1,000 calls–$0.021

Text datasets, accuracy

Kev 0.8BDrex Max
AG News English91.090.5
SST-2 English90.096.0
SST-5 English47.059.0
DAIR Emotion English56.065.0
Banking77 English80.590.5
BoolQ English76.093.0
XNLI English English81.395.3
Typed decisions English46.373.0
XNLI French French66.091.3
XNLI Arabic Arabic58.789.3
MASSIVE scenario Arabic38.573.0
MASSIVE intent Arabic51.588.0
OSACT4 offensive Arabic49.093.5
Tweet sentiment Arabic57.069.0
MIRACL rerank Arabic62.589.5
MIRACL pairwise Arabic67.089.5

Model pages: Kev 0.8B · Drex Max. Latency for API models is the median per call through OpenRouter, timed from a cloud server with 8 calls in flight.