System One Bench

Head to head

Drex v2.0 vs GPT-6 Luna Decisions

Drex v2.0 scores 78.6 and GPT-6 Luna Decisions 76.0 on the System One Index. Drex v2.0 is more accurate on 10 of 16 text datasets, GPT-6 Luna Decisions on 6. Same cases, same request, same scorer.

Overall

Drex v2.0GPT-6 Luna Decisions
System One Index78.676.0
English77.875.2
Arabic79.678.8
Vision Index–81.6
Calibration error1.5%9.8%
Median latency294 ms215 ms
Cost per 1,000 calls$0.015$0.040

Text datasets, accuracy

Drex v2.0GPT-6 Luna Decisions
AG News English88.087.5
SST-2 English94.093.5
SST-5 English56.061.5
DAIR Emotion English55.558.5
Banking77 English80.577.5
BoolQ English92.585.5
XNLI English English87.366.7
Typed decisions English68.771.0
XNLI French French77.362.0
XNLI Arabic Arabic71.354.0
MASSIVE scenario Arabic63.566.0
MASSIVE intent Arabic82.584.5
OSACT4 offensive Arabic94.593.5
Tweet sentiment Arabic69.580.0
MIRACL rerank Arabic87.086.0
MIRACL pairwise Arabic89.087.5

Image datasets, accuracy

Drex v2.0GPT-6 Luna Decisions
SST-2, as an image–88.5
Arabic sentiment, as an image–67.0
Oxford-IIIT Pet–87.0
VQAv2 yes/no–80.5
CountBench–85.0

Model pages: Drex v2.0 · GPT-6 Luna Decisions. Latency for API models is the median per call through OpenRouter, timed from a cloud server with 8 calls in flight.