System One Bench

Head to head

Solar Decide vs d3 edge

Solar Decide scores 68.8 and d3 edge 65.9 on the System One Index. Solar Decide is more accurate on 12 of 16 text datasets, d3 edge on 4. Same cases, same request, same scorer.

Overall

Solar Decided3 edge
System One Index68.865.9
English64.769.1
Arabic73.762.2
Vision Index––
Calibration error20.3%18.7%
Median latency715 ms–
Cost per 1,000 calls$0.042–

Text datasets, accuracy

Solar Decided3 edge
AG News English86.080.0
SST-2 English91.580.5
SST-5 English53.539.5
DAIR Emotion English54.057.0
Banking77 English1.090.0
BoolQ English87.079.5
XNLI English English74.784.0
Typed decisions English69.942.3
XNLI French French67.366.0
XNLI Arabic Arabic58.059.3
MASSIVE scenario Arabic55.541.0
MASSIVE intent Arabic75.055.0
OSACT4 offensive Arabic86.072.5
Tweet sentiment Arabic71.561.5
MIRACL rerank Arabic84.570.0
MIRACL pairwise Arabic85.576.0

Model pages: Solar Decide · d3 edge. Latency for API models is the median per call through OpenRouter, timed from one machine.