System One Bench

Head to head

GPT-6 Luna Decisions vs Classify-1

GPT-6 Luna Decisions scores 76.0 and Classify-1 30.6 on the System One Index. GPT-6 Luna Decisions is more accurate on 15 of 16 text datasets, Classify-1 on 1. Same cases, same request, same scorer.

Overall

GPT-6 Luna DecisionsClassify-1
System One Index76.030.6
English75.230.7
Arabic78.830.6
Vision Index81.6–
Calibration error9.8%3.2%
Median latency215 ms254 ms
Cost per 1,000 calls$0.040$0.018

Text datasets, accuracy

GPT-6 Luna DecisionsClassify-1
AG News English87.526.5
SST-2 English93.550.0
SST-5 English61.513.0
DAIR Emotion English58.559.0
Banking77 English77.51.0
BoolQ English85.538.0
XNLI English English66.730.7
Typed decisions English71.027.2
XNLI French French62.030.7
XNLI Arabic Arabic54.030.7
MASSIVE scenario Arabic66.03.0
MASSIVE intent Arabic84.53.5
OSACT4 offensive Arabic93.580.0
Tweet sentiment Arabic80.035.0
MIRACL rerank Arabic86.012.0
MIRACL pairwise Arabic87.550.0

Image datasets, accuracy

GPT-6 Luna DecisionsClassify-1
SST-2, as an image88.5–
Arabic sentiment, as an image67.0–
Oxford-IIIT Pet87.0–
VQAv2 yes/no80.5–
CountBench85.0–

Model pages: GPT-6 Luna Decisions · Classify-1. Latency for API models is the median per call through OpenRouter, timed from a cloud server with 8 calls in flight.