System One Bench

Head to head

Naluri-279M vs GPT-6 Luna Decisions

Naluri-279M scores 50.4 and GPT-6 Luna Decisions 76.0 on the System One Index. Naluri-279M is more accurate on 1 of 16 text datasets, GPT-6 Luna Decisions on 15. Same cases, same request, same scorer.

Overall

Naluri-279MGPT-6 Luna Decisions
System One Index50.476.0
English52.675.2
Arabic50.778.8
Vision Index–81.6
Calibration error8.3%9.8%
Median latency–215 ms
Cost per 1,000 calls–$0.040

Text datasets, accuracy

Naluri-279MGPT-6 Luna Decisions
AG News English77.587.5
SST-2 English77.093.5
SST-5 English34.061.5
DAIR Emotion English68.558.5
Banking77 English31.077.5
BoolQ English54.585.5
XNLI English English30.766.7
Typed decisions English47.371.0
XNLI French French31.362.0
XNLI Arabic Arabic30.754.0
MASSIVE scenario Arabic58.066.0
MASSIVE intent Arabic52.084.5
OSACT4 offensive Arabic82.593.5
Tweet sentiment Arabic53.080.0
MIRACL rerank Arabic28.086.0
MIRACL pairwise Arabic50.587.5

Image datasets, accuracy

Naluri-279MGPT-6 Luna Decisions
SST-2, as an image–88.5
Arabic sentiment, as an image–67.0
Oxford-IIIT Pet–87.0
VQAv2 yes/no–80.5
CountBench–85.0

Model pages: Naluri-279M · GPT-6 Luna Decisions. Latency for API models is the median per call through OpenRouter, timed from one machine.