JevMade

Sign in
← Back to experiments

Benchmarks & research

Sarvam Prism

Sarvam Prism is an open-weight decision model built on Sarvam 105B: give it a situation, some questions and their options, and it returns a probability for each option in one pass instead of writing an answer.

Bookmark: Sarvam Prism Keep this in your collection.
Leave a noteWhat would you try with this? : Sarvam Prism

Only you can see your notes.

Source screenshot of Sarvam Prism
SOURCE SCREENSHOTFull screenshot ↗

What it does

In Sarvam's own 25-model study it averaged 71.8 at a 44 ms median on one B200, the best score under 100 ms; mammoth-1 and GLiDE 1.2 scored higher but answered more slowly. Sarvam says Prism's confidence runs slightly cautious and its answers held when options were shuffled. Nobody outside Sarvam has evaluated it yet. The Apache 2.0 weights need one GPU with at least 120 GB, and the hosted API takes text only, with no images or streaming.

How you can use it

You can have a developer connect your app to Sarvam Prism using an access key. Your app sends a description of a situation alongside a question and between two and 255 choices. Instead of writing out a long answer, Prism scores each choice with a probability in one fast step.

This works well for quick multiple-choice decisions that require immediate answers. Keep in mind that Prism only works with text, so it cannot evaluate images. Running the open model yourself also requires a very large computer graphics card with at least 120 gigabytes of memory.

Maker-reported (not independently measured by JevMade)

Sarvam's 25-model study, averaging the Jev Decision Index, Sarvam's recreation of the Artificial Analysis Decision Index and an Indian-languages set: Prism 71.8 at a 44 ms median on one B200, the highest under 100 ms. mammoth-1 (75.2 at 284 ms) and GLiDE 1.2 (73.2 at 116 ms) score higher but are slower; Jev 1.14 scored 64.5. · Indian languages (10 Indian languages and Hinglish, per Sarvam): Prism 82.5. · Calibration on answers given with ≥90% confidence (Sarvam): English 3.3% expected errors vs 2.2% actual (Jev 1.14: 1.3% vs 3.5%); Indian languages 5.4% vs 4.4%. · Sarvam reports unchanged answers across shuffled option orders on 2,000 questions, after sorting options into one fixed order before scoring. · Training loss: cross-entropy with 5% label smoothing plus a Brier loss. Median latency went from 664 ms (BF16, two B200s) to 44 ms (FP8, grouped expert kernel, CUDA Graph, merged adapter), 15×. · A LoRA fine-tune of Sarvam 105B, a mixture-of-experts model with 128 experts and 10.3B active parameters (Sarvam 105B model card). · Hosted API: POST /v2/systemone with noul, choice and score questions; 32,768 tokens per question and 2–255 choice options. Sarvam's Token Factory lists ₹4.00 per 1M input tokens and ₹0.00 output, excluding GST.

Primitives
noul, choice, score
Platform
Open weights (FP8, one GPU with ≥120 GB) / Sarvam API
Added

Keep this for later

Sign in to bookmark experiments, guides and videos, and keep notes only you can see.

Continue to sign in

We’ll bring you back to this listing.