JevMade

Sign in
← Back to experiments

Benchmarks & research

Surogate Rune

Surogate's Rune looks at text, a record or a picture and picks one of your answers, with a probability attached to every option it was offered.

Bookmark: Surogate Rune Keep this in your collection.
Leave a noteWhat would you try with this? : Surogate Rune

Only you can see your notes.

Source screenshot of Surogate Rune
SOURCE SCREENSHOTFull screenshot ↗

What it does

Version 3 is Google's Gemma 4 26B-A4B retrained for decisions and released under Apache-2.0 as 51.6 GB of weights. Hugging Face asks you to accept terms first, and the repository keeps a GGUF name although it now holds bf16 files. Switch on thinking and the questions it is unsure of get about five seconds of reasoning first.

How you can use it

Rune suits checks a business makes thousands of times, such as which team should take a bank complaint or whether an invoice matches its purchase order, even when the evidence is a scanned form or a photo. Surogate says that at its recommended setting the model's confidence tracks how often it is right, so confident answers can go through and the rest can go to a person.

Maker-reported (not independently measured by JevMade): Surogate's card reports 57.44 on Decision Index 0.2.1, second on the board as published on 26 September 2026 behind Jev 1.13 at 57.89, after the board's maintainers reproduced its run; the 59.2 it gives for thinking switched on is its own estimate. · On the Decision Index 0.3.1 board read on 10 October 2026, Rune v3 was 10th of 117 entrants at 57.43, with Jev third at 60.11. · On 1,196 image questions built in Image JevBench's format, Surogate reports 77.1% accuracy at the default image setting (83.4% with a larger image budget) against 71.8% for the untuned Gemma 4 model; this is its own run, not a leaderboard result.

Primitives
choice, noul, score
Platform
Surogate / Transformers / Hugging Face
Added
Project created

Keep this for later

Sign in to bookmark experiments, guides and videos, and keep notes only you can see.

Continue to sign in

We’ll bring you back to this listing.