JevMade Sign in
← Back to experiments

Benchmarks & research

open-alternative-jev

This open-weights Jev alternative returns typed, calibrated choices in one Hugging Face or vLLM forward pass.

Source screenshot of open-alternative-jev
SOURCE SCREENSHOTFull screenshot ↗

What it does

On its RACE-H benchmark, writing each passage once for four questions cut token use 2.5-fold and raised throughput 2.3-fold.

How you can use it

Before writing any code, gather your sample texts, such as user tickets or short passages. For each item, write down the specific questions you want answered. List the allowed choices for each question, such as urgency ratings or topic categories.

Your developer can integrate this Python package to answer all your questions about a text at the same time. Note that answering questions together can sometimes cause nearby answers to influence each other. Have your developer run questions separately if decisions must stay completely independent.

Maker-reported (not independently measured by JevMade): RACE-H, 250 passages x 4 questions (n = 1000). One passage, four multiple-choice questions · Packing writes the passage once instead of four times: 2.5x fewer tokens, 2.3x the throughput of batching,

Primitives
choice
Platform
Python
Added
Project created
GitHub stars
3 (snapshot, not live)

Keep this for later

Sign in to bookmark experiments, guides and videos, and keep notes only you can see.

Continue to sign in

We’ll bring you back to this listing.