JevMade

Sign in
← Back to experiments

SDKs & clients

vLLM Jev

vLLM Jev runs open Jev-style decision models on your own hardware: one command downloads a Hugging Face checkpoint and serves Choice, Noul and Score questions over HTTP.

Bookmark: vLLM Jev Keep this in your collection.
Leave a noteWhat would you try with this? : vLLM Jev

Only you can see your notes.

Source screenshot of vLLM Jev
SOURCE SCREENSHOTFull screenshot ↗

What it does

It targets Linux GPUs and Huawei Ascend chips, with a preview for Apple Silicon Macs and an experimental Windows CPU mode for 24 checked text models. Valen and Clef also accept short videos. The project's own speed figures come from A800 and Ascend 910B3 runs, and its notes warn that Kev-0.8B can change its selected label under concurrent batching.

How you can use it

You can have a developer run this tool on your own computer or server to host open AI decision models. Your app sends a question with a list of answers over your local network. The server picks the best choice and returns a probability score for each option.

A developer can start by running a supported model like Open-Jev-2B on a Linux computer with a dedicated graphics card. Be aware that models like Kev-0.8B can occasionally flip their chosen answers when handling several incoming questions at the exact same moment.

Maker-reported (not independently measured by JevMade): Project demo on one A800 per runtime: Valen answers 24 questions about one video in 1.22 s versus 5.31 s on its PyTorch reference path (4.3×), with all 24 answers agreeing; model loading excluded. · RadixFlow (experimental, off by default): Open-Jev-2B short inputs at concurrency 1 rose from 7.53 to 11.54 requests/s (+53.3%) over native vLLM with prefix caching; long inputs at concurrency 1 fell 6.3%. · OpenJev-0.6B completed a 4,096-request run at 79.24 requests/s on an Ascend 910B3 (32 clients, three questions per request). · Windows acceptance snapshot (16 Oct 2026): 24 text checkpoints passed real-weight validation on one Windows 11 CPU host; support remains experimental.

Primitives
choice, noul, score
Platform
Linux (CUDA, Ascend), Apple Silicon, Windows CPU
Added
Project created
GitHub stars
912 (snapshot, not live)

Keep this for later

Sign in to bookmark experiments, guides and videos, and keep notes only you can see.

Continue to sign in

We’ll bring you back to this listing.