What it does
It includes research notes, full result logs and a Hugging Face Space demo; acceleration may fall back when free VRAM is insufficient.
Benchmarks & research
jev-on-a-laptop
This study benchmarks parallel typed decisions on unmodified 1.5B–8B models running on Apple Silicon.
Bookmark: jev-on-a-laptop
Keep this in your collection.
Leave a noteWhat would you try with this?
: jev-on-a-laptop
Only you can see your notes.
Screenshot unavailable. Open the experiment ↗
How you can use it
To try this approach, start by listing your project choices. For example, write down your fraud checks or customer support categories, along with the exact answers each case needs. A developer can then run this study's local code to answer all those questions together using a small model on a computer.
Keep in mind that forcing the model to pick from your list does not guarantee the answer is correct. The test found that the model can be wrong even when it reports very high confidence. You should still have a person review important actions.