What it does
Built for Apple Silicon, it reports roughly 200 milliseconds for four questions over one document on an M4 Pro.
Benchmarks & research
typesafe-local
typesafe-local asks a local MLX model typed questions and returns calibrated probabilities without generating or parsing prose.
Bookmark: typesafe-local
Keep this in your collection.
Leave a noteWhat would you try with this?
: typesafe-local
Only you can see your notes.
Screenshot unavailable. Open the experiment ↗
How you can use it
Start by collecting real customer tickets with known answers. For each ticket, list the yes-or-no checks, urgency ratings, and departments to test. Keep each choice list under 27 items. Always keep the list options in the same order so the results remain consistent.
A developer can run this code locally on an Apple computer. It works entirely offline without an account. Your app sends a ticket and asks several questions at once. Have your developer check the reported certainty numbers so unclear tickets can wait for a human review.