JevMade

Sign in
← Back to guides

JevMade field notes / Local and hosted model comparison

Compare a local decision model with hosted Jev

David Krcek tests Laya on his Mac against earlier hosted Jev results, comparing banking-query labels, German translations and changes caused by reordering the answer options.

Original by David KrcekEvaluation
Leave a noteWhat would you try with this? : Compare a local decision model with hosted Jev

Only you can see your notes.

Listen to this guide

JevMade’s plain-English explanation

0:00 /

Our summary

Some teams want AI decisions without sending their data to a hosted service. David Krcek tests Laya, an open local model, against earlier Jev results on banking questions. His comparison asks both how often the answer is right and what changes when the options or language change.

The test uses two hundred English questions across ten categories, then a hundred German translations. Laya also receives the English options in three orders. The author sends one unchanged Jev-shaped request to Laya's local server and gets matching answer fields, showing that existing calling code can be reused in that example.

In the author's tests, Laya answers faster locally but gets fewer labels right, especially in German, and changing option order changes some answers. Hosted Jev time includes a network trip; local time excludes loading the model. These version-specific results were not independently reproduced, and matching response fields does not establish equivalent quality.

Key takeaways

  1. Test local and hosted choices on the same questions, while keeping network time and model-loading time distinct.
  2. Try different option orders and the languages your users actually write. The interface alone cannot tell you whether decisions are dependable.
  3. Choose cutoffs on your own examples. The author's uncertain-answer handoff is a proposal based on a small test, not a production guarantee.

Independent article about a Jev alternative, not official Jev guidance. Figures compare hosted Jev measured September 25 with Laya 0.3.24 measured October 3 on an M3 Max Mac. Vendor claims, the author's measurements and the one-request compatibility check are separate evidence.

Rote Code Fraktion · Original published

Read the original guide Opens the author’s site in a new tab.

Your note

Only you can see this. Clear the text and save to remove it.

Keep what you save

Sign in to keep bookmarks and private notes on every device. We email you a link; there is no password, and the same link creates your account.