JevMade Sign in
← Back to guides

JevMade field notes / Production experience report

Make uncertainty and spending limits work in a live website

Ahmet Zeybek describes adding Jev to his website, choosing different cutoffs for different decisions, and fixing a broken spending counter and an easily faked request check.

Original by Ahmet ZeybekAgent workflows

Listen to this guide

JevMade’s plain-English explanation

0:00 /

AI narration

Credits

“TypeSafe's Jev in production: thresholds and two bugs” by Ahmet Zeybek. Read the original source.

This expanded guide is an AI-narrated adaptation prepared by JevMade. It expands the source’s essential ideas, examples and caveats in JevMade’s own words and is not a word-for-word reading. The synthetic voice does not imitate the author or imply their endorsement.

Our summary

A website assistant should not answer a greeting with an unrelated article. Ahmet Zeybek uses Jev to recognize that difference and make other small decisions across his site. His account shows that deciding when to trust an answer can take more work than connecting the model.

Code compares each answer with its own cutoff. For some yes-or-no questions, the uncertain middle returns to the old rules rather than forcing a decision. Cosmetic features and note moderation have separate spending limits. Two bugs showed why counting actual usage and checking callers matter as much as the model's answer.

These are one developer's reported observations, not a reproduced trial or a safety guarantee. His moderation lets notes through when the model fails, a policy other sites may not accept. Keeping old rules for uncertain answers cannot prevent a confident wrong answer from making a decision worse. Concurrent spending was not independently audited.

Key takeaways

  1. Choose a cutoff and fallback for each decision. Changing a music mix and rejecting someone's note have different consequences.
  2. Prove that the spending counter increases after real calls. A limit checked against a stale counter is not a working limit.
  3. Keep the full set of answer probabilities for later review. A request header that claims to come from your site is not proof of who sent it.

The article reports ten call sites and eleven thresholds. Single readings and a six-call counter check are not repeated benchmark results. Timeouts, missing keys, spending limits and abuse controls are application policies; its allow-on-failure moderation is not a generally safe default.

zeybek.dev · Original published

Read the original guide Opens the author’s site in a new tab.

Keep this for later

Sign in to bookmark experiments, guides and videos, and keep notes only you can see.

Continue to sign in

We’ll bring you back to this listing.