JevMade Sign in
← Back to guides

JevMade field notes / Written guide

Design decisions before choosing a model

Augustus teaches a planning method for jobs that might use rules, a classifier, a decision model, or a person. It starts with the outcome that matters and asks whether another judgment would actually change the action, rather than assuming every uncertain step needs AI.

Original by 24601Evaluation

Listen to this guide

JevMade’s plain-English explanation

0:00 /

Our summary

Augustus begins by naming the outcome, action, and cost of a mistake. It then asks where another judgment would change the result and whether rules, search, a model, or a person belongs at that point. This keeps the method focused on placement rather than model choice.

The method compares a baseline—a simpler approach used for comparison—and lets the system abstain, meaning decline to decide and ask a person. It builds tests from real labelled cases, measures outcomes, and sets a stopping rule before further improvement work.

This is a design method, not proof that Jev or another model works for a particular job. Teams need representative examples, honest outcome tracking, fixed limits for high-impact actions, and a reason to stop when added complexity does not improve the result.

Key takeaways

  1. Start with the action and its consequences, not the model.
  2. Compare AI judgment with rules, search, and human review.
  3. Decide when to decline, how to test, and when to stop improving the design.

The repository presents a method and examples.

GitHub project documentation

Read the original guide Opens the author’s site in a new tab.

Keep this for later

Sign in to bookmark experiments, guides and videos, and keep notes only you can see.

Continue to sign in

We’ll bring you back to this listing.