JevMade Sign in
← Back to videos

JevMade field notes / Video guide

JEV é hype?

Vini Lana tests offloading agent tool selection to TypeSafe's Jev model across multiple LLMs, analyzing prompt execution steps, tool accuracy, token costs, and contextual failure modes.

Original by Vini LanaEvaluationIntermediate22 min 22 sec Published
Bookmark: JEV é hype? Keep this in your collection.
Leave a noteWhat would you try with this? : JEV é hype?

Only you can see your notes.

Before you press play

What you’ll find in the video

  1. In Vini’s test harness, using Jev for tool selection reduced reported input tokens and cost across the tested model configurations.
  2. The presenter separates typed JSON from correct tool choice; incomplete context can still cause a wrong selection.
  3. Some Jev-routed runs took more steps or skipped a prerequisite tool, so lower cost did not imply better task execution.
Worth knowing

The presented benchmark reflects an informal agent harness evaluation across several synthetic tasks, not a standardized, peer-reviewed industry benchmark.

JEV é hype?

Keep this for later

Sign in to bookmark experiments, guides and videos, and keep notes only you can see.

Continue to sign in

We’ll bring you back to this listing.