JevMade

Sign in
← Back to experiments

Benchmarks & research

Jev on BFCL

Let Jev pick a tool and the values it needs, then have code assemble the call.

Bookmark: Jev on BFCL Keep this in your collection.
Leave a noteWhat would you try with this? : Jev on BFCL

Only you can see your notes.

Source screenshot of Jev on BFCL
SOURCE SCREENSHOTFull screenshot ↗

What it does

Will Rice tests this approach on six BFCL subsets. He used test examples during development, so the reported scores are not clean held-out results or official leaderboard placements.

How you can use it

Ask a developer to give your assistant a list of tools, including a choice to use none. After Jev picks a tool, offer the possible numbers, dates or other values it needs. Code puts the choices together. This project tests proposed calls; it does not carry out the actions.

Trying new requests sends their text, any earlier-message context and tool descriptions to TypeSafe's outside AI service, using paid credits. Share only permitted material. The author used some test examples during development; he did not test conversations over several turns or calls to several tools at once.

Your note

Only you can see this. Clear the text and save to remove it.

Keep what you save

Sign in to keep bookmarks and private notes on every device. We email you a link; there is no password, and the same link creates your account.