What it does
The routing idea did not work. It also found that 52% of probabilities change across byte-identical requests.
Benchmarks & research
S1Rank
Tests Jev as a search reranker, and asks whether its confidence can tell you which queries are worth spending more compute on.
Bookmark: S1Rank
Keep this in your collection.
Leave a noteWhat would you try with this?
: S1Rank
Only you can see your notes.
Screenshot unavailable. Open the experiment ↗
How you can use it
Your search project could put useful documents first by asking a yes-or-no question about each: does it answer the search question? A developer can send the documents together and sort by the AI's probability of yes. Try searches with known answers, since repeating a request can change its scores.