JevMade Sign in
← Back to experiments

Benchmarks & research

System One Code Review

A code-review study asks Jev whether a pull request needs changes and which file deserves attention.

Source screenshot of System One Code Review
SOURCE SCREENSHOTFull screenshot ↗

What it does

Across 983 pull requests tested three times, the author reports stronger file selection than approve-or-change judgments. The latter results do not support automatic approval or blocking; Jev saw code changes, not the rest of each repository.

How you can use it

You can read this published study to see how the AI judged code updates. It asks the AI to find which file needs the most attention. Your developer can borrow these exact test questions to build a similar check for your own project.

The AI reads only the changed code, not your whole project. This test shows that the tool often guesses wrong about whether code is ready. Keep a person in charge of final reviews instead of letting the software approve updates on its own.

Keep this for later

Sign in to bookmark experiments, guides and videos, and keep notes only you can see.

Continue to sign in

We’ll bring you back to this listing.