What it does
The maker found fewer tool calls but no better task completion rate.
Agent tooling
Jev helps Pi choose skills, rank source files and understand failed commands.
Only you can see your notes.
Screenshot unavailable. Open the experiment ↗
The maker found fewer tool calls but no better task completion rate.
You can borrow this idea to help an automated coding tool sort through broken tests. Before writing code, make a list of common software mistakes and simple labels for them, like network trouble or typos. Your developer can then set up an access key to send those errors out for advice.
Keep in mind that external advice is only a suggestion, not a guaranteed fix. Your app will share your code snippets and error logs with an online service to rank them. Your developer must still run real tests to confirm any suggested changes work properly.