JevMade hello@JevMade.com
← Back to guides

JevMade field notes / Architecture and workflow guide

Letting an AI assistant use a physical mouse and keyboard

This guide explains how to connect an AI assistant to a physical mouse. The software looks at a screen, chooses actions from a list, and uses built-in rules to recover from mistakes like broken buttons.

Original by Steven OjoBrowser use

Listen to this guide

JevMade’s plain-English explanation

0:00 /

AI narration

Credits

“ghosthands” by Steven Ojo. Read the original source.

This expanded guide is an AI-narrated adaptation prepared by JevMade. It expands the source’s essential ideas, examples and caveats in JevMade’s own words and is not a word-for-word reading. The synthetic voice does not imitate the author or imply their endorsement.

Our summary

Ghosthands lets an AI assistant control a computer through a physical mouse and keyboard. A small device sends ordinary USB mouse-and-keyboard input instead of software-generated events. That describes the input method, but it does not prove the system can evade security or bot detection.

The software uses an optional tool called Jev, which chooses actions from a list of visible buttons instead of writing out answers. If a click does nothing, the software ignores that button. It also waits for loading screens and checks if a task is actually finished before stopping.

This setup helps people automate simple web tasks quickly. However, the Jev tool is experimental and can still get stuck on longer tasks. The default visual method is more reliable for complex jobs, but it costs more and takes longer to make decisions in these tests.

Key takeaways

  1. Jev chooses actions; a separate AI tool can write text when saved wording does not fit.
  2. Built-in rules stop repeated clicks on unresponsive buttons and limit endless scrolling.
  3. The software pauses for a person when uncertain or facing a payment decision.

The project authors reported these test results and behaviors. The reviewer inspected the code and saved instructions but did not run the software.

Repository README and documentation · Source reviewed

Read the original guide Opens the author’s site in a new tab.