Building a fighting-game computer-use agent with Sai and Jev
The author uses Sai to pretrain moves and Jev to pick the best move in real time, letting an agent play The King of Fighters on Windows by itself; it lost the first match and won the second.
THIS IS INSANE For computer use agent, I have been thinking of what is the best demo case of agent is capable controlling the computer as the human Finally, the best one I found is playing a REAL game, for example the king of fighters, from STEAM on Windows This requires almost ZERO latency if you want to win. So I built one using Sai @sai_borg leveraging @typesafeai - Pretrained a few skills/move to play the game in Sai, including the special move - Sai navigates to start the game and decides which character he is most comfortable playing - Jev decides the best move to make almost simultaneously - Uses special moves when they’re ready - e.g. once enough energy has accumulated - Lost the first match, learned from the it, and won the second one 0 speed up the part when Sai is playing the game If you want to watch a computer use agent plays the game itself, try http://sai.work #robosecretary #SaiFleet