Meta Ray-Bans turned into chess cheat glasses with Opus 5.5 and Jev
An open-source workflow streams the board from Ray-Bans to a Mac, where Jev cheaply filters unchanged frames before Opus 5.5 reads the position and Stockfish suggests a move spoken into the call.
this is wild... a guy reverse-engineered his Meta Ray-Bans 3 with Opus 5.5 and turned it into a 3,000+ Elo chess engine it’s AI chess cheat glasses built on Opus 5.5 + Jev, and the whole workflow is open source here’s the full breakdown: step 1 → one command sets it up on your Mac: npx chesshacker setup it pulls Stockfish from GitHub and checks the checksum step 2 → put on the Ray-Bans and start a WhatsApp video call to your own Mac the glasses look at the board, and the Mac sees exactly what they see step 3 → the Mac captures frames straight from the call window about 1 per second while it waits for your opponent, 1 every 3 seconds when it’s your move step 4 → Jev runs a cheap filter on every frame: can it read the board? is a hand in the way? did a piece move? if nothing changed, the expensive AI call is skipped step 5 → only then does Opus 5.5 read the board it checks the result against the position it already has and accepts a move only if it’s legal step 6 → Stockfish thinks for half a second and returns the best reply with an eval like +1.5 or “mate in 3” step 7 → macOS reads the move aloud through a virtual mic into the call: “Rook a to d1”. it plays right in your ear step 8 → a command center on the Mac shows it all live: whose turn it is, the suggested move with a confidence bar, the move history and a log under the hood: → if Opus loses the board, the glasses say “Lost track of the board”. you fix it with undo or by typing the move in manually → if Stockfish crashes, it restarts once and says “Something went wrong. Still trying” → every game is saved as a PGN, and API keys are stored in the macOS Keychain → an overlay draws the suggested move as an arrow on the live video, ready to drop into OBS grab the workflow below 👇 then read the guide on reverse-engineering anything with Opus 5.5
This post quotes another post: x.com/0xmovez/status/2109604520770548146