Opus builds an Unreal spatial audio interaction demo
Pipecat released C++ client SDKs, and the author used Opus to build spatial audio and multi-character interaction scenes in Unreal, with three open-source repos linked.
Pipecat CXX Client SDKs and transports! Spatial audio and world data from Unreal <> Pipecat are too much fun to experiment with. My gamer instincts took control for a demo, but the scope is much wider (robotics, embedded, etc.) Building stuff like this is just Pipecat, with the same events and pipeline code we're all used to. Sidecar it, bundle it with local weights, so many ideas. Oh, and Opus made the demos. Mad how good it is at creating beautiful scenes and interactions in Unreal with very little prompting. 🔗 C++ client SDK: https://github.com/pipecat-ai/pipecat-client-cxx 🔗 Unreal demo: https://github.com/pipecat-ai/pipecat-unreal-demo 🔗 Pipecat Room (multi-character demo): https://github.com/jptaylor/pipecat-unreal-room