Pipecat voice demo uses Jev as its decision layer
The model stack in NVIDIA's Nemotron 3 voice demo includes Typesafe Jev, which handles the decision step in the conversation.
NVIDIA Nemotron 3 Diarization model card and weights: https://huggingface.co/nvidia/Nemotron-3-Diarization Jon's demo code: https://github.com/pipecat-ai/nemo3-battleships Models used in the demo: - NVIDIA Nemotron 3 Diarization - NVIDIA Nemotron 3.5 ASR - Pipecat Smart Turn - Pipecat PhoneLLM - Typesafe Jev - NVIDIA Magpie TTS
NVIDIA released a fast speaker-labeling model today: Nemotron 3 Diarization. Like all of the Nemotron family from @NVIDIA_AI, this is an open weights model, so you can grab the weights from @huggingface and use the model in the cloud or on your local device. Nemotron 3 Diarization is a useful building block for voice agents and realtime AI applications that need to handle speech from multiple people at the same time. It handles overlapping speech well, can identify up to eight speakers, and pairs with any transcription model you're using in your multi-modal pipelines. @jonptaylor built a demo (code below) and recorded a technical deep-dive showing how to use this diarization model together with a speech-to-text model. Jon's code also uses Jev for super-accurate confirmation of critical voice input in a noisy/multi-speaker environment.