Pipecat 语音 demo 用 Jev 做决策层
NVIDIA Nemotron 3 语音 demo 的模型栈里包含 Typesafe Jev,负责对话中的决策环节。
NVIDIA Nemotron 3 Diarization model card and weights: https://huggingface.co/nvidia/Nemotron-3-Diarization Jon's demo code: https://github.com/pipecat-ai/nemo3-battleships Models used in the demo: - NVIDIA Nemotron 3 Diarization - NVIDIA Nemotron 3.5 ASR - Pipecat Smart Turn - Pipecat PhoneLLM - Typesafe Jev - NVIDIA Magpie TTS
NVIDIA released a fast speaker-labeling model today: Nemotron 3 Diarization. Like all of the Nemotron family from @NVIDIA_AI, this is an open weights model, so you can grab the weights from @huggingface and use the model in the cloud or on your local device. Nemotron 3 Diarization is a useful building block for voice agents and realtime AI applications that need to handle speech from multiple people at the same time. It handles overlapping speech well, can identify up to eight speakers, and pairs with any transcription model you're using in your multi-modal pipelines. @jonptaylor built a demo (code below) and recorded a technical deep-dive showing how to use this diarization model together with a speech-to-text model. Jon's code also uses Jev for super-accurate confirmation of critical voice input in a noisy/multi-speaker environment.