arXiv cs.CLPaper
MSI-Bench: Evaluating Multi-Speaker Voice Interaction for Collaborative AI Agents
Multi-speaker voice agents are moving from research fiction to requirements. This benchmark signals where the capability gap is widest: the gap between single-speaker voice and real-world conversation. If you're building voice agents or evaluating voice models, you should run your system on this. The numbers reveal that Mandarin is significantly harder than English, which should inform your deployment strategy.