Summary

  • A partnership between phone support company Phonely, inference optimisation platform Maitai and chip maker Groq could solve one of the biggest issues facing conversational AI: the awkward delays which give away that the caller is speaking to a machine.
  • By enabling Phonely to reduce response times by 70% and boost accuracy from 81.5% to 99.2% across four iterations, surpassing GPT-4o’s 94.7% benchmark by 4.5 percentage points, the collaboration has managed to side-step the “uncanny valley” of voice AI.
  • This technology could see 350 human call centre workers being replaced this month alone, and is particularly strong in appointment scheduling and lead qualification, says Phonely CEO Will Bodewes.
  • The key lay in Groq’s development of zero-latency LoRA hotswapping – the ability to instantly switch between multiple AI models without any performance penalty.

By Michael Nuñez

Original Article