In a significant development within the rapidly evolving voice AI landscape, Deepgram has announced the acquisition of Daily, the company behind the popular open-source voice AI infrastructure, Pipecat. This move is poised to bolster Deepgram's offerings in real-time voice and video technologies, reflecting a broader trend of consolidation and strategic alliances within the industry. While the financial details of the acquisition remain undisclosed, both companies have confirmed their commitment to maintaining Pipecat's open-source nature.
Pipecat functions as a sophisticated framework designed to orchestrate voice and video streams, seamlessly integrating various components such as speech-to-text (STT), large language models (LLMs), and text-to-speech (TTS) models, all while minimizing latency. Daily, as Pipecat's developer, has been instrumental in providing the underlying infrastructure for diverse voice and video communication needs. This acquisition is expected to provide Deepgram with invaluable insights and a deeper understanding of the intricacies of real-time voice and video infrastructure.
Daily has successfully secured over $62 million in funding from prominent investors including Tiger Global, Highfield Capital, Nat Friedman, Lachy Groom, and Kevin Weil. Deepgram, earlier this year, achieved unicorn status following a $130 million Series C funding round. Interestingly, both Deepgram and Daily were part of the same Y Combinator batch in 2016, highlighting a shared history and perhaps a pre-existing understanding of each other's technological trajectories and organizational cultures.
Kwindla Kramer, co-founder of Daily, revealed that the inspiration for the Pipecat framework emerged from experiments with AI-to-human communication using voice and text, coinciding with the release of GPT-4. Kramer emphasized that despite numerous acquisition offers, Deepgram's CEO, Scott Stephenson, demonstrated a strong commitment to preserving Pipecat's open-source status indefinitely. This commitment, coupled with the alignment of engineering cultures between the two organizations, was a decisive factor, ensuring Daily's team would retain autonomy to innovate across different technological layers within the larger corporate structure.
Stephenson articulated Deepgram's long-standing aspiration to contribute to open-source initiatives. He identified orchestration frameworks for AI agents as a particularly promising area, which ultimately led to the partnership with Daily. Stephenson expressed a vision of fostering an open ecosystem where developers can freely create voice agents, even if it means integrating models from Deepgram's partners to achieve optimal results for specific use cases. This approach, he believes, will also serve as a catalyst for Deepgram to continuously enhance its own models and products.
This strategic acquisition, according to Stephenson, will empower developers to construct highly expressive agents and comprehensive end-to-end speech systems. This is achieved by enabling the seamless integration of diverse models and a 'context bus' that facilitates communication across all system components. The deal also opens doors for Deepgram to venture into new domains beyond traditional voice applications, leveraging Pipecat's versatility in handling real-time communication across various formats.
Kramer clarified that Pipecat was never conceived solely as a voice toolkit but rather as a foundational tool for developing a new generation of AI-native software, always with real-time capabilities as a core principle. In conjunction with the acquisition, Deepgram is also introducing the Real-Time Context Standard (RCS), an open protocol developed collaboratively with the Pipecat team. This protocol is designed to define crucial metadata, such as contextual cues from audio (e.g., a whisper), provide instructions for language models on how to interpret these signals, and guide the desired sound of the response. The voice AI sector continues to attract substantial investment, with both model developers like ElevenLabs, Gradium, and Fish Audio, and infrastructure providers such as LiveKit and Vapi, securing significant funding rounds.
