Smallest.ai raises $13M to build ultra-fast voice AI that sounds genuinely human
While AI agents are increasingly capable of solving customer support problems, most people can still tell immediately when theyâre talking to a machine instead of
While AI agents are increasingly capable of solving customer support problems, most people can still tell immediately when theyâre talking to a machine instead of a human. Smallest.ai, a startup founded in late 2024, is betting the next leap in voice agents will not come from making large language models faster, but from using smaller, specialized models built for human conversation. Simply put, the company wants to make speaking to an AI agent indistinguishable from talking to a human. To do so, itâs developing a small voice model designed to mimic how humans process information by listening, thinking, and speaking simultaneously. âWhile Iâm speaking to you, youâre already thinking, and you might interrupt me if I talk for too long,â Sudarshan Kamath (pictured left), founder and CEO of Smallest.ai, told TechCrunch, adding that this is exactly how the startupâs model is designed to work.
To fuel this mission, Smallest.ai has raised $13 million in a Series A round, led by Seligman Ventures with participation from Sierra Ventures and 3one4 Capital. The fresh capital brings the startupâs total funding to over $21 million. âThe way an LLM works is you give it an entire prompt, and then it starts thinking,â Kamath said. While that latency is acceptable in a text chat, in a voice conversation, even a short pause feels unnatural. âIf you think about how we are talking, Iâm not giving you like a large clipping of my audio, and then you start thinking.â The startupâs model serves as a real-time intelligence layer that enables natural customer conversations on specific topics, with virtually zero response lag. But if the model encounters a subject outside its limited knowledge base, Smallest.ai hands off the query to a large foundational model, briefly placing the customer on hold to âresearchâ the issueâjust as a real human would do.
Kamath believes that all AI agents will soon rely on two models: a small voice model for real-time interaction, and an âofflineâ LLM that is called upon as needed to solve complex problems. Unlike large foundational models, Smallest.ai focuses strictly on voice-specific nuances, such as handling diverse accents, supporting dozens of languages, and operating in noisy environments. The startupâs existing customers include companies in the voice space, including RingCentral and Truecaller. Kamath said that any customer support company, including newer ones like Sierra and Decagon, is a potential customer for the startup. When asked why a well-funded AI customer support company wouldnât build its own voice model, Kamath said that for customer support startups, becoming âextremely good at doing voice is a distraction from their core business.â Smallest.ai competes with voice AI leader ElevenLabs, as well as Cartesia and regional players like Sarvam that focus on local languages.
