2024 08 10 voice support
Voice support- Agent
Connect to a call.
Listed to to voice, convert to text with whisper.
Understand the query,
Find suitable solution,
Use your own genereted clone voice to respind back.
--
Write a planner prompt, Identify the main need for call.
--
Use only the models, that you can locally run.
It shoukd run, independent of network connectivity.
--
Don't fixate on scale and deployment.
Make it usable for 1 person, let it work flawlessly first. Then optimise later after initial runs are successful.