OpenAI, LLMs, WebRTC, voice bots and Programmable Video
Learn about WebRTC LLM and its applications. Discover how this technology can improve real-time communication using conversational AI.
Read MoreWebRTC GetUserMedia is more important than the rest of this communication stack.
Who would have believed? With all the magic and distraction that video calling from a browser brings with it, the real treasure trove resides in the basics - WebRTC GetUserMedia.
Simplifying things, WebRTC has 3 distinct areas/APIs to it:
I've pointed up in the past how WebRTC GetUserMedia gets used by Mailchimp and WhatsApp. Taking a camera snapshot is nice, but what else can we achieve with this access we've been given?
Chris Kranky had an idea a few weeks ago. Measuring how much you're yapping in a call as opposed to listening. So he made it happen. On a shoestring budget, some connections and a bit of time and TalkLessNow was born.
The website is quite spartan. When you go on a phone call (not a WebRTC one), you just press the green Call button on talklessnow.com.
The code on the site "listens" through the machine's microphone to your call. Whenever it hears enough of a volume - it assumes you're talking. If the volume is lower than its configured threshold - you're listening.
Just WebRTC GetUserMedia. No PeerConnection or any other fuss.
Here in Israel, I am sure the results won't be good. We're used to talking over each other and interrupting. Efficiency at its best. If in a call between Israelis it shows less than 70% of talk time per participant, I'll crown that session a success.
Seriously though, we should be listening a lot more than we're talking.
The now defunct Guitar Tuner works the same way. It doesn't work anymore because the site is served on HTTP and WebRTC GetUserMedia now requires HTTPS to work with the latest Chrome release (progress, you know).
Here's another example.
Ziggeo is making use of WebRTC to record videos. They do that by employing WebRTC GetUserMedia, storing the resulting media locally and at the end of the recording sending it to their servers. The sending part doesn't occur via WebRTC.
There's an interesting interview with Susan Danziger, CEO of Ziggeo from last week that you should read.
WHO CARES?
It works. It gives business value - and in ways that weren't really possible up until today.
There's a lot more to WebRTC than classic VoIP.
Learn about WebRTC LLM and its applications. Discover how this technology can improve real-time communication using conversational AI.
Read MoreGet your copy of my ebook on the top 7 video quality metrics and KPIs in WebRTC (below).
Read More