OpenAI, LLMs, WebRTC, voice bots and Programmable Video
Learn about WebRTC LLM and its applications. Discover how this technology can improve real-time communication using conversational AI.
Read MoreNow that we have WebRTC, people are starting to think about SIP over HTML.
At one point in time, we tried to struggle around the idea of going with a video conferencing offer on the web. That was 2 or 3 years ago – before WebRTC. We ended up ruling HTML out and focusing on Flash, which was then ditched due to some technical issues we had. The project got parked.
When WebRTC came out, the architectural solutions I thought you’ll be putting around it look somewhat like this:
You get your current VoIP infrastructure, which probably uses SIP, connected to a new specialized gateway, which then “talks” with web browsers using a proprietary protocol over JavaScript. Media is sent using WebRTC – either directly between endpoints or routed through a media server where transcoding is required.
But now, it seems, there are those who are working on placing SIP right inside the web browser as well. I’ve found three such projects: sip-js, sipml5 and SIP on the Web. This changes the architecture:
Now we have native SIP going end to end at all times. There is a small proxy that translates the transport from TCP/UDP to WebSocket. A media server for transcoding might still be required though.
The gravity of it is huge. This means that now native web applications can be written in a way that require little change in current VoIP architecture and infrastructure. And there are those who are on top of it already - Kevin P. Fleming announced on the Asterisk blog their plans to support WebRTC:
Very soon (hopefully in the next few weeks), we’ll be able to demonstrate a standards-compliant audio/video call from a browser through Asterisk (to any destination or channel technology that Asterisk supports) without the use of any plugins or native code in the browser, at all. Pure HTML5 and JavaScript on the browser end, and new modules on the Asterisk end.
It can’t get any better than that.
I took the liberty of looking a bit closer to the sipml5 version, to see what it means. Here are a few observations:
Why only now? Why did it take so long for SIP to become a web resident, where XMPP (a “competing” protocol) has multiple such libraries written in JavaScript already?
There’s a lot of innovation happening around WebRTC – and not only with voice and video communication. SIP in HTML was the missing piece in the puzzle of connecting current VoIP with the web browser. And now, that piece is here.
Learn about WebRTC LLM and its applications. Discover how this technology can improve real-time communication using conversational AI.
Read MoreGet your copy of my ebook on the top 7 video quality metrics and KPIs in WebRTC (below).
Read More