OpenAI, LLMs, WebRTC, voice bots and Programmable Video
Learn about WebRTC LLM and its applications. Discover how this technology can improve real-time communication using conversational AI.
Read MoreTwilio Programmable Video is no more. What should WebRTC Video API vendors and their customers do from here on?
This week, Twilio dropped a bombshell 🤯
It decided to shut down its Programmable Video service and do a bit of downsizing and trimming around Segment and Flex.
I didn’t intend to write anything more until 2024, but this necessitated changing my plans.
đź’ˇ The image above is an adaptation from a blog post on Twilio's website from 2021...
Each year, Twilio hosts its Twilio Signal event. I’ve attended a couple of them in person and used to cover them here on a yearly basis.
That stopped with Twilio Signal 2021, which was the last time I covered that event here. The reason for that was the pivot Twilio made from CPaaS to CEP (Customer Engagement Platform).
Ever since, I’ve searched for things to talk about and share about Twilio Signal, but found nothing of real value or interest to my readers.
Remember - I cover WebRTC and CPaaS. CPaaS mainly from the point of view of WebRTC and modern communications and less from the SMS and legacy telephony sides of it.
The shift towards CEP meant a lot less investment and focus by Twilio on exactly these areas - WebRTC and CPaaS that are non-SMS/legacy telephony related.
What did Twilio have to show for its investment in video and WebRTC in 2022 and 2023? Nothing. Crickets. Oh… yes… they did integrate with Krisp for noise cancellation. Presumably only in their Video SDK and not the Voice SDK. So that’s down the drain as well.
The decision might be the right one for Twilio, if you look at where their investments and attention are going:
Video is likely 1% or less of their revenue. So why bother? Especially when it requires management attention to get it anywhere meaningful with so much else that is bigger and more important to deal with.
I learned about the concepts of best of breed and best of suite when working at Amdocs.
Twilio started with SMS and voice. It later decided to expand and become “best of suite” by attaching to it email, video, IOT, social messaging, chat , …
What happened though is that in parallel, it worked hard on being best of breed in voice and SMS. Doing that by going upstream and introducing Flex. Flex reduced the effort of contact centers built on top of Twilio.
And then they pivoted. With the acquisition of Segment and the need to tightly integrate it with their CPaaS and Flex offering. Transitioning from taking care of communications to taking care of understanding the customer.
Today?
There are two types of CPaaS vendors:
Interestingly, both are circling like vultures around Twilio to see which customers are going to come out of there looking for alternatives. Some of these CPaaS vultures offer pure WebRTC video solutions. Others offer the whole suite. And there are those who don’t even offer video - but see this as an opportunity to poach customers from Twilio.
I remember that in one of the first Twilio Signal events, Jeff Lawson stood on stage and proudly announced that they never deprecated an official API. The way this was later handled is by having beta and GA phases for products.
This cannot be said anymore… by the end of 2022, Twilio started sunsetting and shutting down services.
It started with a round of layoffs at Twilio. Jeff Lawson, Twilio’s CEO, wrote a message that got to the Twilio blog as well. Here’s what we shared about it at the time with our WebRTC Insights clients:
After the reduction in workforce, came the reduction in product offerings. The first two to go through the chopping block were Twilio IOT and Twilio Live.
Twilio Live was announced dead in November 2022. Low traction of the service and little fit the the direction of Twilio meant this had to die. The way this was done? Let customers know. Officially suggest they go use Mux instead. Somehow, the fact that Mux at the time had a service competing directly with Twilio Programmable Video wasn’t something that worried Twilio.
Twilio IOT was simply sold off to KORE Wireless in March 2023.
Remember that suggestion we gave about FUD in the market against using Twilio for video APIs? (I marked it in yellow above so you won’t miss it)
Here’s what the Twilio product menu looks like on their homepage:
This is likely going to change soon or by the time this gets published.
Each and every piece in the Communications part can be snuggly fit into the products on the left and on the right (Customer Data and Applications).
Video is a bit of a stretch. At least if you look closely at traffic sizes and revenue numbers.
The two other oddballs - IOT and video streaming - were thrown out without too many objections and without hurting Twilio’ bottom line.
What was left was to get rid of the video piece. It likely took too many resources but made no real dent in Twilio’s numbers.
To be frank - the problems likely started with the acquisition of Kurento. Kurento wasn’t fit for what they had in mind for it, and it was riddled with architectural and technical issues. This wasn’t a good starting point for multiparty calling in Twilio Programmable Video.
If I had to guess, a lot of technical debt went into the product to improve and repurpose the media server pieces of Kurento.
Twilio was slow to innovate on video, leaving the room for other vendors - big and small. It missed the lowcode and embeddable experiences that are now common in video APIs. They didn’t invest in AI integrations too much. It didn’t optimize media quality enough to work well for its customers.
And then it left the door open for Amazon with their Chime SDK to threaten them in this domain.
I am guessing growth and revenue from Twilio Programmable Video wasn’t in line of expectations (unsurprisingly). The current market climate, the end of the pandemic, the headaches in Segment and Flex. All of it got them to the conclusion that it would be simpler to just sunset Twilio Programmable Video and move on.
A brave decision. Twilio Programmable Video couldn’t have been sunset in the worst time (unless you consider a few months prior to the pandemic and the quarantines).
A week before this announcement from Twilio, Amazon announced support for video calling in Amazon Connect.
Amazon is investing in adding video to its contact center solution, and Twilio, who has Twilio Flex competing against Amazon Connect, is sunsetting video support for its video API.
Why was Twilio Programmable Video appealing to potential customers? I can think of two main reasons:
The reasons why not to? Quite a few:
All that Twilio had for itself is its brand name. And that in a market that was moving on.
Things other vendors have been doing in that period of time?
Twilio wasn’t able to keep up. Or even pick a direction it wanted to invest in.
Twilio issued an email to its customers on December 5, stating the sunset will take a full year. From this email:
[...] we have decided to End of Life (EOL) our Programmable Video product on December 5, 2024, and we are recommending our customers migrate to the Zoom Video SDK for your video needs.Â
The official recommendation from Twilio is for their customers to migrate to the Zoom Video SDK.
The announcement can’t be found (yet) on any marketing material from Twilio. It can be found on social media accounts from Zoom.
Why Zoom?
They couldn’t suggest vendors that have SMS or voice services.
The rest are mostly smaller vendors - not something Twilio wanted to be identified with is my guess.
There’s only one problem with picking Zoom Video SDK here. Their web experience isn’t on par with the rest of the pack. They rely on WebTransport+WebCodecs+WebAssembly, which isn’t as stable or performant as just using WebRTC. For native, their SDKs should be fine, but for web browsers, I’d be reluctant to use them yet. Add to that the fact that this is a technology shift, requiring some relearning of terms and a reliance on proprietary technology, and you get some increased risk for the vendors switching.
I wonder if Twilio and Zoom came to an agreement here (with Zoom maybe even paying for this suggestion to go out) or if Twilio simply decided to offer some kind of a recommendation and be done with it. Philipp’s bet: Eric Yuan had dinner with Jeff Lawson and paid for it.
Anyhow, customers have a full year to figure out a solution. Or less - depending on how much browsers WebRTC implementations drift away from the current implementation of Twilio. What doesn’t get maintained in WebRTC rots rather quickly.
I am not sure how much Twilio Programmable Video would be missed.
Developers certainly used it. Big and small. Its revenue was probably higher than some of the smaller video API vendors out there. These developers will figure out a way to migrate to other vendors to use. It won’t be the first time a CPaaS vendor has existed in the video API market (we had AddLive, vLine, ooVoo, SightCall, Respoke, Tropo, Forge, CafeX, Circuit, Bit6 all exit this market in the past).
3-4 years ago, we had 3 top dogs in this market: Vonage, Twilio, Agora
A year ago, I’d say I heard a lot more about Vonage, Amazon Chime SDK and Twilio. Less so Agora
Now, we have Vonage and Amazon Chime SDK
Who will take the 3rd spot in the 3 runners when it comes to developers’ mindshare in this industry?
We have Agora, Daily, Dolby, LiveKit and others who are all vying for that spot. Each has its own angle and differentiation.
Would Vonage keep its spot there?
Will Amazon continue investing in its Chime SDK enough?
I don’t have the answers to these questions, but I do have my own opinions.
That is the big question.
If you are using Twilio Programmable Video - who should you go to instead?
And if you are on the lookout for a CPaaS vendor now - who should you pick?
My WebRTC Developer Landscape infographic was last updated in 2022, but can still offer some guidance as to the alternatives available. Some of them I’ve listed throughout this article. Others are just as valid.
Here are a few questions you need to answer for yourself:
Make sure also to read my CPaaS vendor lockin article before making any decision here…
Learn about WebRTC LLM and its applications. Discover how this technology can improve real-time communication using conversational AI.
Read MoreGet your copy of my ebook on the top 7 video quality metrics and KPIs in WebRTC (below).
Read More