How Netflix, Meta, and United Cloud Choose New Codecs and Why
Migrating to new codecs is fraught with challenges and complications for companies with massive content libraries like Netflix and Meta, or live linear providers like United Cloud. What drives change-of-codec decisions and what considerations and trade-offs complicate these decisions vis a vis legacy users and more?
Tim Siglin, Founding Executive Director, Help Me Stream Research Foundation, and Contributing Editor, Streaming Media, discusses these issues with Andrey Norkin, Senior Research Scientist - Video Algorithms, Netflix, Hassene Tmar, Technical Program Manager, Video Infrastructure, Meta, Software Coordinator, AOM, and Boban Kasalovic, Product Manager, Streaming, United Cloud in this clip from Streaming Media Connect.
Siglin begins by asking Norkin what drives Netflix to choose new codecs.
“An important factor is if it enables new applications,” Norkin says. “As in the case of 4K or HDR, you may know that you need a new codec if you want to stream that.” He also emphasizes the importance of projected device support, the particular features specific codecs may have for different streaming scenarios, such as low bitrates and live encoding, and projected device support.
Tmar from Meta says that they primarily focus on the specific benefits based on the needs of their users. “One of the examples we have seen is AV1 enabling a lot of quality for countries with much lower bandwidth,” he says. He also notes that the cost of adding a new codec, including storage and transcoding, is also a major consideration. “So we are actively working on optimizing that. And this is one of the main reasons we are moving away from AVC, because we don't want to keep yet another AVC rendition in terms of storage costs.” The number of videos they handle and store is also a major consideration. “In our use case, we deal with approximately a few billion videos a day, and we tend to try to keep all of those videos so that you can have your memories after 10 or 15 years,” he says. “If we keep them in the original state that it came through, in an AVC high bitrate stream, then we would be paying a lot for our storage. We could recompress that original video with much newer codecs, which will allow us to maintain quality at a much lower bitrate.”
Kasalovic says that three important factors exist for United Cloud to determine when to choose a new codec. “The first one is device footprint coverage because this can be directly proportional to how much savings we can get on the IP network and the CDN side. And that can be very significant for our telcos,” he says. The second factor to consider is the bitrate savings on a new codec versus previous ones. “And the third one is encoding complexity and how we are going to implement that codec,” he says. Other aspects to think of, he says, are DRM support and supporting encapsulation. “From my point of view,” he says, “the best balance between all those things we have with HEVC is [that it is] slightly more expensive on the encoding side but has relatively good device coverage.”
See videos of the full program from Streaming Media Connect February 2024 here.
We'll be back in person for Streaming Media NYC May 20-22, 2024. More details here.
Related Articles
What are the best strategies streamers can follow to manage the costs of cloud streaming architecture and production and maximize efficiencies in their workflows? AWS' John Barber, IMAX's Abdul Rehman, Zixi's Eric Bolten, and SVTA's Jason Thibeault discuss cloud streaming cost management in this clip from Streaming Media Connect 2024.
26 Sep 2024
Streaming Media contributing editor Tim Siglin interviews Netflix engineer Sujana Sooreddy at Streaming Media NYC 2024. She discusses the challenges of encoding and transcoding content for different formats and devices, and she highlights the importance of using data analytics to understand compute usage and viewability of a particular stream. She also talks about the increasing number of women in the field and the value of mentorship within the community.
13 Jun 2024
At Streaming Media NYC 2024, Tim Siglin interviews Jan Ozer of the Streaming Learning Center. Ozer discusses how the Streaming Learning Center has expanded into a platform offering courses on streaming-related topics to help technical people in the industry become familiar with terms, technologies, best practices, and tools. He also talks about machine learning, the shift towards Neural Programming Units (NPUs), and the legal and financial implications of choosing a codec due to potential patent infringements.
10 Jun 2024
How close to obsolescence is AVC in 2024, with AV1 and other more efficient and increasingly well-established "emerging" codecs like VP9 and HEVC on the rise? Meta's Hassene Tmar, Netflix's Andrey Norkin, AMD's Sean Gardner, and Help Me Stream's Tim Siglin weigh in during this clip from Streaming Media Connect 2024.
29 Mar 2024
Avanci Video launched in October 2023 as the latest patent pool contender to stake a claim to a piece of the streaming codec pie. Avanci isn't new to licensing; just to streaming. So how does it impact other existing patent pool players? Two leading patent attorneys with expertise in this market, Garrard R. Beeney of Sullivan & Cromwell, and Robert J.L. Moore of Moore IP Solutions explore what it meant when Avanci joined the patent pool party in this clip from November 2023's Streaming Media Connect.
15 Jan 2024
Via Licensing shook the MPEG licensing world in May 2023 when it acquired MPEG LA to form the Via LA juggernaut. And how is that deal shaking out now, six months on, as licensors and patent holders alike survey the landscape? Sisvel Group's Mattia Fogliacco and patent attorney Robert J.L. Moore of Moore IP Solutions discuss the implications in this clip from November 2023's Streaming Media Connect.
12 Jan 2024
What are the key factors that drive and impede new and emerging codec deployment on premium OTT streaming platforms like Netflix, Disney, and Apple TV+? Streaming Learning Center's Jan Ozer provides a much-needed codec deployment reality check in this clip from his presentation at Streaming Media East 2023.
25 Aug 2023