HEVC, VP9, AV1, and VVC: Presenting a Codec Update in 11 Charts
I’ve got a bad case of TLDR-itis, as in “too long, don’t want to write-itis”. You may be feeling the same way from a reader's perspective. If so, this article is for you.
Lots going on in the codec world, lots to analyze. But for the most part in this article, I’m going to let the pictures do the talking.
New HEVC Codec Leaders Emerge
I’m a big fan of Moscow State University tools and reports. Unlike many codec analysts, MSU asks the codec vendors to suggest the settings used for the encodes, ensuring a fair result, and the group always tests with a wide range of videos. In the most recent comparison MSU tested 13 codecs with 28 videos using multiple quality metrics, including Y-VMAF, Y-SSIM, U-SSIM, V-SSIM, YUV-PSNR, Y-PSNR, U-PSNR, and V-PSNR.
MulticoreWare’s x265 codec gets a lot of attention as the HEVC codec available in FFmpeg and as recently as 2015 was the HEVC quality leader. However, in this year’s report, MSU found that four HEVC codecs outperformed x265, as you can see in Figure 1 below (VMAF metric).
Figure 1. Codec VMAF quality rankings from Moscow State University.
Specifically, Figure 1 compares all HEVC codecs with the VMAF metric and setting the x264 H.264 codec at 100. The HW265 codec, Huawei Technologies, proved about 20 percent more efficient than x265, which is a significant advantage, and encoding speed was middle of the pack.
If you’re considering licensing an HEVC codec, the MSU report is a must, particularly if x265 is on your shortlist. Note that there are two report versions: a free version with a subset of tests and analysis, and the $950 version which includes all test results and over 5,000 charts.
MSU also has an ambitious roadmap for additional studies in 2018, including subjective quality comparisons of the same videos due out in early October and a 4K report that will focus on ultra-high quality presets and will include AV1. So stay tuned.
Bitmovin
Before IBC, Bitmovin published its second annual video developer report, which included 456 survey submissions from over 67 countries, and asked questions about current and planned codec and format usage. In terms of current codec usage, HEVC made the most headway, as you can see in Figure 2, with usage increasing by 50 percent. Imagine what could have been with a fair and cohesive royalty policy. In contrast, VP9 nudged upwards by a mere 10 percent.
Figure 2. Current codec usage among Bitmovin survey respondents.
Looking ahead, however, Bitmovin’s respondents were most bullish about AV1, as you can see in Figure 3. Here, planned usage more than doubled from 14 percent to 29 percent, with both HEVC and VP9 dropping. I wonder how many of these respondents know how long it actually takes to encode AV1 files.
Figure 3. Answering the question, "Which video codecs are you planning to use in the next 12 months?"
There’s lots more interesting data in the Bitmovin report, including streaming formats deployed (HLS, DASH, and Smooth are still the top three), and DRM use. The report is available for free download (registration required).
Netflix and YouTube Ship AV1
Well, sort of. Netflix made one clip available for download while YouTube posted 14 videos with some layers available in AV1 format; others in VP9.
What did we learn? Well, we care about three performance related data points when it comes to a new codec; encoding time, quality, and decode requirements. Neither company disclosed encoding time data, but we learned something about the latter two.
Regarding quality, we learned that neither Netflix or YouTube is pushing quality yet. Here’s MediaInfo on one of the Netflix clips; At 6.7 Mbps for 1080p@24 fps, Netflix is hardly stressing the codec.
Figure 4. Netflix AV1 encodes aren’t stressing AV1 quality parameters.
YouTube is a bit more aggressive with its encodes, as seen in Figure 5, but 5.1 Mbps for 1080p60 is still not pushing the quality envelope. As an example, I just finished a consulting project analyzing VP9 and H264 quality at 1080p60 and our test data rates ranged from 3 to 6 Mbps. For the record, YouTube did say, “At the time of writing, these transcodes are encoded at a very high bitrate for decoder performance testing.”
Figure 5. YouTube is a bit more aggressive but still isn’t pushing the envelope.
AV1 Decode
What about decode requirements? In order to play the YouTube videos, you’ll need to download Chrome Canary; there’s a version of Firefox that’s supposed to work, but I couldn’t find it. You’ll also have to go to the YouTube Testtube and choose your preferences regarding AV1 playback. If you choose like I did in Figure 6, you’ll get up to 1080p video in AV1 format.
Figure 6. Choosing your AV1 preferences.
Related Articles
Anytime you start working with a new codec, there are some fundamental tests that you should run to achieve optimal performance/quality optimization. In this article, I'll take you through those tests while encoding VVC using a version of FFmpeg that includes the Fraunhofer VVC codec.
21 Mar 2023
As recent lawsuits regarding DASH-related patents make clear, royalty payments on adaptive bitrate streaming are inevitable—even if it's not yet clear who'll be paying who, or how much
02 Dec 2019
Advance testing shows the codec producing strong bitrate savings over its competitors, but a tiered licensing model could prevent all users from enjoying the best performance.
14 Nov 2019
Demos and conversations at Streaming Media East showed that HEVC is an excellent technology, and there's real anger around its disfunctional royalty policies.
22 May 2019
Advances in video codec technology driven by the explosion in video over IP are creating heated competition and a fragmented market. Will one winner emerge or is this the new normal?
04 Apr 2019
Sisvel's Video Codec Licensing Platform will employ a "committed volume scheme" rather than a royalty cap, according to CEO Mattia Fogliacco, who did not rule out royalties on software-based encoding
28 Mar 2019
The first tests of AV1 showed glacial encoding times that seriously detracted from the codec's usability. But since then encoding times have improved enough that AV1 is almost usable—and we've got the charts to prove it.
04 Mar 2019
Looking back and the successes and misfires of H.264, HEVC, and VP9 show what the industry can expect from AV1 and VVC.
07 Dec 2018
Ahead of Streaming Media West, a meeting of codec experts offers new developments in leading-edge codecs, as well as field reports from companies already using them.
26 Oct 2018
When comparing the video quality created by different codecs, consider the companies running the comparisons and the metrics they're offering.
23 Oct 2018
AV1 delivers equivalent quality to HEVC, but with a lower data rate. For now, though, it's slow. A five-second clip took 23 hours and 46 minutes to encode.
27 Sep 2018
FFmpeg 4.0 gives many video engineers their first chance to test the new AV1 codec against H.264, HEVC, and VP9. The results? In our tests, quality was impressive, but glacially slow encoding times make AV1 a non-starter for most publishers until hardware acceleration becomes available.
31 Aug 2018
H.264 still leads, HEVC is starting to gain traction, and AV1 had its coming-out party. To add to the confusion, other codecs offer alternatives to all three. Jan Ozer makes sense of all the codec news from this year's NAB.
17 Apr 2018
Companies and Suppliers Mentioned