Author: Mike McCarthy, Technology Consultant
Adobe’s leaders at Adobe MAX 2021 announced great new features for their video products. Mike Mcarthy writes about the power of hardware-accelerated HEVC with premiere pro in his article, Hardware Accelerated HEVC in Premiere Pro, originally posted on Nov 30, 2021.
Hardware Accelerated HEVC in Premiere Pro
The High Efficiency Video Codec (HEVC) or H.265 is a very processing-intensive codec for both encoding and decoding but leads to higher video quality at lower data rates. There have been both CPUs and GPUs available for years that have dedicated hardware within them to accelerate HEVC encoding and decoding. But this hardware acceleration requires specific support within software applications to utilize them. And unlike with software encoders, there are a finite number of supported encoding options that can be accelerated, each of which has to be explicitly supported.
The newest updates to Premiere Pro have greatly increased the number of hardware-accelerated options for HEVC workflows, greatly increasing performance with those types of files.
CPU Based Codec Acceleration
Premiere Pro has had CUDA based GPU acceleration for over a decade, since CS5, but it was not utilizing NVidia’s accelerated encode and decode hardware until recently. Adobe started with Intel’s Hardware based acceleration for H.264 and HEVC encoding in version 13, which was limited to 4k at 8-bit, on CPUs with Quick Sync video processing, which from my perspective, was laptop chips.
The quality was also inferior to software encodes in the initial release, but that was fixed shortly thereafter. The next step was hardware-accelerated decoding of H.264 and HEVC, which made editing with those codecs much more doable on less powerful systems, especially when it came to scrubbing through footage, which is usually rough with long GOP formats.
8-bit color GPU Based Codec Acceleration
Then in June of 2020, Adobe added GPU encoding acceleration to Premiere Pro 14.2. This supported hardware acceleration of H.264 and HEVC encoding with both NVidia and AMD graphics cards, regardless of your CPU. This capability was much more applicable to high-end workstations, which don’t have Intel’s consumer Quick Sync feature, but of course, had a top-end discrete GPU. This is when I started using hardware acceleration for more than just testing purposes, and supported up to 8K on newer hardware, but it was still limited to 8bit color.
The Limits of 8-bit color Hardware Acceleration
Now 8-bit color was fine for most web deliverables, which was what many of those types of encodes were geared towards, but that is also about the time that we started seeing more HDR workflows being developed, and HDR definitely requires at least 10-bit color. So all HDR exports were still using the slower software encoding, and also required more processing anyway, with Max Bit Depth enabled, to actually render the extra color detail under the hood. Once accelerated encoding was pretty mainstream, my standard system benchmarking process was to encode 8K Red to 8K HEVC with hardware encoding to 8-bit Rec709, and with software encoding to 10-bit HDR, which took considerably longer. Those benchmarks were not too affected when Adobe added GPU decoding support for H264 and HEVC in Premiere 14.5, but that support really helped playback performance, especially when using multiple streams, like in a Multicam timeline.
System configuration Intel® Core™ i7–1165G7 Processor @2.8Ghz, 16 GB RAM & Intel® Iris® Xe graphics.
10-bit color hardware acceleration with 4:2:2
With the most recent release of version 22, Adobe added support for accelerated decode of 10 bit 4:2:2 HEVC files, specific to Intel Quick Sync, because neither NVidia nor AMD currently supports 4:2:2 acceleration in their GPUs. Without hardware acceleration, these newer 4:2:2 HEVC files do not playback well at all on most systems. 4:2:2 refers to the amount of color data in a file and used to be much more frequently discussed when the industry was making the jump from SD to HD. The human eye is more sensitive to brightness than chroma, so higher resolution images could be encoded more efficiently by focusing on the luminance values over the chroma data. A 4:2:0 video file has basically half res color detail in both dimensions, while the 4:4:4 file has full-color data for every pixel. 4:2:2 sits between these, while the full vertical but half horizontal resolution for the color data, and is the default format for SDI connections. Because H.264 and HEVC are designed to be delivery formats, they are very targeted to carrying the detail that is visible to the human eye and dropping anything that won’t be noticed, for the sake of efficiency. But now those codecs are being used in cameras for acquisition, and the lost color detail is becoming more noticeable during grading when highlighting image detail that otherwise wouldn’t have been visible. So camera manufacturers, who want the affordable efficiency of HEVC encoding, but better quality imagery, have started using HEVC encoding on 4:2:2 image data.
Specifically, the Canon R5 & R6, as well as Sony’s A7s3, and other DSLRs that continue to be released, use this new format, which is not as widely supported for hardware-accelerated playback. But users of Premiere Pro 22 who have Intel Quick Sync support on their newer CPUs (11th gen graphics or higher), should now have much smooth playback of files from those cameras, on the order of ten times the frame rate for real-time playback, and three times faster processing for export or transcoding tasks.
10-bit Encoding Acceleration
The most recent feature, that just appeared in the Premiere 22.1.1 beta, is 10bit HEVC accelerated encoding, which includes support for HDR output formats, and runs on Intel CPUs or NVidia GPUs.
My initial tests showed my standard benchmarking encodes completing 4 times faster on my workstation (which can already encode pretty fast in software on the top end CPU), and 16 times faster on my Razer laptop. Hardware acceleration usually makes a bigger difference on less powerful systems, because the system has the less spare processing power to throw at the software encoding implementation.
So this new 10-bit encoding acceleration will greatly aid those working in HDR, especially if they are on an Intel laptop, and all the more so if they don’t have a discrete GPU. Export is limited to 4:2:0 color-space. If you have a top-end DSLR shooting 4:2:2 HEVC files, and you want to edit on a laptop and post your work to YouTube in HDR, the playback and export of your project will be a whole lot better with the newest version of Premiere than it would have been before.
For more information on this story see Mike McCarthy’s full write-up here.
About Mike McCarthy
Mike McCarthy is a technology consultant, with extensive experience in the film post-production industry.³
Notices & Disclaimers
Intel technologies may require enabled hardware, software or service activation.
No product or component can be absolutely secure.
Intel does not control or audit third-party data. You should consult other sources to evaluate accuracy.
© Intel Corporation. Intel, the Intel logo, and other Intel marks are trademarks of Intel Corporation or its subsidiaries. Other names and brands may be claimed as the property of others.