Xilinx Adds Advanced Machine Learning Capabilities for Pro AV and Broadcast Platforms

Unveils industry’s first HDMI 2.1 implementation on 7nm Versal ACAP devices for 8K deployment

Amsterdam(10 Feb 2020)

Xilinx, Inc. (NASDAQ: XLNX), the leader in adaptive and intelligent computing, today announced a range of new and advanced machine learning (ML) capabilities for Xilinx devices targeted at the professional audio/video (Pro AV) and broadcast markets. Additionally, Xilinx unveiled the industry’s first demonstration of a programmable HDMI 2.1 implementation on its 7nm Versal™ devices. Xilinx is showcasing these capabilities and more at Integrated Systems Europe (ISE) 2020, taking place this week in Amsterdam. These and other highly adaptable Xilinx solutions for the Pro AV and broadcast markets are designed to help customers reduce costs and future proof investments while keeping pace with new usage models and evolving industry standards.

Advanced ML capabilities for AI edge processing

Newly available ML capabilities for Xilinx Pro AV and broadcast platforms include region-of-interest encoding, intelligent digital signage, automatic object tracking and window cropping, and speech recognition. Customers can now take advantage of these ML capabilities on Xilinx devices, including the already highly integrated Zynq® UltraScale+™ MPSoC platform, for AI edge processing. The combination of real-time audio and video processing, AV connectivity interfaces, codecs, IP networking, CPU, and GPU into an adaptable and scalable single-chip solution can provide users with significant space, power, and cost savings.

“Machine learning is a rapidly developing technology that is stimulating new usage models in Pro AV and broadcast,” said Ramesh Iyer, director of Pro AV & Broadcast at Xilinx. “Adding ML into Xilinx’s adaptable platforms provides a highly integrated AV processor that delivers proven support for 8K video, AV-over-IP, and compression, and now adds advanced capabilities for monetizing analytics, improving workflow efficiency and enhancing usability. Ultimately, these integrated ML features will allow companies to increase innovation, differentiate themselves, and accelerate time-to-market.”

Pro AV market customers can apply the new ML capabilities across many applications and workloads. Key examples, include:

• Region-of-Interest Encoding – detect faces and features using ML and the Zynq UltraScale+ MPSoC integrated H.264/H.265 codec to keep video quality high in those areas and apply higher compression for backgrounds. This reduces the overall bitrate and saves significant costs in live streaming.

• Intelligent Digital Signage – using ML models for  gender, age and gesture detection to present targeted interactive advertising in digital signage. The result is a higher return on investment for advertisers as well as monetizable behaviour metrics.
• Automated Object Tracking and Window Cropping – output multiple HD windows from a single 4K camera using ML. This is particularly useful when providing switchable content at live events and in control rooms.
• Speech Recognition – automatically output text from speech, which is ideal for automating the transcription of meeting notes and language translation in conferencing and collaboration. 

First HDMI 2.1 implementation on 7nm devices

At ISE 2020, Xilinx will demonstrate the industry's first programmable HDMI 2.1 implementation on its 7nm Versal™ devices, built on the first adaptive compute acceleration platform (ACAP). The ACAP is a revolutionary new category of heterogeneous compute devices with capabilities far exceeding those of conventional CPUs, GPUs and FPGAs.

With data rates up to 48Gbps, HDMI 2.1 supports a range of higher video resolutions and frame rates, including 8K60 and 4K120, for a more immersive experience in LED walls, large format displays, digital signage, and applications that rely on fast-moving video such as live sports. Developed in preparation for this, HDMI 2.1 support on Versal ACAP will allow customers to transmit, receive and process up to 8K (7680 x 4320 pixels) ultra-high-definition (UHD) video. 

The 7nm Versal ACAP offers scalar, adaptable and intelligent engines in a software-programmable silicon infrastructure, providing a tight coupling between embedded software, multichannel AV processing pipelines, and AI inferencing. Additionally, combining real-time video processing, AV connectivity interfaces, codecs, IP networking, CPU, GPU and more into a single-chip solution means that customers can save space, power, and cost.

Integrated Systems Europe 2020

Xilinx will be showcasing the newly available ML capabilities, first programmable HDMI 2.1 implementation on a 7nm device, and other cutting-edge solutions for the Pro AV and broadcast markets at ISE 2020 this week in Amsterdam, Netherlands, in booth #15-D240. For more information on the demos Xilinx will showcase, visit: https://www.xilinx.com/about/events/2020/ise-2020.html

Follow Xilinx on Twitter, LinkedIn and Facebook.

About Xilinx
Xilinx develops highly flexible and adaptive processing platforms that enable rapid innovation across a variety of technologies – from the endpoint, to the edge, to the cloud. Xilinx is the inventor of the FPGA, hardware programmable SoCs, and the ACAP, designed to deliver the most dynamic processor technology in the industry and enable the adaptable, intelligent, and connected world of the future. For more information, visit www.xilinx.com.