NVIDIA announced the RTX Broadcast Engine ahead of the TwitchCon 2019. NVIDIA GPUs are currently the most popular option to power the PC games played by streamers. They likewise encode and stream video to platforms such as Twitch, YouTube, Mixer, Huya, and Douyu.[wpinsertshortcodead id=”bzyqm5d3e04029f48f”]
RTX Broadcast Engine is a set of RTX-accelerated SDKs to transform the live streams by using AI capabilities of RTX GPUs. It is powered by AI processors known as Tensor Cores on RTX GPUs. The SDKs can be added to streaming software to enable virtual green screen, detect and track facial features to use with Augmented Reality (AR) and style filters. Thus, with the help of Broadcast Engine’s AI-powered capabilities, RTX GPUs can offer more immersive live streams without any physical props or special cameras.
The RTX Broadcast Engine SDKs includes:
RTX Green screen: It’s a virtual green screen that offers to remove the background intelligently from the webcam feed in real-time without using a physical green screen. With the help of RTX Broadcast Engine, you can replace the background with the game you are playing or anything offering more privacy.
NVIDIA in their press release mentioned, “The RTX Greenscreen AI model understands which part of an image is human and which is background, so gamers get the benefits of a greenscreen without needing to buy one.”
RTX AR: It detects and tracks the facial features such as eyes and mouth, and model the surface of the face to enable real-time AR effects. “Developers can use it to create fun, engaging AR effects, such as overlaying 3D content on a face or allowing a person to control 3D characters with their face,” NVIDIA noted.
RTX Style Filters can be used to change the look and feel of your webcam feed based on the style of another image even you can style your video feed with game art or painting. An image of such is given above where a streamer styled his video with the vibe of Van Gogh’s iconic Starry Night painting.
Additionally, broadcasting applications such as OBS, Huya, Douya, XSplit, and Streamlabs already added support for NVIDIA Video Codec SDK for the better streaming experience. Three other integrations which include Twitch Studio, Discord, and Elgato made their debut this month. The adoption of RTX Broadcast Engine would be more extensive in time; however, NVIDIA didn’t mention any dates for live streaming application to the new features.[wpinsertshortcodead id=”zxikm5d3e04a8f1451″]