Nvidia introduces an AI choreographer based on deep-learning


AI Choreographer dance forms

In today’s day and age, with the regular introduction of newer technology or base models have resulted in very much intriguing and helpful innovations. Speaking of innovations, Nvidia has developed an AI choreographer based on deep learning that can choreograph your next dance video.

This new deep learning-based module is called Nvidia is titled as the AI Choreographer, and it was introduced in Neural Information Processing Systems Conference 2019 in Vancouver, Canada. The development of this module was only possible because of the combined efforts done by Nvidia and the University of California, Merced.

Talking more about the AI Choreographer in brief, as its name, this tool can choreograph a dance video with the help of its AI capabilities. The proper detection of the beat and song texture for choreography is challenging in the tool as it depends upon the calculation of variables. Apart from the calculations, there is an interconnection of three major dance types – Zumba, Hip-Hop, and Ballet, and There are a total of 3,61,000 types of these dance videos.

Dancing forms

The collection of all of these different clips that are approximately 71 hours of dancing footage of different dance forms is there to train the Generative Adversarial Network (GAN). The work of GAN is to educate itself, how to put a correct routine or choreography for the music provided.

Now at the initial stage of the tool’s working, pose processing that is completed by OpenPose. It helped in detecting the movements and posture of humans in real-time and was developed by Carnegie Mellon University. For increasing the efficiency and speed of their AI choreographer, Nvidia and Merced used Nvidia’s v100 GPUs and a deep learning framework called PyTorch.

At the ending of the process, the deep learning module uses the same Nvidia’s v100 GPUs for all of its future projects and work. With each passing day, Artificial intelligence or AI has played a vital role in the innovation, whether it be technology on a smartphone, camera, or machine. As of now, we are writing this article, AI has become more important for our daily life than you have ever imagined. Whether it be medical science, Industry, gaming, or even banking or financial system, AI is used everywhere.

Nvidia is going great in terms of the betterment of Artificial intelligence as it is collaborating and integrating with younger generations in universities. Youngsters have a competent mind, and by working with the American technology company, they are unveiling astounding results like this.

The source code and models of the research will be available on Git Hub soon and you can check the research papers of the project here.

Image source: GitHub NVlabs (NVIDIA)

Akshit Tiwari
Just a 20-year-old tech enthusiast who also likes to read and write, just stick with me if you like my work. I believe in Fountain Pen and Chai <3

Follow us



Windows 10 black screen

How to fix black screen issue on Windows 10 by troubleshooting connection problems and...

On Windows 10, a black screen can take place for a number of factors. It can be connected to a problem with a current graphics...
microsoft build 2020

Microsoft Build 2020 Developer Conference from May 19-21

Microsoft announced the dates for its flagship event Microsoft Build 2020 developer conference which are going to takes place next year.
Microsoft flaunts new Windows logo and redesigned app icons- feature image

Microsoft flaunts new Windows logo and redesigned app icons

Recently, Microsoft has published a post in Medium about the new Office icons. The company redesigned the icons to cop up with the changing world.

Intel 10th Generation Processors “Comet Lake” Line-up leaked

Earlier AMD's Ryzen 7 3000 family, providing a body blow to Intel's whole high-end product stack. The Ryzen 9 3900X overthrows the Core i9-9900K's...
Windows 10 optional cumulative update

Optional cumulative update KB4550945 for Windows 10 version 1909 and 1903

Microsoft releases new optional patch updates KB4550945 for Windows 10 version 1909 and 1903 following the Patch Tuesday of this month, which is a week ago.