Nvidia creates artificial slow motion using its AI technology
Machine learning is on the rise and Nvidia seems to be its front-runner. In yet another one of its endeavors, Nvidia creates artificial slow motion video from a normal 30 fps video, by stuffing in extra frames. The frames were calculated by Nvidia’s AI technology which took the difference between positions of objects in two frames and estimated how the motion went.
How is a slow-motion video shot?
In slow-mo videos, the video is shot at a high frames per second count (around 240 fps) . While 30 fps is enough for normal motion, these extra frames are used to stretch out the video across a lengthier time-line, creating an illusion of a smooth slow-motion.
Problems with capturing slow-mo on smartphones
Many smartphones these days are capable of recording as much as up to 240 fps at 1080p. But capturing video at such a high frame rate takes up a lot of memory and processing power. It can strain the device. They also take up a lot of space on the phone and are just not efficient. Lastly, some phones still can’t record upwards of 30 fps, and are hence unable to create slow-mo videos.
Nvidia’s AI technology to the rescue
The news that Nvidia creates artificial slow motion video from a normal 30 fps is a boon to all slow-mo fanatics. Nvidia’s AI technology looks at two successive frames, calculates the difference between positions of objects. It then draws 7 frames indicating an estimated trajectory of motion. Nvidia’s AI pushes extra frames between the two and the frame count increase to 240 fps.
The example above looks convincing enough to any human eye, unbeknownst to the fact that most of it was imagined and drawn by a machine.
The technology is still not perfect. The model had to be previously trained to detect similar objects to understand their motion. Nvidia claims that this will change in the future. Nvidia’s AI technology will create slow-mo videos without the need for extensive preparation.
We need to sit back and think about how far technology has come. Machines can literally draw our videos for us, can take out useful data from a huge pile of junk and now Nvidia creates artificial slow motion videos from normal videos. What a time to be alive!