Tag Archives: twixtor

NVIDIA Slow Motion Interpolation With AI Deep Learning Tech!

NVIDIA Slow Motion Interpolation

NVIDIA has been hard at work on the problem posed by high frame rate interpolation of video data shot on lower fps.  We have had this tech since the late 1990s with the advent of Twixtor and refined over the decades in systems like Twixtor Pro and Adobe’s Optical Flow in After Effects. You are still not getting real temporal detail data since the frames are created by extrapolating velocity and direction vectors plus pixel values between frames to get the result.

We explored this technique in our post on interpolation here and why it is no substitute from a real slow motion camera solution.  NVIDIA’s new method uses machine learning along with 11,000 videos to arrive at a more convincing result. Considering the relatively small sample size we can imagine a future where hundreds of thousands or millions of footage samples are used to generate near flawless interpolation. This technique takes some serious computation and data sets so as of now it is not really ready for the mass market but that could change with the cloud very soon. → Continue Reading Full Post ←

Fake Slow Motion Is It Worth It?

Fake Slow Motion

There has been a lot of work put it developing software that can interpolate frames for video editing and compositing applications. Twixtor in the late 90’s was perhaps the first time the technology could make something worthwhile and really produce acceptable results in a computationally acceptable timeframe.

Today the most used algorithm is Adobe’s Optical Flow in Premiere or Time Warp in After Effects which use vector directional plus acceleration of pixel values to derive in between frame data to generate new frame information from the preceding frame as point A and the next frame as point B.  The results can do some wonders to really slow down things above the frame rate ceiling of the camera. → Continue Reading Full Post ←