There you can also see that the results with their algorithm gives far better results than classical methods. Here is a link to the research paper: RIFE: Real-Time Intermediate Flow Estimation for Video Frame Interpolation for Video Frame Interpolation. In fact, I first read their research paper before noticing that they also make their algorithms available in a free open source project. That's why we decided to take a new approach.įlowframes – Video-Interpolation with AI (artificial intelligence)ĭuring my thesis, when I was looking for examples of AI applications in video production, I came across FlowFrames. That's what and I had to realize during a video project. Unfortunately, you often come up against the limits of classic algorithms. Video interpolation is supported by pretty much every video editing or compositing program nowadays, and is usually done with a few mouse clicks. Source: Artifacts from conventional motion interpolation These are then visible as distracting artifacts or unnatural-looking movements. Depending on the video source, this process can lead to very good, to terrible results. To do this, the algorithm may not only compare two images, but look at a large number of individual images to better determine the movement. This determines which areas in the image have moved where. In this process, artificial intermediate images are calculated with the help of software algorithms. For example, because the director decides to show a scene in slow motion during the editing process, which was not intended for this beforehand.Īnd this is where frame interpolation comes into play. Even in expensive cinema films this is, unfortunately, often to observe. If you slow down footage that does not have a higher frame rate, this results in unpleasant judder. So, for example, for a 4x slowdown, it makes sense to film a scene at 96fps. It didn’t look cinematic Source: įrame InterpolationIf you now want to include slow motion in your 24fps cinema film, the respective sequence must be filmed with a higher frame rate. Almost as if the performances had been partly sped up…. The movement of the actors looked… strange. It looked like behind the scenes footage. Hobbiton and Middle Earth didn’t feel like a different universe, it felt like a special effect, a film set with actors in costumes. The so-called "soap opera" effect was disturbing for many viewers. A very good example is "The Hobbit", which was shown at 48fps in some cinemas. On the other hand, many people find movies that are played at a higher frame rate disturbing. A classic video game that runs at 24fps feels sluggish and slow. That's why we have cinematic 24fps in the cinema, but professional gamers like to have ten times that much with 240Hz monitors. I don't want to dive too deep into the matter, but as a rule of thumb you can say: the more fps, the more "fluid" a movement on screen feels. Classic PC screens have 60fps (mostly specified in Herz), gaming monitors are now available with 360fps / 360Hz. In the cinema we experience 24fps, on European TV 25fps and in North America 30fps.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |