Files in this item



application/pdfECE499-Sp2019-jayashankar.pdf (16MB)
(no description provided)PDF


Title:LAP-based motion-compensated frame interpolation
Author(s):Jayashankar, Tejas
Contributor(s):Moulin, Pierre
Subject(s):Motion Compensation
Adaptive Separable Convolution
Lucas-Kanade Algorithm
Local All-Pass Filters
Frame Interpolation
Optical Flow
Convolutional Neural Network
Abstract:High-quality video frame interpolation often necessitates accurate motion estimates between consecutive frames. Standard video encoding schemes often estimate the motion between frames using variants of block matching algorithms. For the sole purposes of video frame interpolation, more accurate estimates can be obtained using modern optical flow methods. In this thesis, we use the recently proposed Local All-Pass (LAP) algorithm to compute the optical flow between two consecutive frames. The resulting flow field is used to perform interpolation using cubic splines. We compare the interpolation results against a well-known optical flow estimation algorithm as well as against a recent convolutional neural network scheme for video frame interpolation. Qualitative and quantitative results show that the LAP algorithm performs fast, high-quality video frame interpolation, and perceptually outperforms the neural network and the Lucas-Kanade method on a variety of test sequences. We also perform a case study to compare LAP interpolated frames against those obtained using two leading methods on the Middlebury optical flow benchmark. Finally, we perform a user study to gauge the correlation between the quantitative and qualitative results.
Issue Date:2019-05
Date Available in IDEALS:2019-06-14

This item appears in the following Collection(s)

Item Statistics