University of Illinois Urbana-Champaign

LAP-based motion-compensated frame interpolation

Jayashankar, Tejas

Content Files
ECE499-Sp2019-jayashankar.pdf

Permalink

https://hdl.handle.net/2142/104019

Description

Title
LAP-based motion-compensated frame interpolation
Author(s)
Jayashankar, Tejas
Contributor(s)
Moulin, Pierre
Issue Date
2019-05
Keyword(s)
  • Motion Compensation
  • Adaptive Separable Convolution
  • Lucas-Kanade Algorithm
  • Local All-Pass Filters
  • Frame Interpolation
  • Optical Flow
  • Splines
  • Convolutional Neural Network
Date of Ingest
2019-06-14T21:39:20Z
Abstract
High-quality video frame interpolation often necessitates accurate motion estimates between consecutive frames. Standard video encoding schemes often estimate the motion between frames using variants of block matching algorithms. For the sole purposes of video frame interpolation, more accurate estimates can be obtained using modern optical flow methods. In this thesis, we use the recently proposed Local All-Pass (LAP) algorithm to compute the optical flow between two consecutive frames. The resulting flow field is used to perform interpolation using cubic splines. We compare the interpolation results against a well-known optical flow estimation algorithm as well as against a recent convolutional neural network scheme for video frame interpolation. Qualitative and quantitative results show that the LAP algorithm performs fast, high-quality video frame interpolation, and perceptually outperforms the neural network and the Lucas-Kanade method on a variety of test sequences. We also perform a case study to compare LAP interpolated frames against those obtained using two leading methods on the Middlebury optical flow benchmark. Finally, we perform a user study to gauge the correlation between the quantitative and qualitative results.
Type of Resource
text
Genre of Resource
Other
Language
en
Permalink
http://hdl.handle.net/2142/104019

Owning Collections

Senior Theses - Electrical and Computer Engineering PRIMARY
The best of ECE undergraduate research