Revitalizing Legacy Video Content: Deinterlacing with Bidirectional Information Propagation


Zhaowei Gao (Beijing Jingwei Hirain Technologies Co., Inc.), Mingyang Song (Disney Research, Disney Research), Christopher Schroers (Disney Research|Studios, Disney), Yang Zhang (Disney Research, Disney)
The 35th British Machine Vision Conference

Abstract

Due to old CRT display technology and limited transmission bandwidth, early film and TV broadcasts commonly used interlaced scanning. This meant each field contained only half of the information. Since modern displays require full frames, this has spurred research into deinterlacing, i.e. restoring the missing information in legacy video content. In this paper, we present a deep-learning-based method for deinterlacing animated and live-action content. Our proposed method supports bidirectional spatio-temporal information propagation across multiple scales to leverage information in both space and time. More specifically, we design a Flow-guided Refinement Block (FRB) which performs feature refinement including alignment, fusion, and rectification. Additionally, our method can process multiple fields simultaneously, reducing per-frame processing time, and potentially enabling real-time processing. Our experimental results demonstrate that our proposed method achieves superior performance compared to existing methods.

Citation

@inproceedings{Gao_2024_BMVC,
author    = {Zhaowei Gao and Mingyang Song and Christopher Schroers and Yang Zhang},
title     = {Revitalizing Legacy Video Content: Deinterlacing with Bidirectional Information Propagation},
booktitle = {35th British Machine Vision Conference 2024, {BMVC} 2024, Glasgow, UK, November 25-28, 2024},
publisher = {BMVA},
year      = {2024},
url       = {https://papers.bmvc2024.org/0642.pdf}
}


Copyright © 2024 The British Machine Vision Association and Society for Pattern Recognition
The British Machine Vision Conference is organised by The British Machine Vision Association and Society for Pattern Recognition. The Association is a Company limited by guarantee, No.2543446, and a non-profit-making body, registered in England and Wales as Charity No.1002307 (Registered Office: Dept. of Computer Science, Durham University, South Road, Durham, DH1 3LE, UK).

Imprint | Data Protection