Real-Time 3D Video Compression for Tele-Immersive Environments

Yang, Zhenyu; Cui, Yi; Anwar, Zahid; Bocchino, Robert L., Jr.; Kiyanclar, Nadir; Nahrstedt, Klara; Campbell, Roy H.; Yurcik, William

Permalink

https://hdl.handle.net/2142/11085 Copy

Description

Title

Real-Time 3D Video Compression for Tele-Immersive Environments

Author(s)

• Yang, Zhenyu
• Cui, Yi
• Anwar, Zahid
• Bocchino, Robert L., Jr.
• Kiyanclar, Nadir
• Nahrstedt, Klara
• Campbell, Roy H.
• Yurcik, William

Issue Date

2005-08

Keyword(s)

computer science

Abstract

Tele-immersive system can improve the productivity and aid communication by allowing distributed parties to exchange information via a shared immersive experience. The TEEVE research project at the University of Illinois (UIUC) and the University of California at Berkeley (UC Berkeley) seeks to promote the application of tele-immersive environments by a holistic integration of existing components that capture, transmit, and render three-dimensional (3D) scenes in real time to convey the sense of an immersive space. However, the transmission of 3D videos poses a great challenge. First, it is bandwidth-intensive as multiple large volume 3D video streams have to be transmitted. Second, the video stream contains not only color but also depth information, which requires different treatment. While color information may be compressed in a lossy manner, the depth information should be compressed losslessly. Therefore, a 3D real-time compression algorithm must be deployed to accommodate both the bandwidth requirement and the variety of data. In this paper, we present and evaluate two compression schemes for compressing 3D video streams containing color and depth information. For the first scheme, we use color reduction followed by background removal to compress the color information, which is then compressed along with the depth information using zlib. For the second scheme, we use motion JPEG to compress the color information and run length (RLE) coding followed by Huffman coding to compress the depth information. The experimental results of 3D videos captured from real tele-immersive environment show that: (1) the compressed data preserves enough information to communicate the 3D images effectively (minimum PSNR >40) and (2) even without inter-frame motion estimation, very high compression ratios (average >15) are achievable at speeds sufficient to allow real-time communication (average 13 ms for each video frame).

Type of Resource

text

Permalink

http://hdl.handle.net/2142/11085

Copyright and License Information

You are granted permission for the non-commercial reproduction, distribution, display, and performance of this technical report in any format, BUT this permission is only for a period of 45 (forty-five) days from the most recent time that you verified that this technical report is still available from the University of Illinois at Urbana-Champaign Computer Science Department under terms that include this permission. All other rights are reserved by the author(s).

Owning Collections