Understanding the Human Perceptions in Tele-Immersive Shared Activity

Abstract

Both comparative category rating (CCR) and degradation category rating (DCR) methods have been heavily employed in the subjective evaluations of media systems. The resulting metrics, comparative mean-opinion-score (CMOS) and degradation mean-opinion-score (DMOS), can be used to describe the system subjective quality. However, the subjective metrics may work unsuccessfully when the variance of participant votes is large. The diversity in human interests can appear due to the tradeoffs of multiple quality dimensions, which concurrently dominate the overall quality of the media system. In this paper, we conduct a user study with 19 participants to evaluate the subjective quality of two tele-immersive shared activities (TISA), where media samples of different qualities are evaluated in case of each activity. Our study aims at (1) showing the effectiveness and limitation of CMOS and DMOS using real subjective data, and (2) demonstrating the heterogeneous impacts of TISAs on human perceptions.