Proceedings of the Seventh International Workshop on Video Processing and Quality Metrics for Consumer Electronics (VPQM-2013), Scottsdale, AZ, January 30-February 1, 2013

How To Choose Video Sequences For Video Quality Assessment

Margaret H. Pinson; Karen Sue Boyd; Jessica Hooker; Kristina Muntean

Abstract: This paper presents recommended techniques for choosing video sequences for subjective experiments. Subjective video quality assessment is a well understood field, yet scene selection is often limited by content availability. The Consumer Digital Video Library ( is a solution. Task oriented subjective testing is a newer field than entertainment oriented testing that may require a different approach to scene selection. We describe three different task-based investigations currently underway: performance requirements for public safety equipment, how quality affects comprehension of sign language over a video link, and how video affects oral comprehension over an audiovisual link. Recommendations for scene selection for two types of testing are given. The impact of experiment design will be considered. An example 1080i 29.97fps video sequence set is presented.

Keywords: experiment design; MOS; subjective testing; task-based subjective testing; video quality assessment

For technical information concerning this report, contact:

Margaret H. Pinson
Institute for Telecommunication Sciences
(303) 497-3579

To request a reprint of this report, contact:

Lilli Segre, Publications Officer
Institute for Telecommunication Sciences
(303) 497-3572

Disclaimer: Certain commercial equipment, components, and software may be identified in this report to specify adequately the technical aspects of the reported results. In no case does such identification imply recommendation or endorsement by the National Telecommunications and Information Administration, nor does it imply that the equipment or software identified is necessarily the best available for the particular application or uses.

Back to Search Results