Immersive Media Group

Mission

Quality assessment of immersive media, including virtual reality, augmented reality, stereoscopic 3DTV, and multiview.

Goals

Baseline quality assessment of today’s systems

• Using repurposed traditional content for virtual reality
• New content captured specifically for virtual reality, including 360 cameras and light field cameras
• Virtual reality gaming

Subjective test methods, presentation requirements, and quality of experience guidelines 

Technologies

Light field processing also called plenoptic (e.g., interactive refocusing, changing point-of-view)

Systems with and without feedback (in response to the viewer’s actions):

• Viewpoint responsive (e.g., can look around a tree, virtual reality gaming)
• View direction responsive (e.g., can move your head)
• Non viewpoint responsive (e.g., traditional stereoscopic 3DTV)

Displays ranging from small devices to theater screens

Multiview technologies, including full parallax

Projects

1. VQEG Immersive Media Test Plan

The Immersive Media test is investigating the quality assessment of 360-degree video. The test plan can be found here.\

2. Collaboration with ITU-T SG12, Question 13

A first draft of the proposal for collaboration between VQEG-IMG and ITU Q13/12: https://docs.google.com/document/d/1sJnb2ty1diOflXZgDSE-et9flSkctoTinNlJM9ZLuKQ/edit?usp=sharing\

3. 3DTV Subjective Methods

Project lead: Marcus Barkowsky 

The goal is to define suitable methodologies for subjective quality assessment of stereoscopic 3D video:

• A unique set of video sequences is being produced to conduct the experiments (GroTruQoE dataset).
• The first step will be to conduct a large-scale experiment using the pair-comparison methodology, as we are confident that subjects can provide easily a judgment of overall preference.
• Corresponding test plan is “Establishing a Ground Truth for Quality of Experience in 3D for assessment methodologies in 3D Video Quality Assessment” (GroTruQoE3D1). This document is available in the VQEG project archives.
• The second step will use the results of the pair-comparison testing as a groundtruth database to investigate which more time-efficient subjective testing methodology can be used to predict the results of the pair-comparison test.

This project was instrumental in the development of ITU Recommendations ITU-T Rec. P.914, P.915, and P.916.

Related Activity

MPEG AHG on Quality of Immersive Media

Mandates:

1. Study existing solutions and solicit inputs related to the quality of immersive media.
2. Review and document existing methods to assess human perception and reaction to immersive media stimuli.
3. Study related activities within WG11 (e.g., OMAF, MIV, PCC, test/audio subgroup).

Chairmen: Christian Timmerer, Igor Curcio
Duration: Until the 131st MPEG meeting
Reflector(s): mpeg-i@lists.aau.at
Discussion on Gitlab

History

The immersive media group is the successor to the 3DTV group.