Publications and Software

VQEG Tools and Subjective Labs Setup

The main goal of the VQEG Tools and Subjective Labs Setup support group is to provide the research community with a wide variety of software tools and guidance in order to facilitate video quality research.

• VQEG Tools and Subjective Labs Setup website

VQEG Software Tools

VQEG publishes open source software for video quality assessment, subjective testing, and streaming simulation. More projects are available on GitHub.

• Software Tools and Labs Setup: a collection of software to prepare, conduct, and analyze subjective tests
• Number of Subjects Calculator: calculate the required number of subjects for subjective quality tests (source code)
• SI/TI Tools: calculate spatial and temporal information (SI/TI) of video sequences
• DOI Metadata Generator: generate HTML landing pages and Crossref XML for DOI registration (source code)
• tpkloss: Telchemy packet loss insertion tool for network impairment simulation
• streamsim: a streaming simulation toolkit for video
• T.35 Quality Metadata: specification and registration for ITU-T T.35 quality metadata

VQEG Technical Reports

VQEG Technical Report 2026/001 (VQEG_TR_2026_001), “VQEG White Paper on Quality of Experience-Aware Management for Collaboration Between Network and Application Providers”, March 2026.

• If your browser blocks the PDF, hold down the CNTL button while left-clicking the above link. This will open the PDF in a new tab.

• GitHub repository: https://vqeg.github.io/doi/10.66537/OLKA7578/ 

VQEG Reports from Completed Validation Tests

VQEG has completed the following validation tests of objective video quality models. Each test involved a group of proponents who submitted models for evaluation. The independent lab group (ILG) implemented the test and ensured a fair and unbiased evaluation of models.

Where possible, the videos and individual subject ratings from these validation tests are made available on the Consumer Digital Video Library (CDVL, www.cdvl.org), for research and development purposes. Some VQEG datasets cannot be redistributed due to licensing restrictions on the source content.

• AVHD-AS/P.NATS Phase 2 was a joint project of VQEG and ITU-T Study Group 12 Question 14. The goal was to develop a multitude of objective models, varying in terms of complexity/type of input/use-cases for the assessment of video quality in adaptive bitrate streaming services over reliable transport up to 4K. For more information, see the AVHD project page.

• Hybrid Perceptual Bitstream (Hybrid) examined the performance of Hybrid models for VGA/WVGA and HDTV, using ACR-HR. Ten datasets were created. The test plan, final report, and status of ITU Recommendations are available on the Hybrid project page.

• High Definition Television (HDTV) examined the performance of FR, RR and NR models for HDTV, using ACR-HR. Six datasets were created, five of which can be redistributed for research and development purposes. The test plan, final report, video sequences, and resulting ITU Recommendations are available on the HDTV Phase I project page.

• Reduced Reference/No Reference Television (RRNR-TV) examined the performance of RR and NR models on standard definition video, using ACR-HR. Two datasets were created: 525-line (NTSC) and 625-line (PAL) video. The test plan, final report, and resulting ITU Recommendations are available on the RRNR-TV project page.

• Multimedia (MM) Phase I examined the performance of FR, RR and NR models for VGA, CIF and QCIF video (no audio), using ACR-HR. 41 datasets were created, none of which can be redistributed. The test plan, final report and resulting ITU Recommendations are available on the Multimedia Phase I project page.

• Full Reference Television (FRTV) Phase II examined the performance of FR and NR models on standard definition video, using the DSCQS methodology. Two datasets were created: 525-line (NTSC) and 625-line (PAL) video. The test plan, final report, and resulting ITU Recommendations are available on the FR-TV Phase II project page. The video sequences cannot be distributed due to licensing restrictions.

• Full Reference Television (FRTV) Phase I examined the performance of FR and NR models on standard definition video, using the DSCQS methodology. Four datasets were created: high quality and medium quality, for both 525-line (NTSC) and 625-line (PAL) video. Models were difficult to distinguish due to the narrow range of quality in each dataset. The test plan, final report, and video sequences are available on the FR-TV Phase I project project page.

VQEG Publication Archives

The links below provide access to old T1A1 Contributions and various VQEG files (i.e., eLetters, Progress Reports, project archives, and validation tests). 

Click on ”+” to expand each list of files.