New objective QoE models for evaluating ABR algorithms in DASH
January 1, 2020·

·
0 min read
Ismael de Fez
Román Belda
Juan Carlos Guerri

Abstract
As users become more demanding with regards to the consumption of multimedia content, the importance of measuring their level of satisfaction is growing. The difficulty in terms of time and resources for assessing the Quality of Experience (QoE) has popularized the use of objective QoE models, which try to emulate human behavior regarding the playback of multimedia streaming. Some objective QoE models existing in the literature are based on the bitrate. However, the PSNR (Peak Signal-to-Noise Ratio) or VMAF (Video Multimethod Assessment Fusion) have been proved to be metrics with a closer relationship with the QoE than the bitrate. This paper proposes three new models to measure the QoE analytically in DASH (Dynamic Adaptive Streaming over HTTP) video services. The first is based on the bitrate of the displayed video segments, whereas the second and the third are based on the PSNR and VMAF of each video segment, respectively. The proposed models are compared to the ITU-T standard P.1203 as well as the bitrate-based QoE model proposed by Yin et al. Moreover, the paper presents a subjective study, which confirms the validity of the proposed models. The models are validated by using different DASH adaptation algorithms. In this sense, this paper also presents a DASH ABR (Adaptive Bitrate Streaming) algorithm called Look Ahead, which takes into account the inherent bitrate variability of the video encoding process in order to calculate, in real time, the appropriate quality level that minimizes the number of stalls during the playback.
Type
Publication
Computer Communications, 158, 126–140. Elsevier

Authors
Associate Researcher · Master’s Director at VIU
Ismael de Fez was born in Valencia, Spain in 1983. He received his Telecommunications Engineering degree in 2007 and his M.S. in Telematics in 2010 from the Universitat Politècnica de València (UPV), where his M.Sc. thesis was awarded by the Telefónica chair of UPV. He obtained his PhD in Telecommunications from UPV in 2014 and an MBA from UPV in 2017. He worked as an R&D Engineer at the Institute of Telecommunications and Multimedia Applications (iTEAM, UPV) from 2008 to 2021. Since 2021 he has been Director of the Master’s in Development of Web Applications and Services at the Valencian International University (VIU). His research interests include multimedia transmission, DASH adaptive streaming, QoE modelling, AL-FEC coding for unidirectional wireless environments, and file encoding.

Authors
Assistant Professor
Román Belda received his degree in Computer Science in 2004 and an M.S. in Telematics in 2013 from the Universitat Politècnica de València (UPV), Spain. He obtained his Ph.D. in Telecommunications from UPV in 2021. He is currently an Associate Professor at the Universitat Politècnica de València and a member of the Institute of Telecommunications and Multimedia Applications (iTEAM). His research interests include adaptive video streaming (MPEG-DASH), low-latency and peer-assisted video delivery, Quality of Experience (QoE), mobile applications and multimedia transmission protocols.

Authors
Full Professor · Head of the group
Juan Carlos Guerri Cebollada was born in Valencia, Spain in 1969. He received his M.S. and Ph.D. degrees in Telecommunication Engineering from the Universitat Politècnica de València (UPV) in 1993 and 1997, respectively. He is a Full Professor in the Department of Communications Engineering at UPV, where he teaches at the ETSI Telecomunicación. He leads the Multimedia Communications research group (COMM) of the iTEAM (Institute of Telecommunications and Multimedia Applications). His research spans multimedia communications, adaptive video streaming (DASH), quality of experience, wireless and ad hoc networks, and the application of multimedia technologies to industry, medicine, education and communications.