A Vital Improvement? Relating Google's Core Web Vitals to Actual Web QoE
N. Wehner, M. Amir, M. Seufert, R. Schatz, and T. Hoßfeld. 14th International Conference on Quality of Multimedia Experience (QoMEX), Best Paper Award, Lippstadt, Germany, (September 2022)
Abstract
Providing sophisticated Web Quality of Experience (QoE) has become paramount for web service providers and network operators alike. Due to advances in Web technologies (HTML5, responsive design, etc.), traditional Web QoE models focusing mainly on loading times have to be refined and improved. In this work, we relate Google's Core Web Vitals, a set of metrics for improving user experience, to the loading time aspects of Web QoE. To this end, we first perform objective measurements in the Web using Google's Lighthouse. To close the gap between metrics and experience, we complement these objective measurements with subjective assessment by performing multiple crowdsourcing QoE studies. In these studies, we use CWeQS, a customized framework to emulate the entire web page loading process, and ask users for their experience while controlling the Core Web Vitals. Our results suggest that the Core Web Vitals have less predictive value for Web QoE than expected and that page loading times remain the main influence factor in this context.
%0 Conference Paper
%1 info3-inproceedings-2022-12
%A Wehner, Nikolas
%A Amir, Monisha
%A Seufert, Michael
%A Schatz, Raimund
%A Hoßfeld, Tobias
%B 14th International Conference on Quality of Multimedia Experience (QoMEX), Best Paper Award
%C Lippstadt, Germany
%D 2022
%K myown ucn
%T A Vital Improvement? Relating Google's Core Web Vitals to Actual Web QoE
%X Providing sophisticated Web Quality of Experience (QoE) has become paramount for web service providers and network operators alike. Due to advances in Web technologies (HTML5, responsive design, etc.), traditional Web QoE models focusing mainly on loading times have to be refined and improved. In this work, we relate Google's Core Web Vitals, a set of metrics for improving user experience, to the loading time aspects of Web QoE. To this end, we first perform objective measurements in the Web using Google's Lighthouse. To close the gap between metrics and experience, we complement these objective measurements with subjective assessment by performing multiple crowdsourcing QoE studies. In these studies, we use CWeQS, a customized framework to emulate the entire web page loading process, and ask users for their experience while controlling the Core Web Vitals. Our results suggest that the Core Web Vitals have less predictive value for Web QoE than expected and that page loading times remain the main influence factor in this context.
@inproceedings{info3-inproceedings-2022-12,
abstract = {Providing sophisticated Web Quality of Experience (QoE) has become paramount for web service providers and network operators alike. Due to advances in Web technologies (HTML5, responsive design, etc.), traditional Web QoE models focusing mainly on loading times have to be refined and improved. In this work, we relate Google's Core Web Vitals, a set of metrics for improving user experience, to the loading time aspects of Web QoE. To this end, we first perform objective measurements in the Web using Google's Lighthouse. To close the gap between metrics and experience, we complement these objective measurements with subjective assessment by performing multiple crowdsourcing QoE studies. In these studies, we use CWeQS, a customized framework to emulate the entire web page loading process, and ask users for their experience while controlling the Core Web Vitals. Our results suggest that the Core Web Vitals have less predictive value for Web QoE than expected and that page loading times remain the main influence factor in this context.},
added-at = {2022-06-01T17:28:16.000+0200},
address = {Lippstadt, Germany},
author = {Wehner, Nikolas and Amir, Monisha and Seufert, Michael and Schatz, Raimund and Hoßfeld, Tobias},
biburl = {https://www.bibsonomy.org/bibtex/2d6e6517100accdb77808a154d06c5d5a/uniwue_info3},
booktitle = {14th International Conference on Quality of Multimedia Experience (QoMEX), Best Paper Award},
interhash = {ccbcedce0e18b7ed5924cd294ab390f5},
intrahash = {d6e6517100accdb77808a154d06c5d5a},
keywords = {myown ucn},
month = {9},
timestamp = {2022-09-16T16:45:10.000+0200},
title = {A Vital Improvement? Relating Google's Core Web Vitals to Actual Web QoE},
year = 2022
}