COMPARATIVE ANALYSIS OF AUTOMATED TOOLS FOR CLIENT-SIDE PERFORMANCE TESTING IN MODERN WEB ENVIRONMENTS

Authors

  • Dmytro Tyrtyshnyi

DOI:

https://doi.org/10.26906/SUNZ.2026.1.107

Keywords:

computer system, web performance, Core Web Vitals, Sitespeedio, Lighthouse, false positives, false negatives, RSD, Visual Progress, UI performance

Abstract

Relevance. In the era of Single Page Applications (SPA), the traditional approach to performance testing, focusing solely on server response times, is no longer sufficient. The logic of modern web applications has shifted to the client side. However, standard automated tools often produce misleading results under unstable network conditions, failing to capture the true user experience. Object of research: The process of testing and analyzing the performance of the clientside of web applications. Subject of research: Methods and software tools for automated analysis of web performance metrics. Purpose of the article: To conduct a comparative experimental analysis of automated testing tools (Google Lighthouse vs. Sitespeed.io) under constrained network conditions and on real-world e-commerce applications, identifying specific reliability gaps in standard auditing approaches. Research results: Experiments on a controlled slow application revealed that Google Lighthouse timed out, reporting a critical "False Positive" (Score 98/100) despite a 50-second load time. Conversely, Sitespeed.io correctly captured the full load duration with high statistical stability (RSD < 10%). Further tests on real-world platforms (Nike, Zara) demonstrated "False Negative" behavior in Lighthouse, which reported inflated LCP values significantly higher than manual observation. Conclusions: The analysis confirms that while Lighthouse is useful for general audits, a robust CI/CD framework requires the flexibility of Sitespeed.io to handle custom pageCompleteChecks, OS-level controlled network throttling, and complex visual elements without generating misleading pass/fail results.

Downloads

Download data is not yet available.

References

1. G. C. Vegineni, "Real-time Performance Optimization in Modern UI Applications," 2025 3rd International Conference on Intelligent Cyber Physical Systems and Internet of Things (ICoICI), Coimbatore, India, 2025, pp. 528-533, doi: https://doi.org/10.1109/ICoICI65217.2025.11252913

2. Hort, M., Kechagia, M., Sarro, F. and Harman, M. (2021), "A Survey of Performance Optimization for Mobile Applications", IEEE Transactions on Software Engineering, vol. 47, no. 8, pp. 1–26, doi: https://doi.org/10.1109/TSE.2021.3071193

3. Ericsson, T. (2013), "Front-end website performance optimisation: Optimising the front-end performance of Swedbank’s website", Dissertation, DIVA Portal, URL: https://www.diva-portal.org/smash/get/diva2:645641/FULLTEXT01.pdf

4. Edgar, M. (2023), "Largest Contentful Paint", in Speed Metrics Guide: Choosing the Right Metrics to Use When Evaluating Websites, Apress, Berkeley, CA, pp. 137–152, doi: https://doi.org/10.1007/979-8-8688-0155-6_8

5. Д. А. Тиртишний, С. Ю. Леонов (2024), "Вплив JavaScript-бандлів на метрику Largest Contentful Paint (LCP) та рекомендації щодо оптимізації", NTU "KhPI" Repository, URL: https://repository.kpi.kharkov.ua/items/50f96f0a-f773-4ebb-b852-d76e080efc3a.

6. Д. А. Тиртишний, С. Ю. Леонов (2024), "Стратегії кешування контенту для оптимізації LCP у динамічних вебдодатках", NTU "KhPI" Repository, URL: https://repository.kpi.kharkov.ua/items/f429dd8c-f97d-42f9-843a-dad89ee7c4b5.

7. Д. А. Тиртишний, С. Ю. Леонов (2024), "INP як метрика оцінки взаємодії користувача з вебсторінкою", NTU "KhPI" Repository, URL: https://repository.kpi.kharkov.ua/items/6c41404c-1df4-409a-a6a8-a8661b44e7c4.

8. Ranjith Reddy Gaddam (2025), "Optimizing Core Web Vitals: A Comprehensive Framework for Enhanced Digital Performance", Sarcouncil Journal of Engineering and Computer Science, pp. 704–711, URL: https://sarcouncil.com/download-article/SJECS-218_-_2025-704-711.pdf.

9. Thomas, I. (2024), "The Correlation of the Popularity of E-commerce Websites and the 6 Metrics of the Lighthouse Performance Score", Furman University Scholar Exchange, URL: https://scholarexchange.furman.edu/scjas/2024/all/478/.

10. Marx, R. (2018), "Web Performance Automation for the People", in Companion Proceedings of the The Web Conference 2018 (WWW '18), ACM, New York, NY, USA, pp. 825–829, doi: https://doi.org/10.1145/3184558.3186570.

11. Д. А. Тиртишний, С. Ю. Леонов (2024), "Використання сучасних методів тестування та аналізу клієнтської частини вебдодатків", NTU "KhPI" Repository, URL: https://repository.kpi.kharkov.ua/items/c4f8bf52-2684-43d2-a2ae-6aa1b64b1923.

12. Leonov, S., Tyrtyshnyi, D. (2025), "Development of a software platform for testing the performance of the client part of a web application", Control, Navigation and Communication Systems, Vol. 1, No. 79, pp. 111–115. doi: https://doi.org/10.26906/SUNZ.2025.1.111-115

Published

2026-02-13

Most read articles by the same author(s)