An empirical analysis of UI-based flaky tests

A Romano, Z Song, S Grandhi… - 2021 IEEE/ACM 43rd …, 2021 - ieeexplore.ieee.org
… observed flaky tests collected, 105 tests of the 235 (45.1%) dataset … This group represents a
significant portion of the dataset … our dataset consists of a diverse set of flaky UI test samples. …

Flaky tests in ui: Understanding causes and applying correction strategies

É Sousa, C Bezerra, I Machado - … of the XXXVII Brazilian Symposium on …, 2023 - dl.acm.org
… By examining the selected data, we successfully identified and mapped the frequent
causes of flaky tests within the dataset, creating a comprehensive catalog of the correction …

An Empirical Study of Web Flaky Tests: Understanding and Unveiling DOM Event Interaction Challenges

Y Pei, J Sohn, M Papadakis - … Conference on Software Testing …, 2025 - ieeexplore.ieee.org
… 1) UI-based flaky test dataset: we chose the dataset because it contains a diverse set of flaky
UI test samples, which allows us to easily filter out those involving DOM events interaction. …

Flaky test detection in Android via event order exploration

Z Dong, A Tiwari, XL Yu, A Roychoudhury - Proceedings of the 29th ACM …, 2021 - dl.acm.org
flaky tests through exploration of event orders. Our key observation is that for a test in a mobile
app, there is a testing … on the data set used in Study 1. We reviewed most recent works on …

An empirical study of flaky tests in javascript

N Hashemi, A Tahir, S Rasheed - 2022 IEEE International …, 2022 - ieeexplore.ieee.org
… projects, and identified four categories of causes for UI-based flaky tests. Moran et al. [27] …
Dataset We constructed a dataset of JavaScript projects obtained from GitHub. We targeted …

Wefix: Intelligent automatic generation of explicit waits for efficient web end-to-end flaky tests

X Liu, Z Song, W Fang, W Yang, W Wang - Proceedings of the ACM Web …, 2024 - dl.acm.org
… We first construct a dataset of UI-based flaky tests from real-world GitHub projects. We … We
evaluate WEFix on 122 UI-based flaky tests collected from seven popular GitHub web projects…

What made this test flake? pinpointing classes responsible for test flakiness

S Habchi, G Haben, J Sohn, A Franci… - 2022 IEEE …, 2022 - ieeexplore.ieee.org
… and tools to detect and isolate flaky tests. However, flaky tests are rarely fixed as developers
… a) External validity: The main threat to the external validity of this study is the dataset size. …

Test flakiness across programming languages

K Barbosa, R Ferreira, G Pinto… - IEEE Transactions …, 2022 - ieeexplore.ieee.org
… Considering cost, we found that issues related to flaky tests are resolved either very early …
”%” shows the prevalence of that strategy in our data set. In the following, we discuss concrete …

Vocabulary of Flaky Tests in Javascript

R Rampim Soratto, MA Graciotto Silva - Proceedings of the XXII Brazilian …, 2023 - dl.acm.org
… Method: A dataset was built with flaky test cases extracted from open source software …
were created, considering the source code of flaky tests in the Javascript language. Results: We …

Reproducing Timing-Dependent GUI Flaky Tests in Android Apps via a Single Event Delay

X Cai, Z Dong, Y Wang, A Tiwari, X Peng - … on Software Testing and …, 2024 - dl.acm.org
… technique is efficient in flaky test failure reproduction. Out of the 80 flaky tests, our technique
… In this work, we developed a dataset of 80 timing-dependent flaky tests from 22 large and …