A Binary Classifier for Test Case Feasibility Applied to Automatically Generated Tests of Event-Driven Software

Modern software application testing, such as the testing of software driven by graphical user interfaces (GUIs) or leveraging event-driven architectures in general, requires paying careful attention to context. Model-based testing (MBT) approaches first acquire a model of an application, then use the model to construct test cases covering relevant contexts. A major shortcoming of state-of-the-art automated model-based testing is that many test cases proposed by the model are not actually executable. These \textit{infeasible} test cases threaten the integrity of the entire model-based suite, and any coverage of contexts the suite aims to provide. In this research, I develop and evaluate a novel approach for classifying the feasibility of test cases. I identify a set of pertinent features for the classifier, and develop novel methods for extracting these features from the outputs of MBT tools. I use a supervised logistic regression approach to obtain a model of test case feasibility from a randomly selected training suite of test cases. I evaluate this approach with a set of experiments. The outcomes of this investigation are as follows: I confirm that infeasibility is prevalent in MBT, even for test suites designed to cover a relatively small number of unique contexts. I confirm that the frequency of infeasibility varies widely across applications. I develop and train a binary classifier for feasibility with average overall error, false positive, and false negative rates under 5\%. I find that unique event IDs are key features of the feasibility classifier, while model-specific event types are not. I construct three types of features from the event IDs associated with test cases, and evaluate the relative effectiveness of each within the classifier. To support this study, I also develop a number of tools and infrastructure components for scalable execution of automated jobs, which use state-of-the-art container and continuous integration technologies to enable parallel test execution and the persistence of all experimental artifacts.

Magnetic and Acoustic Investigations of Turbulent Spherical Couette Flow

Title of dissertation: MAGNETIC AND ACOUSTIC INVESTIGATIONS OF TURBULENT SPHERICAL COUETTE FLOW Matthew M. Adams, Doctor of Philosophy, 2016 Dissertation directed by: Professor Daniel Lathrop Department of Physics This dissertation describes experiments in spherical Couette devices, using both gas and liquid sodium. The experimental geometry is motivated by the Earth's outer core, the seat of the geodynamo, and consists of an outer spherical shell and an inner sphere, both of which can be rotated independently to drive a shear flow in the fluid lying between them. In the case of experiments with liquid sodium, we apply DC axial magnetic fields, with a dominant dipole or quadrupole component, to the system. We measure the magnetic field induced by the flow of liquid sodium using an external array of Hall effect magnetic field probes, as well as two probes inserted into the fluid volume. This gives information about possible velocity patterns present, and we extend previous work categorizing flow states, noting further information that can be extracted from the induced field measurements. The limitations due to a lack of direct velocity measurements prompted us to work on developing the technique of using acoustic modes to measure zonal flows. Using gas as the working fluid in our 60~cm diameter spherical Couette experiment, we identified acoustic modes of the container, and obtained excellent agreement with theoretical predictions. For the case of uniform rotation of the system, we compared the acoustic mode frequency splittings with theoretical predictions for solid body flow, and obtained excellent agreement. This gave us confidence in extending this work to the case of differential rotation, with a turbulent flow state. Using the measured splittings for this case, our colleagues performed an inversion to infer the pattern of zonal velocities within the flow, the first such inversion in a rotating laboratory experiment. This technique holds promise for use in liquid sodium experiments, for which zonal flow measurements have historically been challenging.