A Binary Classifier for Test Case Feasibility Applied to Automatically Generated Tests of Event-Driven Software

Modern software application testing, such as the testing of software driven by graphical user interfaces (GUIs) or leveraging event-driven architectures in general, requires paying careful attention to context. Model-based testing (MBT) approaches first acquire a model of an application, then use the model to construct test cases covering relevant contexts. A major shortcoming of state-of-the-art automated model-based testing is that many test cases proposed by the model are not actually executable. These \textit{infeasible} test cases threaten the integrity of the entire model-based suite, and any coverage of contexts the suite aims to provide. In this research, I develop and evaluate a novel approach for classifying the feasibility of test cases. I identify a set of pertinent features for the classifier, and develop novel methods for extracting these features from the outputs of MBT tools. I use a supervised logistic regression approach to obtain a model of test case feasibility from a randomly selected training suite of test cases. I evaluate this approach with a set of experiments. The outcomes of this investigation are as follows: I confirm that infeasibility is prevalent in MBT, even for test suites designed to cover a relatively small number of unique contexts. I confirm that the frequency of infeasibility varies widely across applications. I develop and train a binary classifier for feasibility with average overall error, false positive, and false negative rates under 5\%. I find that unique event IDs are key features of the feasibility classifier, while model-specific event types are not. I construct three types of features from the event IDs associated with test cases, and evaluate the relative effectiveness of each within the classifier. To support this study, I also develop a number of tools and infrastructure components for scalable execution of automated jobs, which use state-of-the-art container and continuous integration technologies to enable parallel test execution and the persistence of all experimental artifacts.

COLLABORATIVE TESTING ACROSS SHARED SOFTWARE COMPONENTS

Large component-based systems are often built from many of the same components. As individual component-based software systems are developed, tested and maintained, these shared components are repeatedly manipulated. As a result there are often significant overlaps and synergies across and among the different test efforts of different component-based systems. However, in practice, testers of different systems rarely collaborate, taking a test-all-by-yourself approach. As a result, redundant effort is spent testing common components, and important information that could be used to improve testing quality is lost. The goal of this research is to demonstrate that, if done properly, testers of shared software components can save effort by avoiding redundant work, and can improve the test effectiveness for each component as well as for each component-based software system by using information obtained when testing across multiple components. To achieve this goal I have developed collaborative testing techniques and tools for developers and testers of component-based systems with shared components, applied the techniques to subject systems, and evaluated the cost and effectiveness of applying the techniques. The dissertation research is organized in three parts. First, I investigated current testing practices for component-based software systems to find the testing overlap and synergy we conjectured exists. Second, I designed and implemented infrastructure and related tools to facilitate communication and data sharing between testers. Third, I designed two testing processes to implement different collaborative testing algorithms and applied them to large actively developed software systems. This dissertation has shown the benefits of collaborative testing across component developers who share their components. With collaborative testing, researchers can design algorithms and tools to support collaboration processes, achieve better efficiency in testing configurations, and discover inter-component compatibility faults within a minimal time window after they are introduced.

High Precision Plasma Etch for Pattern Transfer: Towards Fluorocarbon Based Atomic Layer Etching

A basic requirement of a plasma etching process is fidelity of the patterned organic materials. In photolithography, a He plasma pretreatment (PPT) based on high ultraviolet and vacuum ultraviolet (UV/VUV) exposure was shown to be successful for roughness reduction of 193nm photoresist (PR). Typical multilayer masks consist of many other organic masking materials in addition to 193nm PR. These materials vary significantly in UV/VUV sensitivity and show, therefore, a different response to the He PPT. A delamination of the nanometer-thin, ion-induced dense amorphous carbon (DAC) layer was observed. Extensive He PPT exposure produces volatile species through UV/VUV induced scissioning. These species are trapped underneath the DAC layer in a subsequent plasma etch (PE), causing a loss of adhesion. Next to stabilizing organic materials, the major goals of this work included to establish and evaluate a cyclic fluorocarbon (FC) based approach for atomic layer etching (ALE) of SiO2 and Si; to characterize the mechanisms involved; and to evaluate the impact of processing parameters. Periodic, short precursor injections allow precise deposition of thin FC films. These films limit the amount of available chemical etchant during subsequent low energy, plasma-based Ar+ ion bombardment, resulting in strongly time-dependent etch rates. In situ ellipsometry showcased the self-limited etching. X-ray photoelectron spectroscopy (XPS) confirms FC film deposition and mixing with the substrate. The cyclic ALE approach is also able to precisely etch Si substrates. A reduced time-dependent etching is seen for Si, likely based on a lower physical sputtering energy threshold. A fluorinated, oxidized surface layer is present during ALE of Si and greatly influences the etch behavior. A reaction of the precursor with the fluorinated substrate upon precursor injection was observed and characterized. The cyclic ALE approach is transferred to a manufacturing scale reactor at IBM Research. Ensuring the transferability to industrial device patterning is crucial for the application of ALE. In addition to device patterning, the cyclic ALE process is employed for oxide removal from Si and SiGe surfaces with the goal of minimal substrate damage and surface residues. The ALE process developed for SiO2 and Si etching did not remove native oxide at the level required. Optimizing the process enabled strong O removal from the surface. Subsequent 90% H2/Ar plasma allow for removal of C and F residues.

CERVIXCHECK: A SPIRITUALLY-BASED SMS TEXT MESSAGING PILOT INTERVENTION TO INCREASE CERVICAL CANCER AWARENESS AND PAP TEST SCREENING INTENTION AMONG AFRICAN AMERICAN WOMEN

African American women account for a disproportionate burden of cervical cancer incidence and mortality rate when compared to non-Hispanic White women. Cervical cancer is one of the most preventable types of cancer, and women can be screened for it with a routine Pap test. Given that religion occupies an essential place in African American lives, framing health messages with important spiritual themes and delivering them through a popular communication delivery channel may allow for a more culturally-relevant and accessible technology-based approach to promoting cervical cancer educational content to African American women. Using community-engaged research as a framework, the purpose of this multiple methods study was to develop, pilot test, and evaluate the feasibility, acceptability, and initial efficacy of a spiritually-based SMS text messaging intervention to increase cervical cancer awareness and Pap test screening intention among African American women. The study recruited church-attending African American women ages 21-65 and was conducted in three phases. Phases 1 and 2 consisted of a series of focus group discussions (n=15), cognitive response interviews (n=8), and initial usability testing that were conducted to inform the intervention development and modifications. Phase 3 utilized a non-experimental one-group pretest-posttest design to pilot test the 16-day text messaging intervention (n=52). Of the individuals enrolled, forty-six completed the posttest (retention rate=88%). Findings provided evidence for the early feasibility, high acceptability, and some initial efficacy of the CervixCheck intervention. There were significant pre-post increases observed for knowledge about cervical cancer and the Pap test (p = .001) and subjective norms (p = .006). Additionally, results post-intervention revealed that 83% of participants reported being either “satisfied” or “very satisfied” with the program and 85% found the text messages either “useful” or “very useful”. 85% of the participants also indicated that they would “likely” or “very likely” share the information they learned from the intervention with the women around them, with 39% indicating that they had already shared some of the information they received with others they knew. A spiritually-based SMS text messaging intervention could be a culturally appropriate and cost-effective method of promoting cervical cancer early detection information to African American women.