Designing Software Product Lines for Testability

Software product line (SPL) engineering offers several advantages in the development of families of software products such as reduced costs, high quality and a short time to market. A software product line is a set of software intensive systems, each of which shares a common core set of functionalities, but also differs from the other products through customization tailored to fit the needs of individual groups of customers. The differences between products within the family are well-understood and organized into a feature model that represents the variability of the SPL. Products can then be built by generating and composing features described in the feature model. Testing of software product lines has become a bottleneck in the SPL development lifecycle, since many of the techniques used in their testing have been borrowed from traditional software testing and do not directly take advantage of the similarities between products. This limits the overall gains that can be achieved in SPL engineering. Recent work proposed by both industry and the research community for improving SPL testing has begun to consider this problem, but there is still a need for better testing techniques that are tailored to SPL development. In this thesis, I make two primary contributions to software product line testing. First I propose a new definition for testability of SPLs that is based on the ability to re-use test cases between products without a loss of fault detection effectiveness. I build on this idea to identify elements of the feature model that contribute positively and/or negatively towards SPL testability. Second, I provide a graph based testing approach called the FIG Basis Path method that selects products and features for testing based on a feature dependency graph. This method should increase our ability to re-use results of test cases across successive products in the family and reduce testing effort. I report the results of a case study involving several non-trivial SPLs and show that for these objects, the FIG Basis Path method is as effective as testing all products, but requires us to test no more than 24% of the products in the SPL.

Constructability Testing of Folded Plate Girders

A new steel girder bridge system was developed at the University of Nebraska. The innovative girder design is a box girder folded from a single steel plate that has a trapezoid shape with an opening on the bottom. The girder has application in short span bridges and accelerated construction situations. The structural performance of the girder requires investigation in all stages of a bridge’s lifecycle. This thesis contains descriptions and results from the first two tests from a series of tests developed to evaluate this new girder shape. The objective of these two tests was to investigate the constructability of the girders. During construction a bridge is in its least stable condition and it is important that the bridge components exhibit both adequate strength and stability during this critical stage. To this end, two girders were tested in flexure over a simple span as a non-composite beam simulating the loading the girders would be subjected to during construction. The results of the two tests indicate that the folded girder as a whole, and its components, provide adequate strength and stability at construction load levels. Failure occurred at loads that were above normal construction load levels and resulted in a ductile failure mode, which is a well documented benefit of steel components. The girders remained stable through all phases of loading including failure. The top flange was the weakest component of the beam during construction due to its role as a compression element that has a slender and un-braced form. The compression in the top flange caused local buckling in the top flange even at elastic load levels. This was the cause for loss of stiffness and failure in both specimens. Incorporation of a ridge at the center of the top flange of specimens, results of which are not reported in this thesis, proved to resolve this very early buckling issue.