An Empirical Study of Fault Localization for End-User Programmers

End users develop more software than any other group of programmers, using software authoring devices such as e-mail filtering editors, by-demonstration macro builders, and spreadsheet environments. Despite this, there has been little research on finding ways to help these programmers with the dependability of their software. We have been addressing this problem in several ways, one of which includes supporting end-user debugging activities through fault localization techniques. This paper presents the results of an empirical study conducted in an end-user programming environment to examine the impact of two separate factors in fault localization techniques that affect technique effectiveness. Our results shed new insights into fault localization techniques for end-user programmers and the factors that affect them, with significant implications for the evaluation of those techniques.

Incorporating Varying Test Costs and Fault Severities into Test Case Prioritization

Test case prioritization techniques schedule test cases for regression testing in an order that increases their ability to meet some performance goal. One performance goal, rate offault detection, measures how quickly faults are detected within the testing process. In previous work we provided a metric, APFD, for measuring rate of fault detection, and techniques for prioritizing test cases to improve APFD, and reported the results of experiments using those techniques. This metric and these techniques, however, applied only in cases in which test costs and fault severity are uniform. In this paper, we present a new metric for assessing the rate of fault detection of prioritized test cases, that incorporates varying test case and fault costs. We present the results of a case study illustrating the application of the metric. This study raises several practical questions that might arise in applying test case prioritization; we discuss how practitioners could go about answering these questions.

EFFECTS OF A BIRD HAZARD REDUCTION FORCE ON REDUCING BIRD/AIRCRAFT STRIKE HAZARDS AT THE ATLANTIC CITY INTERNATIONAL AIRPORT, NJ

Bird-aircraft strikes at the Atlantic City International Airport (ACY) increased from 18 in 1989 to 37 in 1990. The number of bird-aircraft strikes involving gulls (Larus spp.) during this time rose from 6 to 27, a 350% increase. The predominant species involved in bird strikes was the laughing gull (L. atricilla). Pursuant to an interagency agreement between the U.S. Department of Transportation (USDOT), Federal Aviation Administration (FAA) and the U.S. Department of Agriculture (USDA)l Animal and Plant Health Inspection Service (APHIS)/Animal Damage Control (ADC), ADC established a Emergency/Experimental Bird Hazard Reduction Force (BHFF) at ACY in 1991. An Environmental Assessment (EA) and Finding of No Significant Impact (FONSI) for the 1991 Emergency/Experimental BHRF was executed and signed by the FAA on 19 May 1991. The BHRF was adopted at this time by the FAA Technical Center as an annual program to reduce bird strikes at ACY. The BHRF goals are to minimize or eliminate the incidence of bird-aircraft strikes and runway closures due to increased bird activities. A BHRF team consisting of ADC personnel patrolled ACY for 95 days from 26 May until 28 August 1992, for a total of 2,949 person-hours. The BHRF used a combination of pyrotechnics, amplified gull distress tapes and live ammunition to harass gulls away from the airport from dawn to dusk. Gullaircraft strikes were reduced during BHRF operations in 1992 by 86% compared to gull strikes during summer months of 1990 when there was not a BHRF team. Runway closures due to bird activity decreased 100% compared to 1990 and 1991 closures. The BHRF should continue at ACY as long as birds are a threat to human safety and aircraft operations.

ENHANCEMENT OF THE FAA’s ON-LINE WILDLIFE AIRCRAFT STRIKE DATABASE WITH AN INTERACTIVE GRAPHICS CAPABILITY

Embry-Riddle Aeronautical University (Prescott, AZ, USA) was awarded a grant from the William J. Hughes FAA Technical Center in October 1999 to develop and maintain a web site dealing with a wide variety of airport safety wildlife concerns. Initially, the web site enabled users to access related topics such as wildlife management (at/near airports), bird identification information, FAA wildlife management guidelines, education, pictures, current news, upcoming meetings and training, available jobs and discussion/forum sections. In April 2001, the web site was augmented with an on-line wildlife strike report (FAA Form 5200-7). Upon submittal on-line, “quick look” email notifications are sent to concerned government personnel. The distribution of these emails varies as to whether there was damage, human injuries/fatalities, and whether feather remains were collected and will be sent to the Smithsonian Institution for identification. In July 2002, a real-time on-line query system was incorporated to allow federal and local government agencies, airport and operator personnel, and USDA and airport wildlife biologists to access this database (which as of June 2005 contains 68,288 researched strike reports added to at a rate of approximately 500 strike reports/month) to formulate strategies to reduce the hazards wildlife present to aviation. To date (June 2005), over 15,000 on-line real-time queries were processed. In June 2004, ERAU was authorized to develop a graphical interface to this on-line query system. Current capabilities include mapping strikes (by species) on the US map, each of the contiguous 48 state maps (with AK and HI being added), and airport diagrams of the major metropolitan airports as well as the next 46 airports with the most reported strikes The latter capability depicts strikes by runway in plan as well as in elevation view. Currently under development is the ability to view time-sequenced strikes on the US map. This extensive graphical interface will give analysts the ability to view strike patterns with a wide variety of variables including species, seasons, migration patterns, etc. on US and state maps and airport diagrams.