Load and Performance Testing of Web Applications on Service Based Environments

Suorituskyky- ja kuormitustestien tekeminen sovelluksille on erittäin tärkeä osa tuotantoprosessia nykypäivänä. Myös Web-sovelluksia testataan yhä enemmän. Tarve suorituskyky- ja kuormitustestien tekemiselle on selvä. Testattavan ympäristön tämänhetkinen, mutta myös tulevaisuuden toimivuus taataan oikein tehdyillä testeillä ja niitä seuraavilla korjaustoimenpiteillä. Suurten käyttäjämäärien testaaminen manuaalisesti on kuitenkin hyvin vaikeaa. Sirpaleisen ympäristön, kuten palveluihin perustuvien Web-sovellusympäristöjen testaaminen on haaste. Tämän työn aiheena on arvioida työkaluja ja menetelmiä, joilla raskaita teollisia Web-sovelluksia voidaan testata. Tavoitteena on löytää testausmenetelmiä, joilla voidaan luotettavasti simuloida suuria käyttäjämääriä. Tavoitteena on myös arvioida erilaisten yhteyksien ja protokollien vaikutusta Web-sovelluksen suorituskykyyn.

Development of Cookstove Emissions and Performance Testing Suite with Time-resolved Particulate Matter Analysis and Excess Air Estimation

Thesis (Master's)--University of Washington, 2016-06

Online MBPeT dashboard : enabling performance testing as a service in the cloud

In this thesis, tool support is addressed for the combined disciplines of Model-based testing and performance testing. Model-based testing (MBT) utilizes abstract behavioral models to automate test generation, thus decreasing time and cost of test creation. MBT is a functional testing technique, thereby focusing on output, behavior, and functionality. Performance testing, however, is non-functional and is concerned with responsiveness and stability under various load conditions. MBPeT (Model-Based Performance evaluation Tool) is one such tool which utilizes probabilistic models, representing dynamic real-world user behavior patterns, to generate synthetic workload against a System Under Test and in turn carry out performance analysis based on key performance indicators (KPI). Developed at Åbo Akademi University, the MBPeT tool is currently comprised of a downloadable command-line based tool as well as a graphical user interface. The goal of this thesis project is two-fold: 1) to extend the existing MBPeT tool by deploying it as a web-based application, thereby removing the requirement of local installation, and 2) to design a user interface for this web application which will add new user interaction paradigms to the existing feature set of the tool. All phases of the MBPeT process will be realized via this single web deployment location including probabilistic model creation, test configurations, test session execution against a SUT with real-time monitoring of user configurable metric, and final test report generation and display. This web application (MBPeT Dashboard) is implemented with the Java programming language on top of the Vaadin framework for rich internet application development. The Vaadin framework handles the complicated web communications processes and front-end technologies, freeing developers to implement the business logic as well as the user interface in pure Java. A number of experiments are run in a case study environment to validate the functionality of the newly developed Dashboard application as well as the scalability of the solution implemented in handling multiple concurrent users. The results support a successful solution with regards to the functional and performance criteria defined, while improvements and optimizations are suggested to increase both of these factors.

An agent-based model of team coordination and performance

This research is based on the premises that teams can be designed to optimize its performance, and appropriate team coordination is a significant factor to team outcome performance. Contingency theory argues that the effectiveness of a team depends on the right fit of the team design factors to the particular job at hand. Therefore, organizations need computational tools capable of predict the performance of different configurations of teams. This research created an agent-based model of teams called the Team Coordination Model (TCM). The TCM estimates the coordination load and performance of a team, based on its composition, coordination mechanisms, and job’s structural characteristics. The TCM can be used to determine the team’s design characteristics that most likely lead the team to achieve optimal performance. The TCM is implemented as an agent-based discrete-event simulation application built using JAVA and Cybele Pro agent architecture. The model implements the effect of individual team design factors on team processes, but the resulting performance emerges from the behavior of the agents. These team member agents use decision making, and explicit and implicit mechanisms to coordinate the job. The model validation included the comparison of the TCM’s results with statistics from a real team and with the results predicted by the team performance literature. An illustrative 26-1 fractional factorial experimental design demonstrates the application of the simulation model to the design of a team. The results from the ANOVA analysis have been used to recommend the combination of levels of the experimental factors that optimize the completion time for a team that runs sailboats races. This research main contribution to the team modeling literature is a model capable of simulating teams working on complex job environments. The TCM implements a stochastic job structure model capable of capturing some of the complexity not capture by current models. In a stochastic job structure, the tasks required to complete the job change during the team execution of the job. This research proposed three new types of dependencies between tasks required to model a job as a stochastic structure. These dependencies are conditional sequential, single-conditional sequential, and the merge dependencies.

Aerodynamic load characteristics evaluation and tri-axial performance testing on fiber reinforced polymer connections and metal fasteners to promote hurricane damage mitigation

Damages during extreme wind events highlight the weaknesses of mechanical fasteners at the roof-to-wall connections in residential timber frame buildings. The allowable capacity of the metal fasteners is based on results of unidirectional component testing that do not simulate realistic tri-axial aerodynamic loading effects. The first objective of this research was to simulate hurricane effects and study hurricane-structure interaction at full-scale, facilitating better understanding of the combined impacts of wind, rain, and debris on inter-component connections at spatial and temporal scales. The second objective was to evaluate the performance of a non-intrusive roof-to-wall connection system using fiber reinforced polymer (FRP) materials and compare its load capacity to the capacity of an existing metal fastener under simulated aerodynamic loads. ^ The Wall of Wind (WoW) testing performed using FRP connections on a one-story gable-roof timber structure instrumented with a variety of sensors, was used to create a database on aerodynamic and aero-hydrodynamic loading on roof-to-wall connections tested under several parameters: angles of attack, wind-turbulence content, internal pressure conditions, with and without effects of rain. Based on the aerodynamic loading results obtained from WoW tests, sets of three force components (tri-axial mean loads) were combined into a series of resultant mean forces, which were used to test the FRP and metal connections in the structures laboratory up to failure. A new component testing system and test protocol were developed for testing fasteners under simulated triaxial loading as opposed to uni-axial loading. The tri-axial and uni-axial test results were compared for hurricane clips. Also, comparison was made between tri-axial load capacity of FRP and metal connections. ^ The research findings demonstrate that the FRP connection is a viable option for use in timber roof-to-wall connection system. Findings also confirm that current testing methods of mechanical fasteners tend to overestimate the actual load capacities of a connector. Additionally, the research also contributes to the development a new testing protocol for fasteners using tri-axial simultaneous loads based on the aerodynamic database obtained from the WoW testing. ^

Aerodynamic Load Characteristics Evaluation and Tri-Axial Performance Testing on Fiber Reinforced Polymer Connections and Metal Fasteners to Promote Hurricane Damage Mitigation

Damages during extreme wind events highlight the weaknesses of mechanical fasteners at the roof-to-wall connections in residential timber frame buildings. The allowable capacity of the metal fasteners is based on results of unidirectional component testing that do not simulate realistic tri-axial aerodynamic loading effects. The first objective of this research was to simulate hurricane effects and study hurricane-structure interaction at full-scale, facilitating better understanding of the combined impacts of wind, rain, and debris on inter-component connections at spatial and temporal scales. The second objective was to evaluate the performance of a non-intrusive roof-to-wall connection system using fiber reinforced polymer (FRP) materials and compare its load capacity to the capacity of an existing metal fastener under simulated aerodynamic loads. The Wall of Wind (WoW) testing performed using FRP connections on a one-story gable-roof timber structure instrumented with a variety of sensors, was used to create a database on aerodynamic and aero-hydrodynamic loading on roof-to-wall connections tested under several parameters: angles of attack, wind-turbulence content, internal pressure conditions, with and without effects of rain. Based on the aerodynamic loading results obtained from WoW tests, sets of three force components (tri-axial mean loads) were combined into a series of resultant mean forces, which were used to test the FRP and metal connections in the structures laboratory up to failure. A new component testing system and test protocol were developed for testing fasteners under simulated tri-axial loading as opposed to uni-axial loading. The tri-axial and uni-axial test results were compared for hurricane clips. Also, comparison was made between tri-axial load capacity of FRP and metal connections. The research findings demonstrate that the FRP connection is a viable option for use in timber roof-to-wall connection system. Findings also confirm that current testing methods of mechanical fasteners tend to overestimate the actual load capacities of a connector. Additionally, the research also contributes to the development a new testing protocol for fasteners using tri-axial simultaneous loads based on the aerodynamic database obtained from the WoW testing.

Performance and emissions testing of a small two stroke engine using mid-level ethanol blends

With the introduction of the mid-level ethanol blend gasoline fuel for commercial sale, the compatibility of different off-road engines is needed. This report details the test study of using one mid-level ethanol fuel in a two stroke hand held gasoline engine used to power line trimmers. The study sponsored by E3 is to test the effectiveness of an aftermarket spark plug from E3 Spark Plug when using a mid-level ethanol blend gasoline. A 15% ethanol by volume (E15) is the test mid-level ethanol used and the 10% ethanol by volume (E10) was used as the baseline fuel. The testing comprises running the engine at different load points and throttle positions to evaluate the cylinder head temperature, exhaust temperature and engine speed. Raw gas emissions were also measured to determine the impact of the performance spark plug. The low calorific value of the E15 fuel decreased the speed of the engine along with reduction in the fuel consumption and exhaust gas temperature. The HC emissions for E15 fuel and E3 spark plug increased when compared to the base line in most of the cases and NO formation was dependent on the cylinder head temperature. The E3 spark plug had a tendency to increase the temperature of the cylinder head irrespective of fuel type while reducing engine speed.

Effects of memory load and distraction on performance and event-related slow potentials in a visuospatial working memory task

Brain electrical activity related to working memory was recorded at 15 scalp electrodes during a visuospatial delayed response task. Participants (N = 18) touched the remembered position of a target on a computer screen after either a 1 or 8 sec delay. These memory trials were compared to sensory trials in which the target remained present throughout the delay and response periods. Distracter stimuli identical to the target were briefly presented during the delay on 30% of trials. Responses were less accurate in memory than sensory trials, especially after the long delay. During the delay slow potentials developed that were significantly more negative in memory than sensory trials. The difference between memory and sensory trials was greater at anterior than posterior electrodes. On trials with distracters, the slow potentials generated by memory trials showed further enhancement of negativity whereas there were minimal effects on accuracy of performance. The results provide evidence that engagement of visuospatial working memory generates slow wave negativity with a timing and distribution consistent with frontal activation. Enhanced brain activity associated with working memory is required to maintain performance in the presence of distraction. © 1997 by the Massachusetts Institute of Technology

A System Dynamics-Based Simulation Experiment for Testing Mental Model and Performance Effects of Using the Balanced Scorecard

This study develops a theoretical model that explains the effectiveness of the balanced scorecard approach by means of a system dynamics and feedback learning perspective. Presumably, the balanced scorecard leads to a better understanding of context, allowing managers to externalize and improve their mental models. We present a set of hypotheses about the influence of the balanced scorecard approach on mental models and performance. A test based on a simulation experiment that uses a system dynamics model is performed. The experiment included three types of parameters: financial indicators; balanced scorecard indicators; and balanced scorecard indicators with the aid of a strategy map review. Two out of the three hypotheses were confirmed. It was concluded that a strategy map review positively influences mental model similarity, and mental model similarity positively influences performance.

Laboratory and Field Testing of an Accelerated Bridge Construction Demonstration Bridge: US Highway 6 Bridge over Keg Creek, RB02-012, 2013

The US Highway 6 Bridge over Keg Creek outside of Council Bluffs, Iowa is a demonstration bridge site chosen to put into practice newly-developed Accelerated Bridge Construction (ABC) concepts. One of these new concepts is the use of prefabricated high performance concrete (HPC) bridge elements that are connected, in place, utilizing advanced material closure-pours and quick-to-install connection details. The Keg Creek Bridge is the first bridge in the US to utilize moment-resisting ultra-high performance concrete (UHPC) joints in negative moment regions over piers. Through laboratory and live load field testing, performance of these transverse joints as well as global bridge behavior is quantified and examined. The effectiveness of the structural performance of the bridge is evaluated to provide guidance for future designs of similar bridges throughout the US.

Evaluation of Long-Term Field Performance of Cold In-Place Recycled Roads: Field and Laboratory Testing, TR-502, 2007

Cold in-place recycling (CIR) has become an attractive method for rehabilitating asphalt roads that have good subgrade support and are suffering distress related to non-structural aging and cracking of the pavement layer. Although CIR is widely used, its use could be expanded if its performance were more predictable. Transportation officials have observed roads that were recycled under similar circumstances perform very differently for no clear reason. Moreover, a rational mix design has not yet been developed, design assumptions regarding the structural support of the CIR layer remain empirical and conservative, and there is no clear understanding of the cause-effect relationships between the choices made during the design/construction process and the resulting performance. The objective of this project is to investigate these relationships, especially concerning the age of the recycled pavement, cumulative traffic volume, support conditions, aged engineering properties of the CIR materials, and road performance. Twenty-four CIR asphalt roads constructed in Iowa from 1986 to 2004 were studied: 18 were selected from a sample of roads studied in a previous research project (HR-392), and 6 were selected from newer CIR projects constructed after 1999. This report describes the results of comprehensive field and laboratory testing for these CIR asphalt roads. The results indicate that the modulus of the CIR layer and the air voids of the CIR asphalt binder were the most important factors affecting CIR pavement performance for high-traffic roads. For low-traffic roads, the wet indirect tensile strength significantly affected pavement performance. The results of this research can help identify changes that should be made with regard to design, material selection, and construction in order to improve the performance and cost-effectiveness of future recycled roads.

Design, Construction, and Field Testing of an Ultra High Performance Concrete Pi-Girder Bridge, TR-574, 2011

Among the variety of road users and vehicle types that travel on U.S. public roadways, slow moving vehicles (SMVs) present unique safety and operations issues. SMVs include vehicles that do not maintain a constant speed of 25 mph, such as large farm equipment, construction vehicles, or horse-drawn buggies. Though the number of crashes involving SMVs is relatively small, SMV crashes tend to be severe. Additionally, SMVs can be encountered regularly on non-Interstate/non-expressway public roadways, but motorists may not be accustomed to these vehicles. This project was designed to improve transportation safety for SMVs on Iowa’s public roadway system. This report includes a literature review that shows various SMV statistics and laws across the United States, a crash study based on three years of Iowa SMV crash data, and recommendations from the SMV community.

Web Application Performance Testing

Web application performance testing is an emerging and important field of software engineering. As web applications become more commonplace and complex, the need for performance testing will only increase. This paper discusses common concepts, practices and tools that lie at the heart of web application performance testing. A pragmatic, hands-on approach is assumed where applicable; real-life examples of test tooling, execution and analysis are presented right next to the underpinning theory. At the client-side, web application performance is primarily driven by the amount of data transmitted over the wire. At the server-side, selection of programming language and platform, implementation complexity and configuration are the primary contributors to web application performance. Web application performance testing is an activity that requires delicate coordination between project stakeholders, developers, system administrators and testers in order to produce reliable and useful results. Proper test definition, execution, reporting and repeatable test results are of utmost importance. Open-source performance analysis tools such as Apache JMeter, Firebug and YSlow can be used to realise effective web application performance tests. A sample case study using these tools is presented in this paper. The sample application was found to perform poorly even under the moderate load incurred by the sample tests.

Model-based testing of software systems : functionality and performance

Software is a key component in many of our devices and products that we use every day. Most customers demand not only that their devices should function as expected but also that the software should be of high quality, reliable, fault tolerant, efficient, etc. In short, it is not enough that a calculator gives the correct result of a calculation, we want the result instantly, in the right form, with minimal use of battery, etc. One of the key aspects for succeeding in today's industry is delivering high quality. In most software development projects, high-quality software is achieved by rigorous testing and good quality assurance practices. However, today, customers are asking for these high quality software products at an ever-increasing pace. This leaves the companies with less time for development. Software testing is an expensive activity, because it requires much manual work. Testing, debugging, and verification are estimated to consume 50 to 75 per cent of the total development cost of complex software projects. Further, the most expensive software defects are those which have to be fixed after the product is released. One of the main challenges in software development is reducing the associated cost and time of software testing without sacrificing the quality of the developed software. It is often not enough to only demonstrate that a piece of software is functioning correctly. Usually, many other aspects of the software, such as performance, security, scalability, usability, etc., need also to be verified. Testing these aspects of the software is traditionally referred to as nonfunctional testing. One of the major challenges with non-functional testing is that it is usually carried out at the end of the software development process when most of the functionality is implemented. This is due to the fact that non-functional aspects, such as performance or security, apply to the software as a whole. In this thesis, we study the use of model-based testing. We present approaches to automatically generate tests from behavioral models for solving some of these challenges. We show that model-based testing is not only applicable to functional testing but also to non-functional testing. In its simplest form, performance testing is performed by executing multiple test sequences at once while observing the software in terms of responsiveness and stability, rather than the output. The main contribution of the thesis is a coherent model-based testing approach for testing functional and performance related issues in software systems. We show how we go from system models, expressed in the Unified Modeling Language, to test cases and back to models again. The system requirements are traced throughout the entire testing process. Requirements traceability facilitates finding faults in the design and implementation of the software. In the research field of model-based testing, many new proposed approaches suffer from poor or the lack of tool support. Therefore, the second contribution of this thesis is proper tool support for the proposed approach that is integrated with leading industry tools. We o er independent tools, tools that are integrated with other industry leading tools, and complete tool-chains when necessary. Many model-based testing approaches proposed by the research community suffer from poor empirical validation in an industrial context. In order to demonstrate the applicability of our proposed approach, we apply our research to several systems, including industrial ones.

The Effect of Trainer Muscularity and Expertise on Self-Presentational Concerns, Body Image, and Performance in College Men during One-Repetition Maximum Testing

This study attempted to manipulate self-presentational efficacy to examine the effect on social anxiety, social physique anxiety, drive for muscularity, and maximal strength performance during a one-repetition maximum (1-RM) chest press and leg press test. Ninety-nine college men with a minimum of six months of previous weight training experience were randomly assigned to complete a 1-RM protocol with either a muscular male trainer described as an expert or a lean male trainer described as a novice. Participants completed measures of self-presentation and body image prior to meeting their respective trainer, and following the completion of the 1-RM tests. Although the self-presentational efficacy manipulation was not successful, the trainers were perceived significantly differently on musculature and expertise. The group with the muscular, expert trainer reported higher social anxiety and attained higher 1-RM scores for the chest and leg press. Thus, trainer characteristics can affect strength performance and self-presentational concerns in this population.