Quantitative Determination of the Relationship between Internal Validity and Bias in Software Engineering Experiments: Consequences for Systematic Literature Reviews

Quality assessment is one of the activities performed as part of systematic literature reviews. It is commonly accepted that a good quality experiment is bias free. Bias is considered to be related to internal validity (e.g., how adequately the experiment is planned, executed and analysed). Quality assessment is usually conducted using checklists and quality scales. It has not yet been proven;however, that quality is related to experimental bias. Aim: Identify whether there is a relationship between internal validity and bias in software engineering experiments. Method: We built a quality scale to determine the quality of the studies, which we applied to 28 experiments included in two systematic literature reviews. We proposed an objective indicator of experimental bias, which we applied to the same 28 experiments. Finally, we analysed the correlations between the quality scores and the proposed measure of bias. Results: We failed to find a relationship between the global quality score (resulting from the quality scale) and bias; however, we did identify interesting correlations between bias and some particular aspects of internal validity measured by the instrument. Conclusions: There is an empirically provable relationship between internal validity and bias. It is feasible to apply quality assessment in systematic literature reviews, subject to limits on the internal validity aspects for consideration.

Quantitative evaluation of artifact removal in real magnetoencephalogram signals with blind source separation

The magnetoencephalogram (MEG) is contaminated with undesired signals, which are called artifacts. Some of the most important ones are the cardiac and the ocular artifacts (CA and OA, respectively), and the power line noise (PLN). Blind source separation (BSS) has been used to reduce the influence of the artifacts in the data. There is a plethora of BSS-based artifact removal approaches, but few comparative analyses. In this study, MEG background activity from 26 subjects was processed with five widespread BSS (AMUSE, SOBI, JADE, extended Infomax, and FastICA) and one constrained BSS (cBSS) techniques. Then, the ability of several combinations of BSS algorithm, epoch length, and artifact detection metric to automatically reduce the CA, OA, and PLN were quantified with objective criteria. The results pinpointed to cBSS as a very suitable approach to remove the CA. Additionally, a combination of AMUSE or SOBI and artifact detection metrics based on entropy or power criteria decreased the OA. Finally, the PLN was reduced by means of a spectral metric. These findings confirm the utility of BSS to help in the artifact removal for MEG background activity.

Influence of leading edge imperfections on the aerodynamic characterictics of NACA 632-215 laminar aerofoils at low Reynolds number

This article deals with the effect of leading edge imperfections on the aerodynamic characteristics of a NACA 632-215 laminar aerofoil at low Reynolds numbers. Wind tunnel tests have been performed at different Reynolds numbers and angles of attack and global aerodynamic loads were measured. To perform these tests, a NACA 632-215 aerofoil was built up in two halves (corresponding to the upper side and to the lower side), the leading edge imperfection here considered being a slight displacement of half aerofoil with respect to the other. From experimental results, a quantitative measure of the influence of the leading edge displacement on the degradation of the aerofoil aerodynamic performances has been obtained. This allows the establishment of a criterion for an acceptance limit for this kind of imperfection

Quantitative evaluation of patient-specific conforming hexahedral meshes of abdominal aortic aneurysms and intraluminal thrombus generated from MRI

A novel method for generating patient-specific high quality conforming hexahedral meshes is presented. The meshes are directly obtained from the segmentation of patient magnetic resonance (MR) images of abdominal aortic aneu-rysms (AAA). The MRI permits distinguishing between struc-tures of interest in soft tissue. Being so, the contours of the lumen, the aortic wall and the intraluminal thrombus (ILT) are available and thus the meshes represent the actual anato-my of the patient?s aneurysm, including the layered morpholo-gies of these structures. Most AAAs are located in the lower part of the aorta and the upper section of the iliac arteries, where the inherent tortuosity of the anatomy and the presence of the ILT makes the generation of high-quality elements at the bifurcation is a challenging task. In this work we propose a novel approach for building quadrilateral meshes for each surface of the sectioned geometry, and generating conforming hexahedral meshes by combining the quadrilateral meshes. Conforming hexahedral meshes are created for the wall and the ILT. The resulting elements are evaluated on four patients? datasets using the Scaled Jacobian metric. Hexahedral meshes of 25,000 elements with 94.8% of elements well-suited for FE analysis are generated.

Quantitative analysis of morphological changes in yeast colonies growing on solid medium: the eccentricity and Fourier indices

The colony shape of four yeast species growing on agar medium wasmeasured for 116 days by image analysis. Initially, all the colonies are circular, with regular edges. The loss of circularity can be quantitatively estimated by the eccentricity index, Ei, calculated as the ratio between their orthogonal vertical and horizontal diameters. Ei can increase from 1 (complete circularity) to a maximum of 1.17–1.30, depending on the species. One colony inhibits its neighbour only when it has reached a threshold area. Then, Ei of the inhibited colony increases proportionally to the area of the inhibitory colony. The initial distance between colonies affects those threshold values but not the proportionality, Ei/area; this inhibition affects the shape but not the total surface of the colony. The appearance of irregularities in the edges is associated, in all the species, not with age but with nutrient exhaustion. The edge irregularity can be quantified by the Fourier index, Fi, calculated by the minimum number of Fourier coefficients that are needed to describe the colony contour with 99% fitness. An ad hoc function has been developed in Matlab v. 7.0 to automate the computation of the Fourier coefficients. In young colonies, Fi has a value between 2 (circumference) and 3 (ellipse). These values are maintained in mature colonies of Debaryomyces, but can reach values up to 14 in Saccharomyces.All the species studied showed the inhibition of growth in facing colony edges, but only three species showed edge irregularities associated with substrate exhaustion. Copyright © 2014 John Wiley & Sons, Ltd.

Forced Response of Mistuned Bladed Disks: Quantitative Validation of the Asymptotic Description

The effect of small mistuning in the forced response of a bladed disk is analyzed using a recently introduced methodology: the asymptotic mistuning model. The asymptotic mistuning model is an extremely reduced, simplified model that is derived directly from the full formulation of the mistuned bladed disk using a consistent perturbative procedure based on the relative smallness of the mistuning distortion. A detailed description of the derivation of the asymptotic mistuning model for a realistic bladed disk configuration is presented. The asymptotic mistuning model results for several different mistuning patterns and forcing conditions are compared with those from a high-resolution finite element model. The asymptotic mistuning model produces quantitatively accurate results, and, probably more relevant, it gives precise information about the factors (tuned modes and components of the mistuning pattern) that actually play a role in the vibrational forced response of mistuned bladed disks.

Quantitative characterization of five cover crop species

The introduction of cover crops in the intercrop period may provide a broad range of ecosystem services derived from the multiple functions they can perform, such as erosion control, recycling of nutrients or forage source. However, the achievement of these services in a particular agrosystem is not always required at the same time or to the same degree. Thus, species selection and definition of targeted objectives is critical when growing cover crops. The goal of the current work was to describe the traits that determine the suitability of five species (barley, rye, triticale, mustard and vetch) for cover cropping. A field trial was established during two seasons (October to April) in Madrid (central Spain). Ground cover and biomass were monitored at regular intervals during each growing season. A Gompertz model characterized ground cover until the decay observed after frosts, while biomass was fitted to Gompertz, logistic and linear-exponential equations. At the end of the experiment, carbon (C), nitrogen (N), and fibre (neutral detergent, acid and lignin) contents, and the N fixed by the legume were determined. The grasses reached the highest ground cover (83–99%) and biomass (1226–1928 g/m2) at the end of the experiment. With the highest C:N ratio (27–39) and dietary fibre (527–600 mg/g) and the lowest residue quality (~680 mg/g), grasses were suitable for erosion control, catch crop and fodder. The vetch presented the lowest N uptake (2·4 and 0·7 g N/m2) due to N fixation (9·8 and 1·6 g N/m2) and low biomass accumulation. The mustard presented high N uptake in the warm year and could act as a catch crop, but low fodder capability in both years. The thermal time before reaching 30% ground cover was a good indicator of early coverage species. Variable quantification allowed finding variability among the species and provided information for further decisions involving cover crop selection and management.