Quantitative Determination of the Relationship between Internal Validity and Bias in Software Engineering Experiments: Consequences for Systematic Literature Reviews

Quality assessment is one of the activities performed as part of systematic literature reviews. It is commonly accepted that a good quality experiment is bias free. Bias is considered to be related to internal validity (e.g., how adequately the experiment is planned, executed and analysed). Quality assessment is usually conducted using checklists and quality scales. It has not yet been proven;however, that quality is related to experimental bias. Aim: Identify whether there is a relationship between internal validity and bias in software engineering experiments. Method: We built a quality scale to determine the quality of the studies, which we applied to 28 experiments included in two systematic literature reviews. We proposed an objective indicator of experimental bias, which we applied to the same 28 experiments. Finally, we analysed the correlations between the quality scores and the proposed measure of bias. Results: We failed to find a relationship between the global quality score (resulting from the quality scale) and bias; however, we did identify interesting correlations between bias and some particular aspects of internal validity measured by the instrument. Conclusions: There is an empirically provable relationship between internal validity and bias. It is feasible to apply quality assessment in systematic literature reviews, subject to limits on the internal validity aspects for consideration.

Fine spatial pattern of an epiphytic lichen species is affected by habitat conditions in two forest types in the Iberian Mediterranean region

Persistence and abundance of species is determined by habitat availability and the ability to disperse and colonize habitats at contrasting spatial scales. Favourable habitat fragments are also heterogeneous in quality, providing differing opportunities for establishment and affecting the population dynamics of a species. Based on these principles, we suggest that the presence and abundance of epiphytes may reflect their dispersal ability, which is primarily determined by the spatial structure of host trees, but also by host quality. To our knowledge there has been no explicit test of the importance of host tree spatial pattern for epiphytes in Mediterranean forests. We hypothesized that performance and host occupancy in a favourable habitat depend on the spatial pattern of host trees, because this pattern affects the dispersal ability of each epiphyte and it also determines the availability of suitable sites for establishment. We tested this hypothesis using new point pattern analysis tools and generalized linear mixed models to investigate the spatial distribution and performance of the epiphytic lichen Lobaria pulmonaria, which inhabits two types of host trees (beeches and Iberian oaks). We tested the effects on L. pulmonaria distribution of tree size, spatial configuration, and host tree identity. We built a model including tree size, stand structure, and several neighbourhood predictors to understand the effect of host tree on L. pulmonaria. We also investigated the relative importance of spatial patterning on the presence and abundance of the species, independently of the host tree configuration. L. pulmonaria distribution was highly dependent on habitat quality for successful establishment, i.e., tree species identity, tree diameter, and several forest stand structure surrogates. For beech trees, tree diameter was the main factor influencing presence and cover of the lichen, although larger lichen-colonized trees were located close to focal trees, i.e., young trees. However, oak diameter was not an important factor, suggesting that bark roughness at all diameters favoured lichen establishment. Our results indicate that L. pulmonaria dispersal is not spatially restricted, but it is dependent on habitat quality. Furthermore, new spatial analysis tools suggested that L. pulmonaria cover exhibits a distinct pattern, although the spatial pattern of tree position and size was random.

Comparative study of auxetic geometrics by means of computer-aided design and engineering

Auxetic materials (or metamaterials) are those with a negative Poisson ratio (NPR) and display the unexpected property of lateral expansion when stretched, as well as an equal and opposing densification when compressed. Such geometries are being progressively employed in the development of novel products, especially in the fields of intelligent expandable actuators, shape morphing structures and minimally invasive implantable devices. Although several auxetic and potentially auxetic geometries have been summarized in previous reviews and research, precise information regarding relevant properties for design tasks is not always provided. In this study we present a comparative study of two-dimensional and three-dimensional auxetic geometries carried out by means of computer-aided design and engineering tools (from now on CAD–CAE). The first part of the study is focused on the development of a CAD library of auxetics. Once the library is developed we simulate the behavior of the different auxetic geometries and elaborate a systematic comparison, considering relevant properties of these geometries, such as Poisson ratio(s), maximum volume or area reductions attainable and equivalent Young's modulus, hoping it may provide useful information for future designs of devices based on these interesting structures.

Monitoring treatment of vocal fold paralysis by biomechanical analysis of voice

A case study of vocal fold paralysis treatment is described with the help of the voice quality analysis application BioMet®Phon. The case corresponds to a description of a 40 - year old female patient who was diagnosed of vocal fold paralysis following a cardio - pulmonar intervention which required intubation for 8 days and posterior tracheotomy for 15 days. The patient presented breathy and asthenic phon ation, and dysphagia. Six main examinations were conducted during a full year period that the treatment lasted consisting in periodic reviews including video - endostroboscopy, voice analysis and breathing function monitoring. The phoniatrician treatment inc luded 20 sessions of vocal rehabilitation, followed by an intracordal infiltration with Radiesse 8 months after the rehabilitation treatment started followed by 6 sessions of rehabilitation more. The videondoscopy and the voicing quality analysis refer a s ubstantial improvement in the vocal function with recovery in all the measures estimated (jitter, shimmer, mucosal wave contents, glottal closure, harmonic contents and biomechanical function analysis). The paper refers the procedure followed and the results obtained by comparing the longitudinal progression of the treatment, illustrating the utility of voice quality analysis tools in speech therapy.

Identification of Degraded Land in the Canary Islands; Tests and Reviews

Degraded Land is an area that either by natural causes (fires, floods, storms or volcanic eruptions) or more by direct or indirect causes of human action, has been altered or modified from its natural state. Restoration is an activity that initiates or accelerates the recovery of an ecosystem. It can be defined as the set of actions taken in order to reverse or reduce the damage caused in the territory. In the case of the Canary Islands there is a high possibility for the territory to suffer processes that degrade the environment, given that the islands are very fragile ecosystems. Added to this they are territories isolated from the continent, which complicates the process of restoring them. In this paper, the different types of common degraded areas in the Canary Islands are identified, as well as the proposed solutions for remediation, such as afforestation of agricultural land or landfill closure and restoration.

Mining mobile apps reviews to support release planning

The mobile apps market is a tremendous success, with millions of apps downloaded and used every day by users spread all around the world. For apps’ developers, having their apps published on one of the major app stores (e.g. Google Play market) is just the beginning of the apps lifecycle. Indeed, in order to successfully compete with the other apps in the market, an app has to be updated frequently by adding new attractive features and by fixing existing bugs. Clearly, any developer interested in increasing the success of her app should try to implement features desired by the app’s users and to fix bugs affecting the user experience of many of them. A precious source of information to decide how to collect users’ opinions and wishes is represented by the reviews left by users on the store from which they downloaded the app. However, to exploit such information the app’s developer should manually read each user review and verify if it contains useful information (e.g. suggestions for new features). This is something not doable if the app receives hundreds of reviews per day, as happens for the very popular apps on the market. In this work, our aim is to provide support to mobile apps developers by proposing a novel approach exploiting data mining, natural language processing, machine learning, and clustering techniques in order to classify the user reviews on the basis of the information they contain (e.g. useless, suggestion for new features, bugs reporting). Such an approach has been empirically evaluated and made available in a web-­‐based tool publicly available to all apps’ developers. The achieved results showed that the developed tool: (i) is able to correctly categorise user reviews on the basis of their content (e.g. isolating those reporting bugs) with 78% of accuracy, (ii) produces clusters of reviews (e.g. groups together reviews indicating exactly the same bug to be fixed) that are meaningful from a developer’s point-­‐of-­‐view, and (iii) is considered useful by a software company working in the mobile apps’ development market.