Looking for Validity or Testing It? The Perils of Stepwise Regression, Extreme-Scores Analysis, Heteroscedasticity, and Measurement Error

When researchers introduce a new test they have to demonstrate that it is valid, using unbiased designs and suitable statistical procedures. In this article we use Monte Carlo analyses to highlight how incorrect statistical procedures (i.e., stepwise regression, extreme scores analyses) or ignoring regression assumptions (e.g., heteroscedasticity) contribute to wrong validity estimates. Beyond these demonstrations, and as an example, we re-examined the results reported by Warwick, Nettelbeck, and Ward (2010) concerning the validity of the Ability Emotional Intelligence Measure (AEIM). Warwick et al. used the wrong statistical procedures to conclude that the AEIM was incrementally valid beyond intelligence and personality traits in predicting various outcomes. In our re-analysis, we found that the reliability-corrected multiple correlation of their measures with personality and intelligence was up to .69. Using robust statistical procedures and appropriate controls, we also found that the AEIM did not predict incremental variance in GPA, stress, loneliness, or well-being, demonstrating the importance for testing validity instead of looking for it.

Clonal variation in nutrient content in woody biomass of hybrid aspen (Populus tremula L. x P. tremuloides Michx.)

Abstract

A general linear relaxometry model of R1 using imaging data.

PURPOSE: The longitudinal relaxation rate (R1 ) measured in vivo depends on the local microstructural properties of the tissue, such as macromolecular, iron, and water content. Here, we use whole brain multiparametric in vivo data and a general linear relaxometry model to describe the dependence of R1 on these components. We explore a) the validity of having a single fixed set of model coefficients for the whole brain and b) the stability of the model coefficients in a large cohort. METHODS: Maps of magnetization transfer (MT) and effective transverse relaxation rate (R2 *) were used as surrogates for macromolecular and iron content, respectively. Spatial variations in these parameters reflected variations in underlying tissue microstructure. A linear model was applied to the whole brain, including gray/white matter and deep brain structures, to determine the global model coefficients. Synthetic R1 values were then calculated using these coefficients and compared with the measured R1 maps. RESULTS: The model's validity was demonstrated by correspondence between the synthetic and measured R1 values and by high stability of the model coefficients across a large cohort. CONCLUSION: A single set of global coefficients can be used to relate R1 , MT, and R2 * across the whole brain. Our population study demonstrates the robustness and stability of the model. Magn Reson Med, 2014. © 2014 The Authors. Magnetic Resonance in Medicine published by Wiley Periodicals, Inc. Magn Reson Med 73:1309-1314, 2015. © 2014 Wiley Periodicals, Inc.

Determination of Asphalt Content and Characteristics of Bituminous Paving Mixtures, MLR-88-11, 1988

Due to the hazardous nature of chemical asphalt extraction agents, nuclear gauges have become an increasingly popular method of determining the asphalt content of a bituminous mix. This report details the results of comparisons made between intended, tank stick, extracted, and nuclear asphalt content determinations. A total of 315 sets of comparisons were made on samples that represented 110 individual mix designs and 99 paving projects. All samples were taken from 1987 construction projects. In addition to the comparisons made, seventeen asphalt cement samples were recovered for determination of penetration and viscosity. Results were compared to similar tests performed on the asphalt assurance samples in an attempt to determine the amount of asphalt hardening that can be expected due to the hot mix process. Conclusions of the report are: 1. Compared to the reflux extraction procedure, nuclear asphalt content gauges determine asphalt content of bituminous mixes with much greater accuracy and comparable precision. 2. As a means for determining asphalt content, the nuclear procedure should be used as an alternate to chemical extractions whenever possible. 3. Based on penetration and viscosity results, softer grade asphalts undergo a greater degree 'of hardening due to hot mix processing than do harder grades, and asphalt viscosity changes caused by the mixing process are subject to much more variability than are changes in penetration. 4. Based on changes in penetration and viscosity, the Thin Film Oven Test provides a reasonable means of estimating how much asphalt hardening can be anticipated due to exposure to the hot mix processing environment.

The Arts (Music, Arts&Crafts and Drama) as a procedure for learning pre-school content: Grupo Edebé Project

There is nothing as amazing and fascinating as children learning process. Between 0 and 6 years old, a child brain develops in a waythat will never be repeated. At this age, children are eager to discover and they have great potential of active and affective life.Because of this, their learning capacity in this period is incalculable. (Jordan-Decarbo y Nelson, 2002; Wild, 1999).Pre-school Education is a unique and special stage, with self identity, which aims are:attending children as a whole,motivate them to learn,give them an affective and stable environment in which they can grow up and get to be balanced and confident people and inwhich they can relate to others, learn, enjoy and be happy.Arts, Music, Visual Arts and Drama (Gardner, 1994) can provide a framework of special, even unique, personal expression.With the aim of introducing qualitative improvements in the education of children and to ensure their emotional wellbeing, and havingnoticed that teachers had important needs and concerns as regards to diversity in their student groups, we developed a programbased on the detection of needs and concerns explained by professionals in education.This program of Grupo edebé, object of our research, is a multicultural, interdisciplinary and globalizing project the aims of which are:developing children's talent and personality,keeping their imagination and creativity and using these as a learning resource,promoting reasoning, favouring expression and communication,providing children with the tools to manage their emotions,and especially, introducing Arts as a procedure to increase learning.We wanted to start the research by studying the impact (Brice, 2003) that this last point had on the learning of five-year-old childrenschooled in multicultural environments.Therefore, the main goal of the research was the assessment of the implementation of a child education programme attending todiversity in a population of five-year-old children, specifically in the practice of procedures based on the use of Arts (music, arts andcrafts and theatre) as a vehicle or procedure for learning contents in Pre-school stage.Because children emotional welfare was a subject of our concern, and bearing in mind that the affective aspects are of vitalimportance for learning and child development (Parke and Gauvain, 2009), Grupo Edebé has also evaluated the starting, evolving andfinal impact in five-year-old children given that they finish Pre-school education at that age.

The family alliance assessment scales : steps toward validity and reliability of an observational assessment tool for early family interactions

We present the first steps in the validation of an observational tool for father-mother-infant interactions: the FAAS (Family Alliance Assessment Scales). Family-level variables are acknowledged as unique contributors to the understanding of the socio-affective development of the child, yet producing reliable assessments of family-level interactions poses a methodological challenge. There is, therefore, a clear need for a validated and clinically relevant tool. This validation study has been carried out on three samples: one non-referred sample, of families taking part in a study on the transition to parenthood (normative sample; n = 30), one referred for medically assisted procreation (infertility sample; n = 30) and one referred for a psychiatric condition in one parent (clinical sample; n = 15). Results show that the FAAS scales have (1) good inter-rater reliability and (2) good validity, as assessed through known-group validity by comparing the three samples and through concurrent validity by checking family interactions against parents' self-reported marital satisfaction.

Saltiness of coarsely ground cooked ham with reduced salt content

Selostus: Suolapitoisuuden pienentämisen vaikutus kinkkuleikkeen aistittuun suolaisuuteen

The External validity in economic experiments

One of the most important questions regarding experimental economics is the external validity of laboratory experiments. This paper goes through a study that tests the generalizability of a Dictator Game as a laboratory analogue for a naturally occurringdecision-making context of teacher absenteeism. Because lab and naturally-occurring environments systematically differ we then discuss other factors that might strongly affect the choices that individuals make. We conclude that the dichotomy drawn between labexperiments and data collected from natural settings is a false one. A combination of the two would provide deeper and better insights than either separately.

Deoxyribonucleic acid content as an indicator of progression of squamous cell carcinogenesis in the esophagus: comparative analysis on imprint-cytospin and tissue section preparation.

BACKGROUND: The purpose of this study was to explore the potential use of image analysis on tissue sections preparation as a predictive marker of early malignant changes during squamous cell (SC) carcinogenesis in the esophagus. Results of DNA ploidy quantification on formalin-fixed, paraffin-embedded tissue using two different techniques were compared: imprint-cytospin and 6 microm thick tissue sections preparation. METHODS: This retrospective study included 26 surgical specimens of squamous cell carcinoma (SCC) from patients who underwent surgery alone at the Department of Surgery in CHUV Hospital in Lausanne between January 1993 and December 2000. We analyzed 53 samples of healthy tissue, 43 tumors and 7 lymph node metastases. RESULTS: Diploid DNA histogram patterns were observed in all histologically healthy tissues, either distant or proximal to the lesion. Aneuploidy was observed in 34 (79%) of 43 carcinomas, namely 24 (75%) of 32 early squamous cell carcinomas and 10 (91%) of 11 advanced carcinomas. DNA content was similar in the different tumor stages, whether patients presented with single or multiple synchronous tumors. All lymph node metastases had similar DNA content as their primary tumor. CONCLUSIONS: Early malignant changes in the esophagus are associated with alteration in DNA content, and aneuploidy tends to correlate with progression of invasive SCC. A very good correlation between imprint-cytospin and tissue section analysis was observed. Although each method used here showed advantages and disadvantages; tissue sections preparation provided useful information on aberrant cell-cycle regulation and helped select the optimal treatment for the individual patient along with consideration of other clinical parameters.

Grain yield and seed quality of soybean selected for high protein content

The objective of this work was to evaluate the effects of selection for high protein on seed physiological quality and grain yield of soybean. Four populations of BC1F4 and four of F4, each from a cross between a commercial variety and a line bearing high protein seeds, were used. The high protein content selection has a tendency to affect negatively the seed physiological quality. Estimates of correlation coefficients between protein content and grain yield were mostly negative but varied among populations. It is possible to obtain lines with high protein content, keeping the grain yield and the seed physiological quality of their respective recurrent progenitors.

Use of the Cognitive Performance Scale (CPS) to detect cognitive impairment in the acute care setting: concurrent and predictive validity.

The Cognitive Performance Scale (CPS) was initially designed to assess cognition in long term care residents. Subsequently, the CPS has also been used among in-home, post-acute, and acute care populations even though CPS' clinimetric performance has not been studied in these settings. This study aimed to determine CPS agreement with the Mini Mental Status Exam (MMSE) and its predictive validity for institutionalization and death in a cohort (N=401) of elderly medical inpatients aged 75 years and over. Medical, physical and mental status were assessed upon admission. The same day, the patient's nurse completed the CPS by interview. Follow-up data were gathered from the central billing system (nursing home stay) and proxies (death). Cognitive impairment was present in 92 (23%) patients according to CPS (score >or= 2). Agreement with MMSE was moderate (kappa 0.52, P<.001). Analysis of discordant results suggested that cognitive impairment was overestimated by the CPS in dependent patients with comorbidities and depressive symptoms, and underestimated in older ones. During follow-up, subjects with abnormal CPS had increased risks of death (adjusted hazard ratio (adjHR) 1.7, 95% CI 1.0-2.8, P=.035) and institutionalization (adjHR 2.7, 95% CI 1.3-5.3, P=.006), independent of demographic, health and functional status. Interestingly, subjects with abnormal CPS were at increased risk of death only if they also had abnormal MMSE. The CPS predicted death and institutionalization during follow-up, but correlated moderately well with the MMSE. Combining CPS and MMSE provided additional predictive information, suggesting that domains other than cognition are assessed by professionals when using the CPS in elderly medical inpatients.

Differences in ureide and amino acid content of water stressed soybean inoculated with Bradyrhizobium japonicum and B. elkanii

The objective of this work was to study the response to water stress of a drought sensitive soybean cultivar inoculated with Bradyrhizobium japonicum (strain CB1809, Semia 586) and B. elkanii (strain 29W, Semia 5019). CB1809 nodulated plants produced a significantly higher root fraction (19%) than 29W (14.6%). Plants inoculated with CB1809 produced less nodules and accumulated more nitrogen than those inoculated with 29W. In general, low amounts of ureides in nodules were found in watered plants inoculated with either CB1809 or 29W strains, but those levels were five-fold increased in stressed plants inoculated with CB1809. Nodules formed by strain CB1809 had aspartate and glutamate as major amino acids, while those formed by 29W had glutamate, asparagine and alanine. In nodules of plants inoculated with CB1809 aspartate showed the highest accumulation (5 µmol g-1); in stressed plants this amino acid reached a value of 26 µmol g-1, and asparagine was not detected. Nodules formed by the strain 29W accumulated 1 µmol g-1 of aspartate, whether plants were stressed or not. Asparagine was the major amino acid found in nodules from watered plants (6 µmol g-1) and the amount of this amino acid was six-fold increased when plants were water stressed.

Feeding and arrestment responses of Diabrotica speciosa to cucurbitacin-content formulations

The objective of this work was to evaluate arrestant and stimulant feeding effects on Diabrotica speciosa (Ger.), using cucurbitacin-content starch-based formulations prepared with varying starch sources, and adding potassium lignate. In a glass slide assay, the wash off resistance of formulations was compared. Potassium lignate did not improve wash off resistance. Lagenaria vulgaris L. powder, in which cucurbitacin B concentration was determined as 0.28%, was added to the most adhesive formulation. The resultant material was used in a two-choice assay in which leaves of common bean, Phaseolus vulgaris L., treated with concentrations of 2.5%, 5%, 10%, 15% and 20% were offered to insects together with untreated control leaves. Greater number of insects and leaves consumed were found on leaves treated with cucurbitacin-content formulation (2.5%, 5% - greatest response -, 10% and 15% concentrations) than on untreated control leaves. The concentration, in which responses were higher, was sprayed in a bean field at 1,000, 1,900 and 3,000 g ha-1. Greater number of beetles was found in plots treated with the highest dosage, 3 and 6 days after spraying. Ten days after spraying, no significant differences were found among dosages, probably due to washoff of the bait.

Characterization of OsMIK in a rice mutant with reduced phytate content reveals an insertion of a rearranged retrotransposon.

The rice low phytic acid (lpa) mutant Os-lpa-XS110-1(XS-lpa) has ~45 % reduction in seed phytic acid (PA) compared with the wild-type cultivar Xiushui 110. Previously, a single recessive gene mutation was shown to be responsible for the lpa phenotype and was mapped to a region of chromosome 3 near OsMIK (LOC_Os03g52760) and OsIPK1 (LOC_Os03g51610), two genes involved in PA biosynthesis. Here, we report the identification of a large insert in the intron of OsMIK in the XS-lpa mutant. Sequencing of fragments amplified through TAIL-PCRs revealed that the insert was a derivative of the LINE retrotransposon gene LOC_Os03g56910. Further analyses revealed the following characteristics of the insert and its impacts: (1) the inserted sequence of LOC_Os03g56910 was split at its third exon and rejoined inversely, with its 5' and 3' flanking sequences inward and the split third exon segments outward; (2) the LOC_Os03g56910 remained in its original locus in XS-lpa, and the insertion probably resulted from homologous recombination repair of a DNA double strand break; (3) while the OsMIK transcripts of XS-lpa and Xiushui 110 were identical, substantial reductions of the transcript abundance (~87 %) and the protein level (~60 %) were observed in XS-lpa, probably due to increased methylation in its promoter region. The above findings are discussed in the context of plant mutagenesis, epigenetics and lpa breeding.

Validity of the acoustic approximation in full-waveform seismic crosshole tomography

Acoustic waveform inversions are an increasingly popular tool for extracting subsurface information from seismic data. They are computationally much more efficient than elastic inversions. Naturally, an inherent disadvantage is that any elastic effects present in the recorded data are ignored in acoustic inversions. We investigate the extent to which elastic effects influence seismic crosshole data. Our numerical modeling studies reveal that in the presence of high contrast interfaces, at which P-to-S conversions occur, elastic effects can dominate the seismic sections, even for experiments involving pressure sources and pressure receivers. Comparisons of waveform inversion results using a purely acoustic algorithm on synthetic data that is either acoustic or elastic, show that subsurface models comprising small low-to-medium contrast (?30%) structures can be successfully resolved in the acoustic approximation. However, in the presence of extended high-contrast anomalous bodies, P-to-S-conversions may substantially degrade the quality of the tomographic images. In particular, extended low-velocity zones are difficult to image. Likewise, relatively small low-velocity features are unresolved, even when advanced a priori information is included. One option for mitigating elastic effects is data windowing, which suppresses later arriving seismic arrivals, such as shear waves. Our tests of this approach found it to be inappropriate because elastic effects are also included in earlier arriving wavetrains. Furthermore, data windowing removes later arriving P-wave phases that may provide critical constraints on the tomograms. Finally, we investigated the extent to which acoustic inversions of elastic data are useful for time-lapse analyses of high contrast engineered structures, for which accurate reconstruction of the subsurface structure is not as critical as imaging differential changes between sequential experiments. Based on a realistic scenario for monitoring a radioactive waste repository, we demonstrated that acoustic inversions of elastic data yield substantial distortions of the tomograms and also unreliable information on trends in the velocity changes.