Looking for Validity or Testing It? The Perils of Stepwise Regression, Extreme-Scores Analysis, Heteroscedasticity, and Measurement Error

When researchers introduce a new test they have to demonstrate that it is valid, using unbiased designs and suitable statistical procedures. In this article we use Monte Carlo analyses to highlight how incorrect statistical procedures (i.e., stepwise regression, extreme scores analyses) or ignoring regression assumptions (e.g., heteroscedasticity) contribute to wrong validity estimates. Beyond these demonstrations, and as an example, we re-examined the results reported by Warwick, Nettelbeck, and Ward (2010) concerning the validity of the Ability Emotional Intelligence Measure (AEIM). Warwick et al. used the wrong statistical procedures to conclude that the AEIM was incrementally valid beyond intelligence and personality traits in predicting various outcomes. In our re-analysis, we found that the reliability-corrected multiple correlation of their measures with personality and intelligence was up to .69. Using robust statistical procedures and appropriate controls, we also found that the AEIM did not predict incremental variance in GPA, stress, loneliness, or well-being, demonstrating the importance for testing validity instead of looking for it.

The career indecision profile : measurement equivalence in two international samples

This study tested for the measurement equivalence of a four-factor measure of career indecision (Career Indecision Profile-65 [CIP-65]) between a U.S. sample and two international samples; one composed of French-speaking young adults from France and Switzerland and the other of Italian ado- lescents. Previous research had supported the four-factor structure of the CIP-65 in both the United States and Iceland but also showed that items on two of the four scales may be interpreted differently by young adults growing up in these two countries. This study extends previous research by testing whether the four CIP-65 factors are measured equivalently in two additional international samples. Results largely supported the configural and metric invariance of the CIP-65 in the United States and international samples, but several scales showed a lack of scalar invariance. Some explanations are offered for these findings along with suggestions for future research and implications for practice.

Radiographic total disc replacement angle measurement accuracy using the Oxford Cobbometer: precision and bias.

Total disc replacement (TDR) clinical success has been reported to be related to the residual motion of the operated level. Thus, accurate measurement of TDR range of motion (ROM) is of utmost importance. One commonly used tool in measuring ROM is the Oxford Cobbometer. Little is known however on its accuracy (precision and bias) in measuring TDR angles. The aim of this study was to assess the ability of the Cobbometer to accurately measure radiographic TDR angles. An anatomically accurate synthetic L4-L5 motion segment was instrumented with a CHARITE artificial disc. The TDR angle and anatomical position between L4 and L5 was fixed to prohibit motion while the motion segment was radiographically imaged in various degrees of rotation and elevation, representing a sample of possible patient placement positions. An experienced observer made ten readings of the TDR angle using the Cobbometer at each different position. The Cobbometer readings were analyzed to determine measurement accuracy at each position. Furthermore, analysis of variance was used to study rotation and elevation of the motion segment as treatment factors. Cobbometer TDR angle measurements were most accurate (highest precision and lowest bias) at the centered position (95.5%), which placed the TDR directly inline with the x-ray beam source without any rotation. In contrast, the lowest accuracy (75.2%) was observed in the most rotated and off-centered view. A difference as high as 4 degrees between readings at any individual position, and as high as 6 degrees between all the positions was observed. Furthermore, the Cobbometer was unable to detect the expected trend in TDR angle projection with changing position. Although the Cobbometer has been reported to be reliable in different clinical applications, it lacks the needed accuracy to measure TDR angles and ROM. More accurate ROM measurement methods need to be developed to help surgeons and researchers assess radiological success of TDRs.

LiveCount Assay: concomitant measurement of cytolytic activity and phenotypic characterisation of CD8(+) T-cells by flow cytometry.

Tumour immunologists strive to develop efficient tumour vaccination and adoptive transfer therapies that enlarge the pool of tumour-specific and -reactive effector T-cells in vivo. To assess the efficiency of the various strategies, ex vivo assays are needed for the longitudinal monitoring of the patient's specific immune responses providing both quantitative and qualitative data. In particular, since tumour cell cytolysis is the end goal of tumour immunotherapy, routine immune monitoring protocols need to include a read-out for the cytolytic efficiency of Ag-specific cells. We propose to combine current immune monitoring techniques in a highly sensitive and reproducible multi-parametric flow cytometry based cytotoxicity assay that has been optimised to require low numbers of Ag-specific T-cells. The possibility of re-analysing those T-cells that have undergone lytic activity is illustrated by the concomitant detection of CD107a upregulation on the surface of degranulated T-cells. To date, the LiveCount Assay provides the only possibility of assessing the ex vivo cytolytic activity of low-frequency Ag-specific cytotoxic T-lymphocytes from patient material.

Measurement of the specific heat and determination of the thermodynamic functions of relaxed amorphous silicon

The specific heat, cp, of two amorphous silicon (a-Si) samples has been measured by differential scanning calorimetry in the 100–900K temperature range. When the hydrogen content is reduced by thermal annealing, cp approaches the value of crystalline Si (c-Si). Within experimental accuracy, we conclude that cp of relaxed pure a-Si coincides with that of c-Si. This result is used to determine the enthalpy, entropy, and Gibbs free energy of defect-free relaxed a-Si. Finally, the contribution of structural defects on these quantities is calculated and the melting point of several states of a-Si is predicted

Quantifying Uncertainty in Real Time Performance Measurement for Highway Winter Maintenance Operations – Phase 2, RB03-013, 2014

Winter weather in Iowa is often unpredictable and can have an adverse impact on traffic flow. The Iowa Department of Transportation (Iowa DOT) attempts to lessen the impact of winter weather events on traffic speeds with various proactive maintenance operations. In order to assess the performance of these maintenance operations, it would be beneficial to develop a model for expected speed reduction based on weather variables and normal maintenance schedules. Such a model would allow the Iowa DOT to identify situations in which speed reductions were much greater than or less than would be expected for a given set of storm conditions, and make modifications to improve efficiency and effectiveness. The objective of this work was to predict speed changes relative to baseline speed under normal conditions, based on nominal maintenance schedules and winter weather covariates (snow type, temperature, and wind speed), as measured by roadside weather stations. This allows for an assessment of the impact of winter weather covariates on traffic speed changes, and estimation of the effect of regular maintenance passes. The researchers chose events from Adair County, Iowa and fit a linear model incorporating the covariates mentioned previously. A Bayesian analysis was conducted to estimate the values of the parameters of this model. Specifically, the analysis produces a distribution for the parameter value that represents the impact of maintenance on traffic speeds. The effect of maintenance is not a constant, but rather a value that the researchers have some uncertainty about and this distribution represents what they know about the effects of maintenance. Similarly, examinations of the distributions for the effects of winter weather covariates are possible. Plots of observed and expected traffic speed changes allow a visual assessment of the model fit. Future work involves expanding this model to incorporate many events at multiple locations. This would allow for assessment of the impact of winter weather maintenance across various situations, and eventually identify locations and times in which maintenance could be improved.

Cultivar response to fungicide application in relation to rice blast control, productivity and sustainability

Four field trials were conducted, from 1995 to 1997, with the objective of studying the response of four upland cultivars to foliar fungicide application in relation to panicle blast control, grain yield and sustainability. Differential disease control and yield response of cultivars to fungicide treatment were obtained. Losses in grain yield of cultivars IAC 202, Caiapó, Rio Paranaíba and Araguaia due to panicle blast were 44.8%, 27.4%, 24.4% and 18.2%, respectively. Two applications of tricyclazole or benomyl controlled panicle blast, as indicated by lower values of disease progress curve and relative panicle blast severity, and increased grain yield of the cultivar IAC 202. The losses in 100 panicle grain weight and grain yield were significantly reduced by 22.3% and 25.1% in IAC 202 and 23.6% and 20.5% in Caiapó, respectively, with two sprays of tricyclazole. Sustainable value index for yield was maximum with two applications of tricyclazole (0.59), followed by one application at booting (0.46) and at heading (0.40) in cultivar IAC 202. Results showed no yield response of the cultivars Rio Paranaíba and Araguaia to fungicide applications for panicle blast control.

A comparative study on inter and intralaboratory reproducibility of renin measurement with a conventional enzymatic method and a new chemiluminescent assay of immunoreactive renin.

BACKGROUND: The activity of the renin-angiotensin system is usually evaluated as plasma renin activity (PRA, ngAI/ml per h) but the reproducibility of this enzymatic assay is notoriously scarce. We compared the inter and intralaboratory reproducibilities of PRA with those of a new automated chemiluminescent assay, which allows the direct quantification of immunoreactive renin [chemiluminescent immunoreactive renin (CLIR), microU/ml]. METHODS: Aliquots from six pool plasmas of patients with very low to very high PRA levels were measured in 12 centres with both the enzymatic and the direct assays. The same methods were applied to three control plasma preparations with known renin content. RESULTS: In pool plasmas, mean PRA values ranged from 0.14 +/- 0.08 to 18.9 +/- 4.1 ngAI/ml per h, whereas those of CLIR ranged from 4.2 +/- 1.7 to 436 +/- 47 microU/ml. In control plasmas, mean values of PRA and of CLIR were always within the expected range. Overall, there was a significant correlation between the two methods (r = 0.73, P < 0.01). Similar correlations were found in plasmas subdivided in those with low, intermediate and high PRA. However, the coefficients of variation among laboratories found for PRA were always higher than those of CLIR, ranging from 59.4 to 17.1% for PRA, and from 41.0 to 10.7% for CLIR (P < 0.01). Also, the mean intralaboratory variability was higher for PRA than for CLIR, being respectively, 8.5 and 4.5% (P < 0.01). CONCLUSION: The measurement of renin with the chemiluminescent method is a reliable alternative to PRA, having the advantage of a superior inter and intralaboratory reproducibility.

Sample size for measurement of root traits on common bean by image analysis

Evaluation of root traits may be facilitated if they are assessed on samples of the root system. The objective of this work was to determine the sample size of the root system in order to estimate root traits of common bean (Phaseolus vulgaris L.) cultivars by digital image analysis. One plant was grown per pot and harvested at pod setting, with 64 and 16 pots corresponding to two and four cultivars in the first and second experiments, respectively. Root samples were scanned up to the completeness of the root system and the root area and length were estimated. Scanning a root sample demanded 21 minutes, and scanning the entire root system demanded 4 hours and 53 minutes. In the first experiment, root area and length estimated with two samples showed, respectively, a correlation of 0.977 and 0.860, with these traits measured in the entire root. In the second experiment, the correlation was 0.889 and 0.915. The increase in the correlation with more than two samples was negligible. The two samples corresponded to 13.4% and 16.9% of total root mass (excluding taproot and nodules) in the first and second experiments. Taproot stands for a high proportion of root mass and must be deducted on root trait estimations. Samples with nearly 15% of total root mass produce reliable root trait estimates.

Inequality measurement for ordered response health data

When health status is an ordered response variable, Allison and Foster (2004)postulate that a distribution Q exhibits more inequality than a distribution P if Q is obtained from P via a sequence of median preserving spreads. This paper introduces a parametric family of inequality indices which are founded on the Allison and Foster ordering. [Authors]

A New Approach for the Carbon Monoxide (CO) Exposure Diagnosis: Measurement of Total CO in Human Blood Versus Carboxyhemoglobin (HbCO).

The aim of the study is to present the application of a headspace-gas chromatography-mass spectrometry (HS-GC-MS) method for the determination of the carbon monoxide (CO) blood concentration and to compare it with carboxyhemoglobin (HbCO) saturation. In postmortem cases, the HbCO measured by spectrophotometry frequently leads to inaccurate results due to inadequate samples or analyses. The true role of CO intoxication in the death of a person could be misclassified. The estimation of HbCO from HS-GC-MS CO measurements provides helpful information by determining the total CO levels (CO linked to hemoglobin (HbCO) and CO dissociated from hemoglobin). The CO concentrations were converted in HbCO saturation levels to define cutoff blood CO values. CO limits were defined as less than 1 μmol/mL for living persons, less than 1.5 μmol/mL for dead persons without CO exposure, and greater than 3 μmol/mL for dead persons with clear CO poisoning.