Looking for Validity or Testing It? The Perils of Stepwise Regression, Extreme-Scores Analysis, Heteroscedasticity, and Measurement Error

When researchers introduce a new test they have to demonstrate that it is valid, using unbiased designs and suitable statistical procedures. In this article we use Monte Carlo analyses to highlight how incorrect statistical procedures (i.e., stepwise regression, extreme scores analyses) or ignoring regression assumptions (e.g., heteroscedasticity) contribute to wrong validity estimates. Beyond these demonstrations, and as an example, we re-examined the results reported by Warwick, Nettelbeck, and Ward (2010) concerning the validity of the Ability Emotional Intelligence Measure (AEIM). Warwick et al. used the wrong statistical procedures to conclude that the AEIM was incrementally valid beyond intelligence and personality traits in predicting various outcomes. In our re-analysis, we found that the reliability-corrected multiple correlation of their measures with personality and intelligence was up to .69. Using robust statistical procedures and appropriate controls, we also found that the AEIM did not predict incremental variance in GPA, stress, loneliness, or well-being, demonstrating the importance for testing validity instead of looking for it.

The career indecision profile : measurement equivalence in two international samples

This study tested for the measurement equivalence of a four-factor measure of career indecision (Career Indecision Profile-65 [CIP-65]) between a U.S. sample and two international samples; one composed of French-speaking young adults from France and Switzerland and the other of Italian ado- lescents. Previous research had supported the four-factor structure of the CIP-65 in both the United States and Iceland but also showed that items on two of the four scales may be interpreted differently by young adults growing up in these two countries. This study extends previous research by testing whether the four CIP-65 factors are measured equivalently in two additional international samples. Results largely supported the configural and metric invariance of the CIP-65 in the United States and international samples, but several scales showed a lack of scalar invariance. Some explanations are offered for these findings along with suggestions for future research and implications for practice.

Radiographic total disc replacement angle measurement accuracy using the Oxford Cobbometer: precision and bias.

Total disc replacement (TDR) clinical success has been reported to be related to the residual motion of the operated level. Thus, accurate measurement of TDR range of motion (ROM) is of utmost importance. One commonly used tool in measuring ROM is the Oxford Cobbometer. Little is known however on its accuracy (precision and bias) in measuring TDR angles. The aim of this study was to assess the ability of the Cobbometer to accurately measure radiographic TDR angles. An anatomically accurate synthetic L4-L5 motion segment was instrumented with a CHARITE artificial disc. The TDR angle and anatomical position between L4 and L5 was fixed to prohibit motion while the motion segment was radiographically imaged in various degrees of rotation and elevation, representing a sample of possible patient placement positions. An experienced observer made ten readings of the TDR angle using the Cobbometer at each different position. The Cobbometer readings were analyzed to determine measurement accuracy at each position. Furthermore, analysis of variance was used to study rotation and elevation of the motion segment as treatment factors. Cobbometer TDR angle measurements were most accurate (highest precision and lowest bias) at the centered position (95.5%), which placed the TDR directly inline with the x-ray beam source without any rotation. In contrast, the lowest accuracy (75.2%) was observed in the most rotated and off-centered view. A difference as high as 4 degrees between readings at any individual position, and as high as 6 degrees between all the positions was observed. Furthermore, the Cobbometer was unable to detect the expected trend in TDR angle projection with changing position. Although the Cobbometer has been reported to be reliable in different clinical applications, it lacks the needed accuracy to measure TDR angles and ROM. More accurate ROM measurement methods need to be developed to help surgeons and researchers assess radiological success of TDRs.

Importance of polyethylene thickness in total shoulder arthroplasty: a finite element analysis.

BACKGROUND: Articular surfaces reconstruction is essential in total shoulder arthroplasty. Because of the limited glenoid bone support, thin glenoid component could improve anatomical reconstruction, but adverse mechanical effects might appear. METHODS: With a numerical musculoskeletal shoulder model, we analysed and compared three values of thickness of a typical all-polyethylene glenoid component: 2, 4 (reference) and 6mm. A loaded movement of abduction in the scapular plane was simulated. We evaluated the humeral head translation, the muscle moment arms, the joint force, the articular contact pattern, and the polyethylene and cement stress. Findings Decreasing polyethylene thickness from 6 to 2mm slightly increased humeral head translation and muscle moment arms. This induced a small decreased of the joint reaction force, but important increase of stress within the polyethylene and the cement mantel. Interpretation The reference thickness of 4mm seems a good compromise to avoid stress concentration and joint stuffing.

Precast Concrete Panel Thickness for Epoxy-Coated Prestressing Strands, Volume 1, HR-353, 1994

This final report for Phase 1 of the research on epoxy-coated, prestressing strands in precast prestressed concrete (PC) panels has been published in two volumes. This volume, Volume 1--Technical Report, contains the problem description, literature review, and survey results; descriptions of the test specimens, experimental tests, and analytical models; discussions of the analytical and experimental results; summary, conclusions, and recommendations; list of references; and acknowledgment. Volume 2--Supplemental Report contains additional information in the form of summarized responses to the questionnaires; graphs showing the strand forces; figures showing the geometry of the specimens and concrete crack patterns that formed in the strand transfer length and strand development length specimens; and graphs of the concrete strains in the strand transfer length specimens, load-point deflections, and strand-slip measurements for the strand development length specimens.

Cell wall thickness and tangential and radial cell diameter of fertilized and irrigated Norway spruce

Abstract

Value of positron emission tomography in full-thickness chest wall resections for malignancies.

Preoperative imaging for resection of chest wall malignancies is generally performed by computed tomography (CT). We evaluated the role of (18)F-fluorodeoxyglucose (FDG) positron emission tomography (PET) in planning full-thickness chest wall resections for malignancies. We retrospectively included 18 consecutive patients operated from 2004 to 2006 at our institution. Tumor extent was measured by CT and PET, using the two largest perpendicular tumor extensions in the chest wall plane to compute the tumor surface assuming an elliptical shape. Imaging measurements were compared to histopathology assessment of tumor borders. CT assessment consistently overestimated the tumor size as compared to PET (+64% vs. +1%, P<0.001). Moreover, PET was significantly better than CT at defining the size of lesions >24 cm(2) corresponding to a mean diameter >5.5 cm or an ellipse of >4 cm x 7.6 cm (positive predictive value 80% vs. 44% and specificity 93% vs. 64%, respectively). Metabolic PET imaging was superior to CT for defining the extent of chest wall tumors, particularly for tumors with a diameter >5.5 cm. PET can complement CT in planning full-thickness chest wall resection for malignancies, but its true value remains to be determined in larger, prospective studies.

LiveCount Assay: concomitant measurement of cytolytic activity and phenotypic characterisation of CD8(+) T-cells by flow cytometry.

Tumour immunologists strive to develop efficient tumour vaccination and adoptive transfer therapies that enlarge the pool of tumour-specific and -reactive effector T-cells in vivo. To assess the efficiency of the various strategies, ex vivo assays are needed for the longitudinal monitoring of the patient's specific immune responses providing both quantitative and qualitative data. In particular, since tumour cell cytolysis is the end goal of tumour immunotherapy, routine immune monitoring protocols need to include a read-out for the cytolytic efficiency of Ag-specific cells. We propose to combine current immune monitoring techniques in a highly sensitive and reproducible multi-parametric flow cytometry based cytotoxicity assay that has been optimised to require low numbers of Ag-specific T-cells. The possibility of re-analysing those T-cells that have undergone lytic activity is illustrated by the concomitant detection of CD107a upregulation on the surface of degranulated T-cells. To date, the LiveCount Assay provides the only possibility of assessing the ex vivo cytolytic activity of low-frequency Ag-specific cytotoxic T-lymphocytes from patient material.

Assessment of skinfold thickness equations in estimating body composition in children with inflammatory bowel

Introduction: Growth is a central process in paediatrics. Weight and height evaluation are therefore routine exams for every child but in some situation, particularly inflammatory bowel disease (IBD), a wider evaluation of nutritional status needs to be performed. The assessment of body composition is essential in order to maintain acceptable growth using the following techniques: Dual-energy X-ray absorptiometry (DEXA), bio-impedance-analysis (BIA) and anthropometric measurements (skinfold thickness skin), the latter being most easily available and most cost effective. Objectives: To assess the accuracy of skinfold equations in estimating percentage body fat (%BF) in children with inflammatory bowel disease (IBD), compared with assessment of body fat dual energy X-ray absorptiometry (DEXA). Methods: Twenty-one patients (11 females, 10 males; mean age: 14.3 years, range 12 - 16 years) with IBD (Crohn's disease n = 15, ulcerative colitis n = 6)). Estimated%BF was computed using 6 established equations based on the triceps, biceps, subscapular and suprailiac skinfolds (Deurenberg, Weststrate, Slaughter, Durnin & Rahaman, Johnston, Brook) and compared to DEXA. Concordance analysis was performed using Lin's concordance correlation and the Bland-Altman limits of agreement method. Results: Durnin & Rahaman's equation shows a higher Lin's concordance coefficient with a small difference amongst raw values for skinfolds and DEXA compared to the other equations. Correlation coefficient between mean and difference is close to zero with a non-significant Bradley-Blackwood test. Conclusion: Body composition in paediatric IBD patients using the Durnin & Rahaman skinfold-equation adequately reflects values obtained by DEXA.

Measurement of the specific heat and determination of the thermodynamic functions of relaxed amorphous silicon

The specific heat, cp, of two amorphous silicon (a-Si) samples has been measured by differential scanning calorimetry in the 100–900K temperature range. When the hydrogen content is reduced by thermal annealing, cp approaches the value of crystalline Si (c-Si). Within experimental accuracy, we conclude that cp of relaxed pure a-Si coincides with that of c-Si. This result is used to determine the enthalpy, entropy, and Gibbs free energy of defect-free relaxed a-Si. Finally, the contribution of structural defects on these quantities is calculated and the melting point of several states of a-Si is predicted

Diabetes and pre-diabetes are associated with cardiovascular risk factors and carotid/femoral intima-media thickness independently of markers of insuline resistance and adiposity

Background Impaired glucose regulation (IGR) is associated with detrimental cardiovascular outcomes such as cardiovascular disease risk factors (CVD risk factors) or intima-media thickness (IMT). Our aim was to examine whether these associations are mediated by body mass index (BMI), waist circumference (waist) or fasting serum insulin (insulin) in a population in the African region. Methods Major CVD risk factors (systolic blood pressure, smoking, LDL-cholesterol, HDL-cholesterol,) were measured in a random sample of adults aged 25-64 in the Seychelles (n=1255, participation rate: 80.2%). According to the criteria of the American Diabetes Association, IGR was divided in four ordered categories: 1) normal fasting glucose (NFG), 2) impaired fasting glucose (IFG) and normal glucose tolerance (IFG/NGT), 3) IFG and impaired glucose tolerance (IFG/IGT), and 4) diabetes mellitus (DM). Carotid and femoral IMT was assessed by ultrasound (n=496). Results Age-adjusted levels of the major CVD risk factors worsened gradually across IGR categories (NFG < IFG/NGT < IFG/IGT < DM), particularly HDL-cholesterol and blood pressure (p for trend <0.001). These relationships were marginally attenuated upon further adjustment for waist, BMI or insulin (whether considered alone or combined) and most of these relationships remained significant. With regards to IMT, the association was null with IFG/NGT, weak with IFG/IGT and stronger with DM (all more markedly at femoral than carotid levels). The associations between IMT and IFG/IGT or DM (adjusted by age and major CVD risk factors) decreased only marginally upon further adjustment for BMI, waist or insulin. Further adjustment for family history of diabetes did not alter the results. Conclusions We found graded relationships between IGR categories and both major CVD risk factors and carotid/femoral IMT. These relationships were only partly accounted for by BMI, waist and insulin. This suggests that increased CVD-risk associated with IGR is also mediated by factors other than the considered markers of adiposity and insulin resistance. The results also imply that IGR and associated major CVD risk factors should be systematically screened and appropriately managed.

Quantifying Uncertainty in Real Time Performance Measurement for Highway Winter Maintenance Operations – Phase 2, RB03-013, 2014

Winter weather in Iowa is often unpredictable and can have an adverse impact on traffic flow. The Iowa Department of Transportation (Iowa DOT) attempts to lessen the impact of winter weather events on traffic speeds with various proactive maintenance operations. In order to assess the performance of these maintenance operations, it would be beneficial to develop a model for expected speed reduction based on weather variables and normal maintenance schedules. Such a model would allow the Iowa DOT to identify situations in which speed reductions were much greater than or less than would be expected for a given set of storm conditions, and make modifications to improve efficiency and effectiveness. The objective of this work was to predict speed changes relative to baseline speed under normal conditions, based on nominal maintenance schedules and winter weather covariates (snow type, temperature, and wind speed), as measured by roadside weather stations. This allows for an assessment of the impact of winter weather covariates on traffic speed changes, and estimation of the effect of regular maintenance passes. The researchers chose events from Adair County, Iowa and fit a linear model incorporating the covariates mentioned previously. A Bayesian analysis was conducted to estimate the values of the parameters of this model. Specifically, the analysis produces a distribution for the parameter value that represents the impact of maintenance on traffic speeds. The effect of maintenance is not a constant, but rather a value that the researchers have some uncertainty about and this distribution represents what they know about the effects of maintenance. Similarly, examinations of the distributions for the effects of winter weather covariates are possible. Plots of observed and expected traffic speed changes allow a visual assessment of the model fit. Future work involves expanding this model to incorporate many events at multiple locations. This would allow for assessment of the impact of winter weather maintenance across various situations, and eventually identify locations and times in which maintenance could be improved.

A comparative study on inter and intralaboratory reproducibility of renin measurement with a conventional enzymatic method and a new chemiluminescent assay of immunoreactive renin.

BACKGROUND: The activity of the renin-angiotensin system is usually evaluated as plasma renin activity (PRA, ngAI/ml per h) but the reproducibility of this enzymatic assay is notoriously scarce. We compared the inter and intralaboratory reproducibilities of PRA with those of a new automated chemiluminescent assay, which allows the direct quantification of immunoreactive renin [chemiluminescent immunoreactive renin (CLIR), microU/ml]. METHODS: Aliquots from six pool plasmas of patients with very low to very high PRA levels were measured in 12 centres with both the enzymatic and the direct assays. The same methods were applied to three control plasma preparations with known renin content. RESULTS: In pool plasmas, mean PRA values ranged from 0.14 +/- 0.08 to 18.9 +/- 4.1 ngAI/ml per h, whereas those of CLIR ranged from 4.2 +/- 1.7 to 436 +/- 47 microU/ml. In control plasmas, mean values of PRA and of CLIR were always within the expected range. Overall, there was a significant correlation between the two methods (r = 0.73, P < 0.01). Similar correlations were found in plasmas subdivided in those with low, intermediate and high PRA. However, the coefficients of variation among laboratories found for PRA were always higher than those of CLIR, ranging from 59.4 to 17.1% for PRA, and from 41.0 to 10.7% for CLIR (P < 0.01). Also, the mean intralaboratory variability was higher for PRA than for CLIR, being respectively, 8.5 and 4.5% (P < 0.01). CONCLUSION: The measurement of renin with the chemiluminescent method is a reliable alternative to PRA, having the advantage of a superior inter and intralaboratory reproducibility.

Sample size for measurement of root traits on common bean by image analysis

Evaluation of root traits may be facilitated if they are assessed on samples of the root system. The objective of this work was to determine the sample size of the root system in order to estimate root traits of common bean (Phaseolus vulgaris L.) cultivars by digital image analysis. One plant was grown per pot and harvested at pod setting, with 64 and 16 pots corresponding to two and four cultivars in the first and second experiments, respectively. Root samples were scanned up to the completeness of the root system and the root area and length were estimated. Scanning a root sample demanded 21 minutes, and scanning the entire root system demanded 4 hours and 53 minutes. In the first experiment, root area and length estimated with two samples showed, respectively, a correlation of 0.977 and 0.860, with these traits measured in the entire root. In the second experiment, the correlation was 0.889 and 0.915. The increase in the correlation with more than two samples was negligible. The two samples corresponded to 13.4% and 16.9% of total root mass (excluding taproot and nodules) in the first and second experiments. Taproot stands for a high proportion of root mass and must be deducted on root trait estimations. Samples with nearly 15% of total root mass produce reliable root trait estimates.

Inequality measurement for ordered response health data

When health status is an ordered response variable, Allison and Foster (2004)postulate that a distribution Q exhibits more inequality than a distribution P if Q is obtained from P via a sequence of median preserving spreads. This paper introduces a parametric family of inequality indices which are founded on the Allison and Foster ordering. [Authors]