Multivariable adjustments counteract spectrum and test review bias in accuracy studies

OBJECTIVES: The STAndards for Reporting studies of Diagnostic accuracy (STARD) for investigators and editors and the Quality Assessment of Diagnostic Accuracy Studies (QUADAS) for reviewers and readers offer guidelines for the quality and reporting of test accuracy studies. These guidelines address and propose some solutions to two major threats to validity: spectrum bias and test review bias. STUDY DESIGN AND SETTING: Using a clinical example, we demonstrate that these solutions fail and propose an alternative solution that concomitantly addresses both sources of bias. We also derive formulas that prove the generality of our arguments. RESULTS: A logical extension of our ideas is to extend STARD item 23 by adding a requirement for multivariable statistical adjustment using information collected in QUADAS items 1, 2, and 12 and STARD items 3-5, 11, 15, and 18. CONCLUSION: We recommend reporting not only variation of diagnostic accuracy across subgroups (STARD item 23) but also the effects of the multivariable adjustments on test performance. We also suggest that the QUADAS be supplemented by an item addressing the appropriateness of statistical methods, in particular whether multivariable adjustments have been included in the analysis.

Design and Test of a 0.5 THz Dipole Antenna With Integrated Schottky Diode Detector on a High Dielectric Constant Ceramic Electromagnetic Bandgap Substrate

This paper presents the first analysis of the input impedance and radiation properties of a dipole antenna, placed on top of Fan 's three-dimensional electromagnetic bandgap (EBG) structure, (Applied Physics Letters, 1994) constructed using a high dielectric constant ceramic. The best position of the dipole on the EBG surface is determined following impedance and radiation pattern analyses. Based on this optimum configuration an integrated Schottky heterodyne detector was designed, manufactured and tested from 0.48 to 0.52 THz. The main antenna features were not degraded by the high dielectric constant substrate due to the use of the EBG approach. Measured radiation patterns are in good agreement with the predicted ones.

The impact of retrieval processes, age, general achievement level, and test scoring scheme for children's metacognitive monitoring and controlling

This multi-phase study examined the influence of retrieval processes on children’s metacognitive processes in relation to and in interaction with achievement level and age. First, N = 150 9/10- and 11/12-year old high and low achievers watched an educational film and predicted their test performance. Children then solved a cloze test regarding the film content including answerable and unanswerable items and gave confidence judgments to every answer. Finally, children withdrew answers that they believed to be incorrect. All children showed adequate metacognitive processes before and during test taking with 11/12- year-olds outperforming 9/10-year-olds when considering characteristics of on-going retrieval processes. As to the influence of achievement level, high compared to low achievers proved to be more accurate in their metacognitive monitoring and controlling. Results suggest that both cognitive resources (operationalized through achievement level) and mnemonic experience (assessed through age) fuel metacognitive development. Nevertheless, when facing higher demands regarding retrieval processes, experience seems to play the more important role.

Development and Test of a Neutron Imaging Setup at the PGAA Instrument at FRM II

We report on the developments of a neutron tomography setup at the instrument for prompt gamma-ray activation analysis (PGAA) at the Maier-Leibnitz Zentrum(MLZ). The recent developments are driven by the idea of combining the spatial information obtained with neutron tomography with the elemental information determined with PGAA, i.e. to further combine both techniques to an investigative technique called prompt gamma activation imaging (PGAI).At the PGAA instrument, a cold neutron flux of up to 6 x 1010 cm-2 s-1 (thermal equivalent) is available in the focus of an elliptically tapered neutron guide. In the reported experiments, the divergence of the neutron beam was investigated, the resolution of the installed detector system tested, and a proof-of-principle tomography experiment performed. In our study a formerly used camera box was upgraded with a better camera and an optical resolution of 8 line pairs/mm was achieved. The divergence of the neutron beam was measured by a systematic scan along the beam axis. Based on the acquired data, a neutron imaging setup with a L/D ratio of 200 was installed. The resolution of the setup was testedin combination with a gadolinium test target and different scintillator screens. The test target was irradiated at two positions to determine the maximum resolution and the resolution at the actual sample position. The performance of the installed tomography setup was demonstrated bya tomography experiment of an electric amplifier tube.

Development of a novel fMRI compatible visual perception prototype battery to test older people with and without dementia

Background: Visuoperceptual deficits in dementia are common and can reduce quality of life. Testing of visuoperceptual function is often confounded by impairments in other cognitive domains and motor dysfunction. We aimed to develop, pilot, and test a novel visuocognitive prototype test battery which addressed these issues, suitable for both clinical and functional imaging use. Methods: We recruited 23 participants (14 with dementia, 6 of whom had extrapyramidal motor features, and 9 age-matched controls). The novel Newcastle visual perception prototype battery (NEVIP-B-Prototype) included angle, color, face, motion and form perception tasks, and an adapted response system. It allows for individualized task difficulties. Participants were tested outside and inside the 3T functional magnetic resonance imaging (fMRI) scanner. Functional magnetic resonance imaging data were analyzed using SPM8. Results: All participants successfully completed the task inside and outside the scanner. Functional magnetic resonance imaging analysis showed activation regions corresponding well to the regional specializations of the visual association cortex. In both groups, there was significant activity in the ventral occipital-temporal region in the face and color tasks, whereas the motion task activated the V5 region. In the control group, the angle task activated the occipitoparietal cortex. Patients and controls showed similar levels of activation, except on the angle task for which occipitoparietal activation was lower in patients than controls. Conclusion: Distinct visuoperceptual functions can be tested in patients with dementia and extrapyramidal motor features when tests use individualized thresholds, adapted tasks, and specialized response systems.

The development and evaluation of a computer-based program to test and to teach the recognition of facial affect

Autism is a chronic pervasive neurodevelopmental disorder characterized by the early onset of social and communicative impairments as well as restricted, ritualized, stereotypic behavior. The endophenotype of autism includes neuropsychological deficits, for instance a lack of "Theory of Mind" and problems recognizing facial affect. In this study, we report the development and evaluation of a computer-based program to teach and test the ability to identify basic facially expressed emotions. 10 adolescent or adult subjects with high-functioning autism or Asperger-syndrome were included in the investigation. A priori the facial affect recognition test had shown good psychometric properties in a normative sample (internal consistency: rtt=.91-.95; retest reliability: rtt=.89-.92). In a prepost design, one half of the sample was randomly assigned to receive computer treatment while the other half of the sample served as control group. The training was conducted for five weeks, consisting of two hours training a week. The trained individuals improved significantly on the affect recognition task, but not on any other measure. Results support the usefulness of the program to teach the detection of facial affect. However, the improvement found is limited to a circumscribed area of social-communicative function and generalization is not ensured.

Variation of a test's sensitivity and specificity with disease prevalence

BACKGROUND Anecdotal evidence suggests that the sensitivity and specificity of a diagnostic test may vary with disease prevalence. Our objective was to investigate the associations between disease prevalence and test sensitivity and specificity using studies of diagnostic accuracy. METHODS We used data from 23 meta-analyses, each of which included 10-39 studies (416 total). The median prevalence per review ranged from 1% to 77%. We evaluated the effects of prevalence on sensitivity and specificity using a bivariate random-effects model for each meta-analysis, with prevalence as a covariate. We estimated the overall effect of prevalence by pooling the effects using the inverse variance method. RESULTS Within a given review, a change in prevalence from the lowest to highest value resulted in a corresponding change in sensitivity or specificity from 0 to 40 percentage points. This effect was statistically significant (p < 0.05) for either sensitivity or specificity in 8 meta-analyses (35%). Overall, specificity tended to be lower with higher disease prevalence; there was no such systematic effect for sensitivity. INTERPRETATION The sensitivity and specificity of a test often vary with disease prevalence; this effect is likely to be the result of mechanisms, such as patient spectrum, that affect prevalence, sensitivity and specificity. Because it may be difficult to identify such mechanisms, clinicians should use prevalence as a guide when selecting studies that most closely match their situation.

Metacognitive monitoring and control in elementary school children: Their interrelations and their role for test performance

Contemporary models of self-regulated learning emphasize the role of distal motivational factors for student's achievement, on the one side, and the proximal role of metacognitive monitoring and control for learning and test outcomes, on the other side. In the present study, two larger samples of elementary school children (9- and 11-year-olds) were included and their mastery-oriented motivation, metacognitive monitoring and control skills were integrated into structural equation models testing and comparing the relative impact of these different constituents for self-regulated learning. For one, results indicate that the factorial structure of monitoring, control and mastery motivation was invariant across the two age groups. Of specific interest was the finding that there were age-dependent structural links between monitoring, control, and test performance (closer links in the older compared to the younger children), with high confidence yielding a direct and positive effect on test performance and a direct and negative effect on adequate control behavior in the achievement test. Mastery-oriented motivation was not found to be substantially associated with monitoring (confidence), control (detection and correction of errors), or test performance underlining the importance of proximal, metacognitive factors for test performance in elementary school children.

Remission in schizophrenia: validity, frequency, predictors, and patients' perspective 5 years later

In March 2005, the Remission in Schizophrenia Working Group (RSWG) proposed a consensus definition of symptomatic remission in schizophrenia and developed specific operational criteria for its assessment. They pointed out, however, that the validity and the relationship to other outcome dimensions required further examination. This article reviews studies on the validity, frequency, and predictors of symptomatic remission in schizophrenia and studies on patients' perspectives. These studies have demonstrated that the RSWG remission criteria appear achievable and sustainable for a significant proportion of patients, and are related to a better overall symptomatic status and functional outcome and, to a less clear extent, to a better quality of life and cognitive performance. However, achieving symptomatic remission is not automatically concurrent with an adequate status in other outcome dimensions. The results of the present review suggest that the RSWG remission criteria are valid and useful. As such, they should be consistently applied in clinical trials. However the lack of consensus definitions of functional remission and adequate quality of life hampers research on their predictive validity on these outcome dimensions. Future research should therefore search for criteria of these dimensions and test whether the RSWG remission criteria consistently predict a "good" outcome with respect to functioning and quality of life.

Hip Osteoarthritis MRI Scoring System (HOAMS): reliability and associations with radiographic and clinical findings

To develop a semiquantitative MRI-based scoring system (HOAMS) of hip osteoarthritis (OA) and test its reliability and validity.

The SerpinB1 knockout mouse a model for studying neutrophil protease regulation in homeostasis and inflammation

SerpinB1 is a clade B serpin, or ov-serpin, found at high levels in the cytoplasm of neutrophils. SerpinB1 inhibits neutrophil serine proteases, which are important in killing microbes. When released from granules, these potent enzymes also destroy host proteins and contribute to morbidity and mortality in inflammatory diseases including emphysema, chronic obstructive pulmonary disease, cystic fibrosis, arthritis, and sepsis. Studies of serpinB1-deficient mice have established a crucial role for this serpin in Pseudomonas aeruginosa infection by preserving lung antimicrobial proteins from proteolysis and by protecting lung-recruited neutrophils from a premature death. SerpinB1⁻/⁻ mice also have a severe defect in the bone marrow reserve of mature neutrophils demonstrating a key role for serpinB1 in cellular homeostasis. Here, key methods used to generate and characterize serpinB1⁻/⁻ mice are described including intranasal inoculation, myeloperoxidase activity, flow cytometry analysis of bone marrow myeloid cells, and elastase activity. SerpinB1-knockout mice provide a model to dissect the pathogenesis of inflammatory disease characterized by protease:antiprotease imbalance and may be used to assess the efficacy of therapeutic compounds.

Tradeoffs associated with constitutive and induced plant resistance against herbivory

Several prominent hypotheses have been posed to explain the immense variability among plant species in defense against herbivores. A major concept in the evolutionary ecology of plant defenses is that tradeoffs of defense strategies are likely to generate and maintain species diversity. In particular, tradeoffs between constitutive and induced resistance and tradeoffs relating these strategies to growth and competitive ability have been predicted. We performed three independent experiments on 58 plant species from 15 different plant families to address these hypotheses in a phylogenetic framework. Because evolutionary tradeoffs may be altered by human-imposed artificial selection, we used 18 wild plant species and 40 cultivated garden-plant species. Across all 58 plant species, we demonstrate a tradeoff between constitutive and induced resistance, which was robust to accounting for phylogenetic history of the species. Moreover, the tradeoff was driven by wild species and was not evident for cultivated species. In addition, we demonstrate that more competitive species—but not fast growing ones—had lower constitutive but higher induced resistance. Thus, our multispecies experiments indicate that the competition–defense tradeoff holds for constitutive resistance and is complemented by a positive relationship of competitive ability with induced resistance. We conclude that the studied genetically determined tradeoffs are indeed likely to play an important role in shaping the high diversity observed among plant species in resistance against herbivores and in life history traits.

The influence of toothbrushing and coffee staining on different composite surface coatings

The aim of our study is to evaluate the performance of surface sealants and conventional polishing after ageing procedures. Eighty circular composite restorations were performed on extracted human molars. After standardised roughening, the restorations were either sealed with one of three surface sealants (Lasting Touch (LT), BisCover LV (BC), G-Coat Plus (GP) or a dentin adhesive Heliobond (HB)) or were manually polished with silicon polishers (MP) (n = 16). The average roughness (Ra) and colourimetric parameters (CP) (L*a*b*) were evaluated. The specimens underwent an artificial ageing process by thermocycling, staining (coffee) and abrasive (toothbrushing) procedures. After each ageing step, Ra and CP measurements were repeated. A qualitative surface analysis was performed with SEM. The differences between the test groups regarding Ra and CP values were analysed with nonparametric ANOVA analysis (α = 0.05). The lowest Ra values were achieved with HB. BC and GP resulted in Ra values below 0.2 μm (clinically relevant threshold), whereas LT and MP sometimes led to higher Ra values. LT showed a significantly higher discolouration after the first coffee staining, but this was normalised to the other groups after toothbrushing. The differences between the measurements and test groups for Ra and CP were statistically significant. However, the final colour difference showed no statistical difference among the five groups. SEM evaluation showed clear alterations after ageing in all coating groups. Surface sealants and dentin adhesives have the potential to reduce surface roughness but tend to debond over time. Surface sealants can only be recommended for polishing provisional restorations.

Protein and lipid binding parameters in rainbow trout (Oncorhynchus mykiss) blood and liver fractions to extrapolate from an in vitro metabolic degradation assay to in vivo bioaccumulation potential of hydrophobic organic chemicals

Binding of hydrophobic chemicals to colloids such as proteins or lipids is difficult to measure using classical microdialysis methods due to low aqueous concentrations, adsorption to dialysis membranes and test vessels, and slow kinetics of equilibration. Here, we employed a three-phase partitioning system where silicone (polydimethylsiloxane, PDMS) serves as a third phase to determine partitioning between water and colloids and acts at the same time as a dosing device for hydrophobic chemicals. The applicability of this method was demonstrated with bovine serum albumin (BSA). Measured binding constants (K(BSAw)) for chlorpyrifos, methoxychlor, nonylphenol, and pyrene were in good agreement with an established quantitative structure-activity relationship (QSAR). A fifth compound, fluoxypyr-methyl-heptyl ester, was excluded from the analysis because of apparent abiotic degradation. The PDMS depletion method was then used to determine partition coefficients for test chemicals in rainbow trout (Oncorhynchus mykiss) liver S9 fractions (K(S9w)) and blood plasma (K(bloodw)). Measured K(S9w) and K(bloodw) values were consistent with predictions obtained using a mass-balance model that employs the octanol-water partition coefficient (K(ow)) as a surrogate for lipid partitioning and K(BSAw) to represent protein binding. For each compound, K(bloodw) was substantially greater than K(S9w), primarily because blood contains more lipid than liver S9 fractions (1.84% of wet weight vs 0.051%). Measured liver S9 and blood plasma binding parameters were subsequently implemented in an in vitro to in vivo extrapolation model to link the in vitro liver S9 metabolic degradation assay to in vivo metabolism in fish. Apparent volumes of distribution (V(d)) calculated from the experimental data were similar to literature estimates. However, the calculated binding ratios (f(u)) used to relate in vitro metabolic clearance to clearance by the intact liver were 10 to 100 times lower than values used in previous modeling efforts. Bioconcentration factors (BCF) predicted using the experimental binding data were substantially higher than the predicted values obtained in earlier studies and correlated poorly with measured BCF values in fish. One possible explanation for this finding is that chemicals bound to proteins can desorb rapidly and thus contribute to metabolic turnover of the chemicals. This hypothesis remains to be investigated in future studies, ideally with chemicals of higher hydrophobicity.