The validity of critical thinking tests for predicting degree performance: A longitudinal study

This study explored the validity of using critical thinking tests to predict final psychology degree marks over and above that already predicted by traditional admission exams (A-levels). Participants were a longitudinal sample of 109 psychology students from a university in the United Kingdom. The outcome measures were: total degree marks; and end of year marks. The predictor measures were: university admission exam results (A-levels); critical thinking test scores (skills & dispositions); and non-verbal intelligence scores. Hierarchical regressions showed A-levels significantly predicted 10% of the final degree score and the 11-item measure of ‘Inference skills’ from the California Critical Thinking Skills Test significantly predicted an additional 6% of degree outcome variance. The findings from this study should inform decisions about the precise measurement constructs included in aptitude tests used in the higher education admission process.

Hui and Walter's latent-class model extended to estimate diagnostic test properties from surveillance data: a latent model for latent data

Diagnostic test sensitivity and specificity are probabilistic estimates with far reaching implications for disease control, management and genetic studies. In the absence of 'gold standard' tests, traditional Bayesian latent class models may be used to assess diagnostic test accuracies through the comparison of two or more tests performed on the same groups of individuals. The aim of this study was to extend such models to estimate diagnostic test parameters and true cohort-specific prevalence, using disease surveillance data. The traditional Hui-Walter latent class methodology was extended to allow for features seen in such data, including (i) unrecorded data (i.e. data for a second test available only on a subset of the sampled population) and (ii) cohort-specific sensitivities and specificities. The model was applied with and without the modelling of conditional dependence between tests. The utility of the extended model was demonstrated through application to bovine tuberculosis surveillance data from Northern and the Republic of Ireland. Simulation coupled with re-sampling techniques, demonstrated that the extended model has good predictive power to estimate the diagnostic parameters and true herd-level prevalence from surveillance data. Our methodology can aid in the interpretation of disease surveillance data, and the results can potentially refine disease control strategies.

Cathepsin S: therapeutic, diagnostic, and prognostic potential

Cathepsin S is a member of the cysteine cathepsin protease family. It is a lysosomal protease which can promote degradation of damaged or unwanted proteins in the endo-lysosomal pathway. Additionally, it has more specific roles such as MHC class II antigen presentation, where it is important in the degradation of the invariant chain. Unsurprisingly, mis-regulation has implicated cathepsin S in a variety of pathological processes including arthritis, cancer, and cardiovascular disease, where it becomes secreted and can act on extracellular substrates. In comparison to many other cysteine cathepsin family members, cathepsin S has uniquely restricted tissue expression and is more stable at a neutral pH, which supports its involvement and importance in localised disease microenvironments. In this review, we examine the known involvement of cathepsin S in disease, particularly with respect to recent work indicating its role in mediating pain, diabetes, and cystic fibrosis. We provide an overview of current literature with regards cathepsin S as a therapeutic target, as well as its role and potential as a predictive diagnostic and/or prognostic marker in these diseases.

Panning for Gold: The Standardizing Work of Filling “Autistic” Shells – Using institutional ethnography to explore textually mediated health relations in the diagnostic process of autism.

Health reform practices in Canada and elsewhere have restructured the purpose and use of diagnostic labels and the processes of naming such labels. Diagnoses are no longer only a means to tell doctors and patients what may be wrong and indicate potential courses of treatment; some diagnoses activate specialized services and supports for persons with a disability and those who provide care for them. In British Columbia, a standardized process of diagnosis with the outcome of an autism spectrum disorder gives access to government provided health care and educational services and supports. Such processes enter individuals into a complex of text mediated relations, regulated by the principles of evidence-based medicine. However, the diagnosis of autism in children is notoriously uncertain. Because of this ambiguity, standardizing the diagnostic process creates a hurdle in gaining help and support for parents who have children with problems that could lead to a diagnosis on the autism spectrum. Such processes and their organizing relations are problematized, explored and explicated below. Grounded in the epistemological and ontological shift offered by Dorothy E. Smith (1987; 1990a; 1999; 2005), this article reports on the findings of an institutional ethnographic study that explored the diagnostic process of autism in British Columbia. More specifically, this article focuses on the processes involved in going from mothers talking from their experience about their childrens problems to the formalized and standardized, and thus “virtually” produced, diagnoses that may or may not give access to services and supports in different systems of care. Two psychologists, a developmental pediatrician, a social worker – members of a specialized multidisciplinary assessment team – and several mothers of children with a diagnosis on the autism spectrum were interviewed. The implications of standardizing the diagnosis process of a disability that is not clear-cut and has funding attached are discussed. This ethnography also provides a glimpse of the implications of current and ongoing reforms in the state-supported health care system in British Columbia, and more generally in Canada, for people’s everyday doings.

Content Validity in Landscape Valuation: A transdisciplinary approach to valuing the landscape of the peninsula of Sorrento, Italy.

This paper addresses the representation of landscape complexity in stated preferences research. It integrates landscape ecology and landscape economics and conducts the landscape analysis in a three-dimensional space to provide ecologically meaningful quantitative landscape indicators that are used as variables for the monetary valuation of landscape in a stated preferences study. Expected heterogeneity in taste intensity across respondents is addressed with a mixed logit model in Willingness to Pay space. The results suggest that the integration of landscape ecology metrics in a stated preferences model provides useful insights for valuing landscape and landscape changes

Establishing the validity of English GP Patient Survey items evaluating out-of-hours care

Background A 2014 national audit used the English General Practice Patient Survey (GPPS) to compare service users’ experience of out-of-hours general practitioner (GP) services, yet there is no published evidence on the validity of these GPPS items. Objectives Establish the construct and concurrent validity of GPPS items evaluating service users’ experience of GP out-of-hours care. Methods Cross-sectional postal survey of service users (n=1396) of six English out-of-hours providers. Participants reported on four GPPS items evaluating out-of-hours care (three items modified following cognitive interviews with service users), and 14 evaluative items from the Out-of-hours Patient Questionnaire (OPQ). Construct validity was assessed through correlations between any reliable (Cochran's α>0.7) scales, as suggested by a principal component analysis of the modified GPPS items, with the ‘entry access’ (four items) and ‘consultation satisfaction’ (10 items) OPQ subscales. Concurrent validity was determined by investigating whether each modified GPPS item was associated with thematically related items from the OPQ using linear regressions. Results The modified GPPS item-set formed a single scale (α=0.77), which summarised the two-component structure of the OPQ moderately well; explaining 39.7% of variation in the ‘entry access’ scores (r=0.63) and 44.0% of variation in the ‘consultation satisfaction’ scores (r=0.66), demonstrating acceptable construct validity. Concurrent validity was verified as each modified GPPS item was highly associated with a distinct set of related items from the OPQ. Conclusions Minor modifications are required for the English GPPS items evaluating out-of-hours care to improve comprehension by service users. A modified question set was demonstrated to comprise a valid measure of service users’ overall satisfaction with out-of-hours care received. This demonstrates the potential for the use of as few as four items in benchmarking providers and assisting services in identifying, implementing and assessing quality improvement initiatives.

Diagnostic performance on briefly presented digital pathology images

Background: Identifying new and more robust assessments of proficiency/expertise (finding new "biomarkers of expertise") in histopathology is desirable for many reasons. Advances in digital pathology permit new and innovative tests such as flash viewing tests and eye tracking and slide navigation analyses that would not be possible with a traditional microscope. The main purpose of this study was to examine the usefulness of time-restricted testing of expertise in histopathology using digital images.
Methods: 19 novices (undergraduate medical students), 18 intermediates (trainees), and 19 experts (consultants) were invited to give their opinion on 20 general histopathology cases after 1 s and 10 s viewing times. Differences in performance between groups were measured and the internal reliability of the test was calculated.
Results: There were highly significant differences in performance between the groups using the Fisher's least significant difference method for multiple comparisons. Differences between groups were consistently greater in the 10-s than the 1-s test. The Kuder-Richardson 20 internal reliability coefficients were very high for both tests: 0.905 for the 1-s test and 0.926 for the 10-s test. Consultants had levels of diagnostic accuracy of 72% at 1 s and 83% at 10 s.
Conclusions: Time-restricted tests using digital images have the potential to be extremely reliable tests of diagnostic proficiency in histopathology. A 10-s viewing test may be more reliable than a 1-s test. Over-reliance on "at a glance" diagnoses in histopathology is a potential source of medical error due to over-confidence bias and premature closure.

Locations of peculiar supernovae as a diagnostic of their origins

We put constraints on the properties of the progenitors of peculiar calcium-rich transients using the distribution of locations within their host galaxies. We confirm that this class of transients do not follow the galaxy stellar mass profile and are more likely to be found in remote locations of their apparent hosts. We test the hypothesis that these transients are from low-metallicity progenitors by comparing their spatial distributions with the predictions of self-consistent cosmological simulations that include star formation and chemical enrichment. We find that while metal-poor stars and our transient sample show a consistent preference for large offsets, metallicity alone cannot explain the extreme cases. Invoking a lower age limit on the progenitor helps to improve the match, indicating these events may result from a very old metal-poor population. We also investigate the radial distribution of globular cluster systems, and show that they too are consistent with the class of calcium-rich transients. Because photometric upper limits exist for globular clusters for some members of the class, a production mechanism related to the dense environment of globular clusters is not favoured for the calcium-rich events. However, the methods developed in this paper may be used in the future to constrain the effects of low metallicity on radially distant core-collapse events or help establish a correlation with globular clusters for other classes of peculiar explosions.