The validity of critical thinking tests for predicting degree performance: A longitudinal study

This study explored the validity of using critical thinking tests to predict final psychology degree marks over and above that already predicted by traditional admission exams (A-levels). Participants were a longitudinal sample of 109 psychology students from a university in the United Kingdom. The outcome measures were: total degree marks; and end of year marks. The predictor measures were: university admission exam results (A-levels); critical thinking test scores (skills & dispositions); and non-verbal intelligence scores. Hierarchical regressions showed A-levels significantly predicted 10% of the final degree score and the 11-item measure of ‘Inference skills’ from the California Critical Thinking Skills Test significantly predicted an additional 6% of degree outcome variance. The findings from this study should inform decisions about the precise measurement constructs included in aptitude tests used in the higher education admission process.

Measuring critical thinking skills and dispositions in undergraduate students

This thesis investigates critical thinking with a particular focus on measurement in undergraduate students. A higher education context was chosen because many regard critical thinking development as a primary goal for third level education. Nine studies, both cross-sectional and longitudinal in design, were conducted with undergraduate psychology students (N=387), using the California Critical Thinking Disposition Inventory (CCTDI) and the California Critical Thinking Skills Test (CCTST). Studies 1-3 revealed psychometric weaknesses in the CCTDI and revised the scale with factor analysis and reliability analysis to form the CCTDI United Kingdom revision (CCTDI-UK). Study 4 investigated convergent validity and showed significant inter-correlation between the sub-scales of the CCTDI-UK, and significant correlations with the Openness scale of the NEO Personality Inventory (NEO PI-R). The study also provided evidence for improvement in scores on three of the six sub-scales in the CCTDI-UK (Truth-Seeking, Inquisitiveness, Open-Mindedness) during the course of an undergraduate degree. Study 5 explored a two factor structure for critical thinking dispositions. Study 6 used reliability analysis to revise the CCTST to produce the CCTST-UK. Study 7 showed that the CCTST-UK had a moderate correlation with degree attainment and a slightly higher correlation with a test of non-verbal intelligence (Raven’s Advanced Progressive Matrices short form); in addition, the study showed that scores on the CCTST-UK improved during the course of the degree. Studies 8 and 9 investigated the potential of critical thinking for predicting degree attainment. A-levels predicted approximately 10% of the variance of degree attainment while entry level scores on the CCTST-UK predicted an additional 5%. Exit level scores on the CCTST-UK and the Inquisitive sub-scale of the CCTDI-UK were found to be predictors of degree attainment The main conclusions of the thesis were that these tests had significant potential for predicting degree attainment and that they measured a substantial proportion of the theoretical constructs identified by the major authors in critical thinking.

An experiment in group learning technology: evaluating critical thinking in face-to-face and computer-supported seminars

Can learning quality be maintained in the face of increasing class size by the use of Computer Supported Co-operative Learning (CSCL) technologies? In particular, can Computer-Mediated Communication promote critical thinking in addition to surface information transfer? We compared face-to-face seminars with asynchronous computer conferencing in the same Information Management class. From Garrison's theory of critical thinking and Henri's critical reasoning skills, we developed two ways of evaluating critical thinking: a student questionnaire and a content analysis technique. We found evidence for critical thinking in both situations, with some subtle differences in learning style. This paper provides an overview of this work.

A content analysis method to measure critical thinking in face-to-face and computer supported group learning

This paper gives a detailed account of the content analysis method developed at Queen's University Belfast to measure critical thinking during group learning, as used in our controlled comparisons between learning in face-to-face and computer conference seminars. From Garrison's 5 stages of critical thinking, and Henri's cognitive skills needed in CMC, we have developed two research instruments: a student questionnaire and this content analysis method. The content analysis relies on identifying, within transcripts, examples of indicators of obviously critical and obviously uncritical thinking, from which several critical thinking ratios can be calculated.