Higher order thinking in chemistry curriculum and its assessment

Higher-order thinking has featured persistently in the reform agenda for science education. The intended curriculum in various countries sets out aspirational statements for the levels of higher-order thinking to be attained by students. This study reports the extent to which chemistry examinations from four Australian states align and facilitate the intended higher-order thinking skills stipulated in curriculum documents. Through content analysis, the curriculum goals were identified for each state and compared to the nature of question items in the corresponding examinations. Categories of higher-order thinking were adapted from the OECD’s PISA Science test to analyze question items. There was considerable variation in the extent to which the examinations from the states supported the curriculum intent of developing and assessing higher-order thinking. Generally, examinations that used a marks-based system tended to emphasize lower-order thinking, with a greater distribution of marks allocated for lower-order thinking questions. Examinations associated with a criterion-referenced examination tended to award greater credit for higher-order thinking questions. The level of complexity of chemistry was another factor that limited the extent to which examination questions supported higher-order thinking. Implications from these findings are drawn for the authorities responsible for designing curriculum and assessment procedures and for teachers.

Engineering the fitness of older patients for chemotherapy : an exploration of Comprehensive Geriatric Assessment in practice

Clinicians often report that currently available methods to assess older patients, including standard clinical consultations, do not elicit the information necessary to make an appropriate cancer treatment recommendation for older cancer patients. An increasingly popular way of assessing the potential of older patients to cope with chemotherapy is a Comprehensive Geriatric Assessment. What constitutes Comprehensive Geriatric Assessment, however, is open to interpretation and varies from one setting to another. Furthermore, Comprehensive Geriatric Assessment’s usefulness as a predictor of fitness for chemotherapy and as a determinant of actual treatment is not well understood. In this article, we analyse how Comprehensive Geriatric Assessment was developed for use in a large cancer service in an Australian capital city. Drawing upon Actor–Network Theory, our findings reveal how, during its development, Comprehensive Geriatric Assessment was made both a tool and a science. Furthermore, we briefly explore the tensions that we experienced as scholars who analyse medico-scientific practices and as practitioner–designers charged with improving the very tools we critique. Our study contributes towards geriatric oncology by scrutinising the medicalisation of ageing, unravelling the practices of standardisation and illuminating the multiplicity of ‘fitness for chemotherapy’.

Predicting fitness for chemotherapy in older cancer patients

Background: The Vulnerable Elders Survey-13 (VES-13) is increasingly used to screen for older patients who can proceed to intensive chemotherapy without further comprehensive assessment. This study compared the VES-13 determination of fitness for treatment with the oncologist's assessments of fitness. Method: Sample: Consecutive series of solid tumour patients ≥65 years (n=175; M=72; range=65-86) from an Australian cancer centre. Patients were screened with the VES-13 before proceeding to usual treatment. Blinded to screening, oncologists concurrently predicted patient fitness for chemotherapy. A sample of 175 can detect, with 90% power, kappa coefficients of agreement between VES-13 and oncologists’ assessments >0.90 ("almost perfect agreement"). Separate backward stepwise logistic regression analyses assessed potential predictors of VES-13 and oncologists’ ratings of fitness. Results: Kappa coefficient for agreement between VES-13 and oncologists’ ratings of fitness was 0.41 (p<0.001). VES-13 and oncologists’ assessments agreed in 71% of ratings. VES-13 sensitivity = 83.3%; specificity = 57%; positive predictive value = 69%; negative predictive value = 75%. Logistic regression modelling indicated that the odds of being vulnerable to chemotherapy (VES-13) increased with increasing depression (OR=1.42; 95% CI: 1.18, 1.71) and decreased with increased functional independence assessed on the Bartel Index (OR=0.82; CI: 0.74, 0.92) and Lawton instrumental activities of daily living (OR=0.44; CI: 0.30, 0.65); RSquare=.65. Similarly, the odds of a patient being vulnerable to chemotherapy, when assessed by physicians, increased with increasing age (OR=1.15; CI: 1.07, 1.23) and depression (OR=1.23; CI: 1.06, 1.43), and decreased with increasing functional independence (OR=0.91; CI: 0.85, 0.98); RSquare=.32. Conclusions: Our data indicate moderate agreement between VES-13 and clinician assessments of patients’ fitness for chemotherapy. Current ‘one-step’ screening processes to determine fitness have limits. Nonetheless, screening tools do have the potential for modification and enhanced predictive properties in cancer care by adding relevant items, thus enabling fit patients to be immediately referred for chemotherapy.

A nurse-led model of oncogeriatric assessment

Background There is growing consensus that a multidisciplinary, comprehensive and standardised process for assessing the fitness of older patients for chemotherapy should be undertaken to determine appropriate cancer treatment. Aim This study tested a model of cancer care for the older patient incorporating Comprehensive Geriatric Assessment (CGA), which aimed to ensure that 'fit' individuals amenable to active treatment were accurately identified; 'vulnerable' patients more suitable for modified or supportive regimens were determined; and 'frail 'individuals who would benefit most from palliative regimens were also identified and offered the appropriate level of care. Methods A consecutive-series n=178 sample of patients >65 years was recruited from a major Australian cancer centre. The following instruments were administered by an oncogeriatric nurse prior to treatment: Vulnerable Elders Survey-13; Cumulative Illness Rating Scale (Geriatric); Malnutrition Screening Tool; Mini-mental State Examination; Geriatric Depression Scale; Barthel Index; and Lawton Instrumental Activities of Daily Living Scale. Scores from these instruments were aggregated to predict patient fitness, vulnerability or frailty for chemotherapy. Physicians provided a concurrent (blinded) prediction of patient fitness, vulnerability or frailty based on their clinical assessment. Data were also collected on actual patient outcomes (eg treatment completed as predicted, treatment reduced) during monthly audits of patient trajectories. Data analysis Data analysis is underway. A sample of 178 is adequate to detect, with 90% power, kappa coefficients of agreement between CGA and physician assessments of K>0.90 ("almost perfect agreement"). Primary endpoints comprise a) whether the nurse-led CGA determination of fit, vulnerable or frail agrees with the oncologist's assessments of fit, vulnerable or frail and b) whether the CGA and physician assessments accurately predict actual patient outcomes. Conclusion An oncogeriatric nurse-led model of care is currently being developed from the results. We conclude with a discussion of the pivotal role of nurses in CGA-based models of care.

Comprehensive assessment of the fitness of older people for chemotherapy

Purpose: To present the results of a mixed-method study comparing the level of agreement of a two-phased, nurse-administered Comprehensive Geriatric Assessment (CGA) with current methods that assess the fitness for chemotherapy of older cancer patients. A nurse-led model of multidisciplinary cancer care based on the results is also described. Methods: The two phases comprised initial screening by a nurse with the Vulnerable Elders Survey-13 [VES-13], followed by nurse administration of a detailed CGA. Both phases were linked to a computerised algorithm categorising the patient as ‘fit’, ‘vulnerable’ or ‘frail’. The study determined the level of agreement between VES-13- and CGA-determined categories; and between the CGA and the physicians’ assessments. It also compared the CGA’s predictive abilities in terms of subsequent treatment toxicity; while interviews determined the acceptability of the nurse-led procedure from key stakeholders' perspectives. Results: Data collection was completed in December 2011. The results will be presented at the conference. A consecutive-series n=170 will be enrolled, 33% of whom are ‘fit’; 33% ‘vulnerable’; and 33% ‘too frail’ for treatment. This sample can detect, with 90% power, kappa coefficients of agreement of ≥ 0.70 or higher (“substantial agreement”). Fitness sub-group comparisons of agreement between the medical oncologist and the nurse assessments can detect kappa estimates of Κ ≥ 0.80 with the same power. Conclusion: The results have informed a nurse-led model of cancer care. It meets a clear need to develop, implement and test a nurse-led, robust, evidence-based, clinically-justifiable and economically-feasible CGA process that has relevance in national and international contexts.