REFRAME: a new approach to evaluation in higher education

Evaluation practices in the higher education sector have been criticised for having unclear purpose and principles; ignoring the complexity and changing nature of learning and teaching and the environments in which they occur; relying almost exclusively on student ratings of teachers working in classroom settings; lacking reliability and validity; using data for inappropriate purposes; and focusing on accountability and marketing rather than the improvement of learning and teaching. In response to similar criticism from stakeholders, in 2011 Queensland University of Technology began a project, entitled REFRAME, to review its approach to evaluation, particularly the student survey system it had been using for the past five years. This presentation will outline the scholarly, evidence based methodology used to undertake institution-wide change, meet the needs of stakeholders suitable to the cultural needs of the institution. It is believed that this approach is broadly applicable to other institutions contemplating change with regard to evaluation of learning and teaching.

Kaleidoscope : illuminating learning and teaching evaluation for a shared stakeholder lens

Within the Australian higher education sector, institutions are required to evaluate teaching, units and courses to assure the quality of the student learning experience, however with hardly any regulatory parameters guiding institutions, and with disparate practices, there are few opportunities to benchmakr across institutions or the sector. QUT has received interest and requests from national and international universities on accessing Reframe: QUT's Evaluation Framework.

A snapshot of 40 years in early childhood education and care through oral histories

The year 2012 marked 40 years since the introduction of the Child Care Act 1972 and the federal government introduced financial support for the provision of child care services in Australia. Significant changes have occurred in social, political and theoretical contexts of early childhood education and care (ECEC) during this time. Bringing these to life, this paper investigates archival data of key changes in ECEC in association with oral histories of staff, parents and children associated with The Gowrie Qld during the years 1972‒2012. With narrative analysis considered alongside historical information, two dominant issues emerge as integral to ECEC in the past, now and the future. These are: 1) what constitutes effective teaching and learning in the educational program and 2) professional expectations in ECEC. Building an historical picture, this paper provides for critical reflection on the past to inform current and future practices.

Evaluation of the alkaline comet assay and urinary 3-methyladenine excretion for monitoring DNA damage in melanoma patients treated with dacarbazine and tamoxifen

Purpose: To develop, using dacarbazine as a model, reliable techniques for measuring DNA damage and repair as pharmacodynamic endpoints for patients receiving chemotherapy. Methods: A group of 39 patients with malignant melanoma were treated with dacarbazine 1 g/m2 i.v. every 21 days. Tamoxifen 20 mg daily was commenced 24 h after the first infusion and continued until 3 weeks after the last cycle of chemotherapy. DNA strand breaks formed during dacarbazine-induced DNA damage and repair were measured in individual cells by the alkaline comet assay. DNA methyl adducts were quantified by measuring urinary 3-methyladenine (3-MeA) excretion using immunoaffinity ELISA. Venous blood was taken on cycles 1 and 2 for separation of peripheral blood lymphocytes (PBLs) for measurement of DNA strand breaks. Results: Wide interpatient variation in PBL DNA strand breaks occurred following chemotherapy, with a peak at 4 h (median 26.6 h, interquartile range 14.75- 40.5 h) and incomplete repair by 24 h. Similarly, there was a range of 3-MeA excretion with peak levels 4-10 h after chemotherapy (median 33 nmol/h, interquartile range 20.448.65 nmol/h). Peak 3-MeA excretion was positively correlated with DNA strand breaks at 4 h (Spearman's correlation coefficient, r = 0.39, P = 0.036) and 24 h (r = 0.46, P = 0.01). Drug-induced emesis correlated with PBL DNA strand breaks (Mann Whitney U-test, P = 0.03) but not with peak 3-MeA excretion. Conclusions: DNA damage and repair following cytotoxic chemotherapy can be measured in vivo by the alkaline comet assay and by urinary 3-MeA excretion in patients receiving chemotherapy.

A phase II study of mitomycin C and oral etoposide for advanced adenocarcinoma of the upper gastrointestinal tract

Background: Mitomycin C and etoposide have both demonstrated activity against gastric carcinoma. Etoposide is a topoisomerase II inhibitor with evidence for phase-specific and schedule-dependent activity. Patients and method. Twenty-eight consecutive patients with advanced upper gastrointestinal adenocarcinoma were treated with intravenous (i.v.) bolus mitomycin C 6 mg/m2 on day 1 every 21 days to a maximum of four courses. Oral etoposide capsules 50 mg b.i.d. (or 35 mg b.i.d. liquid) were administered days 1 to 10 extending to 14 days in subsequent courses if absolute neutrophil count >1.5 x 109/l on day 14 of first course, for up to six courses. Results: Twenty-six patients were assessed for response of whom 12 had measurable disease and 14 evaluable disease. Four patients had a documented response (one complete remission, three partial remissions) with an objective response rate of 15% (95% confidence interval (95% CI) 4%-35%). Eight patients had stable disease and 14 progressive disease. The median survival was six months. The schedule was well tolerated with no treatment-related deaths. Nine patients experienced leucopenia (seven grade II and two grade III). Nausea and vomiting (eight grade II, one grade III), fatigue (eight grade II, two grade III) and anaemia (seven grade II, two grade III) were the predominant toxicities. Conclusion: This out-patient schedule is well tolerated and shows modest activity in the treatment of advanced upper gastrointestinal adenocarcinoma. Further studies using protracted schedules of etoposide both orally and as infusional treatment should be developed.

An evaluation of dog-assisted therapy for residents of aged care facilities with dementia.

Although some research suggests that dog-assisted therapy may be beneficial for people with dementia living in residential aged care facilities, the intervention has not been adequately investigated. To address this shortcoming, we conducted a randomized controlled trial of dog-assisted therapy versus a human-therapist-only intervention for this population. Fifty-five residents with mild to moderate dementia living in three Australian residential aged care facilities completed an 11-week trial of the interventions. Allocation to the intervention was random and participants completed validated measures of mood, psychosocial functioning, and quality of life (QOL), both prior to and following the intervention. No adverse events were associated with the dog-assisted intervention, and following it participants who had worse baseline depression scores demonstrated significantly improved depression scores relative to participants in the human-therapist-only intervention. Participants in the dogassisted intervention also showed significant improvements on a measure of QOL in one facility compared with those in the human-therapist-only group (although worse in another facility that had been affected by an outbreak of gastroenteritis). This study provides some evidence that dog-assisted therapy may be beneficial for some residents of aged care facilities with dementia.

A brief staff dementia education program : implementation and evaluation

Brief dementia education training programs appear to be effective in improving knowledge about dementia and self-confidence in interacting with patients with dementia. It is recommended that brief dementia training sessions be provided on a regular, on-going basis, particularly in view of frequent staff changes in the acute hospital environment.

An evaluation of tumor oxygenation and gene expression in patients with early stage non-small cell lung cancers

Background: To directly assess tumor oxygenation in resectable non - small cell lung cancers (NSCLC) and to correlate tumor pO2 and the selected gene and protein expression to treatment outcomes. Methods: Twenty patients with resectable NSCLC were enrolled. Intraoperative measurements of normal lung and tumor pO2 were done with the Eppendorf polarographic electrode. All patients had plasma osteopontin measurements by ELISA. Carbonic anhydrase-IX (CA IX) staining of tumor sections was done in the majority of patients (n = 16), as was gene expression profiling (n = 12) using cDNA microarrays. Tumor pO2 was correlated with CA IX staining, osteopontin levels, and treatment outcomes. Results: The median tumor pO2 ranged from 0.7 to 46 mm Hg (median, 16.6) and was lower than normal lung pO2 in all but one patient. Because both variables were affected by the completeness of lung deflation during measurement, we used the ratio of tumor/normal lung (T/L) pO2 as a reflection of tumor oxygenation. The median T/L pO 2 was 0.13. T/L pO2 correlated significantly with plasma osteopontin levels (r = 0.53, P = 0.02) and CA IX expression (P = 0.006). Gene expression profiling showed that high CD44 expression was a predictor for relapse, which was confirmed by tissue staining of CD44 variant 6 protein. Other variables associated with the risk of relapse were T stage (P = 0.02), T/L pO2 (P = 0.04), and osteopontin levels (P = 0.001). Conclusions: Tumor hypoxia exists in resectable NSCLC and is associated with elevated expression of osteopontin and CA IX. Tumor hypoxia and elevated osteopontin levels and CD44 expression correlated with poor prognosis. A larger study is needed to confirm the prognostic significance of these factors. © 2006 American Association for Cancer Research.

Talking the talk : therapeutic jurisprudence and oral competence

In Australian criminal justice systems, a wide range of pathways to sentencing and punishment exist alongside traditional court processes. In particular, therapeutic jurisprudence ('TJ') processes have emerged during the last quarter of a century and now occupy a key position in the criminal justice landscape. This article provides an introduction to TJ, highlighting in particular the emphasis it places on the active participation of offenders, before critically discussing offenders' capacity to engage with TJ processes. The article then summarises the research on the oral competence of offenders, and argues that offenders who lack oral competence may be disadvantaged in TJ processes. Finally, we provide an overview of the limited guidance that has been provided to TJ practitioners on how to maximise the participation of offenders with limited oral competence.

Evaluation of canine bone marrow-derived mesenchymal stem cells after long-term cryopreservation

Autologous bone marrow-derived mesenchymal stem cell (BMSCs)-based therapies show great potential in regenerative medicine. However, long-term storage and preservation of BMSCs for clinical use is still a great clinical challenge. The present study aimed to analyze the effect of long-term cryopreservation on the regenerative ability of BMSCs. After cryopreservation of BMSCs from beagle dogs for three years, cell viability, and quantitative analysis of alkaline phosphatase (ALP) activity, surface adherence, and mineralized nodule formation were analyzed. BMSCs in cell-scaffold complex were then implanted into nude mice. There was no significant difference in cell viability and ALP activity between osteogenic differentiation and non-osteogenic differentiation of BMSCs, and BMSCs in cell-scaffold complex retained osteogenic differentiation ability in vivo. These results indicate that long-term cryopreserved BMSCs maintain their have capacity to contribute to regeneration.

Learner-focused evaluation cycles : facilitating learning using feedforward, concurrent and feedback evaluation

There is a growing trend to offer students learning opportunities that are flexible, innovative and engaging. As educators embrace student-centred agile teaching and learning methodologies, which require continuous reflection and adaptation, the need to evaluate students’ learning in a timely manner has become more pressing. Conventional evaluation surveys currently dominate the evaluation landscape internationally, despite recognition that they are insufficient to effectively evaluate curriculum and teaching quality. Surveys often: (1) fail to address the issues for which educators need feedback, (2) constrain student voice, (3) have low response rates and (4) occur too late to benefit current students. Consequently, this paper explores principles of effective feedback to propose a framework for learner-focused evaluation. We apply a three-stage control model, involving feedforward, concurrent and feedback evaluation, to investigate the intersection of assessment and evaluation in agile learning environments. We conclude that learner-focused evaluation cycles can be used to guide action so that evaluation is not undertaken simply for the benefit of future offerings, but rather to benefit current students by allowing ‘real-time’ learning activities to be adapted in the moment. As a result, students become co-producers of learning and evaluation becomes a meaningful, responsive dialogue between students and their instructors.

Design, implementation and multisite evaluation of a system suitability protocol for the quantitative assessment of instrument performance in liquid chromatography-multiple reaction monitoring-MS (LC-MRM-MS)

Multiple reaction monitoring (MRM) mass spectrometry coupled with stable isotope dilution (SID) and liquid chromatography (LC) is increasingly used in biological and clinical studies for precise and reproducible quantification of peptides and proteins in complex sample matrices. Robust LC-SID-MRM-MS-based assays that can be replicated across laboratories and ultimately in clinical laboratory settings require standardized protocols to demonstrate that the analysis platforms are performing adequately. We developed a system suitability protocol (SSP), which employs a predigested mixture of six proteins, to facilitate performance evaluation of LC-SID-MRM-MS instrument platforms, configured with nanoflow-LC systems interfaced to triple quadrupole mass spectrometers. The SSP was designed for use with low multiplex analyses as well as high multiplex approaches when software-driven scheduling of data acquisition is required. Performance was assessed by monitoring of a range of chromatographic and mass spectrometric metrics including peak width, chromatographic resolution, peak capacity, and the variability in peak area and analyte retention time (RT) stability. The SSP, which was evaluated in 11 laboratories on a total of 15 different instruments, enabled early diagnoses of LC and MS anomalies that indicated suboptimal LC-MRM-MS performance. The observed range in variation of each of the metrics scrutinized serves to define the criteria for optimized LC-SID-MRM-MS platforms for routine use, with pass/fail criteria for system suitability performance measures defined as peak area coefficient of variation <0.15, peak width coefficient of variation <0.15, standard deviation of RT <0.15 min (9 s), and the RT drift <0.5min (30 s). The deleterious effect of a marginally performing LC-SID-MRM-MS system on the limit of quantification (LOQ) in targeted quantitative assays illustrates the use and need for a SSP to establish robust and reliable system performance. Use of a SSP helps to ensure that analyte quantification measurements can be replicated with good precision within and across multiple laboratories and should facilitate more widespread use of MRM-MS technology by the basic biomedical and clinical laboratory research communities.

Percutaneous coronary intervention with drug-eluting stents or coronary artery bypass surgery in subjects with type 2 diabetes : evaluation of: Farkouth ME, Domanski M, Sleeper LA, et al. Strategies for multivessel revascularization in patients with diabetes. N Engl J Med 2012;367(25):2375-84, and Contini GA, Nicolini F, Fortuna D, et al. Five-year outcomes of surgical or percutaneous myocardial revascularization in diabetic patients. Int J Cardiol 2012. [Epub ahead of print]

There is debate as to whether percutaneous coronary intervention (PCI) with drug-eluting stents or coronary artery bypass surgery (CABG) is the best procedure for subjects with type 2 diabetes and coronary artery disease requiring revascularization. There is some evidence that following these procedures there is less further revascularization with CABG than PCI in subjects with diabetes. Two recent studies; the FREEDOM (Future Revascularization Evaluation in patients with Diabetes mellitus: Optimal Management of Multivessel Disease) trial, and a trial using a real world diabetic population from a Registry, have shown that the benefits of CABG over PCI in subjects with type 2 diabetes extends to lower rates of death and myocardial infarct, in addition to lower rates of revascularization. However, the rates of stroke may be higher with CABG than PCI with drug-eluting stents in this population. Thus, if CABG is going to be preferred to PCI in subjects with type 2 diabetes and multivessel coronary disease, consideration should be given to how to reduce the rates of stroke with CABG.

Bioavailability study of oral and intravenous OGT 719, a novel nucleoside analogue with preferential activity in the liver

Purpose: Although oral fluoropyrimidine pro-drugs are increasingly being administered in preference to intravenous nucleoside analogues in cancer chemotherapy, their activation in malignant liver tissue may be insufficient. OGT 719 (1-galactopyranosyl-5-fluorouracil) is a novel nucleoside analogue, preferentially localized in hepatocytes and hepatoma cells via the asialoglycoprotein receptor. The aim of this study was to assess the systemic bioavailability of this rationally designed drug in 16 patients with advanced solid cancers. Method: Crossover pharmacokinetic study of oral (400 or 800 mg) and intravenous (250 mg/m 2) OGT 719. Results: Linear pharmacokinetics and oral bioavailability of approximately 25% were observed at the dose levels used in this study. Like other 5-FU prodrugs, considerable interpatient variability was observed in bioavailability following oral dosing. The mean half-life for oral doses was 4 h. OGT 719 was well tolerated. No objective tumour responses were demonstrated. Conclusion: The systemic bioavailability and half-life of oral OGT 719 are sufficient to merit dose escalation studies with frequent daily dosing. Subsequent efficacy studies should be performed in patients with primary and secondary liver malignancies.

Bioavailability study of oral and intravenous OGT 719, a novel nucleoside analogue with preferential activity in the liver

Purpose: Although oral fluoropyrimidine pro-drugs are increasingly being administered in preference to intravenous nucleoside analogues in cancer chemotherapy, their activation in malignant liver tissue may be insufficient. OGT 719 (1-galactopyranosyl-5-fluorouracil) is a novel nucleoside analogue, preferentially localized in hepatocytes and hepatoma cells via the asialoglycoprotein receptor. The aim of this study was to assess the systemic bioavailability of this rationally designed drug in 16 patients with advanced solid cancers. Method: Crossover pharmacokinetic study of oral (400 or 800 mg) and intravenous (250 mg/m 2) OGT 719. Results: Linear pharmacokinetics and oral bioavailability of approximately 25% were observed at the dose levels used in this study. Like other 5-FU prodrugs, considerable interpatient variability was observed in bioavailability following oral dosing. The mean half-life for oral doses was 4 h. OGT 719 was well tolerated. No objective tumour responses were demonstrated. Conclusion: The systemic bioavailability and half-life of oral OGT 719 are sufficient to merit dose escalation studies with frequent daily dosing. Subsequent efficacy studies should be performed in patients with primary and secondary liver malignancies.