Using automated text analysis to evaluate students’ conceptual understanding

Background: A major challenge for assessing students’ conceptual understanding of STEM subjects is the capacity of assessment tools to reliably and robustly evaluate student thinking and reasoning. Multiple-choice tests are typically used to assess student learning and are designed to include distractors that can indicate students’ incomplete understanding of a topic or concept based on which distractor the student selects. However, these tests fail to provide the critical information uncovering the how and why of students’ reasoning for their multiple-choice selections. Open-ended or structured response questions are one method for capturing higher level thinking, but are often costly in terms of time and attention to properly assess student responses. Purpose: The goal of this study is to evaluate methods for automatically assessing open-ended responses, e.g. students’ written explanations and reasoning for multiple-choice selections. Design/Method: We incorporated an open response component for an online signals and systems multiple-choice test to capture written explanations of students’ selections. The effectiveness of an automated approach for identifying and assessing student conceptual understanding was evaluated by comparing results of lexical analysis software packages (Leximancer and NVivo) to expert human analysis of student responses. In order to understand and delineate the process for effectively analysing text provided by students, the researchers evaluated strengths and weakness for both the human and automated approaches. Results: Human and automated analyses revealed both correct and incorrect associations for certain conceptual areas. For some questions, that were not anticipated or included in the distractor selections, showing how multiple-choice questions alone fail to capture the comprehensive picture of student understanding. The comparison of textual analysis methods revealed the capability of automated lexical analysis software to assist in the identification of concepts and their relationships for large textual data sets. We also identified several challenges to using automated analysis as well as the manual and computer-assisted analysis. Conclusions: This study highlighted the usefulness incorporating and analysing students’ reasoning or explanations in understanding how students think about certain conceptual ideas. The ultimate value of automating the evaluation of written explanations is that it can be applied more frequently and at various stages of instruction to formatively evaluate conceptual understanding and engage students in reflective

Submission to KPMG review of the Federal Government Initiative to “analyse dementia program and services funded by the Department of Social Services"

The comments I make are based on my nearly twenty years involvement in the dementia cause at both a national and international level. In preparation, I read two papers namely the Ministerial Dementia Forum – Option Paper produced by KPMG Management Consultants (2014) and Analysis of Dementia Programmes and Services Funded by the Department of Social Services: Conversation Starter prepared by KPMG as a preparation document for those attending a workshop in Brisbane on April 22nd 2015. Dementia is a complex “syndrome” and as is often said, “when you meet one person with dementia, you have met one” meaning that no two persons with dementia are the same. Even in dementia care, Australia is a “lucky country” and there is much to be said for the quality and diversity of dementia care available for people living with dementia. Despite this, I agree with the many views expressed in the material I read that there is scope for improvement, especially in the way that services are coordinated. In saying that, I do not purport to have all the solutions nor claim to have the knowledge required to comment on all the programs covered by this review. If I appear to be a “biased” advocate for Alzheimer’s Australia across the States and Territories, it is because I have seen constant evidence of ordinary people doing extraordinary things with inadequate resources. Dementia care is not cheap and if those funding dementia services are primarily only interested in economic outcomes and benefits, the real purpose of this consultation will be defeated. In addition, nowhere in the material I have read is there any recognition that in many instances program funding is a complex mix of government (at all levels) and private funding. This makes reviewing those programs more complex and less able to be coordinated at a Departmental level. It goes without saying therefore that the Federal Government is not” the only player in this game”. Of all those participating in this review, Alzheimer’s Australia is best placed to comment on programs as it is more connected to people living with dementia and has probably the best record of consulting with them. It would appear however that their role has been reduced to that of a “bit player”. Without wanting to be critical, the Forum Report which deals with the comments made at a gathering of 70 individuals and organisations, only three (3) or 4.28% were actual carers of people living with dementia. Even if it is argued that a number of organisations present represented consumers, the percentage goes up only marginally to 8.57% which is hardly an endorsement of the forum being “consumer driven”. The predominance of those present were service providers, each with their own agenda and each seeking advantage for their “business”. The final point I want to make before commenting on more specific, program related issues, is that many programs being reviewed have a much longer history than is reflected in the material I have read. Their growth and development was pioneered by Alzheimer’s Australia organisations across the country often with no government funding. Attempts to bring about better coordination of programs were often at the behest of Alzheimer’s Australia but in the main were ignored. The opportunity to now put this right is long overdue.

Using children's picture books and process drama to develop students' critical literacy responses

This workshop introduces a range of process drama activities to develop students' critical literacy responses. Whilst children's picture books and process drama strategies have not traditionally been seen as sophisticated resources and strategies for developing students' critical literacy responses, this workshop shows teaching strategies that can be used in language instruction in primary classrooms with diverse student groups. The teaching activities include ‘attribute lists’, ‘sculptures’ and ‘freeze frames’.

Using children's picture books to develop students' critical literacy responses

This lecture introduces a range of children's picture books from around the world and teaching strategies that develop students' critical literacy responses. Whilst children's picture books have not traditionally been seen as sophisticated resources for developing students' critical literacy responses, this lecture presents research that shows young children as code breakers, text participants, text users and text analysts (Luke & Freebody, 1999) of written, visual, oral and gestural texts. This lecture also outlines the teaching strategies as they have been used in language instruction in primary classrooms with diverse student groups.

Environment characterization as an aid to wheat improvement: interpreting genotype-environment interactions by modelling water-deficit patterns in North-Eastern Australia.

Genotype-environment interactions (GEI) limit genetic gain for complex traits such as tolerance to drought. Characterization of the crop environment is an important step in understanding GEI. A modelling approach is proposed here to characterize broadly (large geographic area, long-term period) and locally (field experiment) drought-related environmental stresses, which enables breeders to analyse their experimental trials with regard to the broad population of environments that they target. Water-deficit patterns experienced by wheat crops were determined for drought-prone north-eastern Australia, using the APSIM crop model to account for the interactions of crops with their environment (e.g. feedback of plant growth on water depletion). Simulations based on more than 100 years of historical climate data were conducted for representative locations, soils, and management systems, for a check cultivar, Hartog. The three main environment types identified differed in their patterns of simulated water stress around flowering and during grain-filling. Over the entire region, the terminal drought-stress pattern was most common (50% of production environments) followed by a flowering stress (24%), although the frequencies of occurrence of the three types varied greatly across regions, years, and management. This environment classification was applied to 16 trials relevant to late stages testing of a breeding programme. The incorporation of the independently-determined environment types in a statistical analysis assisted interpretation of the GEI for yield among the 18 representative genotypes by reducing the relative effect of GEI compared with genotypic variance, and helped to identify opportunities to improve breeding and germplasm-testing strategies for this region.

Building teachers' pedagogy practices in reasoning, to improve students' dispositions towards mathematics

Drawing on participatory action research, this study identifies the pedagogies necessary to advance reasoning, which is one of the proficiencies from the Australian Curriculum Mathematics, and explores how reasoning leads to greater productive disposition. With the current emphasis on STEM in schools, this research is timely. This thesis makes an original and substantive contribution to the understanding of why and how teachers can most effectively advance student proficiency in reasoning through targeted instructional strategies and style of instruction. The study explores the ways in which teacher practices, when focused on reasoning, enhance the disposition of students towards greater mathematical proficiency.

Spin State Selective Excitation of Single Quantum Transitions Using Multiple Quantum Spectroscopy- an Aid to Analyse Complex Proton NMR spectra of Oriented Molecules

NMR spectra of molecules oriented in liquid-crystalline matrix provide information on the structure and orientation of the molecules. Thermotropic liquid crystals used as an orienting media result in the spectra of spins that are generally strongly coupled. The number of allowed transitions increases rapidly with the increase in the number of interacting spins. Furthermore, the number of single quantum transitions required for analysis is highly redundant. In the present study, we have demonstrated that it is possible to separate the subspectra of a homonuclear dipolar coupled spin system on the basis of the spin states of the coupled heteronuclei by multiple quantum (MQ)−single quantum (SQ) correlation experiments. This significantly reduces the number of redundant transitions, thereby simplifying the analysis of the complex spectrum. The methodology has been demonstrated on the doubly 13C labeled acetonitrile aligned in the liquid-crystal matrix and has been applied to analyze the complex spectrum of an oriented six spin system.

Tameside College: Triptico games and resources used to engage students

Tracey Holt introduced Triptico to her department after attending training from Sue Shercliff, ESOL Lecturer. Triptico is a resource for teachers to use in conjunction with their interactive whiteboards that currently contains around 20 different interactive resources - all of which can be easily edited, adapted and saved for later use. This quickly spread throughout the entire college. It is a fantastic free resource which promotes more interaction in the classroom between the teacher and students.

Case study: Using social media to engage students with learning difficulties

Case study on Calderdale College using the social learning network Edmodo to support students with learning difficulties or disabilities to engage with social media.

Prioritization of candidate cancer genes-an aid to oncogenomic studies

The development of techniques for oncogenomic analyses such as array comparative genomic hybridization, messenger RNA expression arrays and mutational screens have come to the fore in modern cancer research. Studies utilizing these techniques are able to highlight panels of genes that are altered in cancer. However, these candidate cancer genes must then be scrutinized to reveal whether they contribute to oncogenesis or are coincidental and non-causative. We present a computational method for the prioritization of candidate (i) proto-oncogenes and (ii) tumour suppressor genes from oncogenomic experiments. We constructed computational classifiers using different combinations of sequence and functional data including sequence conservation, protein domains and interactions, and regulatory data. We found that these classifiers are able to distinguish between known cancer genes and other human genes. Furthermore, the classifiers also discriminate candidate cancer genes from a recent mutational screen from other human genes. We provide a web-based facility through which cancer biologists may access our results and we propose computational cancer gene classification as a useful method of prioritizing candidate cancer genes identified in oncogenomic studies.