Verifying a Student Engagement, Success and Retention Maturity Model (SESR-MM): A reality check of the model using data derived from three universities

Australian higher education institutions (HEIs) have entered a new phase of regulation and accreditation which includes performance-based funding relating to the participation and retention of students from social and cultural groups previously underrepresented in higher education. However, in addressing these priorities, it is critical that HEIs do not further disadvantage students from certain groups by identifying them for attention because of their social or cultural backgrounds, circumstances which are largely beyond the control of students. In response, many HEIs are focusing effort on university-wide approaches to enhancing the student experience because such approaches will enhance the engagement, success and retention of all students, and in doing so, particularly benefit those students who come from underrepresented groups. Measuring and benchmarking student experiences and engagement that arise from these efforts is well supported by extensive collections of student experience survey data. However no comparable instrument exists that measures the capability of institutions to influence and/or enhance student experiences where capability is an indication of how well an organisational process does what it is designed to do (Rosemann & de Bruin, 2005). We have proposed that the concept of a maturity model (Marshall, 2010; Paulk, 1999) may be useful as a way of assessing the capability of HEIs to provide and implement student engagement, success and retention activities and we are currently articulating a Student Engagement, Success and Retention Maturity Model (SESR-MM), (Clarke, Nelson & Stoodley, 2012; Nelson, Clarke & Stoodley, 2012). Our research aims to address the current gap by facilitating the development of an SESR-MM instrument that aims (i) to enable institutions to assess the capability of their current student engagement and retention programs and strategies to influence and respond to student experiences within the institution; and (ii) to provide institutions with the opportunity to understand various practices across the sector with a view to further improving programs and practices relevant to their context. Our research extends the generational approach which has been useful in considering the evolutionary nature of the first year experience (FYE) (Wilson, 2009). Three generations have been identified and explored: First generation approaches that focus on co-curricular strategies (e.g. orientation and peer programs); Second generation approaches that focus on curriculum (e.g. pedagogy, curriculum design, and learning and teaching practice); and third generation approaches—also referred to as transition pedagogy—that focus on the production of an institution-wide integrated holistic intentional blend of curricular and co-curricular activities (Kift, Nelson & Clarke, 2010). Our research also moves beyond assessments of students’ experiences to focus on assessing institutional processes and their capability to influence student engagement. In essence, we propose to develop and use the maturity model concept to produce an instrument that will indicate the capability of HEIs to manage and improve student engagement, success and retention programs and strategies. The issues explored in this workshop are (i) whether the maturity model concept can be usefully applied to provide a measure of institutional capability for SESR; (ii) whether the SESR-MM can be used to assess the maturity of a particular set of institutional practices; and (iii) whether a collective assessment of an institution’s SESR capabilities can provide an indication of the maturity of the institution’s SESR activities. The workshop will be approached in three stages. Firstly, participants will be introduced to the key characteristics of maturity models, followed by a discussion of the SESR-MM and the processes involved in its development. Secondly, participants will be provided with resources to facilitate the development of a maturity model and an assessment instrument for a range of institutional processes and related practices. In the final stage of the workshop, participants will “assess” the capability of these practices to provide a collective assessment of the maturity of these processes. References Australian Council for Educational Research. (n.d.). Australasian Survey of Student Engagement. Retrieved from http://www.acer.edu.au/research/ausse/background Clarke, J., Nelson, K., & Stoodley, I. (2012, July). The Maturity Model concept as framework for assessing the capability of higher education institutions to address student engagement, success and retention: New horizon or false dawn? A Nuts & Bolts presentation at the 15th International Conference on the First Year in Higher Education, “New Horizons,” Brisbane, Australia. Department of Education, Employment and Workplace Relations. (n.d.). The University Experience Survey. Advancing quality in higher education information sheet. Retrieved from http://www.deewr.gov.au/HigherEducation/Policy/Documents/University_Experience_Survey.pdf Kift, S., Nelson, K., & Clarke, J. (2010) Transition pedagogy - a third generation approach to FYE: A case study of policy and practice for the higher education sector. The International Journal of the First Year in Higher Education, 1(1), pp. 1-20. Marshall, S. (2010). A quality framework for continuous improvement of e-Learning: The e-Learning Maturity Model. Journal of Distance Education, 24(1), 143-166. Nelson, K., Clarke, J., & Stoodley, I. (2012). An exploration of the Maturity Model concept as a vehicle for higher education institutions to assess their capability to address student engagement. A work in progress. Submitted for publication. Paulk, M. (1999). Using the Software CMM with good judgment, ASQ Software Quality Professional, 1(3), 19-29. Wilson, K. (2009, June–July). The impact of institutional, programmatic and personal interventions on an effective and sustainable first-year student experience. Keynote address presented at the 12th Pacific Rim First Year in Higher Education Conference, “Preparing for Tomorrow Today: The First Year as Foundation,” Townsville, Australia. Retrieved from http://www.fyhe.com.au/past_papers/papers09/ppts/Keithia_Wilson_paper.pdf

An Assessment of Undergraduate Paramedic Students’ Empathy Levels

Abstract: Objectives Evidence suggests that improved empathy behaviours among healthcare professionals directly impacts on healthcare outcomes. However, the ‘nebulous’ properties of empathic behaviour often means that healthcare profession educators fail to incorporate the explicit teaching and assessment of empathy within the curriculum. The objective of this study was to assess the extent of empathy in paramedic students across seven Australian universities. Methods A cross-sectional study using a paper-based questionnaire employing a convenience sample of first, second, and third year undergraduate paramedic students. Student empathy levels were measured using the Medical Condition Regard Scale (MCRS). Results A total of 783 students participated in the study of which 57% were females. The medical conditions: intellectual disability, attempted suicide, and acute mental illness all produced mean scores above 50 suggesting good empathetic regard, while patients presenting with substance abuse produced the lowest mean score M= 41.57 (SD=12.29). There was a statistically significant difference between males (M= 49.79) and females (M=51.61) p=0.006, for patients with intellectual disability. Conclusions The findings from this study found that student reported poor empathetic regard for patients with substance abuse, while female students report higher levels of empathy than their male colleagues across each medical condition. The overall findings provide a framework for educators to begin constructing guidelines focusing on the need to incorporate, promote and instil empathy into paramedic students in order to better prepare them for future out-of-hospital healthcare practice.

Infertility, medical advice and treatment with fertility hormones and/or in vitro fertilisation: a population perspective from the Australian Longitudinal Study on Women's Health

OBJECTIVE: To identify the factors associated with infertility, seeking advice and treatment with fertility hormones and/or in vitro fertilisation (IVF) among a general population of women. METHODS: Participants in the Australian Longitudinal Study on Women's Health aged 28-33 years in 2006 had completed up to four mailed surveys over 10 years (n=9,145). Parsimonious multivariate logistic regression was used to identify the socio-demographic, biological (including reproductive histories), and behavioural factors associated with infertility, advice and hormonal/IVF treatment. RESULTS: For women who had tried to conceive or had been pregnant (n=5,936), 17% reported infertility. Among women with infertility (n=1031), 72% (n=728) sought advice but only 50% (n=356) used hormonal/IVF treatment. Women had higher odds of infertility when: they had never been pregnant (OR=7.2, 95% CI 5.6-9.1) or had a history of miscarriage (OR range=1.5-4.0) than those who had given birth (and never had a miscarriage or termination). CONCLUSION: Only one-third of women with infertility used hormonal and/or IVF treatment. Women with PCOS or endometriosis were the most proactive in having sought advice and used hormonal/IVF treatment. IMPLICATIONS: Raised awareness of age-related declining fertility is important for partnered women aged approximately 30 years to encourage pregnancy during their prime reproductive years and reduce the risk of infertility.

Depression: an emotional obstacle to seeking medical advice for infertility

Objective: To investigate the mental and general health of infertile women who had not sought medical advice for their recognized infertility and were therefore not represented in clinical populations. Design: Longitudinal cohort study.Setting Population based.Patient(s) Participants in the Australian Longitudinal Study on Women's Health aged 28-33 years in 2006 who had ever tried to conceive or had been pregnant (n = 5,936).Intervention(s) None.Main Outcome Measure(s) Infertility, not seeking medical advice. Result(s): Compared with fertile women (n = 4,905), infertile women (n = 1,031) had higher odds of self-reported depression (odds ratio [OR] 1.20, 95% confidence interval [CI] 1.01-1.43), endometriosis (5.43, 4.01-7.36), polycystic ovary syndrome (9.52, 7.30-12.41), irregular periods (1.99, 1.68-2.36), type II diabetes (4.70, 1.79-12.37), or gestational diabetes (1.66, 1.12-2.46). Compared with infertile women who sought medical advice (n = 728), those who had not sought medical advice (n = 303) had higher odds of self-reported depression (1.67, 1.18-2.37), other mental health problems (3.14, 1.14-8.64), urinary tract infections (1.67, 1.12-2.49), heavy periods (1.63, 1.16-2.29), or a cancer diagnosis (11.33, 2.57-49.89). Infertile women who had or had not sought medical advice had similar odds of reporting an anxiety disorder or anxiety-related symptoms. Conclusion(s): Women with self-reported depression were unlikely to have sought medical advice for infertility. Depression and depressive symptoms may be barriers to seeking medical advice for infertility.

Agreement between self-reported use of in vitro fertilization or ovulation induction, and medical insurance claims in Australian women aged 28–36 years

STUDY QUESTION: What is the self-reported use of in vitro fertilization (IVF) and ovulation induction (OI) in comparison with insurance claims by Australian women aged 28–36 years? SUMMARY ANSWER: The self-reported use of IVF is quite likely to be valid; however, the use of OI is less well reported. WHAT IS KNOWN AND WHAT THIS PAPER ADDS: Population-based research often relies on the self-reported use of IVF and OI because access to medical records can be difficult and the data need to include sufficient personal identifying information for linkage to other data sources. There have been few attempts to explore the reliability of the self-reported use of IVF and OI using the linkage to medical insurance claims for either treatment. STUDY DESIGN: This prospective, population-based, longitudinal study included the cohort of women born during 1973–1978 and participating in the Australian Longitudinal Study on Women's Health (ALSWH) (n = 14247). From 1996 to 2009, participants were surveyed up to five times. PARTICIPANTS AND SETTING: Participants self-reported their use of IVF or OI in two mailed surveys when aged 28–33 and 31–36 years (n = 7280), respectively. This study links self-report survey responses and claims for treatment or medication from the universal national health insurance scheme (i.e. Medicare Australia). MAIN RESULTS AND THE ROLE OF CHANCE: Comparisons between self-reports and claims data were undertaken for all women consenting to the linkage (n = 3375). The self-reported use of IVF was compared with claims for OI for IVF (Kappa, K = 0.83), oocyte collection (K = 0.82), sperm preparation (K = 0.83), intracytoplasmic sperm injection (K = 0.40), fresh embryo transfers (K = 0.82), frozen embryo transfers (K = 0.64) and OI for IVF medication (K = 0.17). The self-reported use of OI was compared with ovulation monitoring (K = 0.52) and OI medication (K = 0.71). BIAS, CONFOUNDING AND OTHER REASONS FOR CAUTION: There is a possibility of selection bias due to the inclusion criteria for participants in this study: (1) completion of the last two surveys in a series of five and (2) consent to the linkage of their responses with Medicare data. GENERALIZABILITY TO OTHER POPULATIONS: The results are relevant to questionnaire-based research studies with infertile women in developed countries. STUDY FUNDING/COMPETING INTEREST(S): ALSWH is funded by the Australian Government Department of Health and Ageing. This research is funded by a National Health and Medical Research Council Centre of Research Excellence grant.

Please take out your phones : on the spot solicitation of student feedback in class

The use of mobile devices such as smart phones and tablets in classrooms has been met with mixed sentiments. Some instructors and teachers see them as a distraction and regularly ban their usage. Others who see their potential to enhance learning have started to explore ways to integrate them into their teaching in an attempt to improve student engagement. In this paper we report on a pilot study that forms part of a university-wide project reconceptualising its approach to the student evaluation of learning and teaching. In a progressive decision to embrace mobile technology, the university decided to trial a smart phone app designed for students to check-in to class and leave feedback on the spot. Our preliminary findings from trialling the app indicate that the application establishes a more immediate feedback loop between students and teachers. However, the app’s impact depends on how feedback is shared with students and how the teaching team responds.

Student feedback systems in higher education: a focused literature review and environmental scan

In recent times, higher education institutions have paid increasing attention to the views of students to obtain feedback on their experience of learning and teaching through internal surveys. This article reviews research in the field and reports on practices in other Australian universities. Findings demonstrate that while student feedback is valued and used by all Australian universities, survey practices are idiosyncratic and in the majority of cases, questionnaires lack validity and reliability; data are used inadequately or inappropriately; and they offer limited potential for cross-sector benchmarking. The study confirms the need for institutions to develop an overarching framework for evaluation in which a valid, reliable, multidimensional and useful student feedback survey constitutes just one part. Given external expectations and internal requirements to collect feedback from students on their experience of learning and teaching, the pursuit of sound evaluation practices will continue to be of interest at local, national and international levels.

Promoting student well-being and resilience at law school

University can be a psychologically distressing place for students, particularly those studying law. Legal academics have been concerned about this for some time. In the United States, in particular, it has been found that symptoms of psychological distress rise signifi cantly for students in their fi rst year of law (compared to levels in the general population at that time), and persist throughout the degree to post-graduation. Recognised symptoms include depression, obsessive compulsive behaviour, feelings of inadequacy and inferiority, anxiety, hostility, paranoia, and social alienation. Many students experience law school as an isolating, adversarial and competitive environment, which impacts negatively on their values and motivation...

A framework for mathematics graphical tasks : The influence of the graphic element on student sense making

Graphical tasks have become a prominent aspect of mathematics assessment. From a conceptual stance, the purpose of this study was to better understand the composition of graphical tasks commonly used to assess students’ mathematics understandings. Through an iterative design, the investigation described the sense making of 11–12-year-olds as they decoded mathematics tasks which contained a graphic. An ongoing analysis of two phases of data collection was undertaken as we analysed the extent to which various elements of text, graphics, and symbols influenced student sense making. Specifically, the study outlined the changed behaviour (and performance) of the participants as they solved graphical tasks that had been modified with respect to these elements. We propose a theoretical framework for understanding the composition of a graphical task and identify three specific elements which are dependently and independently related to each other, namely: the graphic; the text; and the symbols. Results indicated that although changes to the graphical tasks were minimal, a change in student success and understanding was most evident when the graphic element was modified. Implications include the need for test designers to carefully consider the graphics embedded within mathematics tasks since the elements within graphical tasks greatly influence student understanding.

Mastering medical terminology : Australia and New Zealand

Mastering Medical Terminology: Australia and New Zealand is medical terminology book of relevance to an audience in Australia and New Zealand. Australian terminology, perspectives, examples and spelling have been included and Australian pronunciation specified. The textbook is accompanied by a self-help workbook, an online workbook and a Smartphone app. Throughout Mastering Medical Terminology, review of medical terminology as it is used in clinical practice is highlighted. Features of the textbook, workbook and electronic product include: • Simple, non-technical explanations of medical terms • Workbook format with ample spaces to write answers • Explanations of clinical procedures, laboratory tests and abbreviations used in Australian clinical practice, as they apply to each body system and speciality area • Pronunciation of terms and spaces to write meanings of terms • Practical applications sections • Exercises that test understanding of terminology as students work through the text chapter by chapter • Review activities that pull together terminology to help students study • Comprehensive glossary and appendices for reference • Links to other useful references, such as websites and textbooks.

Exploiting medical hierarchies for concept-based information retrieval

Search technologies are critical to enable clinical sta to rapidly and e ectively access patient information contained in free-text medical records. Medical search is challenging as terms in the query are often general but those in rel- evant documents are very speci c, leading to granularity mismatch. In this paper we propose to tackle granularity mismatch by exploiting subsumption relationships de ned in formal medical domain knowledge resources. In symbolic reasoning, a subsumption (or `is-a') relationship is a parent-child rela- tionship where one concept is a subset of another concept. Subsumed concepts are included in the retrieval function. In addition, we investigate a number of initial methods for combining weights of query concepts and those of subsumed concepts. Subsumption relationships were found to provide strong indication of relevant information; their inclusion in retrieval functions yields performance improvements. This result motivates the development of formal models of rela- tionships between medical concepts for retrieval purposes.

Exploiting SNOMED CT concepts and relationships for clinical information retrieval : Australian e-Health Research Centre and Queensland University of Technology at the TREC 2012 Medical Track

The Australian e-Health Research Centre and Queensland University of Technology recently participated in the TREC 2012 Medical Records Track. This paper reports on our methods, results and experience using an approach that exploits the concept and inter-concept relationships defined in the SNOMED CT medical ontology. Our concept-based approach is intended to overcome specific challenges in searching medical records, namely vocabulary mismatch and granularity mismatch. Queries and documents are transformed from their term-based originals into medical concepts as defined by the SNOMED CT ontology, this is done to tackle vocabulary mismatch. In addition, we make use of the SNOMED CT parent-child `is-a' relationships between concepts to weight documents that contained concept subsumed by the query concepts; this is done to tackle the problem of granularity mismatch. Finally, we experiment with other SNOMED CT relationships besides the is-a relationship to weight concepts related to query concepts. Results show our concept-based approach performed significantly above the median in all four performance metrics. Further improvements are achieved by the incorporation of weighting subsumed concepts, overall leading to improvement above the median of 28% infAP, 10% infNDCG, 12% R-prec and 7% Prec@10. The incorporation of other relations besides is-a demonstrated mixed results, more research is required to determined which SNOMED CT relationships are best employed when weighting related concepts.

Semantic judgement of medical concepts : combining syntagmatic and paradigmatic information with the tensor encoding model

This paper outlines a novel approach for modelling semantic relationships within medical documents. Medical terminologies contain a rich source of semantic information critical to a number of techniques in medical informatics, including medical information retrieval. Recent research suggests that corpus-driven approaches are effective at automatically capturing semantic similarities between medical concepts, thus making them an attractive option for accessing semantic information. Most previous corpus-driven methods only considered syntagmatic associations. In this paper, we adapt a recent approach that explicitly models both syntagmatic and paradigmatic associations. We show that the implicit similarity between certain medical concepts can only be modelled using paradigmatic associations. In addition, the inclusion of both types of associations overcomes the sensitivity to the training corpus experienced by previous approaches, making our method both more effective and more robust. This finding may have implications for researchers in the area of medical information retrieval.

Encouraging, assisting and time to EAT : improved nutritional intake for older medical patients receiving Protected Mealtimes and/or additional nursing feeding assistance

Background & Aims: Inadequate feeding assistance and mealtime interruptions during hospitalisation may contribute to malnutrition and poor nutritional intake in older people. This study aimed to implement and compare three interventions designed to specifically address mealtime barriers and improve energy intakes of medical inpatients aged ≥65 years. Methods: Pre-post study compared three mealtime assistance interventions: PM: Protected Mealtimes with multidisciplinary education; AIN: additional assistant-in-nursing (AIN) with dedicated meal role; PM+AIN: combined intervention. Dietary intake of 254 patients (pre: n=115, post: n=141; mean age 80±8) was visually estimated on a single day in the first week of hospitalisation and compared with estimated energy requirements. Assistance activities were observed and recorded. Results: Mealtime assistance levels significantly increased in all interventions (p<0.01). Post-intervention participants were more likely to achieve adequate energy intake (OR=3.4, p=0.01), with no difference noted between interventions (p=0.29). Patients with cognitive impairment or feeding dependency appeared to gain substantial benefit from mealtime assistance interventions. Conclusions: Protected Mealtimes and additional AIN assistance (implemented alone or in combination) may produce modest improvements in nutritional intake. Targeted feeding assistance for certain patient groups holds promise; however, alternative strategies are required to address the complex problem of malnutrition in this population.