Verifying a Student Engagement, Success and Retention Maturity Model (SESR-MM): A reality check of the model using data derived from three universities

Australian higher education institutions (HEIs) have entered a new phase of regulation and accreditation which includes performance-based funding relating to the participation and retention of students from social and cultural groups previously underrepresented in higher education. However, in addressing these priorities, it is critical that HEIs do not further disadvantage students from certain groups by identifying them for attention because of their social or cultural backgrounds, circumstances which are largely beyond the control of students. In response, many HEIs are focusing effort on university-wide approaches to enhancing the student experience because such approaches will enhance the engagement, success and retention of all students, and in doing so, particularly benefit those students who come from underrepresented groups. Measuring and benchmarking student experiences and engagement that arise from these efforts is well supported by extensive collections of student experience survey data. However no comparable instrument exists that measures the capability of institutions to influence and/or enhance student experiences where capability is an indication of how well an organisational process does what it is designed to do (Rosemann & de Bruin, 2005). We have proposed that the concept of a maturity model (Marshall, 2010; Paulk, 1999) may be useful as a way of assessing the capability of HEIs to provide and implement student engagement, success and retention activities and we are currently articulating a Student Engagement, Success and Retention Maturity Model (SESR-MM), (Clarke, Nelson & Stoodley, 2012; Nelson, Clarke & Stoodley, 2012). Our research aims to address the current gap by facilitating the development of an SESR-MM instrument that aims (i) to enable institutions to assess the capability of their current student engagement and retention programs and strategies to influence and respond to student experiences within the institution; and (ii) to provide institutions with the opportunity to understand various practices across the sector with a view to further improving programs and practices relevant to their context. Our research extends the generational approach which has been useful in considering the evolutionary nature of the first year experience (FYE) (Wilson, 2009). Three generations have been identified and explored: First generation approaches that focus on co-curricular strategies (e.g. orientation and peer programs); Second generation approaches that focus on curriculum (e.g. pedagogy, curriculum design, and learning and teaching practice); and third generation approaches—also referred to as transition pedagogy—that focus on the production of an institution-wide integrated holistic intentional blend of curricular and co-curricular activities (Kift, Nelson & Clarke, 2010). Our research also moves beyond assessments of students’ experiences to focus on assessing institutional processes and their capability to influence student engagement. In essence, we propose to develop and use the maturity model concept to produce an instrument that will indicate the capability of HEIs to manage and improve student engagement, success and retention programs and strategies. The issues explored in this workshop are (i) whether the maturity model concept can be usefully applied to provide a measure of institutional capability for SESR; (ii) whether the SESR-MM can be used to assess the maturity of a particular set of institutional practices; and (iii) whether a collective assessment of an institution’s SESR capabilities can provide an indication of the maturity of the institution’s SESR activities. The workshop will be approached in three stages. Firstly, participants will be introduced to the key characteristics of maturity models, followed by a discussion of the SESR-MM and the processes involved in its development. Secondly, participants will be provided with resources to facilitate the development of a maturity model and an assessment instrument for a range of institutional processes and related practices. In the final stage of the workshop, participants will “assess” the capability of these practices to provide a collective assessment of the maturity of these processes. References Australian Council for Educational Research. (n.d.). Australasian Survey of Student Engagement. Retrieved from http://www.acer.edu.au/research/ausse/background Clarke, J., Nelson, K., & Stoodley, I. (2012, July). The Maturity Model concept as framework for assessing the capability of higher education institutions to address student engagement, success and retention: New horizon or false dawn? A Nuts & Bolts presentation at the 15th International Conference on the First Year in Higher Education, “New Horizons,” Brisbane, Australia. Department of Education, Employment and Workplace Relations. (n.d.). The University Experience Survey. Advancing quality in higher education information sheet. Retrieved from http://www.deewr.gov.au/HigherEducation/Policy/Documents/University_Experience_Survey.pdf Kift, S., Nelson, K., & Clarke, J. (2010) Transition pedagogy - a third generation approach to FYE: A case study of policy and practice for the higher education sector. The International Journal of the First Year in Higher Education, 1(1), pp. 1-20. Marshall, S. (2010). A quality framework for continuous improvement of e-Learning: The e-Learning Maturity Model. Journal of Distance Education, 24(1), 143-166. Nelson, K., Clarke, J., & Stoodley, I. (2012). An exploration of the Maturity Model concept as a vehicle for higher education institutions to assess their capability to address student engagement. A work in progress. Submitted for publication. Paulk, M. (1999). Using the Software CMM with good judgment, ASQ Software Quality Professional, 1(3), 19-29. Wilson, K. (2009, June–July). The impact of institutional, programmatic and personal interventions on an effective and sustainable first-year student experience. Keynote address presented at the 12th Pacific Rim First Year in Higher Education Conference, “Preparing for Tomorrow Today: The First Year as Foundation,” Townsville, Australia. Retrieved from http://www.fyhe.com.au/past_papers/papers09/ppts/Keithia_Wilson_paper.pdf

Multiuser virtual safety training system for tower crane dismantlement

Tower crane dismantling is one of the most dangerous activities in the construction industry. Tower crane erection and dismantlement causes 10–12% of the fatalities of all crane accidents. The nature of the task is such that off-the-job training is not practicable, and the knowledge and expertise needed has to be gained on the job. However, virtual trainers such as Microsoft Flight Simulator for airplane pilots and mission rehearsal exercise (MRE) for army personnel have been developed and are known to provide a highly successful means of overcoming the risks involved in such on-the-job learning and clearly have potential in construction situations. This paper describes the newly developed multiuser virtual safety training system (MVSTS) aimed at providing a similar learning environment for those involved in tower crane dismantlement. The proposed training system is developed by modifying an existing game engine. Within the close-to-reality virtual environment, trainees can participate in a virtual dismantling process. During the process, they learn the correct dismantling procedure and working location and to cooperate with other trainees by virtually dismantling the crane. The system allows the trainees to experience the complete procedure in a risk-free environment. A case study is provided to demonstrate how the system works and its practical application. The proposed system was evaluated by interviews with 30 construction experts with different backgrounds, divided into three groups according to their experience and trained by the traditional and virtual methods, respectively. The results indicate that the trainees of the proposed system generally learned better than those using the traditional method. The ratings also indicate that the system generally has great potential as a training platform.

Please take out your phones : on the spot solicitation of student feedback in class

The use of mobile devices such as smart phones and tablets in classrooms has been met with mixed sentiments. Some instructors and teachers see them as a distraction and regularly ban their usage. Others who see their potential to enhance learning have started to explore ways to integrate them into their teaching in an attempt to improve student engagement. In this paper we report on a pilot study that forms part of a university-wide project reconceptualising its approach to the student evaluation of learning and teaching. In a progressive decision to embrace mobile technology, the university decided to trial a smart phone app designed for students to check-in to class and leave feedback on the spot. Our preliminary findings from trialling the app indicate that the application establishes a more immediate feedback loop between students and teachers. However, the app’s impact depends on how feedback is shared with students and how the teaching team responds.

Inflammatory cytokine responses to progressive resistance training and supplementation with fortified milk in men aged 50+ years : an 18-month randomized controlled trial

We examined the effects of progressive resistance training (PRT) and supplementation with calcium-vitamin D(3) fortified milk on markers of systemic inflammation, and the relationship between inflammation and changes in muscle mass, size and strength. Healthy men aged 50-79 years (n = 180) participated in this 18-month randomized controlled trial that comprised a factorial 2 x 2 design. Participants were randomized to (1) PRT + fortified milk supplement, (2) PRT, (3) fortified milk supplement, or (4) a control group. Participants assigned to PRT trained 3 days per week, while those in the supplement groups consumed 400 ml day(-1) of milk containing 1,000 mg calcium plus 800 IU vitamin D(3). We collected venous blood samples at baseline, 12 and 18 months to measure the serum concentrations of IL-6, TNF-alpha and hs-CRP. There were no exercise x supplement interactions, but serum IL-6 was 29% lower (95% CI, -62, 0) in the PRT group compared with the control group after 12 months. Conversely, IL-6 was 31% higher (95% CI, -2, 65) in the supplement group compared with the non-supplemented groups after 12 and 18 months. These between-group differences did not persist after adjusting for changes in fat mass. In the PRT group, mid-tibia muscle cross-sectional area increased less in men with higher pre-training inflammation compared with those men with lower inflammation (net difference similar to 2.5%, p < 0.05). In conclusion, serum IL-6 concentration decreased following PRT, whereas it increased after supplementation with fortified milk concomitant with changes in fat mass. Furthermore, low-grade inflammation at baseline restricted muscle hypertrophy following PRT.

The effects of increased endurance training load on biomarkers of heat intolerance during intense exercise in the heat

The effects of increased training (IT) load on plasma concentrations of lipopolysaccharides (LPS), proinflammatory cytokines, and anti-LPS antibodies during exercise in the heat were investigated in 18 male runners, who performed 14 days of normal training (NT) or 14 days of 20% IT load in 2 equal groups. Before (trial 1) and after (trial 2) the training intervention, all subjects ran at 70% maximum oxygen uptake on a treadmill under hot (35 degrees C) and humid (similar to 40%) conditions, until core temperature reached 39.5 degrees C or volitional exhaustion. Venous blood samples were drawn before, after, and 1.5 h after exercise. Plasma LPS concentration after exercise increased by 71% (trial 1, p < 0.05) and 21% (trial 2) in the NT group and by 92% (trial 1, p < 0.01) and 199% (trial 2, p < 0.01) in the IT group. Postintervention plasma LPS concentration was 35% lower before exercise (p < 0.05) and 47% lower during recovery (p < 0.01) in the IT than in the NT group. Anti-LPS IgM concentration during recovery was 35% lower in the IT than in the NT group (p < 0.05). Plasma interleukin (IL)-6 and tumor necrosis factor (TNF)-alpha concentrations after exercise (IL-6, 3-7 times, p < 0.01, and TNF-alpha, 33%, p < 0.01) and during recovery (IL-6, 2-4 times, p < 0.05, and TNF-alpha, 30%, p < 0.01) were higher than at rest within each group. These data suggest that a short-term tolerable increase in training load may protect against developing endotoxemia during exercise in the heat.

Student feedback systems in higher education: a focused literature review and environmental scan

In recent times, higher education institutions have paid increasing attention to the views of students to obtain feedback on their experience of learning and teaching through internal surveys. This article reviews research in the field and reports on practices in other Australian universities. Findings demonstrate that while student feedback is valued and used by all Australian universities, survey practices are idiosyncratic and in the majority of cases, questionnaires lack validity and reliability; data are used inadequately or inappropriately; and they offer limited potential for cross-sector benchmarking. The study confirms the need for institutions to develop an overarching framework for evaluation in which a valid, reliable, multidimensional and useful student feedback survey constitutes just one part. Given external expectations and internal requirements to collect feedback from students on their experience of learning and teaching, the pursuit of sound evaluation practices will continue to be of interest at local, national and international levels.

Promoting student well-being and resilience at law school

University can be a psychologically distressing place for students, particularly those studying law. Legal academics have been concerned about this for some time. In the United States, in particular, it has been found that symptoms of psychological distress rise signifi cantly for students in their fi rst year of law (compared to levels in the general population at that time), and persist throughout the degree to post-graduation. Recognised symptoms include depression, obsessive compulsive behaviour, feelings of inadequacy and inferiority, anxiety, hostility, paranoia, and social alienation. Many students experience law school as an isolating, adversarial and competitive environment, which impacts negatively on their values and motivation...

The use of computerised simulators for training of transthoracic and transoesophageal echocardiography. The future of echocardiographic training?

Echocardiography is the commonest form of non-invasive cardiac imaging and is fundamental to patient management. However, due to its methodology, it is also operator dependent. There are well defined pathways in training and ongoing accreditation to achieve and maintain competency. To satisfy these requirements, significant time has to be dedicated to scanning patients, often in the time pressured clinical environment. Alternative, computer based training methods are being considered to augment echocardiographic training. Numerous advances in technology have resulted in the development of interactive programmes and simulators to teach trainees the skills to perform particular procedures, including transthoracic and transoesophageal echocardiography. 82 sonographers and TOE proceduralists utilised an echocardiographic simulator and assessed its utility using defined criteria. 40 trainee sonographers assessed the simulator and were taught how to obtain an apical 2 chamber (A2C) view and image the superior vena cava (SVC). 100% and 88% found the simulator useful in obtaining the SVC or A2C view respectively. All users found it easy to use and the majority found it helped with image acquisition and interpretation. 42 attendees of a TOE training day utilising the simulator assessed the simulator with 100% finding it easy to use, as well as the augmented reality graphics benefiting image acquisition. 90% felt that it was realistic. This study revealed that both trainee sonographers and TOE proceduralists found the simulation process was realistic, helped in image acquisition and improved assessment of spatial relationships. Echocardiographic simulators may play an important role in the future training of echocardiographic skills.

Is simulation training effective in increasing podiatrists' confidence in foot ulcer management?

Background: Foot ulcers are a frequent reason for diabetes-related hospitalisation. Clinical training is known to have a beneficial impact on foot ulcer outcomes. Clinical training using simulation techniques has rarely been used in the management of diabetes-related foot complications or chronic wounds. Simulation can be defined as a device or environment that attempts to replicate the real world. The few non-web-based foot-related simulation courses have focused solely on training for a single skill or “part task” (for example, practicing ingrown toenail procedures on models). This pilot study aimed to primarily investigate the effect of a training program using multiple methods of simulation on participants’ clinical confidence in the management of foot ulcers. Methods: Sixteen podiatrists participated in a two-day Foot Ulcer Simulation Training (FUST) course. The course included pre-requisite web-based learning modules, practicing individual foot ulcer management part tasks (for example, debriding a model foot ulcer), and participating in replicated clinical consultation scenarios (for example, treating a standardised patient (actor) with a model foot ulcer). The primary outcome measure of the course was participants’ pre- and post completion of confidence surveys, using a five-point Likert scale (1 = Unacceptable-5 = Proficient). Participants’ knowledge, satisfaction and their perception of the relevance and fidelity (realism) of a range of course elements were also investigated. Parametric statistics were used to analyse the data. Pearson’s r was used for correlation, ANOVA for testing the differences between groups, and a paired-sample t-test to determine the significance between pre- and post-workshop scores. A minimum significance level of p < 0.05 was used. Results: An overall 42% improvement in clinical confidence was observed following completion of FUST (mean scores 3.10 compared to 4.40, p < 0.05). The lack of an overall significant change in knowledge scores reflected the participant populations’ high baseline knowledge and pre-requisite completion of web-based modules. Satisfaction, relevance and fidelity of all course elements were rated highly. Conclusions: This pilot study suggests simulation training programs can improve participants’ clinical confidence in the management of foot ulcers. The approach has the potential to enhance clinical training in diabetes-related foot complications and chronic wounds in general.

A framework for mathematics graphical tasks : The influence of the graphic element on student sense making

Graphical tasks have become a prominent aspect of mathematics assessment. From a conceptual stance, the purpose of this study was to better understand the composition of graphical tasks commonly used to assess students’ mathematics understandings. Through an iterative design, the investigation described the sense making of 11–12-year-olds as they decoded mathematics tasks which contained a graphic. An ongoing analysis of two phases of data collection was undertaken as we analysed the extent to which various elements of text, graphics, and symbols influenced student sense making. Specifically, the study outlined the changed behaviour (and performance) of the participants as they solved graphical tasks that had been modified with respect to these elements. We propose a theoretical framework for understanding the composition of a graphical task and identify three specific elements which are dependently and independently related to each other, namely: the graphic; the text; and the symbols. Results indicated that although changes to the graphical tasks were minimal, a change in student success and understanding was most evident when the graphic element was modified. Implications include the need for test designers to carefully consider the graphics embedded within mathematics tasks since the elements within graphical tasks greatly influence student understanding.

Training program impact on thermoplastic immobilization for head and neck radiation therapy

Purpose: To determine whether uniform guidelines and training in the stabilization and formation of thermoplastic shells can improve the reproducibility of set-up for Head and Neck cancer patients. Methods and materials: Image based measurements of the planning and treatment positions for 35 head and neck cancer patients undergoing radical radiotherapy were analysed to provide a baseline of the reproducibility of thermoplastic immobilization. Radiation therapists (RT) were surveyed to establish a perception of their confidence in thermoplastic procedures. An evidence based staff training program was created and implemented. Set-up reproduction and staff perception were reviewed to measure the impact of the training program. Results: The mean (SD) 3D vectors of anatomical displacement, measured on the patient images, improved from 4.64 (2.03) for the baseline group compared to 3.02 (1.65) following training (p < 0.01). The proportion of 3D displacements of patient data exceeding 5 mm 3D vector was decreased from 37.1% to 5.7% (p < 0.001) and the 3 mm vector from 85.7% to 42.9% (p < 0.001). The post-training survey scores demonstrated improved confidence in reproducibility of set-up for head and neck patients. Conclusion: The Thermoplastic Shells Training Program has been found to improve the treatment reproducibility for head and neck radiation therapy patients. Uniform guidelines have increased RT confidence in thermoplastic procedures.

Physiological, perceptual and technical responses to on-court tennis training on hard and clay courts

The aim of this study was to investigate the effect of court surface (clay v hard-court) on technical, physiological and perceptual responses to on-court training. Four high-performance junior male players performed two identical training sessions on hard and clay courts, respectively. Sessions included both physical conditioning and technical elements as led by the coach. Each session was filmed for later notational analysis of stroke count and error rates. Further, players wore a global positioning satellite device to measure distance covered during each session; whilst heart rate, countermovement jump distance and capillary blood measures of metabolites were measured before, during and following each session. Additionally a respective coach and athlete rating of perceived exertion (RPE) were measured following each session. Total duration and distance covered during of each session were comparable (P>0.05; d<0.20). While forehand and backhands stroke volume did not differ between sessions (P>0.05; d<0.30); large effects for increased unforced and forced errors were present on the hard court (P>0.05; d>0.90). Furthermore, large effects for increased heart rate, blood lactate and RPE values were evident on clay compared to hard courts (P>0.05; d>0.90). Additionally, while player and coach RPE on hard courts were similar, there were large effects for coaches to underrate the RPE of players on clay courts (P>0.05; d>0.90). In conclusion, training on clay courts results in trends for increased heart rate, lactate and RPE values, suggesting sessions on clay tend towards higher physiological and perceptual loads than hard courts. Further, coaches appear effective at rating player RPE on hard courts, but may underrate the perceived exertion of sessions on clay courts.

Productivity and time use during occupational therapy and nutrition/dietetics clinical education : a cohort study

Background: Currently in the Australian higher education sector higher productivity from allied health clinical education placements are a contested issue. This paper will report results of a study that investigated output changes associated with occupational therapy and nutrition/dietetics clinical education placements in Queensland, Australia. Supervisors’ and students’ time use during placements and how this changes for supervisors compared to when students are not present in the workplace is also presented. Methodology/Principal Findings: A cohort design was used with students from four Queensland universities, and their supervisors employed by Queensland Health. There was an increasing trend in the number of occasions of service delivered when the students were present, and a statistically significant increase in the daily mean length of occasions of service delivered during the placement compared to pre-placement levels. For project-based placements that were not directly involved in patient care, supervisors’ project activity time decreased during placements, with students undertaking considerably more time in project activities. Conclusions/Significance: A novel method for estimating productivity and time use changes during clinical education programs for allied health disciplines has been applied. During clinical education placements there was a net increase in outputs, suggesting supervisors engage in longer consultations with patients for the purpose of training students, while maintaining patient numbers. Other activities are reduced. This paper is the first time these data have been shown and form a good basis for future assessments of the economic impact of student placements for allied health disciplines.