Verifying a Student Engagement, Success and Retention Maturity Model (SESR-MM): A reality check of the model using data derived from three universities

Australian higher education institutions (HEIs) have entered a new phase of regulation and accreditation which includes performance-based funding relating to the participation and retention of students from social and cultural groups previously underrepresented in higher education. However, in addressing these priorities, it is critical that HEIs do not further disadvantage students from certain groups by identifying them for attention because of their social or cultural backgrounds, circumstances which are largely beyond the control of students. In response, many HEIs are focusing effort on university-wide approaches to enhancing the student experience because such approaches will enhance the engagement, success and retention of all students, and in doing so, particularly benefit those students who come from underrepresented groups. Measuring and benchmarking student experiences and engagement that arise from these efforts is well supported by extensive collections of student experience survey data. However no comparable instrument exists that measures the capability of institutions to influence and/or enhance student experiences where capability is an indication of how well an organisational process does what it is designed to do (Rosemann & de Bruin, 2005). We have proposed that the concept of a maturity model (Marshall, 2010; Paulk, 1999) may be useful as a way of assessing the capability of HEIs to provide and implement student engagement, success and retention activities and we are currently articulating a Student Engagement, Success and Retention Maturity Model (SESR-MM), (Clarke, Nelson & Stoodley, 2012; Nelson, Clarke & Stoodley, 2012). Our research aims to address the current gap by facilitating the development of an SESR-MM instrument that aims (i) to enable institutions to assess the capability of their current student engagement and retention programs and strategies to influence and respond to student experiences within the institution; and (ii) to provide institutions with the opportunity to understand various practices across the sector with a view to further improving programs and practices relevant to their context. Our research extends the generational approach which has been useful in considering the evolutionary nature of the first year experience (FYE) (Wilson, 2009). Three generations have been identified and explored: First generation approaches that focus on co-curricular strategies (e.g. orientation and peer programs); Second generation approaches that focus on curriculum (e.g. pedagogy, curriculum design, and learning and teaching practice); and third generation approaches—also referred to as transition pedagogy—that focus on the production of an institution-wide integrated holistic intentional blend of curricular and co-curricular activities (Kift, Nelson & Clarke, 2010). Our research also moves beyond assessments of students’ experiences to focus on assessing institutional processes and their capability to influence student engagement. In essence, we propose to develop and use the maturity model concept to produce an instrument that will indicate the capability of HEIs to manage and improve student engagement, success and retention programs and strategies. The issues explored in this workshop are (i) whether the maturity model concept can be usefully applied to provide a measure of institutional capability for SESR; (ii) whether the SESR-MM can be used to assess the maturity of a particular set of institutional practices; and (iii) whether a collective assessment of an institution’s SESR capabilities can provide an indication of the maturity of the institution’s SESR activities. The workshop will be approached in three stages. Firstly, participants will be introduced to the key characteristics of maturity models, followed by a discussion of the SESR-MM and the processes involved in its development. Secondly, participants will be provided with resources to facilitate the development of a maturity model and an assessment instrument for a range of institutional processes and related practices. In the final stage of the workshop, participants will “assess” the capability of these practices to provide a collective assessment of the maturity of these processes. References Australian Council for Educational Research. (n.d.). Australasian Survey of Student Engagement. Retrieved from http://www.acer.edu.au/research/ausse/background Clarke, J., Nelson, K., & Stoodley, I. (2012, July). The Maturity Model concept as framework for assessing the capability of higher education institutions to address student engagement, success and retention: New horizon or false dawn? A Nuts & Bolts presentation at the 15th International Conference on the First Year in Higher Education, “New Horizons,” Brisbane, Australia. Department of Education, Employment and Workplace Relations. (n.d.). The University Experience Survey. Advancing quality in higher education information sheet. Retrieved from http://www.deewr.gov.au/HigherEducation/Policy/Documents/University_Experience_Survey.pdf Kift, S., Nelson, K., & Clarke, J. (2010) Transition pedagogy - a third generation approach to FYE: A case study of policy and practice for the higher education sector. The International Journal of the First Year in Higher Education, 1(1), pp. 1-20. Marshall, S. (2010). A quality framework for continuous improvement of e-Learning: The e-Learning Maturity Model. Journal of Distance Education, 24(1), 143-166. Nelson, K., Clarke, J., & Stoodley, I. (2012). An exploration of the Maturity Model concept as a vehicle for higher education institutions to assess their capability to address student engagement. A work in progress. Submitted for publication. Paulk, M. (1999). Using the Software CMM with good judgment, ASQ Software Quality Professional, 1(3), 19-29. Wilson, K. (2009, June–July). The impact of institutional, programmatic and personal interventions on an effective and sustainable first-year student experience. Keynote address presented at the 12th Pacific Rim First Year in Higher Education Conference, “Preparing for Tomorrow Today: The First Year as Foundation,” Townsville, Australia. Retrieved from http://www.fyhe.com.au/past_papers/papers09/ppts/Keithia_Wilson_paper.pdf

The future of Australian e-learning : it’s all about access

This article clarifies the interdependence between high-speed broadband and e-Learning. It does this by identifying the importance of the internet for Australia’s education future and the importance of education for the future of the internet. It concludes by confirming the role the NBN will play as an enabler of both; and the need to ensure access for all to appropriate skills, as well as to services.

Using real-time authentic online learning scenarios to teach criminal intelligence

Criminal intelligence is an area of expertise highly sought-after internationally and within a variety of justice-related professions; however, producing university graduates with the requisite professional knowledge, as well as analytical, organisational and technical skills presents a pedagogical and technical challenge to university educators. The situation becomes even more challenging when students are undertaking their studies by distance education. This best practice session showcases the design of an online undergraduate unit for final year justice students which uses an evolving real-time criminal scenario as the focus of authentic learning activities in order to prepare students for graduate roles within the criminal intelligence and justice professions. Within the unit, students take on the role of criminal intelligence analysts, applying relevant theories, models and strategies to solve a complex but realistic crime and complete briefings and documentation to industry standards as their major summative assessment task. The session will demonstrate how the design of the online unit corresponds to authentic learning principles, and will specifically map the elements of the unit design to Herrington & Oliver’s instructional design framework for authentic learning (2000; Herrington & Herrington 2006). The session will show how a range of technologies was used to create a rich learning experience for students that could be easily maintained over multiple unit iterations without specialist technical support. The session will also discuss the unique pedagogical affordances and challenges implicated in the location of the unit within an online learning environment, and will reflect on some of the lessons learned from the development which may be relevant to other authentic online learning contexts.

Using real-time authentic online learning scenarios to teach criminal intelligence : presentation

Criminal intelligence is an area of expertise highly sought-after internationally and within a variety of justice-related professions; however, producing university graduates with the requisite professional knowledge, as well as analytical, organisational and technical skills presents a pedagogical and technical challenge to university educators. The situation becomes even more challenging when students are undertaking their studies by distance education. This best practice session showcases the design of an online undergraduate unit for final year justice students which uses an evolving real-time criminal scenario as the focus of authentic learning activities in order to prepare students for graduate roles within the criminal intelligence and justice professions. Within the unit, students take on the role of criminal intelligence analysts, applying relevant theories, models and strategies to solve a complex but realistic crime and complete briefings and documentation to industry standards as their major summative assessment task. The session will demonstrate how the design of the online unit corresponds to authentic learning principles, and will specifically map the elements of the unit design to Herrington & Oliver’s instructional design framework for authentic learning (2000; Herrington & Herrington 2006). The session will show how a range of technologies was used to create a rich learning experience for students that could be easily maintained over multiple unit iterations without specialist technical support. The session will also discuss the unique pedagogical affordances and challenges implicated in the location of the unit within an online learning environment, and will reflect on some of the lessons learned from the development which may be relevant to other authentic online learning contexts.

Feasibility of using technology to disseminate evidence to rural nurses and improve patient outcomes

Background: Rural African American women receive less frequent mammography screening and die of breast cancer at a higher rate than is seen in the general population. To overcome this disparity, it is necessary to assist rural providers in their efforts to influence women to obtain screening. Method: This study examined the feasibility of using distance education to disseminate knowledge about timely and appropriate mammography screening to rural nurses, using patient outcome data to evaluate the effectiveness of this intervention. Results: Overall, there was a decline in referrals and mammography screening, but the intervention group centers showed a smaller decline after the educational intervention than did the control group. Conclusion: The findings show the effect of dissemination of information and the feasibility of using patient outcome data for educational evaluation. Neighboring academic health centers and nursing schools should include in their mission the provision of educational programs for relatively isolated rural nurses.

Applying academagogy : the transference of an organised heuristic teaching approach to the digital realm

Much has been written about transferring class materials and teaching techniques to digital platforms, but less has been written about applying heuristic organizing constructs in the same manner. With the transformation of learning ecologies over the past decades as well as requirements to adjust to constantly shifting digital tools and environments, the challenges for learning facilitators are to readily adapt and change, as well as to engage a changing learner demographic. However, most importantly is to engage most effectively with learners in these online environments. This article reviews the existing literature in the heuristic construct of academagogy [1] and applies a case study methodology to discussion of the first application of academagogy to the online delivery of an undergraduate design unit. Through a focus on effective teaching and learning techniques, the transfer from face-to-face (f2f) to the digital realm is explored through four main focal points: Tools for teaching, teaching and learning, communicating with students, and effective teaching methods. These four focal points are then used to discuss ways to meet the challenges of teaching online including how they create new dimensions in teaching practice and how the digital experience changes learning experiences. The article concludes with reflection and consolidation of the similarities and differences between the face-to-face and digital deliveries, and by suggesting changes to the academagogic heuristic to enable its use more easily in a digital space.

Let's do it: A framework to investigate the affordances of experimental learning environments

BACKGROUND Experimental learning, traditionally conducted in on-campus laboratory venues, is the cornerstone of science and engineering education. In order to ensure that engineering graduates are exposed to ‘real-world’ situations and attain the necessary professional skill-sets, as mandated by course accreditation bodies such as Engineers Australia, face-to-face laboratory experimentation with real equipment has been an integral component of traditional engineering education. The online delivery of engineering coursework endeavours to mimic this with remote and simulated laboratory experimentation. To satisfy student and accreditation requirements, the common practice has been to offer equivalent remote and/or simulated laboratory experiments in lieu of the ones delivered, face-to face, on campus. The current implementations of both remote and simulated laboratories tend to be specified with a focus on technical characteristics, instead of pedagogical requirements. This work attempts to redress this situation by developing a framework for the investigation of the suitability of different experimental educational environments to deliver quality teaching and learning. PURPOSE For the tertiary education sector involved with technical or scientific training, a research framework capable of assessing the affordances of laboratory venues is an important aid during the planning, designing and evaluating stages of face-to-face and online (or cyber) environments that facilitate student experimentation. Providing quality experimental learning venues has been identified as one of the distance-education providers’ greatest challenges. DESIGN/METHOD The investigation draws on the expertise of staff at three Australian universities: Swinburne University of Technology (SUT), Curtin University (Curtin) and Queensland University of Technology (QUT). The aim was to analyse video recorded data, in order to identify the occurrences of kikan-shido (a Japanese term meaning ‘between desks instruction’ and over-the-shoulder learning and teaching (OTST/L) events, thereby ascertaining the pedagogical affordances in face-to-face laboratories. RESULTS These will be disseminated at a Master Class presentation at this conference. DISCUSSION Kikan-shido occurrences did reflect on the affordances of the venue. Unlike with other data collection methods, video recorded data and its analysis is repeatable. Participant bias is minimised or even eradicated and researcher bias tempered by enabling re-coding by others. CONCLUSIONS Framework facilitates the identification of experiential face-to-face learning venue affordances. Investigation will continue with on-line venues.

Towards automated content analysis of discussion transcripts: A cognitive presence case

In this paper, we present the results of an exploratory study that examined the problem of automating content analysis of student online discussion transcripts. We looked at the problem of coding discussion transcripts for the levels of cognitive presence, one of the three main constructs in the Community of Inquiry (CoI) model of distance education. Using Coh-Metrix and LIWC features, together with a set of custom features developed to capture discussion context, we developed a random forest classification system that achieved 70.3% classification accuracy and 0.63 Cohen's kappa, which is significantly higher than values reported in the previous studies. Besides improvement in classification accuracy, the developed system is also less sensitive to overfitting as it uses only 205 classification features, which is around 100 times less features than in similar systems based on bag-of-words features. We also provide an overview of the classification features most indicative of the different phases of cognitive presence that gives an additional insights into the nature of cognitive presence learning cycle. Overall, our results show great potential of the proposed approach, with an added benefit of providing further characterization of the cognitive presence coding scheme.

Digital videos in financial accounting: A sociocognitive approach to learning

Understanding the important concepts necessary to undertake the preparation of consolidated financial statements has proven challenging for many accounting undergraduate students. As a result, the development of multimedia modelling concepts such as acquisition analysis, business combination valuation entries, reacquisition entries and intragroup transactions were embedded within an e-learning environment. The principle of modelling, derived from social cognitive theory, was applied to the design of the multimedia. A study was conducted to gauge the effectiveness of the approach and consider student perceptions with regard to learning through this approach. Quantitative data were collected from accounting undergraduate students (n= 464) enrolled across three different cohorts including international campuses (n=386), an Australian campus (n=49) and a distance education cohort (n=29). Analyses were undertaken to show significant differences between these cohorts. This research paper presents findings that indicate a positive and significant association between the number of times the videos were accessed, and the assignment score (p<0.05) was evident, suggesting that students that referred to the videos relatively frequently were able to utilise the knowledge gained from the videos to assist them in completing the assignment.

The Hot Topic Community: Videoconferencing to reduce the professional isolation of teachers in rural Western Australia

Access to quality professional learning and the opportunity to collaborate with other educators can be limited for teachers in rural and remote areas of Western Australia. A recognised need to enhance the skills of rural teaching professionals and encourage teachers in small communities to join collegial networks was established by the members of several professional organisations. A working group consisting of representatives from the Australian College of Educators-WA (ACE-WA), the Rural and Remote Education Advisory Council (RREAC), the Society for the Provision of Education in Rural Australia (SPERA) and the School of Isolated and Distance Education (SIDE) provided teachers in rural areas with the opportunity to reduce professional isolation through the provision of relevant, convenient, and cost effective in-service education. Through a videoconferencing system, accessed within the Western Australian Telecentre Network and other educational organisations, the audience connected and participated with the presenter and studio based audience for two Hot Topics Seminars in 2008. This paper reports on the challenges and successes encountered by the working group and the findings of the research conducted throughout 2008.

Engaging in online postgraduate education as means of professional learning

With enrolments in higher education becoming a competitive market, through the removal of caps in 2012, the equitable access to postgraduate education is raised. Postgraduate education, provided through higher education institutions, is an important aspect of career development for professionals. Professionals working outside of the metropolitan area are increasingly seeking postgraduate education opportunities that will be delivered online, at a distance. In this research study, data collected from the teaching profession, has culminated in a model that will ultimately improve access to professional learning. This research paper aims to highlight the important role that higher education providers play in the delivery of postgraduate education to professionals working in regional and remote areas of Australia. Although this paper focuses on the realm of education, the model of connectedness, where synchronous and asynchronous technologies are used, can be adapted and applied to any profession that requires equitable access to professional learning.

Transforming teaching practice through virtual classrooms: A study of staff and student views of synchronous learning

Australia is a vast land and access to quality higher education is challenging for many Australians that live outside the larger metropolitan areas. In 2010, the School of Education at an Australian university (Curtin University in Western Australia) moved to flexible delivery of a fully online Bachelor of Education degree for their rural students. The new model of delivery allows access for students from any location provided they have a computer and an internet connection.A number of teaching staff had previously used an asynchronous environment to deliver learning modules housed within a learning management system (LMS) but had not used synchronous software with their students. To enhance the learning environment and to provide high quality learning experiences to students learning at a distance, the adoption of synchronous software (Elluminate Live) was introduced. This software is a real-time virtual classroom environment that allows for communication through Voice over Internet Protocol (VoIP) and video conferencing, alongside a large number of collaboration tools to engage learners.This research paper reports on the integration of a live e-learning solution into the current Learning Management System (LMS) environment. Staff were interviewed about their perceptions and a questionnaire was administered to a sample of students to identify their experience with the synchronous software in order to inform future practice.

Creating physical education in remote Australian schools: Overcoming the tyranny of distance through communities of practice

This paper reports on a qualitative case study undertaken in a remote part of Queensland, Australia. While there is some modest agreement about the capacity of contemporary information technologies to overcome the problems of schooling in areas of extreme remoteness, generally, children educated in such contexts are considered to be disadvantaged. The experiential areas of the curriculum, which often require specific teaching expertise, present the greatest challenge to teachers, and of these, physical education is perhaps the most problematic. This research reports on a case study of three remote Queensland multi-age primary (elementary) schools that come together to form a community of practice to overcome the problems of teaching physical education in such difficult circumstances. Physical education is constructed in these contexts by blurring the school and community boundaries, by contextualizing the subject content to make it relevant, and by adjusting the school day to accommodate potential physical education experiences. Each community gathers its collective experience to ensure the widest possible experiences are made available for the children. In doing so, the children develop a range of competencies that enable seamless transition to boarding high schools.

The judicious utilization of new technologies through authentic learning in higher education : a case study

Though technology holds significant promise for enhanced teaching and learning it is unlikely to meet this promise without a principled approach to course design. There is burgeoning discourse about the use of technological tools and models in higher education, but much of the discussion is fixed upon distance learning or technology based courses. This paper will develop and propose a balanced model for effective teaching and learning for “on campus” higher education, with particular emphasis on the opportunities for revitalisation available through the judicious utilisation of new technologies. It will explore the opportunities available for the creation of more authentic learning environments through the principled design. Finally it will demonstrate with a case study how these have come together enabling the creation of an effective and authentic learning environment for one pre-service teacher education course at the University of Queensland.

Synchronous learner support for music sequencing software

In the field of music technology there is a distinct focus on networking between spatially disparate locales to improve teaching and learning through real-time communication. This article proposes a new delivery model for learner support based on a review of technical and learning services, pilot research using remote desktops to teach music-sequencing software, and recent education research regarding professional development. A 24/7 delivery model using remote desktops, mobile devices and shared calendars offers a flexible real-time addition to the learner support services already on offer. Treating every user of the service as a potential expert, the model aims to deliver universal support situated in a personalized context, which will serve the technical and education requirements of teachers and learners.