Moving beyond transition pedagogy: Maturity models and student engagement

Australian higher education institutions (HEIs) have entered a new phase of regulation and accreditation which includes performance-based funding relating to the participation and retention of students from social and cultural groups previously underrepresented in higher education. However, in addressing these priorities, it is critical that HEIs do not further disadvantage students from certain groups by identifying them for attention because of their social or cultural backgrounds, circumstances which are largely beyond the control of students. In response, many HEIs are focusing effort on university-wide approaches to enhancing the student experience because such approaches will enhance the engagement, success and retention of all students, and in doing so, particularly benefit those students who come from underrepresented groups. Measuring and benchmarking student experiences and engagement that arise from these efforts is well supported by extensive collections of student experience survey data. However no comparable instrument exists that measures the capability of institutions to influence and/or enhance student experiences where capability is an indication of how well an organisational process does what it is designed to do (Rosemann & de Bruin, 2005). This paper proposes that the concept of a maturity model (Marshall, 2010; Paulk, 1999) may be useful as a way of assessing the capability of HEIs to provide and implement student engagement, success and retention activities. We will describe the Student Engagement, Success and Retention Maturity Model (SESR-MM), (Clarke, Nelson & Stoodley, 2012; Nelson, Clarke & Stoodley, 2012) we are currently investigating. We will discuss if our research may address the current gap by facilitating the development of an SESR-MM instrument that aims (i) to enable institutions to assess the capability of their current student engagement and retention programs and strategies to influence and respond to student experiences within the institution; and (ii) to provide institutions with the opportunity to understand various practices across the sector with a view to further improving programs and practices relevant to their context. The first aim of our research is to extend the generational approach which has been useful in considering the evolutionary nature of the first year experience (FYE) (Wilson, 2009). Three generations have been identified and explored: First generation approaches that focus on co-curricular strategies (e.g. orientation and peer programs); Second generation approaches that focus on curriculum (e.g. pedagogy, curriculum design, and learning and teaching practice); and third generation approaches—also referred to as transition pedagogy—that focus on the production of an institution-wide integrated holistic intentional blend of curricular and co-curricular activities (Kift, Nelson & Clarke, 2010). The second aim of this research is to move beyond assessments of students’ experiences to focus on assessing institutional processes and their capability to influence student engagement. In essence, we propose to develop and use the maturity model concept to produce an instrument that will indicate the capability of HEIs to manage and improve student engagement, success and retention programs and strategies. References Australian Council for Educational Research. (n.d.). Australasian Survey of Student Engagement. Retrieved from http://www.acer.edu.au/research/ausse/background Clarke, J., Nelson, K., & Stoodley, I. (2012, July). The Maturity Model concept as framework for assessing the capability of higher education institutions to address student engagement, success and retention: New horizon or false dawn? A Nuts & Bolts presentation at the 15th International Conference on the First Year in Higher Education, “New Horizons,” Brisbane, Australia. Kift, S., Nelson, K., & Clarke, J. (2010) Transition pedagogy - a third generation approach to FYE: A case study of policy and practice for the higher education sector. The International Journal of the First Year in Higher Education, 1(1), pp. 1-20. Department of Education, Employment and Workplace Relations. (n.d.). The University Experience Survey. Advancing quality in higher education information sheet. Retrieved from http://www.deewr.gov.au/HigherEducation/Policy/Documents/University_Experience_Survey.pdf Marshall, S. (2010). A quality framework for continuous improvement of e-Learning: The e-Learning Maturity Model. Journal of Distance Education, 24(1), 143-166. Nelson, K., Clarke, J., & Stoodley, I. (2012). An exploration of the Maturity Model concept as a vehicle for higher education institutions to assess their capability to address student engagement. A work in progress. Submitted for publication. Paulk, M. (1999). Using the Software CMM with good judgment, ASQ Software Quality Professional, 1(3), 19-29. Wilson, K. (2009, June–July). The impact of institutional, programmatic and personal interventions on an effective and sustainable first-year student experience. Keynote address presented at the 12th Pacific Rim First Year in Higher Education Conference, “Preparing for Tomorrow Today: The First Year as Foundation,” Townsville, Australia. Retrieved from http://www.fyhe.com.au/past_papers/papers09/ppts/Keithia_Wilson_paper.pdf

Verifying a Student Engagement, Success and Retention Maturity Model (SESR-MM): A reality check of the model using data derived from three universities

Australian higher education institutions (HEIs) have entered a new phase of regulation and accreditation which includes performance-based funding relating to the participation and retention of students from social and cultural groups previously underrepresented in higher education. However, in addressing these priorities, it is critical that HEIs do not further disadvantage students from certain groups by identifying them for attention because of their social or cultural backgrounds, circumstances which are largely beyond the control of students. In response, many HEIs are focusing effort on university-wide approaches to enhancing the student experience because such approaches will enhance the engagement, success and retention of all students, and in doing so, particularly benefit those students who come from underrepresented groups. Measuring and benchmarking student experiences and engagement that arise from these efforts is well supported by extensive collections of student experience survey data. However no comparable instrument exists that measures the capability of institutions to influence and/or enhance student experiences where capability is an indication of how well an organisational process does what it is designed to do (Rosemann & de Bruin, 2005). We have proposed that the concept of a maturity model (Marshall, 2010; Paulk, 1999) may be useful as a way of assessing the capability of HEIs to provide and implement student engagement, success and retention activities and we are currently articulating a Student Engagement, Success and Retention Maturity Model (SESR-MM), (Clarke, Nelson & Stoodley, 2012; Nelson, Clarke & Stoodley, 2012). Our research aims to address the current gap by facilitating the development of an SESR-MM instrument that aims (i) to enable institutions to assess the capability of their current student engagement and retention programs and strategies to influence and respond to student experiences within the institution; and (ii) to provide institutions with the opportunity to understand various practices across the sector with a view to further improving programs and practices relevant to their context. Our research extends the generational approach which has been useful in considering the evolutionary nature of the first year experience (FYE) (Wilson, 2009). Three generations have been identified and explored: First generation approaches that focus on co-curricular strategies (e.g. orientation and peer programs); Second generation approaches that focus on curriculum (e.g. pedagogy, curriculum design, and learning and teaching practice); and third generation approaches—also referred to as transition pedagogy—that focus on the production of an institution-wide integrated holistic intentional blend of curricular and co-curricular activities (Kift, Nelson & Clarke, 2010). Our research also moves beyond assessments of students’ experiences to focus on assessing institutional processes and their capability to influence student engagement. In essence, we propose to develop and use the maturity model concept to produce an instrument that will indicate the capability of HEIs to manage and improve student engagement, success and retention programs and strategies. The issues explored in this workshop are (i) whether the maturity model concept can be usefully applied to provide a measure of institutional capability for SESR; (ii) whether the SESR-MM can be used to assess the maturity of a particular set of institutional practices; and (iii) whether a collective assessment of an institution’s SESR capabilities can provide an indication of the maturity of the institution’s SESR activities. The workshop will be approached in three stages. Firstly, participants will be introduced to the key characteristics of maturity models, followed by a discussion of the SESR-MM and the processes involved in its development. Secondly, participants will be provided with resources to facilitate the development of a maturity model and an assessment instrument for a range of institutional processes and related practices. In the final stage of the workshop, participants will “assess” the capability of these practices to provide a collective assessment of the maturity of these processes. References Australian Council for Educational Research. (n.d.). Australasian Survey of Student Engagement. Retrieved from http://www.acer.edu.au/research/ausse/background Clarke, J., Nelson, K., & Stoodley, I. (2012, July). The Maturity Model concept as framework for assessing the capability of higher education institutions to address student engagement, success and retention: New horizon or false dawn? A Nuts & Bolts presentation at the 15th International Conference on the First Year in Higher Education, “New Horizons,” Brisbane, Australia. Department of Education, Employment and Workplace Relations. (n.d.). The University Experience Survey. Advancing quality in higher education information sheet. Retrieved from http://www.deewr.gov.au/HigherEducation/Policy/Documents/University_Experience_Survey.pdf Kift, S., Nelson, K., & Clarke, J. (2010) Transition pedagogy - a third generation approach to FYE: A case study of policy and practice for the higher education sector. The International Journal of the First Year in Higher Education, 1(1), pp. 1-20. Marshall, S. (2010). A quality framework for continuous improvement of e-Learning: The e-Learning Maturity Model. Journal of Distance Education, 24(1), 143-166. Nelson, K., Clarke, J., & Stoodley, I. (2012). An exploration of the Maturity Model concept as a vehicle for higher education institutions to assess their capability to address student engagement. A work in progress. Submitted for publication. Paulk, M. (1999). Using the Software CMM with good judgment, ASQ Software Quality Professional, 1(3), 19-29. Wilson, K. (2009, June–July). The impact of institutional, programmatic and personal interventions on an effective and sustainable first-year student experience. Keynote address presented at the 12th Pacific Rim First Year in Higher Education Conference, “Preparing for Tomorrow Today: The First Year as Foundation,” Townsville, Australia. Retrieved from http://www.fyhe.com.au/past_papers/papers09/ppts/Keithia_Wilson_paper.pdf

The future of Australian e-learning : it’s all about access

This article clarifies the interdependence between high-speed broadband and e-Learning. It does this by identifying the importance of the internet for Australia’s education future and the importance of education for the future of the internet. It concludes by confirming the role the NBN will play as an enabler of both; and the need to ensure access for all to appropriate skills, as well as to services.

Evaluating the use of online synchronous communication to enhance learning in statistics

According to social constructivists, learners are active participants in constructing new knowledge in a social process where they interact with others. In these social settings teachers or more knowledgeable peers provide support. This research study investigated the contribution that an online synchronous tutorial makes to support teaching and learning of undergraduate introductory statistics offered by an Australian regional university at a distance. The introductory statistics course which served as a research setting in this study was a requirement of a variety of programs at the University, including psychology, business and science. Often students in these programs perceive this course to be difficult and irrelevant to their programs of study. Negative attitudes and associated anxiety mean that students often struggle with the content. While asynchronous discussion forums have been shown to provide a level of interaction and support, it was anticipated that online synchronous tutorials would offer immediate feedback to move students forward through ―stuck places.‖ At the beginning of the semester the researcher offered distance students in this course the opportunity to participate in a weekly online synchronous tutorial which was an addition to the usual support offered by the teaching team. This tutorial was restricted to 12 volunteers to allow sufficient interaction to occur for each of the participants. The researcher, as participant-observer, conducted the weekly tutorials using the University's interactive online learning platform, Wimba Classroom, whereby participants interacted using audio, text chat and a virtual whiteboard. Prior to the start of semester, participants were surveyed about their previous mathematical experiences, their perceptions of the introductory statistics course and why they wanted to participate in the online tutorial. During the semester, they were regularly asked pertinent research questions related to their personal outcomes from the tutorial sessions. These sessions were recorded using screen capture software and the participants were interviewed about their experiences at the end of the semester. Analysis of these data indicated that the perceived value of online synchronous tutorial lies in the interaction with fellow students and a content expert and with the immediacy of feedback given. The collaborative learning environment offered the support required to maintain motivation, enhance confidence and develop problemsolving skills in these distance students of introductory statistics. Based on these findings a model of online synchronous learning is proposed.

Feasibility of using technology to disseminate evidence to rural nurses and improve patient outcomes

Background: Rural African American women receive less frequent mammography screening and die of breast cancer at a higher rate than is seen in the general population. To overcome this disparity, it is necessary to assist rural providers in their efforts to influence women to obtain screening. Method: This study examined the feasibility of using distance education to disseminate knowledge about timely and appropriate mammography screening to rural nurses, using patient outcome data to evaluate the effectiveness of this intervention. Results: Overall, there was a decline in referrals and mammography screening, but the intervention group centers showed a smaller decline after the educational intervention than did the control group. Conclusion: The findings show the effect of dissemination of information and the feasibility of using patient outcome data for educational evaluation. Neighboring academic health centers and nursing schools should include in their mission the provision of educational programs for relatively isolated rural nurses.

Applying academagogy : the transference of an organised heuristic teaching approach to the digital realm

Much has been written about transferring class materials and teaching techniques to digital platforms, but less has been written about applying heuristic organizing constructs in the same manner. With the transformation of learning ecologies over the past decades as well as requirements to adjust to constantly shifting digital tools and environments, the challenges for learning facilitators are to readily adapt and change, as well as to engage a changing learner demographic. However, most importantly is to engage most effectively with learners in these online environments. This article reviews the existing literature in the heuristic construct of academagogy [1] and applies a case study methodology to discussion of the first application of academagogy to the online delivery of an undergraduate design unit. Through a focus on effective teaching and learning techniques, the transfer from face-to-face (f2f) to the digital realm is explored through four main focal points: Tools for teaching, teaching and learning, communicating with students, and effective teaching methods. These four focal points are then used to discuss ways to meet the challenges of teaching online including how they create new dimensions in teaching practice and how the digital experience changes learning experiences. The article concludes with reflection and consolidation of the similarities and differences between the face-to-face and digital deliveries, and by suggesting changes to the academagogic heuristic to enable its use more easily in a digital space.

Let's do it: A framework to investigate the affordances of experimental learning environments

BACKGROUND Experimental learning, traditionally conducted in on-campus laboratory venues, is the cornerstone of science and engineering education. In order to ensure that engineering graduates are exposed to ‘real-world’ situations and attain the necessary professional skill-sets, as mandated by course accreditation bodies such as Engineers Australia, face-to-face laboratory experimentation with real equipment has been an integral component of traditional engineering education. The online delivery of engineering coursework endeavours to mimic this with remote and simulated laboratory experimentation. To satisfy student and accreditation requirements, the common practice has been to offer equivalent remote and/or simulated laboratory experiments in lieu of the ones delivered, face-to face, on campus. The current implementations of both remote and simulated laboratories tend to be specified with a focus on technical characteristics, instead of pedagogical requirements. This work attempts to redress this situation by developing a framework for the investigation of the suitability of different experimental educational environments to deliver quality teaching and learning. PURPOSE For the tertiary education sector involved with technical or scientific training, a research framework capable of assessing the affordances of laboratory venues is an important aid during the planning, designing and evaluating stages of face-to-face and online (or cyber) environments that facilitate student experimentation. Providing quality experimental learning venues has been identified as one of the distance-education providers’ greatest challenges. DESIGN/METHOD The investigation draws on the expertise of staff at three Australian universities: Swinburne University of Technology (SUT), Curtin University (Curtin) and Queensland University of Technology (QUT). The aim was to analyse video recorded data, in order to identify the occurrences of kikan-shido (a Japanese term meaning ‘between desks instruction’ and over-the-shoulder learning and teaching (OTST/L) events, thereby ascertaining the pedagogical affordances in face-to-face laboratories. RESULTS These will be disseminated at a Master Class presentation at this conference. DISCUSSION Kikan-shido occurrences did reflect on the affordances of the venue. Unlike with other data collection methods, video recorded data and its analysis is repeatable. Participant bias is minimised or even eradicated and researcher bias tempered by enabling re-coding by others. CONCLUSIONS Framework facilitates the identification of experiential face-to-face learning venue affordances. Investigation will continue with on-line venues.

Towards automated content analysis of discussion transcripts: A cognitive presence case

In this paper, we present the results of an exploratory study that examined the problem of automating content analysis of student online discussion transcripts. We looked at the problem of coding discussion transcripts for the levels of cognitive presence, one of the three main constructs in the Community of Inquiry (CoI) model of distance education. Using Coh-Metrix and LIWC features, together with a set of custom features developed to capture discussion context, we developed a random forest classification system that achieved 70.3% classification accuracy and 0.63 Cohen's kappa, which is significantly higher than values reported in the previous studies. Besides improvement in classification accuracy, the developed system is also less sensitive to overfitting as it uses only 205 classification features, which is around 100 times less features than in similar systems based on bag-of-words features. We also provide an overview of the classification features most indicative of the different phases of cognitive presence that gives an additional insights into the nature of cognitive presence learning cycle. Overall, our results show great potential of the proposed approach, with an added benefit of providing further characterization of the cognitive presence coding scheme.

Digital videos in financial accounting: A sociocognitive approach to learning

Understanding the important concepts necessary to undertake the preparation of consolidated financial statements has proven challenging for many accounting undergraduate students. As a result, the development of multimedia modelling concepts such as acquisition analysis, business combination valuation entries, reacquisition entries and intragroup transactions were embedded within an e-learning environment. The principle of modelling, derived from social cognitive theory, was applied to the design of the multimedia. A study was conducted to gauge the effectiveness of the approach and consider student perceptions with regard to learning through this approach. Quantitative data were collected from accounting undergraduate students (n= 464) enrolled across three different cohorts including international campuses (n=386), an Australian campus (n=49) and a distance education cohort (n=29). Analyses were undertaken to show significant differences between these cohorts. This research paper presents findings that indicate a positive and significant association between the number of times the videos were accessed, and the assignment score (p<0.05) was evident, suggesting that students that referred to the videos relatively frequently were able to utilise the knowledge gained from the videos to assist them in completing the assignment.

The Hot Topic Community: Videoconferencing to reduce the professional isolation of teachers in rural Western Australia

Access to quality professional learning and the opportunity to collaborate with other educators can be limited for teachers in rural and remote areas of Western Australia. A recognised need to enhance the skills of rural teaching professionals and encourage teachers in small communities to join collegial networks was established by the members of several professional organisations. A working group consisting of representatives from the Australian College of Educators-WA (ACE-WA), the Rural and Remote Education Advisory Council (RREAC), the Society for the Provision of Education in Rural Australia (SPERA) and the School of Isolated and Distance Education (SIDE) provided teachers in rural areas with the opportunity to reduce professional isolation through the provision of relevant, convenient, and cost effective in-service education. Through a videoconferencing system, accessed within the Western Australian Telecentre Network and other educational organisations, the audience connected and participated with the presenter and studio based audience for two Hot Topics Seminars in 2008. This paper reports on the challenges and successes encountered by the working group and the findings of the research conducted throughout 2008.

Occupational health nurses’ roles, credentials, and continuing education in Ontario, Canada

The role of the occupational health nurse is broad and includes health care provider, manager/coordinator, educator/advisor, and case manager and consultant, depending on the type of industry and the country in which the nurse practices. Regardless of the type of role, the occupational health nurse must participate in continuing nursing education (CNE) activities. This study describes the roles, credentials, and number of CNE activities undertaken by occupational health nurses working in Ontario, Canada. Using a non-experimental descriptive design, a questionnaire was mailed to all practicing occupational health nurses who are members (n = 900) of a local nursing association. Three hundred fifty-four questionnaires were returned. Nurses reported a variety of roles in the following categories: case management, health promotion, policy development, infection control/travel health, ergonomics, education, research, health and safety, direct care, consultation, disaster preparedness, and industrial hygiene. Sixty-five percent of nurses held an occupational health nurse credential, and 19% of nurses attended more than 100 hours of CNE annually. Occupational health nurses have multiple workplace roles. Many attend CNE activities and they often prepare for credentialing.

Does usability engineering matters for STEM education?

Technological maturity and the exponential growth of digital applications are contributing to lifestyle changes worldwide. Consequently, learning and teaching is demanding more effective sociotechnical interactions involving emerging technologies, as opposed to traditional, conventional face-to-face learning and teaching approaches. In this context, usability engineering is making significant contributions for improving computer and distance-based learning, both for learners and instructors, which have often been ignored when designing online learning and teaching applications. Usability testing is a central part of the human centered learning approach for developing sustainable STEM education from the socio-technological perspective. Our experiences with usability engineering and the impact of teaching low-cost rapid usability testing methods on knowledge translation from undergraduate to graduate courses to real-world practice (i.e. getting the methods out there in real use) are diverse and multi-modal. Our sample space has been hundreds of trained students who have learned how to do effective usability engineering in real-world situations at higher levels of realism (i.e. fidelity) and at a much lower cost than using traditional fixed usability labs. Furthermore, this low-cost rapid approach to usability engineering has been adopted by many of our graduates who are now managers, CIOs etc and who are using the methods routinely in their organizations in real world applications and scenarios. This knowledge has been used to improve design and implementation of a wide range of applications, including applications designed for teaching and learning.

Creating physical education in remote Australian schools: Overcoming the tyranny of distance through communities of practice

This paper reports on a qualitative case study undertaken in a remote part of Queensland, Australia. While there is some modest agreement about the capacity of contemporary information technologies to overcome the problems of schooling in areas of extreme remoteness, generally, children educated in such contexts are considered to be disadvantaged. The experiential areas of the curriculum, which often require specific teaching expertise, present the greatest challenge to teachers, and of these, physical education is perhaps the most problematic. This research reports on a case study of three remote Queensland multi-age primary (elementary) schools that come together to form a community of practice to overcome the problems of teaching physical education in such difficult circumstances. Physical education is constructed in these contexts by blurring the school and community boundaries, by contextualizing the subject content to make it relevant, and by adjusting the school day to accommodate potential physical education experiences. Each community gathers its collective experience to ensure the widest possible experiences are made available for the children. In doing so, the children develop a range of competencies that enable seamless transition to boarding high schools.

The judicious utilization of new technologies through authentic learning in higher education : a case study

Though technology holds significant promise for enhanced teaching and learning it is unlikely to meet this promise without a principled approach to course design. There is burgeoning discourse about the use of technological tools and models in higher education, but much of the discussion is fixed upon distance learning or technology based courses. This paper will develop and propose a balanced model for effective teaching and learning for “on campus” higher education, with particular emphasis on the opportunities for revitalisation available through the judicious utilisation of new technologies. It will explore the opportunities available for the creation of more authentic learning environments through the principled design. Finally it will demonstrate with a case study how these have come together enabling the creation of an effective and authentic learning environment for one pre-service teacher education course at the University of Queensland.

Enabling authentic collaborative education in an online environment : the QUT Virtual Law Placement

This paper explores an innovative model for work-integrated learning using a virtual paradigm – The Virtual Law Placement Unit at Queensland University of Technology (QUT) Australia. It builds upon the conceptual model previously explored at WACE 2007 and provides an account of the lessons learned from the pilot offering of the unit which was conducted and evaluated in 2008. ----- The Virtual Placement Unit offers students the opportunity to complete an authentic workplace task under the guidance of a real-life workplace supervisor, where student-student communication and student-supervisor communication is all conducted virtually (and potentially asynchronously) to create an engaging but flexible learning environment using a combination of Blackboard and SharePoint technologies. This virtual experience is pioneering in the sense that it enables law students to access an unprecedented range of law graduate destination workplaces and projects, including international and social justice placements, absent the constraints traditionally associated with arranging physical placements. ----- All aspects of this unit have been designed in conjunction with community partners with a view to balancing student learning objectives with community needs through co-operative education. This paper will also explore how the implementation of the project is serving to strengthen those partnerships with the wider community, simultaneously addressing the community engagement agenda of the University and enabling students to engage meaningfully with local, national and international community partners in the real world of work.