Helping undergraduate students across disciplines and cultures actively engage and collaborate as equal members of a community of scholars : peer review within an e-learning environment

At the international level, the higher education sector is currently being subjected to increased calls for public accountability and the current move by the OECD to rank universities based on the quality of their teaching and learning outcomes. At the national level, Australian universities and their teaching staff face numerous challenges including financial restrictions, increasing student numbers and the reality of an increasingly diverse student population. The Australian higher education response to these competing policy and accreditation demands focuses on precise explicit systems and procedures which are inflexible and conservative and which ignore the fact that assessment is the single biggest influence on how students approach their learning. By seriously neglecting the quality of student learning outcomes, assessment tasks are often failing to engage students or reflect the tasks students will face in the world of practice. Innovative assessment design, which includes new paradigms of student engagement and learning and pedagogically based technologies have the capacity to provide some measure of relief from these internal and external tensions by significantly enhancing the learning experience for an increasingly time-poor population of students. That is, the assessment process has the ability to deliver program objectives and active learning through a knowledge transfer process which increases student participation and engagement. This social constructivist view highlights the importance of peer review in assisting students to participate and collaborate as equal members of a community of scholars with both their peers and academic staff members. As a result of increasing the student’s desire to learn, peer review leads to more confident, independent and reflective learners who also become more skilled at making independent judgements of their own and others' work. Within this context, in Case Study One of this project, a summative, peer-assessed, weekly, assessment task was introduced in the first “serious” accounting subject offered as part of an undergraduate degree. The positive outcomes achieved included: student failure rates declined 15%; tutorial participation increased fourfold; tutorial engagement increased six-fold; and there was a 100% student-based approval rating for the retention of the assessment task. However, in stark contrast to the positive student response, staff issues related to the loss of research time associated with the administration of the peer-review process threatened its survival. This paper contributes to the core conference topics of new trends and experiences in undergraduate assessment education and in terms of innovative, on-line, learning and teaching practices, by elaborating the Case Study Two “solution” generated to this dilemma. At the heart of the resolution is an e-Learning, peer-review process conducted in conjunction with the University of Melbourne which seeks to both create a virtual sense of belonging and to efficiently and effectively meet academic learning objectives with minimum staff involvement. In outlining the significant level of success achieved, student-based qualitative and quantitative data will be highlighted along with staff views in a comparative analysis of the advantages and disadvantages to both students and staff of the staff-led, peer review process versus its on-line counterpart.

Moving beyond transition pedagogy: Maturity models and student engagement

Australian higher education institutions (HEIs) have entered a new phase of regulation and accreditation which includes performance-based funding relating to the participation and retention of students from social and cultural groups previously underrepresented in higher education. However, in addressing these priorities, it is critical that HEIs do not further disadvantage students from certain groups by identifying them for attention because of their social or cultural backgrounds, circumstances which are largely beyond the control of students. In response, many HEIs are focusing effort on university-wide approaches to enhancing the student experience because such approaches will enhance the engagement, success and retention of all students, and in doing so, particularly benefit those students who come from underrepresented groups. Measuring and benchmarking student experiences and engagement that arise from these efforts is well supported by extensive collections of student experience survey data. However no comparable instrument exists that measures the capability of institutions to influence and/or enhance student experiences where capability is an indication of how well an organisational process does what it is designed to do (Rosemann & de Bruin, 2005). This paper proposes that the concept of a maturity model (Marshall, 2010; Paulk, 1999) may be useful as a way of assessing the capability of HEIs to provide and implement student engagement, success and retention activities. We will describe the Student Engagement, Success and Retention Maturity Model (SESR-MM), (Clarke, Nelson & Stoodley, 2012; Nelson, Clarke & Stoodley, 2012) we are currently investigating. We will discuss if our research may address the current gap by facilitating the development of an SESR-MM instrument that aims (i) to enable institutions to assess the capability of their current student engagement and retention programs and strategies to influence and respond to student experiences within the institution; and (ii) to provide institutions with the opportunity to understand various practices across the sector with a view to further improving programs and practices relevant to their context. The first aim of our research is to extend the generational approach which has been useful in considering the evolutionary nature of the first year experience (FYE) (Wilson, 2009). Three generations have been identified and explored: First generation approaches that focus on co-curricular strategies (e.g. orientation and peer programs); Second generation approaches that focus on curriculum (e.g. pedagogy, curriculum design, and learning and teaching practice); and third generation approaches—also referred to as transition pedagogy—that focus on the production of an institution-wide integrated holistic intentional blend of curricular and co-curricular activities (Kift, Nelson & Clarke, 2010). The second aim of this research is to move beyond assessments of students’ experiences to focus on assessing institutional processes and their capability to influence student engagement. In essence, we propose to develop and use the maturity model concept to produce an instrument that will indicate the capability of HEIs to manage and improve student engagement, success and retention programs and strategies. References Australian Council for Educational Research. (n.d.). Australasian Survey of Student Engagement. Retrieved from http://www.acer.edu.au/research/ausse/background Clarke, J., Nelson, K., & Stoodley, I. (2012, July). The Maturity Model concept as framework for assessing the capability of higher education institutions to address student engagement, success and retention: New horizon or false dawn? A Nuts & Bolts presentation at the 15th International Conference on the First Year in Higher Education, “New Horizons,” Brisbane, Australia. Kift, S., Nelson, K., & Clarke, J. (2010) Transition pedagogy - a third generation approach to FYE: A case study of policy and practice for the higher education sector. The International Journal of the First Year in Higher Education, 1(1), pp. 1-20. Department of Education, Employment and Workplace Relations. (n.d.). The University Experience Survey. Advancing quality in higher education information sheet. Retrieved from http://www.deewr.gov.au/HigherEducation/Policy/Documents/University_Experience_Survey.pdf Marshall, S. (2010). A quality framework for continuous improvement of e-Learning: The e-Learning Maturity Model. Journal of Distance Education, 24(1), 143-166. Nelson, K., Clarke, J., & Stoodley, I. (2012). An exploration of the Maturity Model concept as a vehicle for higher education institutions to assess their capability to address student engagement. A work in progress. Submitted for publication. Paulk, M. (1999). Using the Software CMM with good judgment, ASQ Software Quality Professional, 1(3), 19-29. Wilson, K. (2009, June–July). The impact of institutional, programmatic and personal interventions on an effective and sustainable first-year student experience. Keynote address presented at the 12th Pacific Rim First Year in Higher Education Conference, “Preparing for Tomorrow Today: The First Year as Foundation,” Townsville, Australia. Retrieved from http://www.fyhe.com.au/past_papers/papers09/ppts/Keithia_Wilson_paper.pdf

Verifying a Student Engagement, Success and Retention Maturity Model (SESR-MM): A reality check of the model using data derived from three universities

Australian higher education institutions (HEIs) have entered a new phase of regulation and accreditation which includes performance-based funding relating to the participation and retention of students from social and cultural groups previously underrepresented in higher education. However, in addressing these priorities, it is critical that HEIs do not further disadvantage students from certain groups by identifying them for attention because of their social or cultural backgrounds, circumstances which are largely beyond the control of students. In response, many HEIs are focusing effort on university-wide approaches to enhancing the student experience because such approaches will enhance the engagement, success and retention of all students, and in doing so, particularly benefit those students who come from underrepresented groups. Measuring and benchmarking student experiences and engagement that arise from these efforts is well supported by extensive collections of student experience survey data. However no comparable instrument exists that measures the capability of institutions to influence and/or enhance student experiences where capability is an indication of how well an organisational process does what it is designed to do (Rosemann & de Bruin, 2005). We have proposed that the concept of a maturity model (Marshall, 2010; Paulk, 1999) may be useful as a way of assessing the capability of HEIs to provide and implement student engagement, success and retention activities and we are currently articulating a Student Engagement, Success and Retention Maturity Model (SESR-MM), (Clarke, Nelson & Stoodley, 2012; Nelson, Clarke & Stoodley, 2012). Our research aims to address the current gap by facilitating the development of an SESR-MM instrument that aims (i) to enable institutions to assess the capability of their current student engagement and retention programs and strategies to influence and respond to student experiences within the institution; and (ii) to provide institutions with the opportunity to understand various practices across the sector with a view to further improving programs and practices relevant to their context. Our research extends the generational approach which has been useful in considering the evolutionary nature of the first year experience (FYE) (Wilson, 2009). Three generations have been identified and explored: First generation approaches that focus on co-curricular strategies (e.g. orientation and peer programs); Second generation approaches that focus on curriculum (e.g. pedagogy, curriculum design, and learning and teaching practice); and third generation approaches—also referred to as transition pedagogy—that focus on the production of an institution-wide integrated holistic intentional blend of curricular and co-curricular activities (Kift, Nelson & Clarke, 2010). Our research also moves beyond assessments of students’ experiences to focus on assessing institutional processes and their capability to influence student engagement. In essence, we propose to develop and use the maturity model concept to produce an instrument that will indicate the capability of HEIs to manage and improve student engagement, success and retention programs and strategies. The issues explored in this workshop are (i) whether the maturity model concept can be usefully applied to provide a measure of institutional capability for SESR; (ii) whether the SESR-MM can be used to assess the maturity of a particular set of institutional practices; and (iii) whether a collective assessment of an institution’s SESR capabilities can provide an indication of the maturity of the institution’s SESR activities. The workshop will be approached in three stages. Firstly, participants will be introduced to the key characteristics of maturity models, followed by a discussion of the SESR-MM and the processes involved in its development. Secondly, participants will be provided with resources to facilitate the development of a maturity model and an assessment instrument for a range of institutional processes and related practices. In the final stage of the workshop, participants will “assess” the capability of these practices to provide a collective assessment of the maturity of these processes. References Australian Council for Educational Research. (n.d.). Australasian Survey of Student Engagement. Retrieved from http://www.acer.edu.au/research/ausse/background Clarke, J., Nelson, K., & Stoodley, I. (2012, July). The Maturity Model concept as framework for assessing the capability of higher education institutions to address student engagement, success and retention: New horizon or false dawn? A Nuts & Bolts presentation at the 15th International Conference on the First Year in Higher Education, “New Horizons,” Brisbane, Australia. Department of Education, Employment and Workplace Relations. (n.d.). The University Experience Survey. Advancing quality in higher education information sheet. Retrieved from http://www.deewr.gov.au/HigherEducation/Policy/Documents/University_Experience_Survey.pdf Kift, S., Nelson, K., & Clarke, J. (2010) Transition pedagogy - a third generation approach to FYE: A case study of policy and practice for the higher education sector. The International Journal of the First Year in Higher Education, 1(1), pp. 1-20. Marshall, S. (2010). A quality framework for continuous improvement of e-Learning: The e-Learning Maturity Model. Journal of Distance Education, 24(1), 143-166. Nelson, K., Clarke, J., & Stoodley, I. (2012). An exploration of the Maturity Model concept as a vehicle for higher education institutions to assess their capability to address student engagement. A work in progress. Submitted for publication. Paulk, M. (1999). Using the Software CMM with good judgment, ASQ Software Quality Professional, 1(3), 19-29. Wilson, K. (2009, June–July). The impact of institutional, programmatic and personal interventions on an effective and sustainable first-year student experience. Keynote address presented at the 12th Pacific Rim First Year in Higher Education Conference, “Preparing for Tomorrow Today: The First Year as Foundation,” Townsville, Australia. Retrieved from http://www.fyhe.com.au/past_papers/papers09/ppts/Keithia_Wilson_paper.pdf

Shut up and write! Facilitating informal learning in doctoral candidature

Doctoral candidates spend at least 2/3 of their degree outside of structured classroom instruction; most of their learning and writing takes place in their own time. Providing research degree candidates with writing help during their degree study is difficult. Candidates come into their degree with widely varying needs and levels of experience. Course work might seem to offer a way to create parity, but, according to the Australian Qualification Framework, mandated coursework can only occupy 1⁄3 of the degree

A model for enhancing assessment and teaching practice at the coalface : Insights from a Fellow-In-Residence engagement program

Australian universities are currently engaging with new governmental policies and regulations that require them to demonstrate enhanced quality and accountability in teaching and research. The development of national academic standards for learning outcomes in higher education is one such instance of this drive for excellence. These discipline-specific standards articulate the minimum, or Threshold Learning Outcomes, to be addressed by higher education institutions so that graduating students can demonstrate their achievement to their institutions, accreditation agencies, and industry recruiters. This impacts not only on the design of Engineering courses (with particular emphasis on pedagogy and assessment), but also on the preparation of academics to engage with these standards and implement them in their day-to-day teaching practice on a micro level. This imperative for enhanced quality and accountability in teaching is also significant at a meso level, for according to the Australian Bureau of Statistics, about 25 per cent of teachers in Australian universities are aged 55 and above and more than 54 per cent are aged 45 and above (ABS, 2006). A number of institutions have undertaken recruitment drives to regenerate and enrich their academic workforce by appointing capacity-building research professors and increasing the numbers of early- and mid-career academics. This nationally driven agenda for quality and accountability in teaching permeates also the micro level of engineering education, since the demand for enhanced academic standards and learning outcomes requires both a strong advocacy for a shift to an authentic, collaborative, outcomes-focused education and the mechanisms to support academics in transforming their professional thinking and practice. Outcomes-focused education means giving greater attention to the ways in which the curriculum design, pedagogy, assessment approaches and teaching activities can most effectively make a positive, verifiable difference to students’ learning. Such education is authentic when it is couched firmly in the realities of learning environments, student and academic staff characteristics, and trustworthy educational research. That education will be richer and more efficient when staff works collaboratively, contributing their knowledge, experience and skills to achieve learning outcomes based on agreed objectives. We know that the school or departmental levels of universities are the most effective loci of changes in approaches to teaching and learning practices in higher education (Knight & Trowler, 2000). Heads of Schools are being increasingly entrusted with more responsibilities - in addition to setting strategic directions and managing the operational and sometimes financial aspects of their school, they are also expected to lead the development and delivery of the teaching, research and other academic activities. Guiding and mentoring individuals and groups of academics is one critical aspect of the Head of School’s role. Yet they do not always have the resources or support to help them mentor staff, especially the more junior academics. In summary, the international trend in undergraduate engineering course accreditation towards the demonstration of attainment of graduate attributes poses new challenges in addressing academic staff development needs and the assessment of learning. This paper will give some insights into the conceptual design, implementation and empirical effectiveness to date, of a Fellow-In-Residence Engagement (FIRE) program. The program is proposed as a model for achieving better engagement of academics with contemporary issues and effectively enhancing their teaching and assessment practices. It will also report on the program’s collaborative approach to working with Heads of Schools to better support academics, especially early-career ones, by utilizing formal and informal mentoring. Further, the paper will discuss possible factors that may assist the achievement of the intended outcomes of such a model, and will examine its contributions to engendering an outcomes-focussed thinking in engineering education.

Examining the Assessment Opportunities for Cultural Connectedness for Student Learning : A Sociocultural Analysis

The disparity that exists between the highest and lowest achievers together with deficit approaches to teaching, learning and assessment raise serious equity issues related to fairness, validity, culture and access, which were analysed in a recent Australian Research Council funded project. This chapter explores the potential that exists for teachers to work with Indigenous Teacher Assistants (ITAs) to secure cultural connectedness in teaching, learning and assessment of Indigenous students. The study was a design experiment, which was conducted in seven Catholic and Independent primary schools in northern Queensland and involved semi-structured focus group interviews with Year 4 and 6 Indigenous students, principals, teachers and Indigenous Teacher Assistants. Classroom observations and document analyses were also conducted. This corpus of data was analysed using a sociocultural theoretical lens. The use of a sociocultural analysis helped to identify cultural influences, Indigenous students’ funds of knowledge and values. The information from this analysis was made explicit to teachers to demonstrate how they could enhance their pedagogic and assessment practices by embracing and extending the cultural spaces for learning and teaching of Indigenous students. The way in which teachers construct their interactions for greater cultural connectedness and enhanced learning would appear to rely on relationship building with Indigenous staff, Indigenous students’ cultural knowledge, and improved understanding of assessment and related equity issues.

Assessment as a Generative Dance : Connecting Teaching, Learning and Curriculum

This chapter focuses on learning and assessment as social and cultural practices situated within national and international policy contexts of educational change. Classroom assessment was researched using a conceptualization of knowing in action, or the ‘generative dance’. Fine-grained analyses of interactivity between students, and between teacher and student/s, and their patterns of participation in assessment and learning were conducted. The findings offer original insights into how learners draw on explicit and tacit forms of knowing in order to successfully participate in learning. Assessment is re-imagined as a dynamic space in which teachers learn about their students as they learn with their students, and where all students can be empowered to find success.

Reconstructing places and spaces in blended work integrated learning

This paper considers the emergence and ongoing development of an embedded, studentnegotiated work placement model of Work Integrated Learning (WIL) in the engineering and built environment disciplines at an Australian metropolitan university. The characteristics of the model and a continuous improvement strategy are provided. The model is characterised by large student cohorts independently sourcing and negotiating relevant work placements and completing at least one, mandatory credit-bearing WIL unit. Through ongoing analyses and evaluation of the model more experiential and collaborative learning approaches have been adopted. This has included the creation of blended learning spaces using technology. The paper focuses on the five year journey travelled by the teaching team as they embarked on ways to improve curriculum, pedagogy, administrative processes and assessment - effectively relocating much of their interaction with students online. The insights derived from this rich, single case study should be of interest to others considering alternative ways of responding to increasing student enrolments in WIL and the impact of blended learning in this context.

Psycho-educational assessment of specific learning disabilities: Views and practices of Australian psychologists and guidance counsellors

This paper reports an investigation of the views and practices of 203 Australian psychologists and guidance counsellors with respect to psycho-educational assessment of students with Specific Learning Disabilities (SLDs). Results from an online survey indicated that practitioners draw upon a wide-range of theoretical perspectives when conceptualising and identifying SLDs, including both response to intervention and IQ – achievement discrepancy models. Intelligence tests (particularly the Wechsler scales) are commonly employed, with the main stated reasons for their use being ‘traditional’ perspectives (including IQ-achievement discrepancy-based definitions of SLDs), to exclude a diagnosis of intellectual disability, and to guide further assessment and intervention. In contrast participants reported using measures of academic achievement and tests of specific cognitive deficits known to predict SLDs (e.g., phonological awareness) relatively infrequently.

How small business advisory program delivery methods (collective learning, tailored, and practice-based approaches) affect learning and innovation

Past studies relate small business advisory program effectiveness to advisory characteristics such as advisory intensity and scope. We contribute to existing literature by seeking to identify the impact of different advisory program methods of delivery on learning and subsequent firm innovation behavior. Our research is based on a survey of 257 Australian firms completing small business advisory programs in the three years preceding the research. We explore the range of small business advisory program delivery methods in which our surveyed firms participated and, with reference to the literature on organizational learning and innovation, we analyze predictors of firms' learning ability and innovativeness based on the identified delivery methods. First, we found that business advisory programs that involved high levels of collective learning and tailored approaches enhanced firms' perceptions of their learning of critical skills or capabilities. We also found that small business advisory programs that were delivered by using practice-based approaches enhanced firms' subsequent organizational innovation. We verified this finding by testing whether firms that have participated in small business advisory services subsequently demonstrate improved behavior in terms of organizational innovativeness, when compared with matched firms that have not participated in an advisory program.

Robots, the internet and teaching history in the age of the NBN and the Australian curriculum

Have you ever wished you were Doctor Who and could pop yourself and your students into a Tardis and teleport them to an historical event or to meet a historical figure? We all know that unfortunately time travel is not (yet) possible, but maybe student and teacher teleportation just might be – sort of. Over the past few centuries and in lieu of time travel our communities have developed museums as a means of experiencing some of our history...

Perspectives on Australian, Indian and Malaysian approaches to STEM education

STEM education faces an interesting conundrum. Western countries have implemented constructivist inspired student centred practices which are argued to be more engaging and relevant to student learning than the traditional, didactic approaches. However, student interest in pursuing careers in STEM have fallen or stagnated. In contrast, students in many developing countries in which teaching is still somewhat didactic and teacher centred are more disposed to STEM related careers than their western counterparts. Clearly, factors are at work which impact the way students value science and mathematics. This review draws on three components that act as determinants of science education in three different countries – Australia, India and Malaysia. We explore how national priorities and educational philosophy impacts educational practices as well as teacher beliefs and the need for suitable professional development. Socio-economic conditions for science education that are fundamental for developing countries in adopting constructivist educational models are analysed. It is identified that in order to reduce structural dissimilarities among countries that cause fragmentation of scientific knowledge, for Malaysia constructivist science education through English medium without losing the spirit of Malaysian culture and Malay language is essential while India need to adopt constructivist quality indicators in education. While adopting international English education, and reducing dominance of impact evaluation, India and Malaysia need to prevent losing their cultural and social capital vigour. Furthermore the paper argues that Australia might need to question the efficacy of current models that fail to engage students’ long term interest in STEM related careers. Australian and Malaysian science teachers must be capable of changing the personal biographies of learners for developing scientific conceptual information. In addition both Malaysia and Australia need to provide opportunities for access to different curricular programmes of knowledge based constructivist learning for different levels of learner competencies.

Recognising change and seeking affirmation: Themes for embeddding Indigenous knowledges on teaching practicum

The imperative for Indigenous education in Australia is influenced by national political, social and economic discourses as Australian education systems continue to grapple with an agreed aspiration of full participation for Aboriginal and Torres Strait Islander students. Innovations within and policies guiding our education systems are often driven by agendas of reconciliation, equity, equality in participation and social justice. In this paper, we discuss key themes that emerged from a recent Australian Office for Learning and Teaching (OLT) research project which investigated ways in which preservice teachers from one Australian university embedded Indigenous knowledges (IK) on teaching practicum . Using a phenomenological approach, the case involved 25 preservice teacher and 23 practicum supervisor participants, over a 30 month investigation. Attention was directed to the nature of subjective (lived) experiences of participants in these pedagogical negotiations and thus preservice and supervising teacher voice was actively sought in naming and analysing these experiences. Findings revealed that change, knowledge, help and affirmation were key themes for shaping discourses around Indigenous knowledges and perspectives in the Australian curriculum and defined the nature of the pedagogical relationships between novice and experienced teachers. We focus particularly on the need for change and affirmation by preservice teachers and their teaching practicum supervisors as they developed their pedagogical relationships whilst embedding Indigenous knowledges in learning and teaching.

Exploring the experiences and conceptions of good teaching in higher education : Development of a questionnaire for assessing students' approaches to learning and experiences of the teaching-learning environment

The aim of this dissertation was to adapt a questionnaire for assessing students’ approaches to learning and their experiences of the teaching-learning environment. The aim was to explore the validity of the modified Experiences of Teaching and Learning Questionnaire (ETLQ) by examining how the instruments measure the underlying dimensions of student experiences and their learning. The focus was on the relation between students’ experiences of their teaching-learning environment and their approaches to learning. Moreover, the relation between students’ experiences and students’ and teachers’ conceptions of good teaching was examined. In Study I the focus was on the use of the ETLQ in two different contexts: Finnish and British. The study aimed to explore the similarities and differences between the factor structures that emerged from both data sets. The results showed that the factor structures concerning students’ experiences of their teaching-learning environment and their approaches to learning were highly similar in the two contexts. Study I also examined how students’ experiences of the teaching-learning environment are related to their approaches to learning in the two contexts. The results showed that students’ positive experiences of their teaching-learning environment were positively related to their deep approach to learning and negatively to the surface approach to learning in both the Finnish and British data sets. This result was replicated in Study II, which examined the relation between approaches to learning and experiences of the teaching-learning environment on a group level. Furthermore, Study II aimed to explore students’ approaches to learning and their experiences of the teaching-learning environment in different disciplines. The results showed that the deep approach to learning was more common in the soft sciences than in the hard sciences. In Study III, students’ conceptions of good teaching were explored by using qualitative methods, more precisely, by open-ended questions. The aim was to examine students’ conceptions, disciplinary differences and their relation to students’ approaches to learning. The focus was on three disciplines, which differed in terms of students’ experiences of their teaching-learning environment. The results showed that students’ conceptions of good teaching were in line with the theory of good teaching and there were disciplinary differences in their conceptions. Study IV examined university teachers’ conceptions of good teaching, which corresponded to the learning-focused approach to teaching. Furthermore, another aim in this doctoral dissertation was to compare the students’ and teachers’ conceptions of good teaching, the results of which showed that these conceptions appear to have similarities. The four studies indicated that the ETLQ appears to be a sufficiently robust measurement instrument in different contexts. Moreover, its strength is its ability to be at the same time a valid research instrument and a practical tool for enhancing the quality of students’ learning. In addition, the four studies emphasise that in order to enhance teaching and learning in higher education, various perspectives have to be taken into account. This study sheds light on the interaction between students’ approaches to learning, their conceptions of good teaching, their experiences of the teaching-learning environment, and finally, the disciplinary culture.