Harnessing assessment and feedback in the first year to support learning success, engagement and retention

It has been argued that intentional first year curriculum design has a critical role to play in enhancing first year student engagement, success and retention (Kift, 2008). A fundamental first year curriculum objective should be to assist students to make the successful transition to assessment in higher education. Scott (2006) has identified that ‘relevant, consistent and integrated assessment … [with] prompt and constructive feedback’ are particularly relevant to student retention generally; while Nicol (2007) suggests that ‘lack of clarity regarding expectations in the first year, low levels of teacher feedback and poor motivation’ are key issues in the first year. At the very minimum, if we expect first year students to become independent and self-managing learners, they need to be supported in their early development and acquisition of tertiary assessment literacies (Orrell, 2005). Critical to this attainment is the necessity to alleviate early anxieties around assessment information, instructions, guidance, and performance. This includes, for example:  inducting students thoroughly into the academic languages and assessment genres they will encounter as the vehicles for evidencing learning success; and  making expectations about the quality of this evidence clear. Most importantly, students should receive regular formative feedback of their work early in their program of study to aid their learning and to provide information to both students and teachers on progress and achievement. Leveraging research conducted under an ALTC Senior Fellowship that has sought to articulate a research-based 'transition pedagogy' (Kift & Nelson, 2005) – a guiding philosophy for intentional first year curriculum design and support that carefully scaffolds and mediates the first year learning experience for contemporary heterogeneous cohorts – this paper will discuss theoretical and practical strategies and examples that should be of assistance in implementing good assessment and feedback practices across a range of disciplines in the first year.

Ensuring student success : the role of support services in improving the quality of the student learning experience

This paper is based on the premise that universities have an obligation to provide adequate student support services, such as learning assistance (that is, assistance with academic writing and other study skills) and that in order to be effective such services must be responsive to the wider policy and social implications of student attrition and retention. The paper outlines briefly some of the factors that have influenced the development of learning assistance practices in Australia and America. This is followed by an account of experiences at one Australian metropolitan university where learning assistance service provision shifted from a decentralised, faculty-based model to a centralised model of service delivery. This shift was in response to concerns about lack of quality and consistency in a support model dependent upon faculty resources yet a follow up study identified other problems in the centralised delivery of learning assistance services. These problems, clustered under the heading contextualised versus decontextualised learning assistance, include the relevance of generic learning assistance services to students struggling with specific course related demands; the apparent tensions between challenging students and assisting students at risk of failure; and variations in the level of collaboration between learning advisers and academic staff in supporting students in the learning environment. These problems are analysed using the theoretical modelling derived from the tools made available through cultural historical activity theory and expansive visibilisation (Engeström & Miettinen, 1999).

A transition pedagogy for student engagement and first-year learning, success and retention

This chapter argues that higher education institutions (HEIs) must direct coordinated, whole-of-institution attention to changing, both culturally and structurally, the fundamental and prevailing character of the first-year experience (FYE). It leverages evidence from the sector(Nelson, Kift and Clarke, 2011), from research-led practice in our institution (for example, Kift, Nelson and Clarke, 2010; Nelson et al.,in press) and from research conducted under an Australian Learning and Teaching Council Senior Fellowship (Kift, 2009a, 2009b, 2009c) to assert that student engagement and success should not be left to chance, particularly those aspects such as curriculum design and enactment that are within our institutional control.

Critical success elements for the design and implementation of organisational e-learning

Organisations are engaging in e-learning as a mechanism for delivering flexible learning to meet the needs of individuals and organisations. In light of the increasing use and organisational investment in e-learning, the need for methods to evaluate the success of its design and implementation seems more important than ever. To date, developing a standard for the evaluation of e-learning appears to have eluded both academics and practitioners. The currently accepted evaluation methods for e-learning are traditional learning and development models, such as Kirkpatrick’s model (1976). Due to the technical nature of e-learning it is important to broaden the scope and consider other evaluation models or techniques, such as the DeLone and McLean Information Success Model, that may be applicable to the e-learning domain. Research into the use of e-learning courses has largely avoided considering the applicability of information systems research. Given this observation, it is reasonable to conclude that e-learning implementation decisions and practice could be overlooking useful or additional viewpoints. This research investigated how existing evaluation models apply in the context of organisational e-learning, and resulted in an Organisational E-learning success Framework, which identifies the critical elements for success in an e-learning environment. In particular this thesis highlights the critical importance of three e-learning system creation elements; system quality, information quality, and support quality. These elements were explored in depth and the nature of each element is described in detail. In addition, two further elements were identified as factors integral to the success of an e-learning system; learner preferences and change management. Overall, this research has demonstrated the need for a holistic approach to e-learning evaluation. Furthermore, it has shown that the application of both traditional training evaluation approaches and the D&M IS Success Model are appropriate to the organisational e-learning context, and when combined can provide this holistic approach. Practically, this thesis has reported the need for organisations to consider evaluation at all stages of e-learning from design through to implementation.

Critical success factors in distance learning construction programs at Central Queensland University : students’ perspective

Distance education has gone through rapid expansion over the years. Many Australian universities are pushing the use of distance education in delivering construction education programs. However, the critical success factors (CSFs) in distance learning construction programs (DLCPs) are not fully understood. More importantly, students’ demographic features may affect the selection of distance education technologies. Situation-matching strategies should therefore be taken by universities or institutions with different student cohorts. A survey is adopted in Central Queensland University (CQU) to identify and rank the critical success factors in a DLCP in Australia where there is a significant number of earner-learners and students with low socioeconomic background. The findings suggest that the most important CSFs include access to computers and internet, reliability of web-based learning sites, high relevance and clarity of learning materials and assessment items, the availability of web-based learning sites that can be easily manipulated, and the capability of the instructors to provide well-structured courses. The findings also suggest that students with low socioeconomic background have more rigorous requirements on interface design, instructors’ support, and the integration of practical components into courses. The results provide good guidance of the design and delivery of DLCPs and will be useful for universities and institutions that are seeking to implement the distance mode in construction education.

Success factors of engaging higher education students and staff with e-learning tools within Learning Management Systems

This thesis explored the state of the use of e-learning tools within Learning Management Systems in higher education and developed a distinct framework to explain the factors influencing users' engagement with these tools. The study revealed that the Learning Management System design, preferences for other tools, availability of time, lack of adequate knowledge about tools, pedagogical practices, and social influences affect the uptake of Learning Management System tools. Semi structured interviews with 74 students and lecturers of a major Australian university were used as a source of data. The applied thematic analysis method was used to analyse the collected data.

Unlocking the learning potential of incarcerated Indigenous and low SES young people; Mathematics outcomes for future success: a discussion paper

This presentation provides a beginning discussion about what the literature reports about incarcerated young people. Incarcerated Indigenous and low SES young people typically have very low literacy and mathematics skills which precludes them from future education and or employment opportunities, thus continuing the cycle of disadvantage, exclusion and despair(Payne, 2007). Being locked out of learning, they are stuck in a cycle of underachievement, a scenario which contributes to unacceptably high levels of recidivism(ACER, 2014). Success at education is considered an important protective factor against delinquent behaviours such as offending, substance abuse and truancy. Youth education and training centres provide educational opportunities for the incarcerated Indigenous youth but achievement continues to be lower than expected, particularly in mathematics. This presentation provides an introductory literature review focusing on incarcerated young people and education. It is also the preliminary writing for a small pilot project currently being conducted in one Youth Education and Training Centre in Australia.

It's all in the Team: Collaborations driving success in learning – a first year case

First year medical laboratory science students (up to 120) undertake a group e-poster project, based in a blended learning model Google Drive, encompassing Google’s cloud computing software, provides a readily accessible, transparent online space for students to collaborate with each other and realise tangible outcomes from their learning The Cube provides an inspiring digital learning display space for student ‘conference style’ presentations

The use of animation to promote student learning about the importance of mental well-being for tertiary study success

It is now widely acknowledged that student mental well-being is a critical factor in the tertiary student learning experience and is important to student learning success. The issue of student mental well-being also has implications for effective student transition out of university and into the world of work. It is therefore vital that intentional strategies are adopted by universities both within the formal curriculum, and outside it, to promote student well-being and to work proactively and preventatively to avoid a decline in student psychological well-being. This paper describes how the Queensland University of Technology Law School is using animation to teach students about the importance for their learning success of the protection of their mental well-being. Mayer and Moreno (2002) define an animation as an external representation with three main characteristics: (1) it is a pictorial representation, (2) it depicts apparent movement, and (3) it consists of objects that are artificially created through drawing or some other modelling technique. Research into the effectiveness of animation as a tool for tertiary student learning engagement is relatively new and growing field of enquiry. Nash argues, for example, that animations provide a “rich, immersive environment [that] encourages action and interactivity, which overcome an often dehumanizing learning management system approach” (Nash, 2009, 25). Nicholas states that contemporary millennial students in universities today, have been immersed in animated multimedia since their birth and in fact need multimedia to learn and communicate effectively (2008). However, it has also been established, for example through the work of Lowe (2003, 2004, 2008) that animations can place additional perceptual, attentional, and cognitive demands on students that they are not always equipped to cope with. There are many different genres of animation. The dominant style of animation used in the university learning environment is expository animation. This approach is a useful tool for visualising dynamic processes and is used to support student understanding of subjects and themes that might otherwise be perceived as theoretically difficult and disengaging. It is also a form of animation that can be constructed to avoid any potential negative impact on cognitive load that the animated genre might have. However, the nature of expository animation has limitations for engaging students, and can present as clinical and static. For this reason, the project applied Kombartzky, Ploetzner, Schlag, and Metz’s (2010) cognitive strategy for effective student learning from expository animation, and developed a hybrid form of animation that takes advantage of the best elements of expository animation techniques along with more engaging short narrative techniques. First, the paper examines the existing literature on the use of animation in tertiary educational contexts. Second, the paper describes how animation was used at QUT Law School to teach students about the issue of mental well-being and its importance to their learning success. Finally, the paper analyses the potential of the use of animation, and of the cognitive strategy and animation approach trialled in the project, as a teaching tool for the promotion of student learning about the importance of mental well-being.

Recipe for success — Lessons learnt from using xAPI within the Connected Learning Analytics toolkit

An ongoing challenge for Learning Analytics research has been the scalable derivation of user interaction data from multiple technologies. The complexities associated with this challenge are increasing as educators embrace an ever growing number of social and content related technologies. The Experience API (xAPI) alongside the development of user specific record stores has been touted as a means to address this challenge, but a number of subtle considerations must be made when using xAPI in Learning Analytics. This paper provides a general overview to the complexities and challenges of using xAPI in a general systemic analytics solution - called the Connected Learning Analytics (CLA) toolkit. The importance of design is emphasised, as is the notion of common vocabularies and xAPI Recipes. Early decisions about vocabularies and structural relationships between statements can serve to either facilitate or handicap later analytics solutions. The CLA toolkit case study provides us with a way of examining both the strengths and the weaknesses of the current xAPI specification, and we conclude with a proposal for how xAPI might be improved by using JSON-LD to formalise Recipes in a machine readable form.

University Students' Approaches to Learning, Self-Regulation, and Cognitive and Attributional Strategies : Connections with Well-Being and Academic Success

This dissertation empirically explores the relations among three theoretical perspectives: university students approaches to learning, self-regulated learning, as well as cognitive and attributional strategies. The relations were quantitatively studied from both variable- and person-centered perspectives. In addition, the meaning that students gave to their disciplinary choices was examined. The general research questions of the study were: 1) What kinds of relationships exist among approaches to learning, regulation of learning, and cognitive and attributional strategies? What kinds of cognitive-motivational profiles can be identified among university students, and how are such profiles related to study success and well-being? 3) How do university students explain their disciplinary choices? Four empirical studies addressed these questions. Studies I, II, and III were quantitative, applying self-report questionnaires, and Study IV was qualitative in nature. Study I explored relations among cognitive strategies, approaches to learning, regulation of learning, and study success by using correlations and a K-means cluster analysis. The participants were 366 students from various faculties at different phases of their studies. The results showed that all the measured constructs were logically related to each other in both variable- and person-centered approaches. Study II further examined what kinds of cognitive-motivational profiles could be identified among first-year university students (n=436) in arts, law, and agriculture and forestry. Differences in terms of study success, exhaustion, and stress among students with differing profiles were also looked at. By using a latent class cluster analysis (LCCA), three groups of students were identified: non-academic (34%), self-directed (35%), and helpless students (31%). Helpless students reported the highest levels of stress and exhaustion. Self-directed students received the highest grades. In Study III, cognitive-motivational profiles were identified among novice teacher students (n=213) using LCCA. Well-being, epistemological beliefs, and study success were looked at in relation to the profiles. Three groups of students were found: non-regulating (50%), self-directed (35%), and non-reflective (22%). Self-directed students again received the best grades. Non-regulating students reported the highest levels of stress and exhaustion, the lowest level of interest, and showed the strongest preference for certain and practical knowledge. Study IV, which was qualitative in nature, explored how first-year students (n = 536 ) in three fields of studies, arts, law, and veterinary medicine explained their disciplinary choices. Content analyses showed that interest appeared to be a common concept in students description of their choices across the three faculties. However, the objects of interest of the freshmen appeared rather unspecified. Veterinary medicine and law students most often referred to future work or a profession, whereas only one-fifth of the arts students did so. The dissertation showed that combining different theoretical perspectives and methodologies enabled us to build a rich picture of university students cognitive and motivational predispositions towards studying and learning. Further, cognitive-emotional aspects played a significant role in studying, not only in relation to study success, but also in terms of well-being. Keywords: approaches to learning, self-regulation, cognitive and attributional strategies, university students

Case study: Improving success by flipping the learning

Case study on Hull College and how they have maximised student enjoyment and success in construction, engineering and motor vehicle programmes to a further four vocational areas.

Creating a Space for Self-Transformation: Factors of Success for Adult Literacy Learners with Specific Learning Difficulties

A significant number of adults in adult literacy programs in Ontario have specific learning difficulties. This study sought to examine the holistic factors that contributed to these learners achieving their goals. Through a case study design, the data revealed that a combination of specific learning methods and strategies, along with particular characteristics of the instructor, participant, and class, and the evidence of self-transformation all seemed to contribute to the participant's success in the program. Instructor-directed teaching and cooperative learning were the main learning methods used in the class. General learning strategies employed were the use of core curriculum and authentic documents, and using phonics, repetition, assistive resources, and using activities that appealed to various learning styles. The instructor had a history of both professional development in the area of learning disabilities as well as experience working with learners who had specific learning difficulties. There also seemed to be a goodness of fit between the participant and the instructor. Several characteristics of the participant seemed to aid in his success: his positive self-esteem, self-advocacy skills, self-determination, self-awareness, and the fact that he enjoyed learning. The size (3-5 people) and type of class (small group) also seemed to have an impact. Finally, evidence that the participant went through a self-transformation seemed to contribute to a positive learner identity. These results have implications for practice, theory, and further research in adult education.

How Learning Styles, Chemistry Attitudes and Experiences, Confidence, and Demographics Correlate with Academic Success in First and Second Year Chemistry Courses

At Brock University, the Faculty of Mathematics and Science currently has one of the highest percentages of students on academic probation, with many students reporting the most difficulty with Introductory Chemistry in first year and Organic Chemistry in second year. To identify strategies to improve students' performance and reduce the number of students on academic probation, a multi-year research project was undertaken involving several chemistry courses. Students were asked to complete three questionnaires, and provide consent to obtain their final Chemistry grade from the Registrar's Office. Research began at the end of the 2007-08 academic year with CHEM IPOO, and in the 2008-09 academic year, students in the larger CHEM IF92 Introductory Chemistry course were invited to participate in this research near the beginning of the academic year. Students who went on to take second year Organic and Analytical Chemistry were asked to complete these questionnaires in each second year course. The three questionnaires included the Kolb Learning Styles Inventory (Kolb, 1984) modified to include specific reference to Chemistry in each question, Dalgety, ColI, and Jones' (2002) Chemistry Attitudes and Experiences Questionnaire (CAEQ), and lastly, a demographic survey. Correlations were found between learning style and academic success; concrete learners were not as successful as abstract learners. Differences were noted between females and males with respect to learning styles, academic success, and confidence. Several differences were also noted between those who are the First in the Family to attend university and those who are not First in the Family to attend university.