The impact of learning outcomes in business education: assessing value, relevance and graduate ability in a multi-country study of employers and business graduates

This paper discusses critical findings from a two-year EU-funded research project involving four European countries: Austria, England, Slovenia and Romania. The project had two primary aims. The first of these was to develop a systematic procedure for assessing the balance between learning outcomes acquired in education and the specific needs of the labour market. The second aim was to develop and test a set of meta-level quality indicators aimed at evaluating the linkages between education and employment. The project was distinctive in that it combined different partners from Higher Education, Vocational Training, Industry and Quality Assurance. One of the key emergent themes identified in exploratory interviews was that employers and recent business graduates in all four countries want a well-rounded education which delivers a broad foundation of key business knowledge across the various disciplines. Both groups also identified the need for personal development in critical skills and competencies. Following the exploratory study, a questionnaire was designed to address five functional business areas, as well as a cluster of 8 business competencies. Within the survey, questions relating to the meta-level quality indicators assessed the impact of these learning outcomes on the workplace, in terms of the following: 1) value, 2) relevance and 3) graduate ability. This paper provides an overview of the study findings from a sample of 900 business graduates and employers. Two theoretical models are proposed as tools for predicting satisfaction with work performance and satisfaction with business education. The implications of the study findings for education, employment and European public policy are discussed.

Maximizing Hospitality Learning Outcomes: An Integrated Experiential In-Class Approach

This study explored the influence of an experiential, in-class approach to the hospitality curriculum as a means of increasing its efficiency and effectiveness. Specifically, the study provides an example of how hospitality faculty might utilize an experiential, in-class approach to integrate additional hospitality-specific content along with process and content issues for working in teams and team decision-making. The results of this study support the efficient and effective use of an experiential inclass teaching method. The value of this study is twofold: (1) it provides an initial test of this approach’s usefulness and (2) it provides a forum for continued conversations of how experiential approaches can be utilized to enhance and reinforce other hospitality content and managerial skills and to bridge the gap between vocational and liberal education outcomes.

The impact of pre -training interventions on cognitive, skill, and affective learning outcomes: A meta -analytic examination of four decades of research

Technological advancements and the ever-evolving demands of a global marketplace may have changed the way in which training is designed, implemented, and even managed, but the ultimate goal of organizational training programs remains the same: to facilitate learning of a knowledge, skill, or other outcome that will yield improvement in employee performance on the job and within the organization (Colquitt, LePine, & Noe, 2000; Tannenbaum & Yukl, 1992). Studies of organizational training have suggested medium to large effect sizes for the impact of training on employee learning (e.g., Arthur, Bennett, Edens, & Bell, 2003; Burke & Day, 1986). However, learning may be differentially affected by such factors as the (1) level and type of preparation provided prior to training, (2) targeted learning outcome, (3) training methods employed, and (4) content and goals of training (e.g., Baldwin & Ford, 1988). A variety of pre-training interventions have been identified as having the potential to enhance learning from training and practice (Cannon-Bowers, Rhodenizer, Salas, & Bowers, 1998). Numerous individual studies have been conducted examining the impact of one or more of these pre-training interventions on learning. ^ I conducted a meta-analytic examination of the effect of these pre-training interventions on cognitive, skill, and affective learning. Results compiled from 359 independent studies (total N = 37,038) reveal consistent positive effects for the role of pre-training interventions in enhancing learning. In most cases, the provision of a pre-training intervention explained approximately 5–10% of the variance in learning, and in some cases, explained up to 40–50% of variance in learning. Overall attentional advice and meta-cognitive strategies (as compared with advance organizers, goal orientation, and preparatory information) seem to result in the most consistent learning gains. Discussion focuses on the most beneficial match between an intervention and the learning outcome of interest, the most effective format of these interventions, and the most appropriate circumstances under which these interventions should be utilized. Also highlighted are the implications of these results for practice, as well as propositions for important avenues for future research. ^

Undergraduate Students’ Perceptions of Study Abroad and Their Level of Achievement of Global Learning Outcomes

This study expanded on current research on study abroad and global learning, using the Global Perspective Inventory (GPI), and conducted at Florida International University (FIU) in Miami, FL. The GPI assesses the holistic development of a global perspective in higher education within three domains and their respective FIU-determined equivalents: cognitive (global awareness), intrapersonal (global perspective), and interpersonal (global engagement). The main purpose of this study was to assess FIU’s undergraduate students’ perceptions of study abroad on their level of achievement of global awareness, global perspective, and global engagement. The secondary purpose was to determine how the students described their study abroad experience and achievement of global learning. The research design for this study consisted of parallel mixed methods. The quantitative component was an ex post facto with hypothesis design, using a pretest/posttest nonequivalent group methodology. FIU undergraduates (N=147) who studied abroad for one semester or more completed the GPI pre- and post-tests. Descriptive statistics and paired t-tests were conducted to compare the means. The interviews included 10 students, and were analyzed through Structural coding, Saldaña’s In Vivo coding, and Value coding. Quantitative analyses indicated positive changes in the students’ global awareness and global perspective. These analyses also showed that the FIU students achieved higher post-test means on all the domains of the GPI compared to other studies. Qualitative analyses showed that the students’ experiences incorporated all three global learning outcomes, most notably global awareness and perspective.

Developement and evidencing achievement of graduate learning outcomes in Deakin University's enhanced mooc

There is now a plethora of Massive Open On-line courses (MOOCs) offered worldwide. Whilst many MOOCs focus on discipline-specific content, little attention has been paid to how MOOCs can explicitly help participants develop generic employability skills such as communication, digital literacy, global citizenship and the like. Similarly little attention been paid to explicitly assuring the quality of MOOCs with respect to alignment with regulatory body standards. Deakin University's first MOOC, DeakinPrimer, is an introduction to humanitarian responses to 21st century disasters. It has been designed to assist participants to explicitly evidence generic or employability skills, some of Deakin's eight Graduate Learning Outcomes (GLOs) including communication, digital literacy, critical thinking and global citizenship. Other key features of DeakinPrimer include opportunities for networking with fellow participants and experts within the humanitarian field, and the opportunity to apply for credit towards the Graduate Certificate in International Community Development (level 8 in the Australian Qualifications Framework [AQF]) and for those with a prior Bachelor degree, the Masters in Humanitarian Assistance or the Masters of International Community Development (level 9 in the AQF). DeakinPrimer is designed as a test bed for a learning innovation, particularly micro-credentialing GLOs using digital badges to enable self and peer endorsement of evidence of learning. Badging is integrated in two ways. Firstly, DeakinPrimer participants build portfolios of learning artefacts associated with learning activities, then assess their work against a set of holistic, generic learning outcomes standards rubrics. If they judge their evidence as meeting the required standard, they can claim a badge (self endorsement) associated with particular GLOs. Secondly, participants can request and provide peer feedback and endorsement (using peer badges). The integration of self and peer review in the assessment tasks helps participants develop important employability skills, the ability to critically self-reflect on their own work and critically analyse the work of others and provide evidence-based feedback. DeakinPrimer is scheduled to commence in July 2013. This paper explains the way in which the course curricula has been designed to use technologies to enable participants to curate evidence of learning, and self and peer endorse such learning against defined standards.

Evaluation of student learning outcomes in fourth year engineering mechatronics through design based learning curriculum

This paper focuses on evaluation of student learning outcomes in fourth year engineering mechatronics through design based learning curriculum. The purpose of all engineering degrees is to provide strong grounding with principles of engineering science and technology. By learning engineering methods and approaches in an academic environment, graduates can enter the world of work and tackle real world problems with innovation and creativity. In many cases, academic staff are responsible for driving and setting high expectations in their classrooms. Sometimes staff are expected to teach subjects outside their expertise. This research paper is concerned with evaluating student learning outcomes through feedback sought from students on design-based learning approach.

Good practice guidelines for curriculum, supervision and assessment of final year engineering projects and AQF8 learning outcomes

Undergraduate engineering programs require final year students to complete capstone final year projects and demonstrate that they can integrate knowledge, skills and professional graduate attributes developed during the program at Australian Qualification Framework, level 8 (AQF8) outcomes. Literature shows that currently there is no guarantee of consistency for curriculum, supervision and assessment practices of FYEPs. Practices differ greatly between universities and littlework has been initiated that seeks to identify good practice, highlighting the need for the development of guidelines for curriculum, supervision and assessment of FYEPs. This workshop is designed to share and disseminate the good practice guidelines that have been developed on curriculum, supervision and assessment of Final Year Engineering Projects as a part of phase 2 of the project ‘Assessing Final Year Engineering Projects (FYEPs): Ensuring Learning and Teaching Standards and AQF8 Outcomes’ funded by the Australian Office for Learning and Teaching (OLT) with people working in the area of FYEPs. The guidelines typically apply to four year undergraduate engineering degrees with embedded Honours and support achievement of AQF8learning outcomes. The project team has 7 partner Universities – Central Queensland University (the lead), University of Technology Sydney, University of Adelaide, Curtin University, Deakin University, University of Tasmania and RMIT University.Participants will be invited to reflect on and evaluate guidelines and findings derived from FYEP coordinators, supervisors and the wider literature and to consider the ways in which these findings might lead to improvements in their practice.

Identifying pedagogy and teaching strategies for achieving nationally prescribed learning outcomes

With the globalisation of university education, national frameworks are commonly used to prescribe standardised learning outcomes and achieve accountability. However, these frameworks are generally not accompanied by guiding pedagogy to support academics in adjusting their teaching practices to achieve the set outcomes. This paper reports the results of a scoping review of health science literature aimed at identifying pedagogy and teaching strategies relevant to achieve the learning outcomes specified by the Australian Qualifications Framework at a master's degree level. Eight practical teaching messages emerged from the review and three broad pedagogical trends were identified: the need to use authentic disciplinary-based learning activities; ensure that students are able to discover different perspectives about future practice and bring student reflection about their own knowledge into curricula. More critically, the review highlights that academics attempting to translate national learning outcome frameworks into their teaching practices face a complex and time-consuming task which may involve searching beyond their own disciplinary focus to identify practical teaching strategies to meet prescribed learning outcomes.

Leadership and Pedagogical Interaction as Predictors of Learning Outcomes in Physical Education

This research aims to understand the relative contribution of leadership styles and teacher-student and student-student pedagogical interaction concerning learning performance and academic achievement in Physical Education. A quantitative methodology was implemented, comprising a sample of 447 students attending a school grouping located in the coastal region of central Portugal. In order to verify the nature, the strength and the direction of the relations among the variables, correlation and multiple regression analyses were used. For this, scales already validated and used in other researches were applied. The results show that the learning performance and the academic achievement are significantly associated with teacher leadership styles and teacher-student and student-student pedagogical interaction. A stronger association was obtained with leadership styles, especially the democratic one. It should be mentioned that these factors provide a higher relative contribution to the learning performance than to the academic achievement. The analysis conducted highlights the importance of the democratic teacher leadership style and of the pedagogical interaction established within the classroom towards the improvement of students’ ability to understand the gains and the effort made in learning.

Leadership and Pedagogical Interaction as Predictors of Learning Outcomes in Physical Education

Problem Statement: This research aims to understand the relative contribution of leadership styles and teacher-student and student-student pedagogical interaction concerning the learning performance and academic achievement in physical education. Research Questions: Are the teacher leadership style and the teacher-student and student-student pedagogical interaction related to the learning performance and academic achievement in physical education in basic schooling? Purpose of Study: There are several factors that contribute for the explanation of learning outcomes, namely teacher leadership styles in the classroom, as well as teacher-student and student-student pedagogical interactions. These factors are considered to be essential in the teaching-learning process and in the subsequent improvement of educational outcomes. Research Methods: A quantitative methodology was implemented, comprising a sample of 447 students attending a School Grouping located in the Central Region of Portugal. In order to verify the nature, the strength and the direction of the relations among the variables, correlation and multiple regression analyses were used. For this, scales already validated and used in other researches were applied. Findings: The results show that the learning performance and the academic achievement are significantly associated with teacher leadership styles and teacher-student and student-student pedagogical interaction. A stronger association was obtained with leadership styles, especially the democratic one. It should be mentioned that these factors provide a higher relative contribution to the learning performance than to the academic achievement. Conclusions: This study sought to deepen the understanding of the explanatory factors of academic success concerning the teaching-learning process in physical education. The analysis conducted highlights the importance of the democratic teacher leadership style and of the pedagogical interaction established within the classroom towards the improvement of students' ability to understand the gains and the effort made in learning.

Do perceptions mirror reality? Student perceptions of learning versus grade outcomes

This research addresses whether educators should consider measuring if students have learned what was intended, as recommended by education researchers. Students in an Introductory Marketing subject were asked to complete a voluntary survey rating their own progress on the intended learning outcomes for the course. One hundred and one surveys were completed by students in the second-last teaching week of the semester. Student identification numbers were used to link student perceptions with their grade outcomes. Regression analysis was used to ascertain whether student perceptions of their progress on the intended learning outcomes for the course could be used to predict their grades. While the results were significant, student perceptions of their progress on learning outcomes were a poor predictor of grade outcomes. The results of this study suggest that student perceptions may not mirror the reality. These results are somewhat surprising and future research examining the degree of change in the learning outcomes perceived by students is warranted. This will further contribute to decisions surrounding whether educators should measure if students have learned what was intended.

Systematic evaluation of GoSoapBox in tertiary education : a student response system for improving learning experiences and outcomes

There is currently a wide range of research into the recent introduction of student response systems in higher education and tertiary settings (Banks 2006; Kay and Le Sange, 2009; Beatty and Gerace 2009; Lantz 2010; Sprague and Dahl 2009). However, most of this pedagogical literature has generated ‘how to’ approaches regarding the use of ‘clickers’, keypads, and similar response technologies. There are currently no systematic reviews on the effectiveness of ‘GoSoapBox’ – a more recent, and increasingly popular student response system – for its capacity to enhance critical thinking, and achieve sustained learning outcomes. With rapid developments in teaching and learning technologies across all undergraduate disciplines, there is a need to obtain comprehensive, evidence-based advice on these types of technologies, their uses, and overall efficacy. This paper addresses this current gap in knowledge. Our teaching team, in an undergraduate Sociology and Public Health unit at the Queensland University of Technology (QUT), introduced GoSoapBox as a mechanism for discussing controversial topics, such as sexuality, gender, economics, religion, and politics during lectures, and to take opinion polls on social and cultural issues affecting human health. We also used this new teaching technology to allow students to interact with each other during class – both on both social and academic topics – and to generate discussions and debates during lectures. The paper reports on a data-driven study into how this interactive online tool worked to improve engagement and the quality of academic work produced by students. This paper will firstly, cover the recent literature reviewing student response systems in tertiary settings. Secondly, it will outline the theoretical framework used to generate this pedagogical research. In keeping with the social and collaborative features of Web 2.0 technologies, Bandura’s Social Learning Theory (SLT) will be applied here to investigate the effectiveness of GoSoapBox as an online tool for improving learning experiences and the quality of academic output by students. Bandura has emphasised the Internet as a tool for ‘self-controlled learning’ (Bandura 2001), as it provides the education sector with an opportunity to reconceptualise the relationship between learning and thinking (Glassman & Kang 2011). Thirdly, we describe the methods used to implement the use of GoSoapBox in our lectures and tutorials, and which aspects of the technology we drew on for learning purposes, as well as the methods for obtaining feedback from the students about the effectiveness or otherwise of this tool. Fourthly, we report cover findings from an examination of all student/staff activity on GoSoapBox as well as reports from students about the benefits and limitations of it as a learning aid. We then display a theoretical model that is produced via an iterative analytical process between SLT and our data analysis for use by academics and teachers across the undergraduate curriculum. The model has implications for all teachers considering the use of student response systems to improve the learning experiences of their students. Finally, we consider some of the negative aspects of GoSoapBox as a learning aid.

Comparing different approach and avoidance models of learning and personality in the prediction of work, university, and leadership outcomes

Jackson (2005) developed a hybrid model of personality and learning, known as the learning styles profiler (LSP) which was designed to span biological, socio-cognitive, and experiential research foci of personality and learning research. The hybrid model argues that functional and dysfunctional learning outcomes can be best understood in terms of how cognitions and experiences control, discipline, and re-express the biologically based scale of sensation-seeking. In two studies with part-time workers undertaking tertiary education (N equals 137 and 58), established models of approach and avoidance from each of the three different research foci were compared with Jackson's hybrid model in their predictiveness of leadership, work, and university outcomes using self-report and supervisor ratings. Results showed that the hybrid model was generally optimal and, as hypothesized, that goal orientation was a mediator of sensation-seeking on outcomes (work performance, university performance, leader behaviours, and counterproductive work behaviour). Our studies suggest that the hybrid model has considerable promise as a predictor of work and educational outcomes as well as dysfunctional outcomes.