Towards a framework for aligning learning outcomes, academic literacies and assessment criteria

Although Australian students spend three or more years studying they can seem quite unaware of any of the expected learning outcomes of their course. They are often single unit focused, paying most attention to individual assessment items thus not developing a holistic view of their course. This paper presents a theoretical framework to support staff and students to recognise, scaffold and achieve learning outcomes and academic skills at unit level and to recognise how these contribute to course and graduate learning outcomes, within the boundaries of Australian university and professional accreditation requirements. A case study is described that demonstrates the manual implementation of the framework. The complex nature of the implementation suggests that a software solution is required to ease the process and ensure the resulting mapping will have some longevity by being maintainable.

Evidencing learning outcomes: a multi-level, multi-dimensional course alignment model

This conceptual framework proposes a multi-level, multi-dimensional course alignment model to implement a contextualised constructive alignment of rubric design that authentically evidences and assesses learning outcomes. By embedding quality control mechanisms at each level for each dimension, this model facilitates the development of an aligned curriculum. The use of rubrics is a crucial theme for many higher education institutions owing to the binding requirement by universities to provide evidence to quality assurance agencies. The success of evidencing learning outcomes through rubrics, however, is only one piece of the puzzle. The other is the contextualised constructive alignment of intertwined factors. Despite the significance of embedding these factors, there has been little, if any, systematic framework in this area. The two key instrumental forces underpinning the conception of this model are: seeking external accreditation and the implementation of programme enhancement thus realising the strategic agenda for an Australian university.

The design of a syllabus for translation students: learning outcomes in the subjects of spanish language

[EN]In the new design of educational programs in European Higher Education Area (EHEA), what defines a subject it is Learning Outcomes (LO). These LO, as explicit and precise declarations, turn into the center of teaching and learning process. Keeping this change is mind, our research examines the Educational Guides (EG) of Spanish Language (SL) through a list of verbs, according to the graduation of educacionational objectives of Bllom's Taxonomy (2014-2015)

Assessment of learning outcomes in computing studies

The assessment of learning outcomes is a key concept in the European Credit Transfer and Accumulation System (ECTS) since credits are awarded when the assessment shows the competences which were aimed at have been developed at an appropriate level. This paper describes a study which was first part of the project of the Bologna Experts Team-Spain and then developed as an independent study. It was carried out with the overall goal to gain experience in the assessment of learning outcomes. More specifically it aimed at 1) designing procedures for the assessment of learning outcomes related to these compulsory generic competences; 2) testing some basic psychometric features that an assessment device with some consequences for the subjects being evaluated needs to prove; 3) testing different procedures of standard setting, and 4) using assessment results as orienting feedback to students and their tutors. The process of development of tests to carry out the assessment of learning outcomes related to these competences, as well as some basic features regarding their reliability and validity is described and first results on the comparison of results achieved at two academic levels, will also be described at a later stage.

Investigating and Understanding Student Learning Outcomes in an Online and Face-to-Face Graduate Level Legal Administration Course: An Embedded Mixed Methods Design

Online education is a new teaching and learning medium with few current guidelines for faculty, administrators or students. Its rapid growth over the last decade has challenged academic institutions to keep up with the demand, while also providing a quality education. Our understanding of the factors that determine quality and effective online learning experiences that lead to student learning outcomes is still evolving. There is a lack of consensus on the effectiveness of online versus face-to-face education in the current research. The U.S. Department of Education conducted a meta-analysis in 2009 and concluded that student-learning outcomes in online courses were equal to and, often times, better than face-to-face traditional courses. Subsequent research has found contradictory findings, and further inquiry is necessary. The purpose of this embedded mixed methods design research study is to further our understanding of the factors that create quality and successful educational outcomes in an online course. To achieve this, the first phase of this study measured and compared learning outcomes in an online and in class graduate-level legal administration course. The second phase of the study entailed interviews with those students in both the online and face-to-face sections to understand their perspectives on the factors contributing to learning outcomes. Six themes emerged from the qualitative findings: convenience, higher order thinking, discussions, professor engagement, professor and student interaction, and face-to-face interaction. Findings from this study indicate the factors students perceive as contributing to learning outcomes in an online course are consistent among all students and are supported in the existing literature. Higher order thinking, however, emerged as a stronger theme than indicated in the current research, and the face-to-face nature of the traditional classroom may be more an issue of familiarity than a factor contributing to learning outcomes. As education continues to reach new heights and developments in technology advance, the factors found to contribute to student learning outcomes will be refined and enhanced. These developments will continue to transform the ways in which we deliver and receive knowledge in both traditional and online classrooms. While there is a growing body of research on online education, the field’s evolution has unsettled earlier findings and posed new areas to investigate.

The impact of learning outcomes in business education: assessing value, relevance and graduate ability in a multi-country study of employers and business graduates

This paper discusses critical findings from a two-year EU-funded research project involving four European countries: Austria, England, Slovenia and Romania. The project had two primary aims. The first of these was to develop a systematic procedure for assessing the balance between learning outcomes acquired in education and the specific needs of the labour market. The second aim was to develop and test a set of meta-level quality indicators aimed at evaluating the linkages between education and employment. The project was distinctive in that it combined different partners from Higher Education, Vocational Training, Industry and Quality Assurance. One of the key emergent themes identified in exploratory interviews was that employers and recent business graduates in all four countries want a well-rounded education which delivers a broad foundation of key business knowledge across the various disciplines. Both groups also identified the need for personal development in critical skills and competencies. Following the exploratory study, a questionnaire was designed to address five functional business areas, as well as a cluster of 8 business competencies. Within the survey, questions relating to the meta-level quality indicators assessed the impact of these learning outcomes on the workplace, in terms of the following: 1) value, 2) relevance and 3) graduate ability. This paper provides an overview of the study findings from a sample of 900 business graduates and employers. Two theoretical models are proposed as tools for predicting satisfaction with work performance and satisfaction with business education. The implications of the study findings for education, employment and European public policy are discussed.

Maximizing Hospitality Learning Outcomes: An Integrated Experiential In-Class Approach

This study explored the influence of an experiential, in-class approach to the hospitality curriculum as a means of increasing its efficiency and effectiveness. Specifically, the study provides an example of how hospitality faculty might utilize an experiential, in-class approach to integrate additional hospitality-specific content along with process and content issues for working in teams and team decision-making. The results of this study support the efficient and effective use of an experiential inclass teaching method. The value of this study is twofold: (1) it provides an initial test of this approach’s usefulness and (2) it provides a forum for continued conversations of how experiential approaches can be utilized to enhance and reinforce other hospitality content and managerial skills and to bridge the gap between vocational and liberal education outcomes.

The impact of pre -training interventions on cognitive, skill, and affective learning outcomes: A meta -analytic examination of four decades of research

Technological advancements and the ever-evolving demands of a global marketplace may have changed the way in which training is designed, implemented, and even managed, but the ultimate goal of organizational training programs remains the same: to facilitate learning of a knowledge, skill, or other outcome that will yield improvement in employee performance on the job and within the organization (Colquitt, LePine, & Noe, 2000; Tannenbaum & Yukl, 1992). Studies of organizational training have suggested medium to large effect sizes for the impact of training on employee learning (e.g., Arthur, Bennett, Edens, & Bell, 2003; Burke & Day, 1986). However, learning may be differentially affected by such factors as the (1) level and type of preparation provided prior to training, (2) targeted learning outcome, (3) training methods employed, and (4) content and goals of training (e.g., Baldwin & Ford, 1988). A variety of pre-training interventions have been identified as having the potential to enhance learning from training and practice (Cannon-Bowers, Rhodenizer, Salas, & Bowers, 1998). Numerous individual studies have been conducted examining the impact of one or more of these pre-training interventions on learning. ^ I conducted a meta-analytic examination of the effect of these pre-training interventions on cognitive, skill, and affective learning. Results compiled from 359 independent studies (total N = 37,038) reveal consistent positive effects for the role of pre-training interventions in enhancing learning. In most cases, the provision of a pre-training intervention explained approximately 5–10% of the variance in learning, and in some cases, explained up to 40–50% of variance in learning. Overall attentional advice and meta-cognitive strategies (as compared with advance organizers, goal orientation, and preparatory information) seem to result in the most consistent learning gains. Discussion focuses on the most beneficial match between an intervention and the learning outcome of interest, the most effective format of these interventions, and the most appropriate circumstances under which these interventions should be utilized. Also highlighted are the implications of these results for practice, as well as propositions for important avenues for future research. ^

Undergraduate Students’ Perceptions of Study Abroad and Their Level of Achievement of Global Learning Outcomes

This study expanded on current research on study abroad and global learning, using the Global Perspective Inventory (GPI), and conducted at Florida International University (FIU) in Miami, FL. The GPI assesses the holistic development of a global perspective in higher education within three domains and their respective FIU-determined equivalents: cognitive (global awareness), intrapersonal (global perspective), and interpersonal (global engagement). The main purpose of this study was to assess FIU’s undergraduate students’ perceptions of study abroad on their level of achievement of global awareness, global perspective, and global engagement. The secondary purpose was to determine how the students described their study abroad experience and achievement of global learning. The research design for this study consisted of parallel mixed methods. The quantitative component was an ex post facto with hypothesis design, using a pretest/posttest nonequivalent group methodology. FIU undergraduates (N=147) who studied abroad for one semester or more completed the GPI pre- and post-tests. Descriptive statistics and paired t-tests were conducted to compare the means. The interviews included 10 students, and were analyzed through Structural coding, Saldaña’s In Vivo coding, and Value coding. Quantitative analyses indicated positive changes in the students’ global awareness and global perspective. These analyses also showed that the FIU students achieved higher post-test means on all the domains of the GPI compared to other studies. Qualitative analyses showed that the students’ experiences incorporated all three global learning outcomes, most notably global awareness and perspective.