Transforming assessment practices

This research project produced a number of resources to assist faculties in reviewing their assessment practices. These resources include an Evidence of Learning Matrix, Assessment Review Flowchart and Action Plan. In completing a review of assessment practices, this would then inform a curriculum review or retreat.

The moderating role of learning on competitive advantage : longitudinal evidence from young firms

The question of how young firms reconcile the absence of well-established learning routines arising from the “liabilities of newness” with the “learning advantages of newness” has received scant attention in entrepreneurship. While older firms follow established learning routines and sometimes face problems in overcoming inertia, young firms with lower levels of inertia are better poised to explore, search and test unique avenues for their products and services. The process of learning and capability development as well as establishing uniqueness in their product offerings is an important part not only in the early stages of firm growth, but also in firm survival. Given their inexperience, for young firms, these learning processes are iterative and include contrasting learning loops that sometimes progress and at other times digress from initially perceived unique ideas. Such processes are embedded within capabilities that the firm develops and nurtures. Based on this premise and adopting a capabilities-based view, we examine how strategic networks and environmental knowledge affects uniqueness- mediated performance in young firms. We identify firms with digressive learning strategies based on their self-assessment of learning and compare them with other firms to demonstrate a differential effect on performance.

Governance of learning mechanisms : evidence from construction firms

The focus of knowledge management (KM) in the construction industry is moving towards capability building for value creation. The study reported by this paper is motivated by recent assertions about the genesis and evolution of knowledge management capability (KMC) in the strategic management field. It attempts to shed light on the governance of learning mechanisms that develop KMC within the context of construction firms. A questionnaire survey was administered to a sample of construction contractors operating in the very dynamic Hong Kong market to elicit opinions on the learning mechanisms and business outcomes of targeted firms. On the basis of a total of 149 usable responses, structural equation modeling (SEM) analysis identified relationships among knowledge-governance mechanisms, knowledge processes, and business performance, thereby supporting the existence of strategic learning loops. The study findings provide evidence from the construction context for capability assertions that knowledge-governance mechanisms and processes form learning mechanisms that carry out strategic learning to create value, effect performance outcomes, and ultimately drive the evolution of KMC. The findings imply that it is feasible for managing construction firms to govern learning mechanisms through managing the capability-based holistic KM system, thereby reconfiguring KMC to match needs in the dynamic market environment over time.

School libraries and teacher-librarians : evidence of their contribution to student literacy and learning

International research provides compelling evidence that school libraries and teacher-librarians make a significant contribution to student literacy and learning outcomes. After summarising previous research, this article presents recent research focused on Gold Coast schools. These new Australian findings present an evidenced based snapshot of school libraries and teacher-librarians, from the principals’ perspective. They indicate that school NAPLAN scores for reading and writing were generally higher when student-to-library staff ratios were lower (i.e. better) and when the school employed a teacher-librarian. In light of the National Plan for School Improvement, the findings are of potential interest to education authorities, policy makers, school leadership teams, teacher-librarians, teachers, parents and researchers. They offer evidence to inform policy development and strategic planning for school libraries and professional staffing.

Self-regulated learning and social media – a ‘natural’ alliance? Evidence on students’ self-regulation of learning, social media use and student-teacher relationship

Article is available at: http://www.tandfonline.com/doi/full/10.1080/17439884.2015.1064953.

In Support of the Matrix Language Frame Model: Evidence from Igbo-English Intrasentential Codeswitching

This paper explores the morphosyntactic features of mixed nominal expressions in a sample of empirical Igbo-English intrasentential codeswitching data (i.e. codeswitching within a bilingual clause) in terms of the Matrix Language Frame (MLF) model. Since both Igbo and English differ in the relative order of head and complement within the nominal argument phrase, the analysed data seem appropriate for testing the veracity of the principal assumption underpinning the MLF model: the notion that the two languages (in our case Igbo and English) participating in codeswitching do not both contribute equally to the morphosyntactic frame of a mixed constituent. As it turns out, the findings provide both empirical and quantitative support for the basic theoretical view that there is a Matrix Language (ML) versus Embedded Language (EL) hierarchy in classic codeswitching as predicted by the MLF model because both Igbo and English do not simultaneously satisfy the roles of the ML in Igbo-English codeswitching.

Networks of learning : how motorsport companies collaborate and share knowledge:evidence from the UK and Italian motorsport industries

The motorsport industry is a high value-added and highly innovative business sector. The UK’s leading racing car manufacturers are world class centres of research, development and engineering. However, individual firms in the sector do not have the range and depth of capabilities to compete independently in motorsport’s dynamic and competitive environment. Industry attention has therefore progressively focused on how networks of collaborating firms can work together to develop new products, improve business processes and reduce costs. This report presents findings from a three year Cardiff Business School study which examined the ways in which firms collaborate as part of wider networks. The research involved gathering data from over 120 firms in the UK and Italian motorsport sectors.

Complex skills and academic writing:a review of evidence about the types of learning required to meet core assessment criteria

Assessment criteria are increasingly incorporated into teaching, making it important to clarify the pedagogic status of the qualities to which they refer. We reviewed theory and evidence about the extent to which four core criteria for student writing-critical thinking, use of language, structuring, and argument-refer to the outcomes of three types of learning: generic skills learning, a deep approach to learning, and complex learning. The analysis showed that all four of the core criteria describe to some extent properties of text resulting from using skills, but none qualify fully as descriptions of the outcomes of applying generic skills. Most also describe certain aspects of the outcomes of taking a deep approach to learning. Critical thinking and argument correspond most closely to the outcomes of complex learning. At lower levels of performance, use of language and structuring describe the outcomes of applying transferable skills. At higher levels of performance, they describe the outcomes of taking a deep approach to learning. We propose that the type of learning required to meet the core criteria is most usefully and accurately conceptualized as the learning of complex skills, and that this provides a conceptual framework for maximizing the benefits of using assessment criteria as part of teaching. © 2006 Taylor & Francis.

Discovering, applying and integrating: The process of learning in coaching

Professional coaching is a rapidly expanding field with interdisciplinary roots and broad application. However, despite abundant prescriptive literature, research into the process of coaching is minimal. Similarly, although learning is inherently recognised in the process of coaching, the process of learning in coaching is little understood and learning theory makes up only a small part of the evidence-based coaching literature. In this grounded theory study of coaches and their clients, the process of learning in coaching across a range of coaching models is examined and discussed. The findings demonstrate how learning in coaching emerged as a process of discovering, applying and integrating new knowledge, which culminated in a process of developing. This process occurred through eight key coaching processes shared between coaches and clients and combined a multitude of learning theories.

Case study of collaborative learning in two contexts : what do English language learners gain?

This chapter describes the use of collaborative learning as an approach to enhance English language learning by students from non-English speaking backgrounds. Communicative Language Teaching (CLT) principles were applied to two case studies, one comprising of undergraduate English as Foreign Language Learners in Turkey and the other involved English as Second Language learners in Australia. Social constructivism inspired communicative language teaching using collaborative learning activities such as team work, interactive peer-based learning, and iterative stages of learning matrix were incorporated to enhance students' learning outcomes. Data collected after the CLT intervention was made up of field notes, reflective logs and focus group interviews which revealed complementarities, as well as subtle differences between the two cases. The findings were summarized as learning dispositions; speaking fluency and confidence; learning diagnostics and completion deficiencies; task engagement, flow theory and higher order thinking skills; in addition to self efficacy and development of student identity. CLT has the potential to provide a more inclusive and dynamic education for diverse learners through vital outcomes and benefits which resonate with the real world.

Transfer of learning across the globe : pre-service teachers taking the initiative

A continuing challenge for pre-service teacher education is the learning transfer between the university based components and the practical school based components of their training. It is not clear how easily pre-service teachers can transfer university learnings into ‘in school’ practice. Similarly, it is not clear how easily knowledge learned in the school context can be disembedded from this particular context and understood more generally by the pre-service teacher. This paper examines the effect of a community of practice formed specifically to explore learning transfer via collaboration and professional enquiry, in ‘real time’, across the globe. “Activity Theory” (Engestrom, 1999) provided the theoretical framework through which the cognitive, physical and social processes involved could be understood. For the study, three activity systems formed community of practice network. The first activity system involved pre-service teachers at a large university in Queensland, Australia. The second activity system was introduced by the pre-service teachers and involved Year 12 students and teachers at a private secondary school also in Queensland, Australia. The third activity system involved university staff engineers at a large university in Pennsylvania, USA. The common object among the three activity systems was to explore the principles and applications of nanotechnology. The participants in the two Queensland activity systems, controlled laboratory equipment (a high powered Atomic Force Microscope – CPII) in Pennsylvania, USA, with the aim of investigating surface topography and the properties of nano particles. The pre-service teachers were to develop their remote ‘real time’ experience into school classroom tasks, implement these tasks, and later report their findings to other pre-service teachers in the university activity system. As an extension to the project, the pre-service teachers were invited to co-author papers relating to the project. Data were collected from (a) reflective journals; (b) participant field notes – a pre-service teacher initiative; (c) surveys – a pre-service teacher initiative; (d) lesson reflections and digital recordings – a pre-service teacher initiative; and (e) interviews with participants. The findings are reported in terms of the major themes: boundary crossing, the philosophy of teaching, and professional relationships The findings have implications for teacher education. The researchers feel that deliberate planning for networking between activity systems may well be a solution to the apparent theory/practice gap. Proximity of activity systems need not be a hindering issue.

Discovering, applying and integrating self-knowledge : a grounded theory study of learning in life coaching

Professional coaching is a rapidly expanding field with interdisciplinary roots and broad application. However, despite abundant prescriptive literature, research into the process of coaching, and especially life coaching, is minimal. Similarly, although learning is inherently recognised in the process of coaching, and coaching is increasingly being recognised as a means of enhancing teaching and learning, the process of learning in coaching is little understood, and learning theory makes up only a small part of the evidence-based coaching literature. In this grounded theory study of life coaches and their clients, the process of learning in life coaching across a range of coaching models is examined and explained. The findings demonstrate how learning in life coaching emerged as a process of discovering, applying and integrating self-knowledge, which culminated in the development of self. This process occurred through eight key coaching processes shared between coaches and clients and combined a multitude of learning theory.

Curriculum alignment: Exploring student perception of learning achievement measures

The importance of constructively aligned curriculum is well understood in higher education. Based on the principles of constructive alignment, this research considers whether student perception of learning achievement measures can be used to gain insights into how course activities and pedagogy are assisting or hindering students in accomplishing course learning goals. Students in a Marketing Principles course were asked to complete a voluntary survey rating their own progress on the intended learning goals for the course. Student perceptions of learning achievement were correlated with actual student learning, as measured by grade, suggesting that student perceptions of learning achievement measures are suitable for higher educators. Student perception of learning achievement measures provide an alternate means to understand whether students are learning what was intended, which is particularly useful for educators faced with large classes and associated restrictions on assessment. Further, these measures enable educators to simultaneously gather evidence to document the impact of teaching innovations on student learning. Further implications for faculty and future research are offered.

Hunters & gatherers : strategies for curriculum mapping and data collection for assurance of learning

Assurance of learning is a predominant feature in both quality enhancement and assurance in higher education. Assurance of learning is a process that articulates explicit program outcomes and standards, and systematically gathers evidence to determine the extent to which performance matches expectations. Benefits accrue to the institution through the systematic assessment of whole of program goals. Data may be used for continuous improvement, program development, and to inform external accreditation and evaluation bodies. Recent developments, including the introduction of the Tertiary Education and Quality Standards Agency (TEQSA) will require universities to review the methods they use to assure learning outcomes. This project investigates two critical elements of assurance of learning: 1. the mapping of graduate attributes throughout a program; and 2. the collection of assurance of learning data. An audit was conducted with 25 of the 39 Business Schools in Australian universities to identify current methods of mapping graduate attributes and for collecting assurance of learning data across degree programs, as well as a review of the key challenges faced in these areas. Our findings indicate that external drivers like professional body accreditation (for example: Association to Advance Collegiate Schools of Business (AACSB)) and TEQSA are important motivators for assuring learning, and those who were undertaking AACSB accreditation had more robust assurance of learning systems in place. It was reassuring to see that the majority of institutions (96%) had adopted an embedding approach to assuring learning rather than opting for independent standardised testing. The main challenges that were evident were the development of sustainable processes that were not considered a burden to academic staff, and obtainment of academic buy in to the benefits of assuring learning per se rather than assurance of learning being seen as a tick box exercise. This cultural change is the real challenge in assurance of learning practice.

Understanding evaluation of learning support in mathematics and statistics

With rapid and continuing growth of learning support initiatives in mathematics and statistics found in many parts of the world, and with the likelihood that this trend will continue, there is a need to ensure that robust and coherent measures are in place to evaluate the effectiveness of these initiatives. The nature of learning support brings challenges for measurement and analysis of its effects. After briefly reviewing the purpose, rationale for, and extent of current provision, this article provides a framework for those working in learning support to think about how their efforts can be evaluated. It provides references and specific examples of how workers in this field are collecting, analysing and reporting their findings. The framework is used to structure evaluation in terms of usage of facilities, resources and services provided, and also in terms of improvements in performance of the students and staff who engage with them. Very recent developments have started to address the effects of learning support on the development of deeper approaches to learning, the affective domain and the development of communities of practice of both learners and teachers. This article intends to be a stimulus to those who work in mathematics and statistics support to gather even richer, more valuable, forms of data. It provides a 'toolkit' for those interested in evaluation of learning support and closes by referring to an on-line resource being developed to archive the growing body of evidence. © 2011 Taylor & Francis.