A conceptual model for reflecting on expected learning vs. demonstrated student performance

Educators are faced with many challenging questions in designing an effective curriculum. What prerequisite knowledge do students have before commencing a new subject? At what level of mastery? What is the spread of capabilities between bare-passing students vs. the top performing group? How does the intended learning specification compare to student performance at the end of a subject? In this paper we present a conceptual model that helps in answering some of these questions. It has the following main capabilities: capturing the learning specification in terms of syllabus topics and outcomes; capturing mastery levels to model progression; capturing the minimal vs. aspirational learning design; capturing confidence and reliability metrics for each of these mappings; and finally, comparing and reflecting on the learning specification against actual student performance. We present a web-based implementation of the model, and validate it by mapping the final exams from four programming subjects against the ACM/IEEE CS2013 topics and outcomes, using Bloom's Taxonomy as the mastery scale. We then import the itemised exam grades from 632 students across the four subjects and compare the demonstrated student performance against the expected learning for each of these. Key contributions of this work are the validated conceptual model for capturing and comparing expected learning vs. demonstrated performance, and a web-based implementation of this model, which is made freely available online as a community resource.

Successful outcomes in vocational education and training courses : how pedagogy and expectations influence achievement

This paper reports on a four year Australian Research Council funded Linkage Project titled Skilling Indigenous Queensland, conducted in regional areas of Queensland, Australia from 2009 to 2013. The project sought to investigate vocational education, training (VET) and teaching, Indigenous learners’ needs, employer cultural and expectations and community culture and expectations to identify best practice in numeracy teaching for Indigenous VET learners. Specifically it focused on ways to enhance the teaching and learning of courses and the associated mathematics in such courses to benefit learners and increase their future opportunities of employment. To date thirty-nine teachers/trainers/teacher aides and two hundred and thirty-one students consented to participate in the project. Nine VET courses were nominated to be the focus on the study. This paper focuses on questionnaire and interview responses from four trainers, two teacher aides and six students. In recent years a considerable amount of funding has been allocated to increasing Indigenous Peoples’ participation in education and employment. This increased funding is predicated on the assumption that it will make a difference and contribute to closing the education gap between Indigenous and non-Indigenous Australians (Council of Australia Governments, 2009). The central tenet is that access to education for Indigenous People will create substantial social and economic benefits for regional and remote Indigenous People. The project’s aim is to address some of the issues associated with the gap. To achieve the aims, the project adopted a mixed methods design aimed at benefitting research participants and included: participatory collaborative action research (Kemmis & McTaggart, 1988) and, community research (Smith, 1999). Participatory collaborative action research refers to a is a “collective, self-reflective enquiry undertaken by participants in social situations in order to improve the rationality and justice of their own social and educational practices” (Kemmis et al., 1988, p. 5). Community research is described as an approach that “conveys a much more intimate, human and self-defined space” (p. 127). Community research relies on and validates the community’s own definitions. As the project is informed by the social at a community level, it is described as “community action research or emancipatory research” (Smith, 1999, p. 127). It seeks to demonstrate benefit to the community, making positive differences in the lives of Indigenous People and communities. The data collection techniques included survey questionnaires, video recording of teaching and learning processes, teacher reflective video analysis of teaching, observations, semi-structured interviews and student numeracy testing. As a result of these processes, the findings indicate that VET course teachers work hard to adopt contextualising strategies to their teaching, however this process is not always straight forward because of the perceptions of how mathematics has been taught and learned historically. Further teachers, trainers and students have high expectations of one another with the view to successful outcomes from the courses.

Governance of learning mechanisms : evidence from construction firms

The focus of knowledge management (KM) in the construction industry is moving towards capability building for value creation. The study reported by this paper is motivated by recent assertions about the genesis and evolution of knowledge management capability (KMC) in the strategic management field. It attempts to shed light on the governance of learning mechanisms that develop KMC within the context of construction firms. A questionnaire survey was administered to a sample of construction contractors operating in the very dynamic Hong Kong market to elicit opinions on the learning mechanisms and business outcomes of targeted firms. On the basis of a total of 149 usable responses, structural equation modeling (SEM) analysis identified relationships among knowledge-governance mechanisms, knowledge processes, and business performance, thereby supporting the existence of strategic learning loops. The study findings provide evidence from the construction context for capability assertions that knowledge-governance mechanisms and processes form learning mechanisms that carry out strategic learning to create value, effect performance outcomes, and ultimately drive the evolution of KMC. The findings imply that it is feasible for managing construction firms to govern learning mechanisms through managing the capability-based holistic KM system, thereby reconfiguring KMC to match needs in the dynamic market environment over time.

Games for change and transformative learning : an ethnographic case study

This thesis aims to contribute to a better understanding of how serious games/games for change function as learning frameworks for transformative learning in an educational setting. This study illustrates how the meaning-making processes and learning with and through computer gameplay are highly contingent, and are significantly influenced by the uncertainties of the situational context. The study focuses on SCAPE, a simulation game that addresses urban planning and sustainability. SCAPE is based on the real-world scenario of Kelvin Grove Urban Village, an inner city redevelopment area in Brisbane, Queensland, Australia. The game is embedded within an educational program, and I thus account for the various gameplay experiences of different school classes participating in this program. The networks emerging from the interactions between students/players, educators, facilitators, the technology, the researcher, as well as the setting, result in unanticipated, controversial, and sometimes unintended gameplay experiences and outcomes. To unpack play, transformative learning and games, this study adopts an ecological approach that considers the magic circle of gameplay in its wider context. Using Actor-Network Theory as the ontological lens for inquiry, the methods for investigation include an extensive literature review, ethnographic participant observation of SCAPE, as well as student and teacher questionnaires, finishing with interviews with the designers and facilitators of SCAPE. Altogether, these methods address my research aim to better understand how the heterogeneous actors engage in the relationships in and around gameplay, and illustrate how their conflicting understandings enable, shape or constrain the (transformative) learning experience. To disentangle these complexities, my focus continuously shifts between the following modes of inquiry into the aims „h To describe and analyse the game as a designed artefact. „h To examine the gameplay experiences of players/students and account for how these experiences are constituted in the relationships of the network. „h To trace the meaning-making processes emerging from the various relations of players/students, facilitators, teachers, designers, technology, researcher, and setting, and consider how the boundaries of the respective ecology are configured and negotiated. „h To draw out the implications for the wider research area of game-based learning by using the simulation game SCAPE as an example for introducing gameplay to educational settings. Accounting in detail for five school classes, these accounts represent, each in its own right, distinct and sometimes controversial forms of engagement in gameplay. The practices and negotiations of all the assembled human and non-human actors highlight the contingent nature of gameplay and learning. In their sum, they offer distinct but by no means exhaustive examples of the various relationships that emerge from the different assemblages of human and non-human actors. This thesis, hence, illustrates that game-based learning in an educational setting is accompanied by considerable unpredictability and uncertainty. As ordinary life spills and leaks into gameplay experiences, group dynamics and the negotiations of technology, I argue that overly deterministic assertions of the game¡¦s intention, as well as a too narrowly defined understanding of the transformative learning outcome, can constrain our inquiries and hinder efforts to further elucidate and understand the evolving uncertainties around game-based learning. Instead, this thesis posits that playing and transformative learning are relational effects of the respective ecology, where all actors are networked in their (partial) enrolment in the process of translation. This study thus attempts to foreground the rich opportunities for exploring how game-based learning is assembled as a network of practices.

Principles of motor learning in ecological dynamics : a comment on functions of learning and the acquisition of motor skills (with reference to sport)

This paper provides a commentary on the contribution by Dr Chow who questioned whether the functions of learning are general across all categories of tasks or whether there are some task-particular aspects to the functions of learning in relation to task type. Specifically, they queried whether principles and practice for the acquisition of sport skills are different than what they are for musical, industrial, military and human factors skills. In this commentary we argue that ecological dynamics contains general principles of motor learning that can be instantiated in specific performance contexts to underpin learning design. In this proposal, we highlight the importance of conducting skill acquisition research in sport, rather than relying on empirical outcomes of research from a variety of different performance contexts. Here we discuss how task constraints of different performance contexts (sport, industry, military, music) provide different specific information sources that individuals use to couple their actions when performing and acquiring skills. We conclude by suggesting that his relationship between performance task constraints and learning processes might help explain the traditional emphasis on performance curves and performance outcomes to infer motor learning.

A Summative Evaluation of the Stronger Smarter Learning Communities Project : Vol 1 and Vol 2

This is a summative evaluation of the Stronger Smarter Learning Communities (SSLC) project that examines whether and how the SSLC project had an impact on Australian state schools which adopted its models and approaches. Drawing from qualitative and quantitative data sets, it also presents the largest scale and most comprehensive analysis of Indigenous education practices and outcomes to date. It includes empirical findings on: success in changing school ethos and community engagement; challenges in progress at closure of the 'gap' in conventionally measured achievement and performance; schools' and principals' choices in curriculum and instruction; profiles of teachers' and principals' training and views on teacher education; and a strong emphasis on community and school Indigenoous voices and views on Indigenous education.

Designing Innovative Business Models : A Design Catalyst Learning Resource

The term Design Led Innovation is emerging as a fundamental business process, which is rapidly being adopted by large as well as small to medium sized firms. The value that design brings to an organisation is a different way of thinking, of framing situations and possibilities, doing things and tackling problems: essentially a cultural transformation of the way the firm undertakes its business. Being Design Led is increasingly being seen by business as a driver of company growth, allowing firms to provide a strong point of difference to its stakeholders. Achieving this Design Led process, requires strong leadership to enable the organisation to develop a clear vision for top line growth. Specifically, based on deep customer insights and expanded through customer and stakeholder engagements, the outcomes of which are then adopted by all aspects of the business. To achieve this goal, several tools and processes are available, which need to be linked to new organisational capabilities within a business transformation context. The Design Led Innovation Team focuses on embedding tools and processes within an organisation and matching this with design leadership qualities to enable companies to create breakthrough innovation and achieve sustained growth, through ultimately transforming their business model. As all information for these case studies was derived from publicly accessed data, this resource is not intended to be used as reference material, but rather is a learning tool for designers to begin to consider and explore businesses at a strategic level. It is not the results that are key, but rather the process and philosophies that were used to create these case studies and disseminate this way of thinking amongst the design community. It is this process of unpacking a business guided by the framework of Osterwalder’s Business Model Canvas* which provides an important tool for designers to gain a greater perspective of a company’s true innovation potential.

Making the implicit explicit : successful student skills for commencing cohorts

Making institutional expectations explicit using clear and common language engages commencing students and promotes help-seeking behaviour. When first year students enter university they cross the threshold into an unfamiliar environment (Devlin, Kift, Nelson, Smith & McKay, 2012). Universities endeavour to provide appropriate learning support services and resources; however research suggests that there is limited up take of these services, particularly in high risk students (Nelson-Field & Goodman, 2005). The Successful Student Skills Checklist is a tool which will be trialled during the 2013 Orientation period at the QUT Caboolture campus. The new tool is a response to the university’s commitment to provide “an environment where [students] are supported to take responsibility for their own learning, and to embrace an active role in succeeding to their full potential” (QUT, 2012, 6.2.1). This paper will outline the design of the support tool implemented during Orientation, as well as discuss the anticipated outcomes of the trial.

Valuing student and community voices in the university : action research as a framework for community service-learning

The Community Service-learning Lab (the Lab) was initiated as a university-wide service-learning experience at an Australian university. The Lab engages students, academics, and key community organisations in interdisciplinary action research projects to support student learning and to explore complex and ongoing problems nominated by the community partners. The current study uses feedback from the first offering of the Lab and focuses on exploring student experiences of the service learning project using an action research framework. Student reflections on this experience have revealed some positive outcomes of the Lab such as an appreciation for positive and strengths-based change. These outcomes are corroborated by collected reflections from community partners and academics. The students also identified challenges balancing the requirements for assessment and their goals to serve the community partner’s needs. This feedback has provided vital information for the academic team, highlighting the difficulties in balancing the agenda of the academic framework and the desire to give students authentic experiences.

The practice of quality assuring learning in higher education

There remains a lack of published empirical data on the substantive outcomes of higher learning and the establishment of quality processes for determining them. Studies that do exist are nationally focused with available rankings of institutions reflecting neither the quality of teaching and learning nor the diversity of institutions. This paper describes two studies in which Associate Deans from Australian higher education institutions and focus groups of management and academics identify current issues and practices in the design, development and implementation of processes for assuring the quality of learning and teaching. Results indicate that developing a perspective on graduate attributes and mapping assessments to measure outcomes across an entire program necessitates knowledge creation and new inclusive processes. Common elements supporting consistently superior outcomes included: inclusivity; embedded graduate attributes; consistent and appropriate assessment; digital collection mechanisms; and systematic analysis of outcomes used in program review. Quality measures for assuring learning are proliferating nationally and changing the processes, systems and culture of higher education as a result.

Learning English by walking down the street

With internationalisation and globalisation, English has proliferated in urban spaces around the world. This creates new opportunities for EFL learning and teaching. An English literacy walk is one activity that can be used productively to capitalise on this potential. The activity has roots in: (i) long-established approaches to emergent literacy education for young children; and (ii) pedagogic projects inspired by recent research on linguistic landscapes. Drawing on these traditions, teachers can target reading outcomes involving code, semantic, pragmatic and critical knowledge and skills. We use the four resources model of literate practices to systematically map some of the potential of literacy walks in multilingual, multimodal linguistic landscapes. We suggest tasks and teacher questions that might be used for purposes of explicit teaching of reading during and after literacy walks. Although grounded in Taipei, our ideas might be of interest to EFL teachers in other globalised cities around the world.

Using projects instead of pracs for hands on learning

In 1999, power electronics laboratory practicals were isolated two-hour sessions with only nominal assessment. Students were unmotivated, and didn’t prepare for or subsequently review these sessions. The pracs were rushed, and students’ actions task oriented. Learning was shallow at best. In 2000, the practical component was changed to two projects, each spanning four weeks. The projects were larger, linked, real world problems, tackled by groups of three students. Assessment was via individual workbooks kept during the project, a group demonstration of the working project by all members, and a subsequent written report. These projects were highly successful in motivating the students, and achieved the transfer of the theory presented in lectures into personal practical understanding of that material. These outcomes were judged by observations of the class, project and exam marks, and responses to a questionnaire given at the conclusion of the semester.

Learning without boundaries

Discipline boundaries of science and technology education are inevitable. Often, such barriers are an obstacle to industry-based learning leading to preventable complexities. Industry-based learning is a complex scenario, rather than conventional learning, leading to the study of liquid learning, which is a timely concept to investigate learning without boundaries. Liquid learning consists of accountability, expectations and driven by outcomes with different learning choices. Liquid learning is a significant phenomenon requiring awareness in the science and technology education. This paper aims to discuss some practical issues when designing industry-based learning without boundaries. A case study approach is reviewed and presented.

An examination of learning design in elite springboard diving

The overarching aim of this programme of work was to evaluate the effectiveness of the existing learning environment within the Australian Institute of Sport (AIS) elite springboard diving programme. Unique to the current research programme, is the application of ideas from an established theory of motor learning, specifically ecological dynamics, to an applied high performance training environment. In this research programme springboard diving is examined as a complex system, where individual, task, and environmental constraints are continually interacting to shape performance. As a consequence, this thesis presents some necessary and unique insights into representative learning design and movement adaptations in a sample of elite athletes. The questions examined in this programme of work relate to how best to structure practice, which is central to developing an effective learning environment in a high performance setting. Specifically, the series of studies reported in the chapters of this doctoral thesis: (i) provide evidence for the importance of designing representative practice tasks in training; (ii) establish that completed and baulked (prematurely terminated) take-offs are not different enough to justify the abortion of a planned dive; and (iii), confirm that elite athletes performing complex skills are able to adapt their movement patterns to achieve consistent performance outcomes from variable dive take-off conditions. Chapters One and Two of the thesis provide an overview of the theoretical ideas framing the programme of work, and include a review of literature pertinent to the research aims and subsequent empirical chapters. Chapter Three examined the representativeness of take-off tasks completed in the two AIS diving training facilities routinely used in springboard diving. Results highlighted differences in the preparatory phase of reverse dive take-offs completed by elite divers during normal training tasks in the dry-land and aquatic training environments. The most noticeable differences in dive take-off between environments began during the hurdle (step, jump, height and flight) where the diver generates the necessary momentum to complete the dive. Consequently, greater step lengths, jump heights and flight times, resulted in greater board depression prior to take-off in the aquatic environment where the dives required greater amounts of rotation. The differences observed between the preparatory phases of reverse dive take-offs completed in the dry-land and aquatic training environments are arguably a consequence of the constraints of the training environment. Specifically, differences in the environmental information available to the athletes, and the need to alter the landing (feet first vs. wrist first landing) from the take-off, resulted in a decoupling of important perception and action information and a decomposition of the dive take-off task. In attempting to only practise high quality dives, many athletes have followed a traditional motor learning approach (Schmidt, 1975) and tried to eliminate take-off variations during training. Chapter Four examined whether observable differences existed between the movement kinematics of elite divers in the preparation phases of baulked (prematurely terminated) and completed take-offs that might justify this approach to training. Qualitative and quantitative analyses of variability within conditions revealed greater consistency and less variability when dives were completed, and greater variability amongst baulked take-offs for all participants. Based on these findings, it is probable that athletes choose to abort a planned take-off when they detect small variations from the movement patterns (e.g., step lengths, jump height, springboard depression) of highly practiced comfortable dives. However, with no major differences in coordination patterns (topology of the angle-angle plots), and the potential for negative performance outcomes in competition, there appears to be no training advantage in baulking on unsatisfactory take-offs during training, except when a threat of injury is perceived by the athlete. Instead, it was considered that enhancing the athletes' movement adaptability would be a more functional motor learning strategy. In Chapter Five, a twelve-week training programme was conducted to determine whether a sample of elite divers were able to adapt their movement patterns and complete dives successfully, regardless of the perceived quality of their preparatory movements on the springboard. The data indeed suggested that elite divers were able to adapt their movements during the preparatory phase of the take-off and complete good quality dives under more varied take-off conditions; displaying greater consistency and stability in the key performance outcome (dive entry). These findings are in line with previous research findings from other sports (e.g., shooting, triple jump and basketball) and demonstrate how functional or compensatory movement variability can afford greater flexibility in task execution. By previously only practising dives with good quality take-offs, it can be argued that divers only developed strong couplings between information and movement under very specific performance circumstances. As a result, this sample was sometimes characterised by poor performance in competition when the athletes experienced a suboptimal take-off. Throughout this training programme, where divers were encouraged to minimise baulking and attempt to complete every dive, they demonstrated that it was possible to strengthen the information and movement coupling in a variety of performance circumstances, widening of the basin of performance solutions and providing alternative couplings to solve a performance problem even when the take-off was not ideal. The results of this programme of research provide theoretical and experimental implications for understanding representative learning design and movement pattern variability in applied sports science research. Theoretically, this PhD programme contributes empirical evidence to demonstrate the importance of representative design in the training environments of high performance sports programmes. Specifically, this thesis advocates for the design of learning environments that effectively capture and enhance functional and flexible movement responses representative of performance contexts. Further, data from this thesis showed that elite athletes performing complex tasks were able to adapt their movements in the preparatory phase and complete good quality dives under more varied take-off conditions. This finding signals some significant practical implications for athletes, coaches and sports scientists. As such, it is recommended that care should be taken by coaches when designing practice tasks since the clear implication is that athletes need to practice adapting movement patterns during ongoing regulation of multi-articular coordination tasks. For example, volleyball servers can adapt to small variations in the ball toss phase, long jumpers can visually regulate gait as they prepare for the take-off, and springboard divers need to continue to practice adapting their take-off from the hurdle step. In summary, the studies of this programme of work have confirmed that the task constraints of training environments in elite sport performance programmes need to provide a faithful simulation of a competitive performance environment in order that performance outcomes may be stabilised with practice. Further, it is apparent that training environments can be enhanced by ensuring the representative design of task constraints, which have high action fidelity with the performance context. Ultimately, this study recommends that the traditional coaching adage 'perfect practice makes perfect", be reconsidered; instead advocating that practice should be, as Bernstein (1967) suggested, "repetition without repetition".

Enhancing teacher education : the School-Community Intergrated Learning (SCIL) pathway

National Australian reviews advocate exploring new models for preservice teacher education. This study investigates the outcomes of the School-Community Integrated Learning (SCIL) pathway as a model for advancing preservice teachers’ understandings of teaching. Thirty-two final-year preservice teachers were surveyed with extended written responses on how the SCIL pathway advanced their understandings of teaching. Results indicated 100% agreement on 6 of the 27 survey items. Indeed, 78% or more preservice teachers agreed that they had a range of experiences across the five categories (i.e., personal-professional skill development, understandings of system requirements, teaching practices, student behaviour and reflective practices). Extended responses suggested they had developed understandings around setting up classrooms, whole school planning processes with professional development, the allocation of teacher responsibilities (e.g., playground duties), parent-teacher interviews, diagnostic testing for literacy and numeracy, commencing running records of students’ assessment results, and the development of relationships (students, teachers and parents). Although a longitudinal study is required to determine long-term effects, the SCIL pathway may be viewed as a positive step towards preparing final-year preservice teachers for their first year as fully-fledged teachers.