Understanding evaluation of learning support in mathematics and statistics

With rapid and continuing growth of learning support initiatives in mathematics and statistics found in many parts of the world, and with the likelihood that this trend will continue, there is a need to ensure that robust and coherent measures are in place to evaluate the effectiveness of these initiatives. The nature of learning support brings challenges for measurement and analysis of its effects. After briefly reviewing the purpose, rationale for, and extent of current provision, this article provides a framework for those working in learning support to think about how their efforts can be evaluated. It provides references and specific examples of how workers in this field are collecting, analysing and reporting their findings. The framework is used to structure evaluation in terms of usage of facilities, resources and services provided, and also in terms of improvements in performance of the students and staff who engage with them. Very recent developments have started to address the effects of learning support on the development of deeper approaches to learning, the affective domain and the development of communities of practice of both learners and teachers. This article intends to be a stimulus to those who work in mathematics and statistics support to gather even richer, more valuable, forms of data. It provides a 'toolkit' for those interested in evaluation of learning support and closes by referring to an on-line resource being developed to archive the growing body of evidence. © 2011 Taylor & Francis.

New perspectives on context-based chemistry education : using a dialectical sociocultural approach to view teaching and learning

Context-based chemistry education aims to improve student interest and motivation in chemistry by connecting canonical chemistry concepts with real-world contexts. Implementation of context-based chemistry programmes began 20 years ago in an attempt to make the learning of chemistry meaningful for students. This paper reviews such programmes through empirical studies on six international courses, ChemCom (USA), Salters (UK), Industrial Science (Israel), Chemie im Kontext (Germany), Chemistry in Practice (The Netherlands) and PLON (The Netherlands). These studies are categorised through emergent characteristics of: relevance, interest/attitudes motivation and deeper understanding. These characteristics can be found to an extent in a number of other curricular initiatives, such as science-technology-society approaches and problem-based learning or project based science, the latter of which often incorporates an inquiry-based approach to science education. These initiatives in science education are also considered with a focus on the characteristics of these approaches that are emphasised in context-based education. While such curricular studies provide a starting point for discussing context-based approaches in chemistry, to advance our understanding of how students connect canonical science concepts with the real-world context, a new theoretical framework is required. A dialectical sociocultural framework originating in the work of Vygotsky is used as a referent for analysing the complex human interactions that occur in context-based classrooms, providing teachers with recent information about the pedagogical structures and resources that afford students the agency to learn.

Less but more : weaving disparate disciplines together for learners to construct their own knowledge

This paper reports on a Professional Learning Program conducted in China with 140 general technology teachers. It aimed to integrate robotics technology across and within the disciplines of science, technology, engineering and mathematics. With the help of university facilitators teachers developed General Technology lessons that seamlessly integrated with rich learning content across disciplines. Teachers engaged in seminars and workshops, which provided the opportunities for them to actively couch sound principles of learning in their daily work. They gained first-hand experience in applying an aligned system of assessments, standards and quality learning experiences geared to the needs of each student. Teachers worked collaboratively in teams to create inquiry, design and collaborative learning activities that aligned with their curriculum and which dealt with real world problems, issues and challenges. They continually discussed and reflected deeply on the activities and shared the newly developed resources online with teachers across the entire country. It is evident from the preliminary analysis of data that teachers are beginning to apply rich pedagogical practices and are becoming ‘adaptive’ in their approach when using LEGO® robotic tools to design, redesign, create and re-create learning activities for their students.

Collaborative academic/practitioner research in project management : theory and models

Purpose – The purpose of this paper is to provide of a review of the theory and models underlying project management (PM) research degrees that encourage reflective learning. Design/methodology/approach – Review of the literature and reflection on the practice of being actively involved in conducting and supervising academic research and disseminating academic output. The paper argues the case for the potential usefulness of reflective academic research to PM practitioners. It also highlights theoretical drivers of and barriers to reflective academic research by PM practitioners. Findings – A reflective learning approach to research can drive practical results though it requires a great deal of commitment and support by both academic and industry partners. Practical implications – This paper suggests how PM practitioners can engage in academic research that has practical outcomes and how to be more effective at disseminating these research outcomes. Originality/value – Advanced academic degrees, in particular those completed by PM practitioners, can validate a valuable source of innovative ideas and approaches that should be more quickly absorbed into the PM profession’s sources of knowledge. The value of this paper is to critically review and facilitate a reduced adaptation time for implementation of useful reflective academic research to industry.

Informed learning in online environments : supporting the higher education curriculum beyond Web 2.0

As boundaries between physical and online learning spaces become increasingly blurred in higher education, how can students gain full benefit of Web 2.0 social media and mobile technologies for learning? How can we, as information professionals and educators, best support the information literacy learning needs of students who are universally mobile and Google-focused? This chapter presents informed learning (Bruce, 2008) as a pedagogical construct with potential to support learning across the higher education curriculum, for Web 2.0 and beyond. After outlining the principles of informed learning and how they may enrich the higher education curriculum, we explain the role of library and information professionals in promoting informed learning for Web 2.0 and beyond. Then, by way of illustration, we describe recent experience at an American university where librarians simultaneously learned about and applied informed learning principles in reshaping the information literacy program.

Getting stuck in together : improving work integrated learning from an Australian institution and faculty perspective

According to a recent report Australian higher education is not in crisis. However, we could be doing it better. The report Mapping Australian Higher Education (Norton, 2012) highlights comparative weaknesses such as levels f student engagement; interactions between students and academic staff; and academic staff preferences for research over teaching. The report points out that despite these concerns most graduates continue to get good, well-paid jobs, student satisfaction is improving, and levels of public confidence in Australian higher education are high. It also stresses that ‘the promise of higher education is that it provides adaptable cognitive skills, not that it always provides the job specific skills graduates will need in their future employment’ (Norton, 2012, p.58). This is worth keeping in mind as we contribute to the significant growth in curriculum initiatives aimed at preparing graduates for the world of work. Work Integrated Learning (WIL) is not a new concept but there is increased pressure on higher education globally to address graduate employability skills. The sector is under pressure in an increasingly competitive environment to demonstrate the relevance of courses, accountability and effective use of public funds (Peach & Gamble, 2011). In the Australian context this also means responding to the skills shortage in areas such as engineering, health, construction and business (DEEWR, 2010). This paper provides a brief overview of collaborative efforts over several years to improve the activity of WIL at the Queensland University of Technology (QUT). These efforts have resulted in changes to curriculum, pedagogy, systems and processes, and the initiation of local, regional, national, and international networks. The willingness of students, staff, and industry partners to ‘get stuck in’ and try new approaches in these different contexts can be understood as a form of boundary spanning. That is, the development of the capability to mediate between different forms of expertise and the demands of different contexts in order to nurture student learning and improve the outcomes of higher education through WIL (Peach, Cates, Ilg, Jones, Lechleiter, 2011).

Books, toys and tablets : playing and learning in the age of digital media

Introduction During a recent study of how parents source information about children‘s early learning, one of us made our first serious foray into a local store licensed to the global chain Toys'R' Us. While walking the aisles, closely observing layout, signage and stock, several things became obvious. Firstly, large numbers of toys were labeled'educational'. Secondly, many toys in that category were intended for children under the age of two years. These were further differentiated as intended for 'babies' or 'infants', and sub-categorized on packaging or shelving using even smaller age increments (e.g. 0-3 months, 12-18 months, and so on). Thirdly, many products were labeled as 'interactive' and 'learning' toys that promised to assist children‘s early learning and development. The activation of some of these toys relied on embedded computer chip technology and promised to 'connect' children with the home television, computer and the Internet. These products were hybrids between a toy and a platform for digital media interaction. Closer inspection of toy packaging and other promotional material suggested that industry had begun to invest heavily in developing highly differentiated children‘s markets for products that yoked together concepts of learning and development, the 'fun toy' that incorporates digital technology, and offline- and online participation. In this chapter we explore the growth of this contemporary cultural phenomenon that now connects books, toys and mobile digital media with children‘s play and learning.

Learning in and beyond small business advisory programmes

The purpose of this paper is to analyse how participants learn in small business advisory programmes and to explore the impact of these learning programmes on the development of reflective learning dispositions in participants. The research involves two case studies of small business advisory programmes in Queensland, a state of Australia. One involves training in the use of GPS/GIS technology amongst rural SMEs and the other seeks to develop improved management and operational capabilities in regional and metropolitan manufacturing SMEs. Face to face semi-structured interviews were conducted throughout rural, regional and metropolitan Queensland with participants, trainers and senior executives in the administering organisations that ran the programmes. Learning in these programmes occurs through a combination of interaction with others and the adoption of practice-based and learner-centred processes. The impact of the programmes on participants includes the development of reflective learning dispositions, improved confidence in learning and appreciation of the value of new knowledge to their business. The research suggests that small business training programmes have the potential to affect the development of critical reflective learning dispositions in participants which is of fundamental importance to the development of a learning or knowledge economy.

A holistic blended design studio model : a basis for exploring and expanding learning opportunities

While the studio environment has been promoted as an ideal educational setting for project-based disciplines, few qualitative studies have been undertaken in a comprehensive way (Bose, 2007). This study responds to this need by adopting Grounded Theory methodology in a qualitative comparative approach. The research aims to explore the limitations and benefits of a face-to-face (f2f) design studio as well as a virtual design studio (VDS) as experienced by architecture students and educators at an Australian university in order to find the optimal combination for a blended environment to maximize learning. The main outcome is a holistic multidimensional blended model being sufficiently flexible to adapt to various setting, in the process, facilitating constructivist learning through self-determination, self-management, and personalization of the learning environment.

Australian higher education evaluation through assurance of learning

A collaborative research project conducted by five Australian universities inquired into the philosophy and motivation for Assurance of Learning (AoL) as a process of education evaluation. Associate Deans Teaching and Learning representing Business schools from twenty-five universities across Australia participated in telephone interviews. Data was analysed using NVIVO9. Results indicated that articulated rationale for AoL was both ensuring that students had acquired the attributes and skills the universities claimed they had, and the philosophy of continuous improvement. AoL was motivated both by ritualistic objectives to satisfy accreditation requirements and virtuous agendas for quality improvement. Closing-the-loop was emphasised, but was mostly wishful thinking for next steps beyond data collection and reporting. AoL was conceptualised as one element within the larger context of quality review, but there was no evidence of comprehensive frameworks or strategic plans.

Team teaching : working together to promote student learning

This book chapter examines the concept of team teaching from the perspective of the various stakeholders, in order to discuss the advantages and disadvantages of team teaching for students, to consider the positive and negative dimensions of collaborative teaching for teachers, and to review the implications for educational administration. In addition, attention will be paid to the issues associated with team teaching in the context of e-learning. The chapter concludes with a case study which discusses how the implementation of collaborative teaching within the library and information science discipline at an Australian university helped develop the authors’ understanding of socially constructed knowledge.

Towards visualising people’s ecology of hybrid personal learning environments

Ambient media architecture can provide place-based collaborative learning experiences and pathways for social interactions that would not be otherwise possible. This paper is concerned with ways of enhancing peer-to-peer learning affordances in library spaces; how can the library facilitate the community of library users to learn from each other? We report on the findings of a study that employed a participatory design method where participants were asked to reflect and draw places, social networks, and activities that they use to work (be creative, productive), play (have fun, socialize, be entertained), and learn (acquire new information, knowledge, or skills). The results illustrate how informal learning – learning outside the formal education system – is facilitated by a personal selection of physical and socio-cultural environments, as well as online tools, platforms, and networks. This paper sheds light on participants’ individually curated ecologies of their work, play, and learning related networks and the hybrid (physical and digital) nature of these places. These insights reveal opportunities for ambient media architecture to increase awareness of and connections between people’s hybrid personal learning environments.

An expanded critical incident approach for exploring information use and learning

Critical incidents offer a focus for exploratory research about human experiences, including information use and information literacy learning. This paper describes how critical incidents underpinned research about international students’ use of online information resources at two Australian universities. It outlines the development and application of an expanded critical incident approach (ECIA), explaining how ECIA built upon critical incident technique (CIT) and incorporated information literacy theory. It discusses points of expansion (differences) between CIT and ECIA. While CIT initially proved useful in structuring the research, the pilot study revealed methodological limitations. ECIA allowed more nuanced data analysis and the integration of reflection. The study produced a multifaceted word picture of international students’ experience of using online information resources to learn, and a set of critical findings about their information literacy learning needs. ECIA offers a fresh approach for researching information use, information experience, evidence-based practice, information literacy and informed learning.

Articulation in property programs : an international multi-campus tertiary model

This paper will present program developers and institutional administrators with a program delivery model suitable for cross cultural international delivery developing students from industry through to master’s level tertiary qualifications. The model was designed to meet the needs of property professionals from an industry where technical qualifications are the norm and tertiary qualifications are emerging. A further need was to develop and deliver a program that enhanced the University’s current program profile in both the domestic and international arenas. Early identification of international educational partners, industry need and the ability to service the program were vital to the successful development of Master of Property program. The educational foundations of the program rest in educational partners, local tutorial support, international course management, cultural awareness of and in content, online communication fora, with a delivery focus on problem-based learning, self-directed study, teamwork and the development of a global understanding and awareness of the international property markets. In enrolling students from a diverse cultural background with technical qualifications and/or extensive work experience there are a number of educational barriers to be overcome for all students to successfully progress and complete the program. These barriers disappear when the following mechanisms are employed: individual student pathways, tutorial support by qualified peers, enculturation into tertiary practice, assessment tasks that recognise cultural norms and values, and finally that value is placed on the experiential knowledge, cultural practices and belief systems of the students.

Solo life to Second Life : the design of physical and virtual learning spaces inspired by the drama classroom

This paper explores the design of virtual and physical learning spaces developed for students of drama and theatre studies. What can we learn from the traditional drama workshop that will inform the design of drama and theatre spaces created in technology-mediated learning environments? The authors examine four examples of spaces created for online, distance and on-campus students and discuss the relationship between the choice of technology, the learning and teaching methods, and the outcomes for student engagement. Combining insights from two previous action research projects, the discussion focuses on the physical space used for contemporary drama workshops, supplemented by Web 2.0 technologies; a modular online theatre studies course; the blogging space of students creating a group devised play; and the open and immersive world of Second Life, where students explore 3D simulations of historical theatre sites. The authors argue that the drama workshop can be used as inspiration for the design of successful online classrooms. This is achieved by focusing on students’ contributions to the learning as individuals and group members, the aesthetics and mise-en-scene of the learning space, and the role of mobile and networked technologies. Students in this environment increase their capacity to become co-creators of knowledge and to achieve creative outcomes. The drama workshop space in its physical and virtual forms is seen as a model for classrooms in other disciplines, where dynamic, creative and collaborative spaces are required.