A formative evaluation of the Stronger Smarter Learning Communities Project. 2011 report.

This report is a formative evaluation of the operations of the DEEWR funded Stronger Smarter Learning Community (SSLC) project from September 2009 to July 2011. It is undertaken by an independent team of researchers from Queensland University of Technology, the University of Newcastle and Harvard University. It reports on findings from: documentary analysis; qualitative case studies of SSLC Hub schools; descriptive, multivariate and multilevel analysis of survey data from school leaders and teachers from SSLC Hub and Affiliate schools and from a control group of non-SSLC schools; and multilevel analysis of school-level data on SSLC Hubs, Affiliates and ACARA like-schools. Key findings from this work are that: • SSLC school leaders and teachers are reporting progress in changing school ethos around issues of: recognition of Indigenous identity, Indigenous leadership, innovative approaches to staffing and school models, Indigenous community engagement and high expectations leadership; • Many Stronger Smarter messages are reportedly having better uptake in schools with high percentages of Indigenous students; • There are no major or consistent patterns of differences between SSLC and non-SSLC schools in teacher and school leader self-reports of curriculum and pedagogy practices; and • There is no evidence to date that SSLC Hubs and Affiliates have increased attendance or increased achievement gains compared to ACARA like-schools. Twenty-one months is relatively early in this school reform project. Hence the major focus of subsequent reports will be on the documentation of comparative longitudinal gains in achievement tests and improved attendance. The 2011 and 2012 research also will model the relationships between change in school ethos/climate, changed Indigenous community relations, improved curriculum/pedagogy, and gains in Indigenous student achievement, attendance and outcomes. The key challenge for SSLC and the Stronger Smarter approach will be whether it can systematically generate change and reform in curriculum and pedagogy practices that can be empirically linked to improved student outcomes.

Good Practice Report : Blended Learning

In early 2011, the Australian Learning and Teaching Council Ltd (ALTC) commissioned a series of Good Practice Reports on completed ALTC projects and fellowships. This report will: • Provide a summative evaluation of the good practices and key outcomes for teaching and learning from completed ALTC projects and fellowships relating to blended learning • Include a literature review of the good practices and key outcomes for teaching and learning from national and international research • Identify areas in which further work or development are appropriate. The literature abounds with definitions; it can be argued that the various definitions incorporate different perspectives, but there is no single, collectively accepted definition. Blended learning courses in higher education can be placed somewhere on a continuum, between fully online and fully face-to-face courses. Consideration must therefore be given to the different definitions for blended learning presented in the literature and by users and stakeholders. The application of this term in these various projects and fellowships is dependent on the particular focus of the team and the conditions and situations under investigation. One of the key challenges for projects wishing to develop good practice in blended learning is the lack of a universally accepted definition. The findings from these projects and fellowships reveal the potential of blended learning programs to improve both student outcomes and levels of satisfaction. It is clear that this environment can help teaching and learning engage students more effectively and allow greater participation than traditional models. Just as there are many definitions, there are many models and frameworks that can be successfully applied to the design and implementation of such courses. Each academic discipline has different learning objectives and in consequence there can’t be only one correct approach. This is illustrated by the diversity of definitions and applications in the ALTC funded projects and fellowships. A review of the literature found no universally accepted guidelines for good practice in higher education. To inform this evaluation and literature review, the Seven Principles for Good Practice in Undergraduate Education, as outlined by Chickering and Gamson (1987), were adopted: 1. encourages contacts between students and faculty 2. develops reciprocity and cooperation among students 3. uses active learning techniques 4. gives prompt feedback 5. emphasises time on task 6. communicates high expectations 7. respects diverse talents and ways of learning. These blended learning projects have produced a wide range of resources that can be used in many and varied settings. These resources include: books, DVDs, online repositories, pedagogical frameworks, teaching modules. In addition there is valuable information contained in the published research data and literature reviews that inform good practice and can assist in the development of courses that can enrich and improve teaching and learning.

The professional conversation : a new approach to professional learning in early childhood education and care

In 2009, Australia celebrated the introduction of a national Early Years Learning Framework. This is a critical component in a series of educational reforms designed to support quality pedagogy and practice in early childhood education and care (ECEC) and successful transition to school. As with any policy change, success in real terms relies upon building shared understanding and the capacity of educators to apply new knowledge and support change and improved practice within their service. With these outcomes in mind, a collaborative research project is investigating the efficacy of a new approach to professional learning in ECEC: The professional conversation. This paper provides an overview of the professional conversation approach, including underpinning principles and the design and use of reflective questions to support meaningful conversation and learning.

Can transfer of learning be enriched by valuing knowledge transformation and co-creation? Exploring new ways to improve training design

This paper argues that a possible cause of issues with management education outcomes is the fact that most training models operate from a limited ‘transfer’ metaphor. This theoretical paper contends that by reconceptualising existing models, specifically Holton’s transfer of learning model, to incorporate multiple processes and acknowledge the importance of educator- or trainer-student interaction in co-creating knowledge, there is potential to improve training design and ultimately achieve more satisfactory training outcomes.

Developing and enhancing independent learning skills : using video tutorials as a means of helping students help themselves

Purpose – The purpose of this paper is to examine the use of short video tutorials in a post-graduate accounting subject, as a means of helping students develop and enhance independent learning skills. Design/methodology/approach – In total, five short (approximately five to 10 minutes) video tutorials were introduced in an effort to shift the reliance for learning from the lecturer to the student. Data on students’ usage of online video tutorials, and comments by students in university questionnaires were collated over three semesters from 2008 to 2009. Interviews with students were then conducted in late 2009 to more comprehensively evaluate the use and perceived benefits of video tutorials. Findings – Findings reveal preliminary but positive outcomes in terms of both more efficient and effective teaching and learning. Research limitations/implications – The shift towards more independent learning through the use of video tutorials has positive implications for educators, employers, and professional accounting bodies; each of whom has identified the need for this skill in accounting graduates. Practical implications – The use of video tutorials has the potential for more rewarding teaching and more effective learning. Originality/value – This study is one of the first to examine the use and benefits of video tutorials as a means of developing independent learning skills in accountancy students – addressing a key concern within the profession.

Teachers' conceptions of how to engage students through inquiry learning : foundations for STEM

The advocacy for inquiry-based learning in contemporary curricula assumes the principle that students learn in their own way by drawing on direct experience fostered by the teacher. That students should be able to discover answers themselves through active engagement with new experiences was central to the thinking of eminent educators such as Pestalozzi, Dewey and Montessori. However, even after many years of research and practice, inquiry learning as a referent for teaching still struggles to find expression in the average teachers' pedagogy. This study drew on interview data from 20 primary teachers. A phenomenographic analysis revealed three conceptions of teaching that support inquiry learning in science in the primary years of schooling: (a) The Experience-centred conception where teachers focused on providing interesting sensory experiences to students; (b) The Problem-centred conception where teachers focused on challenging students with engaging problems; and (c) The Question-centred conception where teachers focused on helping students to ask and answer their own questions. Understanding teachers' conceptions of teaching has implications for both the enactment of inquiry teaching in the classroom as well as the uptake of new teaching behaviours during professional development, with enhanced outcomes for engaging students in STEM.

Learning science through real-world contexts

Curriculum developers and researchers have promoted context based programmes to arrest waning student interest and participation in the enabling sciences at high school and university. Context-based programmes aim for connections between scientific discourse and real-world contexts to elevate curricular relevance without diminishing conceptual understanding. Literature relating to context-based approaches to learning will be reviewed in this chapter. In particular, international trends in curricular development and results from evaluations of major projects (e.g. PLON, Salters Advanced Chemistry, ChemCom) will be highlighted. Research projects that explore context-based interventions focusing on such outcomes as student interest, perceived relevance and conceptual understanding also will feature in the review. The chapter culminates with a discussion of current context-based research that interprets classroom actions from a dialectical socio-cultural framework, and identifies possible new directions for research.

Getting stuck in together : improving work integrated learning from an Australian institution and faculty perspective

According to a recent report Australian higher education is not in crisis. However, we could be doing it better. The report Mapping Australian Higher Education (Norton, 2012) highlights comparative weaknesses such as levels f student engagement; interactions between students and academic staff; and academic staff preferences for research over teaching. The report points out that despite these concerns most graduates continue to get good, well-paid jobs, student satisfaction is improving, and levels of public confidence in Australian higher education are high. It also stresses that ‘the promise of higher education is that it provides adaptable cognitive skills, not that it always provides the job specific skills graduates will need in their future employment’ (Norton, 2012, p.58). This is worth keeping in mind as we contribute to the significant growth in curriculum initiatives aimed at preparing graduates for the world of work. Work Integrated Learning (WIL) is not a new concept but there is increased pressure on higher education globally to address graduate employability skills. The sector is under pressure in an increasingly competitive environment to demonstrate the relevance of courses, accountability and effective use of public funds (Peach & Gamble, 2011). In the Australian context this also means responding to the skills shortage in areas such as engineering, health, construction and business (DEEWR, 2010). This paper provides a brief overview of collaborative efforts over several years to improve the activity of WIL at the Queensland University of Technology (QUT). These efforts have resulted in changes to curriculum, pedagogy, systems and processes, and the initiation of local, regional, national, and international networks. The willingness of students, staff, and industry partners to ‘get stuck in’ and try new approaches in these different contexts can be understood as a form of boundary spanning. That is, the development of the capability to mediate between different forms of expertise and the demands of different contexts in order to nurture student learning and improve the outcomes of higher education through WIL (Peach, Cates, Ilg, Jones, Lechleiter, 2011).

A randomised trial of a psychosocial intervention for cancer patients integrated into routine care: The PROMPT study (promoting optimal outcomes in mood through tailored psychosocial therapies)

Background Despite evidence that up to 35% of patients with cancer experience significant distress, access to effective psychosocial care is limited by lack of systematic approaches to assessment, a paucity of psychosocial services, and patient reluctance to accept treatment either because of perceived stigma or difficulties with access to specialist psycho-oncology services due to isolation or disease burden. This paper presents an overview of a randomised study to evaluate the effectiveness of a brief tailored psychosocial Intervention delivered by health professionals in cancer care who undergo focused training and participate in clinical supervision. Methods/design Health professionals from the disciplines of nursing, occupational therapy, speech pathology, dietetics, physiotherapy or radiation therapy will participate in training to deliver the psychosocial Intervention focusing on core concepts of supportive-expressive, cognitive and dignity-conserving care. Health professional training will consist of completion of a self-directed manual and participation in a skills development session. Participating health professionals will be supported through structured clinical supervision whilst delivering the Intervention. In the stepped wedge design each of the 5 participating clinical sites will be allocated in random order from Control condition to Training then delivery of the Intervention. A total of 600 patients will be recruited across all sites. Based on level of distress or risk factors eligible patients will receive up to 4 sessions, each of up to 30 minutes in length, delivered face-to-face or by telephone. Participants will be assessed at baseline and 10-week follow-up. Patient outcome measures include anxiety and depression, quality of life, unmet psychological and supportive care needs. Health professional measures include psychological morbidity, stress and burnout. Process evaluation will be conducted to assess perceptions of participation in the study and the factors that may promote translation of learning into practice. Discussion This study will provide important information about the effectiveness of a brief tailored psychological Intervention for patients with cancer and the potential to prevent development of significant distress in patients considered at risk. It will yield data about the feasibility of this model of care in routine clinical practice and identify enablers and barriers to its systematic implementation in cancer settings.

Meta-evaluation to improve learning, evaluation capacity development and sustainability : Findings from a participatory evaluation project in Nepal

Recent studies suggest that meta-evaluation can be valuable in developing new approaches to evaluation, building evaluation capacities, and enhancing organizational learning. These new extensions of the concept of meta-evaluation are significant, given the growing emphasis on improving the quality and effectiveness of evaluation practices in the South Asian region. Following a review of the literature, this paper presents a case study of the use of concurrent meta-evaluation in the four-year project Assessing Communication for Social Change which developed and trialled a participatory impact assessment methodology in collaboration with a development communication Non-government organization (NGO) in Nepal. Key objectives of the meta-evaluation included to: continuously develop, adapt and improve the impact assessment methodology, Monitoring and Evaluation (M&E) systems and process and other project activities; identify impacts of the project; and build capacities in critical reflection and review. Our analysis indicates that this meta-evaluation was essential to understanding various constraints related to the organizational context that affected the success of the project and the development of improved M&E systems and capacities within the NGO. We identified several limitations of our meta-evaluation methods, which were balanced by the strengths of other methods. Our case study suggests that as well as assessing the quality, credibility and value of evaluation practices, meta-evaluations need to focus on important contextual issues that can have significant impacts on the outcomes of participatory evaluation projects. They include hierarchical organizational cultures, communication barriers, power/knowledge relations, and the time and resources available. Meta-evaluations also need to consider wider issues such as the sustainability of evaluation systems and approaches.

Mentoring preservice teachers' reflective practices towards producing teaching outcomes

Reflective practice appears crucial for professional growth, and making connections between mentoring practices and mentees’ reflections may assist mentors to guide reflective processes. This interpretive study initially explores, through the literature (e.g., Dewey, Schön), common processes of reflective thinking and uses a mentoring feedback framework with six practices to collect and analyse video, audio and observational data around two mentor-mentee case studies. The findings showed that these mentors (experienced primary teachers) articulated expectations for teaching, modelled reflective practices to their mentees (preservice teachers), and facilitated time and opportunities for advancing teaching practices, which influenced the mentees’ reflective practices and their pedagogical development. This study showed that the mentors’ personal attributes influenced the mentoring relationship and the mentees’ abilities to critically reflect on their practices.

Learning to think spatially : what do students 'see' in numeracy test items?

Learning to think spatially in mathematics involves developing proficiency with graphics. This paper reports on 2 investigations of spatial thinking and graphics. The first investigation explored the importance of graphics as 1 of 3 communication systems (i.e. text, symbols, graphics) used to provide information in numeracy test items. The results showed that graphics were embedded in at least 50 % of test items across 3 year levels. The second investigation examined 11 – 12-year-olds’ performance on 2 mathematical tasks which required substantial interpretation of graphics and spatial thinking. The outcomes revealed that many students lacked proficiency in the basic spatial skills of visual memory and spatial perception and the more advanced skills of spatial orientation and spatial visualisation. This paper concludes with a reaffirmation of the importance of spatial thinking in mathematics and proposes ways to capitalize on graphics in learning to think spatially.

Looking Yonder : Longitudinal Research and Evaluation of the Yonder Participative Arts-based Learning Model Report 2010-2012

Since 2007, KITE Arts Education Program @ QPAC has been engaged in a series of arts and drama-based experiences for students in selected primary schools on the edges of Brisbane and in regional Queensland. The in-school workshop experiences of the program have culminated in a performance by the children for their school community, parents and carers at the Queensland Performing Arts Centre or a regional cultural venue. In conducting an analysis of the Yonder project, the researcher aimed to provide evidence of outcomes brought about through participation by schools, school staff, students and their communities in the Yonder project. To develop longitudinal data project initiators, participants were interviewed at six-monthly intervals to establish patterns of engagement and participation. The report analyses arts-based workshops conducted by the teacher artist in edge-city Brisbane and a regional centre; interviews with teachers and school administrators from the participating schools; interviews with teacher artist and professional artists; interviews with community partners; teacher professional development workshops; community-based workshops; performance outcomes that were the culminating events of the workshop program; student work samples and student reflections on the program. This document covers data and project outputs from February 2010 to July 2012. There have been five iterations of the Yonder project since its commencement in mid-2009 — three in regional Queensland (February–April 2010; February–May 2011; February–May 2012) and two in edge-city1 Brisbane (July–September 2010; August–October 2011). This report is a result of a research partnership between Queensland Performing Arts Centre and Queensland University of Technology (QUT) Creative Industries Faculty(Drama).

Enriching students’ intellectual diet through inquiry based learning

Traditionally, Science education has stressed the importance of teaching students to conduct ‘scientific inquiry’, with the main focus being the experimental model of inquiry used by real world scientists. Current educational approaches using constructivist pedagogy recognise the value of inquiry as a method for promoting the development of deep understanding of discipline content. A recent Information Learning Activity undertaken by a Grade Eight Science class was observed to discover how inquiry based learning is implemented in contemporary Science education. By analysing student responses to questionnaires and assessment task outcomes, the author was able to determine the level of inquiry inherent in the activity and how well the model supported student learning and the development of students’ information literacy skills. Although students achieved well overall, some recommendations are offered that may enable teachers to better exploit the learning opportunities provided by inquiry based learning. Planning interventions at key stages of the inquiry process can assist students to learn more effective strategies for dealing with cognitive and affective challenges. Allowing students greater input into the selection of topic or focus of the activity may encourage students to engage more deeply with the learning task. Students are likely to experience greater learning benefit from access to developmentally appropriate resources, increased time to explore topics and multiple opportunities to undertake information searches throughout the learning activity. Finally, increasing the cognitive challenge can enhance both the depth of students’ learning and their information literacy skills.

Learning processes in creative industries initiatives in developing countries : an examination of policy and practice

What does a dance group in Benin that mixes contemporary and ethnic dancing have in common with Mongolian felt producers that want to enter the design market in Europe? These are both examples of learning processes in Creative Industries initiatives in developing countries. Following the concept of sustainable development, I argue that the challenge for developing countries in contemporary society is to meet the very real need of people for economic development and opportunities for income generation, while at the same time avoiding unintended and unwanted consequences of economic development and globalisation. The concept of the Creative Industries may be a way to promote a development that is sustainable and avoids social exclusion of groups-at-risk. In line with this, I argue that the Creative Industries sector could, in fact, link economic development and the continuation and evolution of local traditions and cultural heritage. A pressing question then is: how can education and learning contribute to creating a context in which talent can flourish? This study aims to provide a comprehensive analysis of the research problem of this thesis: what elements are conducive for individual learning processes in creative development initiatives? In this, I argue that it is crucial to determine what ingredients and characteristics contribute to making these initiatives successful, that is, to meet their specific goals, in a developing context. This is explored through a staged analysis: an overview of quantitative data, an inventory and comparative case studies and, finally, the description and analysis of two in-depth case studies – felt design in Mongolia (Asia) and dance in Benin (Africa), in which I was an observer of the action phase of the local interventions. The analysis culminates in practice-related outcomes related to the operation of creative development initiatives, as well as the contribution to the academic debate on issues like the cultural gap between developed and developing countries, transformative learning and the connection of learning spaces.