Meta-evaluation to improve learning, evaluation capacity development and sustainability : Findings from a participatory evaluation project in Nepal

Recent studies suggest that meta-evaluation can be valuable in developing new approaches to evaluation, building evaluation capacities, and enhancing organizational learning. These new extensions of the concept of meta-evaluation are significant, given the growing emphasis on improving the quality and effectiveness of evaluation practices in the South Asian region. Following a review of the literature, this paper presents a case study of the use of concurrent meta-evaluation in the four-year project Assessing Communication for Social Change which developed and trialled a participatory impact assessment methodology in collaboration with a development communication Non-government organization (NGO) in Nepal. Key objectives of the meta-evaluation included to: continuously develop, adapt and improve the impact assessment methodology, Monitoring and Evaluation (M&E) systems and process and other project activities; identify impacts of the project; and build capacities in critical reflection and review. Our analysis indicates that this meta-evaluation was essential to understanding various constraints related to the organizational context that affected the success of the project and the development of improved M&E systems and capacities within the NGO. We identified several limitations of our meta-evaluation methods, which were balanced by the strengths of other methods. Our case study suggests that as well as assessing the quality, credibility and value of evaluation practices, meta-evaluations need to focus on important contextual issues that can have significant impacts on the outcomes of participatory evaluation projects. They include hierarchical organizational cultures, communication barriers, power/knowledge relations, and the time and resources available. Meta-evaluations also need to consider wider issues such as the sustainability of evaluation systems and approaches.

Coteaching social education : an oasis in changing times

With the introduction and continued steady roll-out of the Australian Curriculum, teaching Social Education in 21st Century Australia has become increasingly challenging. This article explores how two teacher-educators tackled the challenge when developing a new Social Education course at a Queensland university using the strategy of coteaching. During the case study, data were collated from cogenerative dialogues, pre-service teacher questionnaires, and reflective journals. The data were subsequently explored using concepts from cultural sociology such as capital (Bourdieu, 1977) and agency and structure (Sewell, 1992). This paper examines how coteaching afforded the teacher-educators a vehicle to develop innovative curriculum and model ways to create a productive learning environment that reflected the philosophy of Social Education. It therefore speaks to higher-education institutions and schools about ways for navigating the present educational milieu through the adoption of collaborative strategies based on ethical relations that promote shared decision-making and reflexive practices.

Team teaching : working together to promote student learning

This book chapter examines the concept of team teaching from the perspective of the various stakeholders, in order to discuss the advantages and disadvantages of team teaching for students, to consider the positive and negative dimensions of collaborative teaching for teachers, and to review the implications for educational administration. In addition, attention will be paid to the issues associated with team teaching in the context of e-learning. The chapter concludes with a case study which discusses how the implementation of collaborative teaching within the library and information science discipline at an Australian university helped develop the authors’ understanding of socially constructed knowledge.

Using cases in a mixed learning environment : meeting the challenges of higher education reform

This paper explains the context for pedagogy in a specific undergraduate course; the comparative benefits of using cases in a mixed learning environment (simultaneous large and small groups); and illustrates one significant way for universities to respond to increasing demand for delivery efficiency while maintaining high quality learning outcomes. Thus, to achieve objectives of the subject, tutorial classes expand on what is taught in lectures and provide the necessary context to analyse cases in more detail. A small, qualitative study explored experiences of market research tutors with the use of case method teaching reported. Implications of the study for case teaching in higher education are identified.

Researcher attitudes to data sharing : cultural change requires better motivations

While undertaking the ANDS RDA Gold Standard Record Exemplars project, research data sharing was discussed with many QUT researchers. Our experiences provided rich insight into researcher attitudes towards their data and the sharing of such data. Generally, we found traditional altruistic motivations for research data sharing did not inspire researchers, but an explanation of the more achievement-oriented benefits were more compelling.

Building community resilience – learning from the 2011 floods in Southeast Queensland, Australia

The year 2010 was the wettest year on record for Queensland, Australia and the wettest year since 1974 for Southeast Queensland. The extremely heavy rain in early January 2011 fell on the catchments of heavily saturated Brisbane and Stanley Rivers systems resulting in significant runoff which rapidly produced a widespread and devastating flood event. The area of inundation was equivalent to the total land area of France and Germany combined. Over 200,000 people were affected leaving 35 people dead and 9 missing. The damage bill was estimated at over $1B and cost to the economy at over $10B with over 30,000 homes and 6,000 business flooded and 86 towns and regional centres affected. The need to disburse disaster funding in a prompt manner to the affected population was paramount to facilitate individuals getting their lives back to some normality. However, the payout of insurance claims has proved to be a major area of community anger. The ongoing impasse in payment of insurance compensation is attributed to the nature and number of claims, confusing definition of flooding and the lack or accuracy of information needed to determine individually the properties affected and legitimacy of claims. Information was not readily available at the micro-level including, extent and type of inundation, flood heights at property level and cause of damage. Events during the aftermath highlighted widespread community misconceptions concerning the technical factors associated with the flood event and the impact of such on access to legitimate compensation and assistance. Individual and community wide concerns and frustration, anger and depression, have arisen resulting from delays in the timely settlement of insurance claims. Lessons learnt during the aftermath are presented in the context of their importance as a basis for inculcating communities impacted by the flood event with resilience for the future.

Bending and blurring blended learning boundaries [Extended Abstract]

This presentation presents a blended learning model that provides greater opportunity for learning to be self-managed and personalized.

Managing distraction in 21st century learning environments

First year students attend face-to-face classes armed with an arsenal of internet enabled digital devices. The conundrum is that while these devices offer scope for enhancing opportunities for engagement in face-to-face learning, they may simultaneously distract students away from learning and compound isolation issues. This paper considers how to best to use these devices for maximum engagement in first year face-to-face learning so as to assist students in connecting with other learners and instructors within the learning environment

A holistic blended design studio model : Exploring and expanding learning opportunities

This book involves a comprehensive study of the learning environment by adopting Grounded Theory methodology in a qualitative comparative way.It explores the limitations and benefits of a face-to-face and a virtual design studio as experienced by architecture students and educators at an Australian university in order to find the optimal combination for a blended environment to enhance the students’ experience. The main outcome:holistic multidimensional blended learning model,that through the various modalities,provides adaptive capacity in a range of settings.The model facilitates learning through self-determination,self-management,and the personalisation of the learning environment. Another outcome:a conceptual design education framework,provides a basic tool for educators to evaluate existing learning environments and to develop new learning environments with enough flexibility to respond effectively to a highly dynamic and increasingly technological world.The provision of a practical framework to assist design schools to improve their educational settings according to a suitable pedagogy that meets today’s needs and accommodates tomorrow’s changes.

The development of teacher assessment identity through participation in online moderation

Teachers’ professional conversations regarding the qualities evidenced in student work provide opportunities to develop a shared understanding of achievement standards. This research investigates social moderation conducted in a synchronous online mode as a specific form of professional conversation. The discussion considers the different factors that influenced these conversations which included the technologic medium of the meeting. The focus of the discussion is how participation in online moderation can support teachers to develop an assessment identity as one who works within a standards-based assessment system. Qualitative data were gathered from middle school teachers from different year levels, in different curriculum areas, in diverse geographic locations, and in a range of sociocultural contexts within Queensland, Australia. Analysis of the data through a sociocultural lens of becoming suggests that participation in online moderation, while challenging for teachers, can also provide opportunities to construct and to negotiate an identity as an assessor of student work.

Listening skill requires a further look into second/foreign language learning

Current English-as-a-second and foreign-language (ESL/EFL) research has encouraged to treat each communicative macroskill separately due to space constraint, but the interrelationship among these skills (listening, speaking, reading, and writing) is not paid due attention. This study attempts to examine first the existing relationship among the four dominant skills, second the potential impact of reading background on the overall language proficiency, and finally the relationship between listening and overall language proficiency as listening is considered an overlooked/passive skill in the pedagogy of the second/foreign language classroom. However, the literature in language learning has revealed that listening skill has salient importance in both first and second language learning. The purpose of this study is to investigate the role of each of four skills in EFL learning and their existing interrelationships in an EFL setting. The outcome of 701 Iranian applicants undertaking International English Language Testing System (IELTS) in Tehran demonstrates that all communicative macroskills have varied correlations from moderate (reading and writing) to high (listening and reading). The findings also show that the applicants’ reading history assisted them in better performing at high stakes tests, and what is more, listening skill was strongly correlated with the overall language proficiency.

Developing relationships that support learning and participation

Developing supportive, authentic and collaborative partnerships between all partners is crucial to inclusive school culture. This chapter highlights understandings of collaboration within such a culture. It also draws attention to what is involved in achieving these relationships, and identifies associated characteristics. In addition, it describes how successful collegial teams can be developed and ways in which teachers can work as collaborative members of these teams for students with disabilities within inclusive educational settings.

Towards visualising people’s ecology of hybrid personal learning environments

Ambient media architecture can provide place-based collaborative learning experiences and pathways for social interactions that would not be otherwise possible. This paper is concerned with ways of enhancing peer-to-peer learning affordances in library spaces; how can the library facilitate the community of library users to learn from each other? We report on the findings of a study that employed a participatory design method where participants were asked to reflect and draw places, social networks, and activities that they use to work (be creative, productive), play (have fun, socialize, be entertained), and learn (acquire new information, knowledge, or skills). The results illustrate how informal learning – learning outside the formal education system – is facilitated by a personal selection of physical and socio-cultural environments, as well as online tools, platforms, and networks. This paper sheds light on participants’ individually curated ecologies of their work, play, and learning related networks and the hybrid (physical and digital) nature of these places. These insights reveal opportunities for ambient media architecture to increase awareness of and connections between people’s hybrid personal learning environments.

An expanded critical incident approach for exploring information use and learning

Critical incidents offer a focus for exploratory research about human experiences, including information use and information literacy learning. This paper describes how critical incidents underpinned research about international students’ use of online information resources at two Australian universities. It outlines the development and application of an expanded critical incident approach (ECIA), explaining how ECIA built upon critical incident technique (CIT) and incorporated information literacy theory. It discusses points of expansion (differences) between CIT and ECIA. While CIT initially proved useful in structuring the research, the pilot study revealed methodological limitations. ECIA allowed more nuanced data analysis and the integration of reflection. The study produced a multifaceted word picture of international students’ experience of using online information resources to learn, and a set of critical findings about their information literacy learning needs. ECIA offers a fresh approach for researching information use, information experience, evidence-based practice, information literacy and informed learning.

The moderating role of learning on competitive advantage : longitudinal evidence from young firms

The question of how young firms reconcile the absence of well-established learning routines arising from the “liabilities of newness” with the “learning advantages of newness” has received scant attention in entrepreneurship. While older firms follow established learning routines and sometimes face problems in overcoming inertia, young firms with lower levels of inertia are better poised to explore, search and test unique avenues for their products and services. The process of learning and capability development as well as establishing uniqueness in their product offerings is an important part not only in the early stages of firm growth, but also in firm survival. Given their inexperience, for young firms, these learning processes are iterative and include contrasting learning loops that sometimes progress and at other times digress from initially perceived unique ideas. Such processes are embedded within capabilities that the firm develops and nurtures. Based on this premise and adopting a capabilities-based view, we examine how strategic networks and environmental knowledge affects uniqueness- mediated performance in young firms. We identify firms with digressive learning strategies based on their self-assessment of learning and compare them with other firms to demonstrate a differential effect on performance.