Meta-evaluation to improve learning, evaluation capacity development and sustainability : Findings from a participatory evaluation project in Nepal

Recent studies suggest that meta-evaluation can be valuable in developing new approaches to evaluation, building evaluation capacities, and enhancing organizational learning. These new extensions of the concept of meta-evaluation are significant, given the growing emphasis on improving the quality and effectiveness of evaluation practices in the South Asian region. Following a review of the literature, this paper presents a case study of the use of concurrent meta-evaluation in the four-year project Assessing Communication for Social Change which developed and trialled a participatory impact assessment methodology in collaboration with a development communication Non-government organization (NGO) in Nepal. Key objectives of the meta-evaluation included to: continuously develop, adapt and improve the impact assessment methodology, Monitoring and Evaluation (M&E) systems and process and other project activities; identify impacts of the project; and build capacities in critical reflection and review. Our analysis indicates that this meta-evaluation was essential to understanding various constraints related to the organizational context that affected the success of the project and the development of improved M&E systems and capacities within the NGO. We identified several limitations of our meta-evaluation methods, which were balanced by the strengths of other methods. Our case study suggests that as well as assessing the quality, credibility and value of evaluation practices, meta-evaluations need to focus on important contextual issues that can have significant impacts on the outcomes of participatory evaluation projects. They include hierarchical organizational cultures, communication barriers, power/knowledge relations, and the time and resources available. Meta-evaluations also need to consider wider issues such as the sustainability of evaluation systems and approaches.

Team teaching : working together to promote student learning

This book chapter examines the concept of team teaching from the perspective of the various stakeholders, in order to discuss the advantages and disadvantages of team teaching for students, to consider the positive and negative dimensions of collaborative teaching for teachers, and to review the implications for educational administration. In addition, attention will be paid to the issues associated with team teaching in the context of e-learning. The chapter concludes with a case study which discusses how the implementation of collaborative teaching within the library and information science discipline at an Australian university helped develop the authors’ understanding of socially constructed knowledge.

Using cases in a mixed learning environment : meeting the challenges of higher education reform

This paper explains the context for pedagogy in a specific undergraduate course; the comparative benefits of using cases in a mixed learning environment (simultaneous large and small groups); and illustrates one significant way for universities to respond to increasing demand for delivery efficiency while maintaining high quality learning outcomes. Thus, to achieve objectives of the subject, tutorial classes expand on what is taught in lectures and provide the necessary context to analyse cases in more detail. A small, qualitative study explored experiences of market research tutors with the use of case method teaching reported. Implications of the study for case teaching in higher education are identified.

Building community resilience – learning from the 2011 floods in Southeast Queensland, Australia

The year 2010 was the wettest year on record for Queensland, Australia and the wettest year since 1974 for Southeast Queensland. The extremely heavy rain in early January 2011 fell on the catchments of heavily saturated Brisbane and Stanley Rivers systems resulting in significant runoff which rapidly produced a widespread and devastating flood event. The area of inundation was equivalent to the total land area of France and Germany combined. Over 200,000 people were affected leaving 35 people dead and 9 missing. The damage bill was estimated at over $1B and cost to the economy at over $10B with over 30,000 homes and 6,000 business flooded and 86 towns and regional centres affected. The need to disburse disaster funding in a prompt manner to the affected population was paramount to facilitate individuals getting their lives back to some normality. However, the payout of insurance claims has proved to be a major area of community anger. The ongoing impasse in payment of insurance compensation is attributed to the nature and number of claims, confusing definition of flooding and the lack or accuracy of information needed to determine individually the properties affected and legitimacy of claims. Information was not readily available at the micro-level including, extent and type of inundation, flood heights at property level and cause of damage. Events during the aftermath highlighted widespread community misconceptions concerning the technical factors associated with the flood event and the impact of such on access to legitimate compensation and assistance. Individual and community wide concerns and frustration, anger and depression, have arisen resulting from delays in the timely settlement of insurance claims. Lessons learnt during the aftermath are presented in the context of their importance as a basis for inculcating communities impacted by the flood event with resilience for the future.

Bending and blurring blended learning boundaries [Extended Abstract]

This presentation presents a blended learning model that provides greater opportunity for learning to be self-managed and personalized.

Managing distraction in 21st century learning environments

First year students attend face-to-face classes armed with an arsenal of internet enabled digital devices. The conundrum is that while these devices offer scope for enhancing opportunities for engagement in face-to-face learning, they may simultaneously distract students away from learning and compound isolation issues. This paper considers how to best to use these devices for maximum engagement in first year face-to-face learning so as to assist students in connecting with other learners and instructors within the learning environment

A holistic blended design studio model : Exploring and expanding learning opportunities

This book involves a comprehensive study of the learning environment by adopting Grounded Theory methodology in a qualitative comparative way.It explores the limitations and benefits of a face-to-face and a virtual design studio as experienced by architecture students and educators at an Australian university in order to find the optimal combination for a blended environment to enhance the students’ experience. The main outcome:holistic multidimensional blended learning model,that through the various modalities,provides adaptive capacity in a range of settings.The model facilitates learning through self-determination,self-management,and the personalisation of the learning environment. Another outcome:a conceptual design education framework,provides a basic tool for educators to evaluate existing learning environments and to develop new learning environments with enough flexibility to respond effectively to a highly dynamic and increasingly technological world.The provision of a practical framework to assist design schools to improve their educational settings according to a suitable pedagogy that meets today’s needs and accommodates tomorrow’s changes.

Listening skill requires a further look into second/foreign language learning

Current English-as-a-second and foreign-language (ESL/EFL) research has encouraged to treat each communicative macroskill separately due to space constraint, but the interrelationship among these skills (listening, speaking, reading, and writing) is not paid due attention. This study attempts to examine first the existing relationship among the four dominant skills, second the potential impact of reading background on the overall language proficiency, and finally the relationship between listening and overall language proficiency as listening is considered an overlooked/passive skill in the pedagogy of the second/foreign language classroom. However, the literature in language learning has revealed that listening skill has salient importance in both first and second language learning. The purpose of this study is to investigate the role of each of four skills in EFL learning and their existing interrelationships in an EFL setting. The outcome of 701 Iranian applicants undertaking International English Language Testing System (IELTS) in Tehran demonstrates that all communicative macroskills have varied correlations from moderate (reading and writing) to high (listening and reading). The findings also show that the applicants’ reading history assisted them in better performing at high stakes tests, and what is more, listening skill was strongly correlated with the overall language proficiency.

Developing relationships that support learning and participation

Developing supportive, authentic and collaborative partnerships between all partners is crucial to inclusive school culture. This chapter highlights understandings of collaboration within such a culture. It also draws attention to what is involved in achieving these relationships, and identifies associated characteristics. In addition, it describes how successful collegial teams can be developed and ways in which teachers can work as collaborative members of these teams for students with disabilities within inclusive educational settings.

Towards visualising people’s ecology of hybrid personal learning environments

Ambient media architecture can provide place-based collaborative learning experiences and pathways for social interactions that would not be otherwise possible. This paper is concerned with ways of enhancing peer-to-peer learning affordances in library spaces; how can the library facilitate the community of library users to learn from each other? We report on the findings of a study that employed a participatory design method where participants were asked to reflect and draw places, social networks, and activities that they use to work (be creative, productive), play (have fun, socialize, be entertained), and learn (acquire new information, knowledge, or skills). The results illustrate how informal learning – learning outside the formal education system – is facilitated by a personal selection of physical and socio-cultural environments, as well as online tools, platforms, and networks. This paper sheds light on participants’ individually curated ecologies of their work, play, and learning related networks and the hybrid (physical and digital) nature of these places. These insights reveal opportunities for ambient media architecture to increase awareness of and connections between people’s hybrid personal learning environments.

An expanded critical incident approach for exploring information use and learning

Critical incidents offer a focus for exploratory research about human experiences, including information use and information literacy learning. This paper describes how critical incidents underpinned research about international students’ use of online information resources at two Australian universities. It outlines the development and application of an expanded critical incident approach (ECIA), explaining how ECIA built upon critical incident technique (CIT) and incorporated information literacy theory. It discusses points of expansion (differences) between CIT and ECIA. While CIT initially proved useful in structuring the research, the pilot study revealed methodological limitations. ECIA allowed more nuanced data analysis and the integration of reflection. The study produced a multifaceted word picture of international students’ experience of using online information resources to learn, and a set of critical findings about their information literacy learning needs. ECIA offers a fresh approach for researching information use, information experience, evidence-based practice, information literacy and informed learning.

The moderating role of learning on competitive advantage : longitudinal evidence from young firms

The question of how young firms reconcile the absence of well-established learning routines arising from the “liabilities of newness” with the “learning advantages of newness” has received scant attention in entrepreneurship. While older firms follow established learning routines and sometimes face problems in overcoming inertia, young firms with lower levels of inertia are better poised to explore, search and test unique avenues for their products and services. The process of learning and capability development as well as establishing uniqueness in their product offerings is an important part not only in the early stages of firm growth, but also in firm survival. Given their inexperience, for young firms, these learning processes are iterative and include contrasting learning loops that sometimes progress and at other times digress from initially perceived unique ideas. Such processes are embedded within capabilities that the firm develops and nurtures. Based on this premise and adopting a capabilities-based view, we examine how strategic networks and environmental knowledge affects uniqueness- mediated performance in young firms. We identify firms with digressive learning strategies based on their self-assessment of learning and compare them with other firms to demonstrate a differential effect on performance.

The pedagogical, linguistic and content features of popular English language learning websites in China : a framework for analysis and design

As increasing numbers of Chinese language learners choose to learn English online (CNNIC, 2012), there is a need to investigate popular websites and their language learning designs. This paper reports on the first stage of a study that analysed the pedagogical, linguistic and content features of 25 Chinese English Language Learning (ELL) websites ranked according to their value and importance to users. The website ranking was undertaken using a system known as PageRank. The aim of the study was to identify the features characterising popular sites as opposed to those of less popular sites for the purpose of producing a framework for ELL website design in the Chinese context. The study found that a pedagogical focus with developmental instructional materials accommodating diverse proficiency levels was a major contributor to website popularity. Chinese language use for translations and teaching directives and intermediate level English for learning materials were also significant features. Content topics included Anglophone/Western and non-Anglophone/Eastern contexts. Overall, popular websites were distinguished by their mediation of access to and scaffolded support for ELL.

Learning how to be responsive to public policy issues affecting SSSI members

Human survival depends on human ingenuity in using resources at hand to sustain human life. The historical record – in wrings and archaeological artefacts – provides evidence of the growth and collapse of political organisations and societies. In the institutions of Western civilisation, some traditions have endured over millennia where the roles of monarchs and public officials have been organised in perpetual succession. These roles were developed as conventions in the British Parliament after 1295 and provided the models of corporate governance in both public and private enterprise that have been continuously refined to the present day. In 2011, the Queensland Parliament legislated to introduce a new and more open system of scrutiny of legislation through a system of portfolio-based parliamentary committees. The committees began to function more actively in July 2012 and have inviting submissions from stakeholders and experts in a structured way to consider the government’s priorities in its legislative programme. The questions now are whether the Surveying and Spatial Sciences can respond expertly to address the terms of reference and meet the timetables of the various parliamentary committees. This paper discusses some of the more important and urgent issues that deserve debate that the profession needs to address in becoming more responsive to matters of public policy.

Many paths lead to discovery : analogical retrieval of cancer therapies

This paper addresses the issue of analogical inference, and its potential role as the mediator of new therapeutic discoveries, by using disjunction operators based on quantum connectives to combine many potential reasoning pathways into a single search expression. In it, we extend our previous work in which we developed an approach to analogical retrieval using the Predication-based Semantic Indexing (PSI) model, which encodes both concepts and the relationships between them in high-dimensional vector space. As in our previous work, we leverage the ability of PSI to infer predicate pathways connecting two example concepts, in this case comprising of known therapeutic relationships. For example, given that drug x TREATS disease z, we might infer the predicate pathway drug x INTERACTS WITH gene y ASSOCIATED WITH disease z, and use this pathway to search for drugs related to another disease in similar ways. As biological systems tend to be characterized by networks of relationships, we evaluate the ability of quantum-inspired operators to mediate inference and retrieval across multiple relations, by testing the ability of different approaches to recover known therapeutic relationships. In addition, we introduce a novel complex vector based implementation of PSI, based on Plate’s Circular Holographic Reduced Representations, which we utilize for all experiments in addition to the binary vector based approach we have applied in our previous research.