Meta-evaluation to improve learning, evaluation capacity development and sustainability : Findings from a participatory evaluation project in Nepal

Recent studies suggest that meta-evaluation can be valuable in developing new approaches to evaluation, building evaluation capacities, and enhancing organizational learning. These new extensions of the concept of meta-evaluation are significant, given the growing emphasis on improving the quality and effectiveness of evaluation practices in the South Asian region. Following a review of the literature, this paper presents a case study of the use of concurrent meta-evaluation in the four-year project Assessing Communication for Social Change which developed and trialled a participatory impact assessment methodology in collaboration with a development communication Non-government organization (NGO) in Nepal. Key objectives of the meta-evaluation included to: continuously develop, adapt and improve the impact assessment methodology, Monitoring and Evaluation (M&E) systems and process and other project activities; identify impacts of the project; and build capacities in critical reflection and review. Our analysis indicates that this meta-evaluation was essential to understanding various constraints related to the organizational context that affected the success of the project and the development of improved M&E systems and capacities within the NGO. We identified several limitations of our meta-evaluation methods, which were balanced by the strengths of other methods. Our case study suggests that as well as assessing the quality, credibility and value of evaluation practices, meta-evaluations need to focus on important contextual issues that can have significant impacts on the outcomes of participatory evaluation projects. They include hierarchical organizational cultures, communication barriers, power/knowledge relations, and the time and resources available. Meta-evaluations also need to consider wider issues such as the sustainability of evaluation systems and approaches.

Nonprofit organisations face a restructuring state : the case of local social services in the Hunter region of New South Wales

This paper is concerned with certain of the characteristics of local social services, and their role in a restructuring Australian welfare state. I am particularly concerned with the distinctive gender characteristics of these organisations, because in comparison with most other organisations they have a feminised quality. This partly mirrors women's traditional role of undertaking the major part of the caring labour of society. However, simultaneously work in these organisation deviates from more traditional patterns where employed women occupy subordinate positions. In many community organisations, women occupy leadership roles. The analysis here is concerned with the apparently paradoxical nature of these organisations in their capacity to entrench traditional gender roles and to challenge these by allowing women to fill management positions. It is also concerned to examine whether changes that have been occurring in the community services sector over the last two decades are likely to enhance women's general position in the society, or diminish the power exercised by women. The paper draws in a preliminary way on a study of local services in the Hunter Region of NSW undertaken in the latter half of 1992. These preliminary findings are set against the broader picture of developments in the contemporary welfare state.

From 'what' to 'how' : capacity building in health promotion for HIV/AIDS prevention in the Solomon Islands

This paper describes a capacity building process undertaken within the HIV/AIDS prevention project of the Adventist Development and Relief Agency (ADRA) in the Solomon Islands. ADRA HIV/AIDS has recently reoriented its project structure, moving beyond its awareness raising approach to incorporate health promotion frameworks, theories, strategies and assumptions. These have been used to inform project practice in project planning, delivery and evaluation. This paper shares what has worked and not worked in the capacity building process, including a project evaluation of the initial HIV/AIDS awareness raising project and the application of a number of capacity building strategies, including utilising a volunteer Australian Youth Ambassador for Development (AYAD) funded by the Australian Agency for International Development (AusAID). Existing and new projects are outlined. The underlying theme is that any capacity building exercise must include structural support (e.g. management, national frameworks) to ensure the incorporation of new initiatives and approaches. With time this enables ownership by counterparts and external partnerships to develop. The presence of an AYAD volunteer has been an effective strategy to achieve this. Reflections from the evaluators, the AYAD volunteer and the HIV/AIDS team are included.

News media representations of homelessness : do economic news production pressures prevent journalists from adequately reporting complex social issues

This study used both content and frame analyses to test news-media representations of homelessness in The Courier-Mail newspaper for evidence of restricted journalism practice. Specifically, it sought signs of either direct manipulation of issue representation based on ideological grounds, and also evidence of news organisations prioritising low-cost news production over Public Sphere journalistic news values. The study found that news stories from the earlier parts of the longitudinal study showed stereotypical misrepresentations of homelessness for public deliberation which might be attributed to either, or both of the nominated restricting factors. However news stories from the latter part of the study saw a distinct change in the way the issue was represented, indicating a journalistic capacity to thoughtfully and sensitively represent a complex social issue to the public. Further study is recommended to ascertain how and why this change occurred, so that journalistic practice might be further improved.

Enhancing capacity for 'systematic' thinking in public health

The concept of being evidence based or evidence informed is widely acknowledged as an important component of decision-making. It is perhaps most universally referred to in medicine, however has extended into many other disciplines over the past decade, including public health. Evidence-based public health has been defined as the ‘conscientious, explicit and judicious use of current best evidence in making decisions about the care of communities and populations in the domain of health protection, disease prevention, health maintenance and improvement (health promotion)’.1 More recent literature favours the use of the term evidence informed over evidence based to acknowledge the varying influences on decisions in this complex field.2,3 Evidence-informed activities in any discipline require a specific set of skills in critical thinking. These skills include identifying the questions to be resolved, collecting relevant evidence, and assessing, synthesizing and distilling evidence in a way that can inform the set of activities to be undertaken as a result.

Does the social inclusion discourse add value?

The election of a national Labor Government in 2007 saw ‘social inclusion’ emerge as Australia’s overarching social policy agenda. Being ‘included’ has since been defined as being able to ‘have the resources, opportunities and capabilities needed to learn, work, engage and have a voice’. Various researchers have adopted the social inclusion concept to construct a multi-dimensional framework for measuring disadvantage, beyond poverty alleviation. This research program has enabled various forms of statistical modelling based on some agreement about what it means to be ‘included’ in society. At the same time it is acknowledged that social inclusion remains open and contestable and can be used in the name of both progressive and more punitive programs and policies. This ambiguity raises questions about whether the social inclusion framework, as it is presently defined, has the potential to be a progressive and transformative discourse. In this paper we examine whether the Australian social inclusion agenda has the capacity to address social inequality in a meaningful way, concluding with a discussion about the need to understand social inequality and social disadvantage in relational terms.

Education for social responsibility: Ethics and imagination for engaging students and teachers in educational reform

In this chapter we make assumptions about the primary role of education for the life of its beneficiaries and for society. Undoubtedly, formal education plays an important role in enhancing the likelihood for participation in future social life, including enjoyment and employment, by the student as well as the development of the well being of society in general. Similarly, education is often seen as a main means for intergenerational transmission of knowledge and culture. However, as Dewey (1916) argues, in liberal societies, education has the capacity of enhancing democratic participation in society that goes beyond passive participation by its members. One can argue that the achievement of the ideals of democracy demands a free and strong education system. In other words, while education can function as an instrument to integrate students into the present society, it also has the potential to become an instrument for its transformation by means of which citizens can develop an understanding of how their society functions and a sense of agency towards its transformation. Arguably, this is what Freire (1985) meant when he talked about the role of education to “read and write” the world. A stream of progressive educators (e.g., Apple (2004), Freire, (1985), Giroux (2001) and McLaren (2002)) taught us that the reading of the world that is capable of leading into writing the world is a critical reading; i.e., a reading that poses “Why” questions and imagines “What else can be” (Carr & Kemmis, 1987).

The Capacity to Share : A Study of Cuba's International Cooperation in Educational Development

Since 1959, international cooperation has been a key feature of Cuba’s commitment to egalitarian social well-being. Aspects of this experience have been well documented , in general and with reference to specific initiatives across human development and occupational sectors. Others have been little examined, of which education is one. This book describes the internationalism of Cuban education policy as practised in Cuba and in other parts of the Global “South.”

Gender and the capacity of women with NIDDM to implement medical advice

This qualitative study of women with non-insulin dependent diabetes mellitus (NIDDM) examined constructions of their diabetes management and socio-familial relationships as potential sources of support. Semi-structured interview data was collected from 16 women. The transcripts were analysed with the aim of examining the ways in which Sender relations structured women's accounts of health-related behaviours. Women talked about themselves as wives, mothers, being pregnant and parenting, and friends of other women in ways that demonstrated how caring for others impeded their capacity to care for themselves. Meeting the food preferences of husbands and dietary requirements of diabetic husbands were dominant themes in women's accounts of marriage, and in various ways women justified their husbands' lack of support. Furthermore, the care of others during pregnancy and parenting was also an obstacle to women caring for themselves. An awareness of the gender politics inherent within social and family contexts is crucial to improving the effectiveness of medical advice for diabetes management.

Evaluating Communication for Development : A Framework for Social Change

Evaluating Communication for Development presents a comprehensive framework for evaluating communication for development (C4D). This framework combines the latest thinking from a number of fields in new ways. It critiques dominant instrumental, accountability-based approaches to development and evaluation and offers an alternative holistic, participatory, mixed methods approach based on systems and complexity thinking and other key concepts. It maintains a focus on power, gender and other differences and social norms. The authors have designed the framework as a way to focus on achieving sustainable social change and to continually improve and develop C4D initiatives. The benefits and rigour of this approach are supported by examples and case studies from a number of action research and evaluation capacity development projects undertaken by the authors over the past fifteen years. Building on current arguments within the fields of C4D and development, the authors reinforce the case for effective communication being a central and vital component of participatory forms of development, something that needs to be appreciated by decision makers. They also consider ways of increasing the effectiveness of evaluation capacity development from grassroots to management level in the development context, an issue of growing importance to improving the quality, effectiveness and utilisation of monitoring and evaluation studies in this field. The book includes a critical review of the key approaches, methodologies and methods that are considered effective for planning evaluation, assessing the outcomes of C4D, and engaging in continuous learning. This rigorous book is of immense theoretical and practical value to students, scholars, and professionals researching or working in development, communication and media, applied anthropology, and evaluation and program planning.

Legal Regulation of Corporate Social Responsibility : A Meta-Regulation Approach of Law for Raising CSR in a Weak Economy

"Even though Corporate Social Responsibility (CSR) has become a widely accepted concept promoted by different stakeholders, business corporations' internal strategies, known as corporate self-regulation in most of the weak economies, respond poorly to this responsibility. Major laws relating to corporate regulation and responsibilities of these economies do not possess adequate ongoing influence to insist on corporate self-regulation to create a socially responsible corporate culture. This book describes how the laws relating to CSR could contribute to the inclusion of CSR principles at the core of the corporate self-regulation of these economies in general, without being intrusive in normal business practice. It formulates a meta-regulation approach to law, particularly by converging patterns of private ordering and state control in contemporary corporate law from the perspective of a weak economy. It proposes that this approach is suitable for alleviating regulators' limited access to information and expertise, inherent limitations of prescriptive rules, ensuring corporate commitment, and enhance the self-regulatory capacity of companies. This book describes various meta-regulation strategies for laws to link social values to economic incentives and disincentives, and to indirectly influence companies to incorporate CSR principles at the core of their self-regulation strategies. It investigates this phenomenon using Bangladesh as a case study."--publisher website

Surveillance Town: Social inclusion-exclusion through surveillance, ‘the dignity of work’ and income management

This paper discusses the situation of welfare claimants, constructed as faulty citizens and flawed welfare subjects at the receiving end of complex and multi-layered, private and public, forms of monitoring and surveillance aimed at securing socially responsible, consuming and compliant behaviours. In Australia as in many other western countries, the rise of neoliberal economic regimes with their harsh and often repressive treatment of welfare claimants operates in tandem with a growing arsenal of CCTV and assorted urban governance measures (Monahan 2008, Maki 2011). The capacity for all forms of surveillance to intensify social inequalities through the lens of CCTV and other modes and methods of electronic monitoring is amply demonstrated in the surveillance studies literature, raising fundamental questions around issues of social justice, equity and the expenditure of societal resources (Norris and Armstrong 1999, Lyon 1994, 2001, Loader 1996).

Measurement, modelling and capacity analysis for novel, fixed multi-user single-antenna MIMO-OFDM system, in rural environments

High-speed broadband internet access is widely recognised as a catalyst to social and economic development. However, the provision of broadband Internet services with the existing solutions to rural population, scattered over an extensive geographical area, remains both an economic and technical challenge. As a feasible solution, the Commonwealth Scientific and Industrial Research Organization (CSIRO) proposed a highly spectrally efficient, innovative and cost-effective fixed wireless broadband access technology, which uses analogue TV frequency spectrum and Multi-User MIMO (MUMIMO) technology with Orthogonal-Frequency-Division-Multiplexing (OFDM). MIMO systems have emerged as a promising solution for the increasing demand of higher data rates, better quality of service, and higher network capacity. However, the performance of MIMO systems can be significantly affected by different types of propagation environments e.g., indoor, outdoor urban, or outdoor rural and operating frequencies. For instance, large spectral efficiencies associated with MIMO systems, which assume a rich scattering environment in urban environments, may not be valid for all propagation environments, such as outdoor rural environments, due to the presence of less scatterer densities. Since this is the first time a MU-MIMO-OFDM fixed broadband wireless access solution is deployed in a rural environment, questions from both theoretical and practical standpoints arise; For example, what capacity gains are available for the proposed solution under realistic rural propagation conditions?. Currently, no comprehensive channel measurement and capacity analysis results are available for MU-MIMO-OFDM fixed broadband wireless access systems which employ large scale multiple antennas at the Access Point (AP) and analogue TV frequency spectrum in rural environments. Moreover, according to the literature, no deterministic MU-MIMO channel models exist that define rural wireless channels by accounting for terrain effects. This thesis fills the aforementioned knowledge gaps with channel measurements, channel modeling and comprehensive capacity analysis for MU-MIMO-OFDM fixed wireless broadband access systems in rural environments. For the first time, channel measurements were conducted in a rural farmland near Smithton, Tasmania using CSIRO's broadband wireless access solution. A novel deterministic MU-MIMO-OFDM channel model, which can be used for accurate performance prediction of rural MUMIMO channels with dominant Line-of-Sight (LoS) paths, was developed under this research. Results show that the proposed solution can achieve 43.7 bits/s/Hz at a Signal-to- Noise Ratio (SNR) of 20 dB in rural environments. Based on channel measurement results, this thesis verifies that the deterministic channel model accurately predicts channel capacity in rural environments with a Root Mean Square (RMS) error of 0.18 bits/s/Hz. Moreover, this study presents a comprehensive capacity analysis of rural MU-MIMOOFDM channels using experimental, simulated and theoretical models. Based on the validated deterministic model, further investigations on channel capacity and the eects of capacity variation, with different user distribution angles (θ) around the AP, were analysed. For instance, when SNR = 20dB, the capacity increases from 15.5 bits/s/Hz to 43.7 bits/s/Hz as θ increases from 10° to 360°. Strategies to mitigate these capacity degradation effects are also presented by employing a suitable user grouping method. Outcomes of this thesis have already been used by CSIRO scientists to determine optimum user distribution angles around the AP, and are of great significance for researchers and MU-MUMO-OFDM system developers to understand the advantages and potential capacity gains of MU-MIMO systems in rural environments. Also, results of this study are useful to further improve the performance of MU-MIMO-OFDM systems in rural environments. Ultimately, this knowledge contribution will be useful in delivering efficient, cost-effective high-speed wireless broadband systems that are tailor-made for rural environments, thus, improving the quality of life and economic prosperity of rural populations.

The Role of Social and Human Capital Among Nascent Entrepreneurs

This study examines nascent entrepreneurship by comparing individuals engaged in nascent activities (n=380) with a control group (n=608), after screening a sample from the general population (n=30,427). The study then follows the developmental process of nascent entrepreneurs for 18 months. Bridging and bonding social capital, consisting of both strong and weak ties, was a robust predictor for nascent entrepreneurs, as well as for advancing through the start-up process. With regard to outcomes like first sale or showing a profit, only one aspect of social capital, viz. being a member of a business network, had a statistically significant positive effect. The study supports human capital in predicting entry into nascent entrepreneurship, but only weakly for carrying the start-up process towards successful completion.

Humanities and social scientific research methods in porn studies

Porn studies researchers in the humanities have tended to use different research methods from those in social sciences. There has been surprisingly little conversation between the groups about methodology. This article presents a basic introduction to textual analysis and statistical analysis, aiming to provide for all porn studies researchers a familiarity with these two quite distinct traditions of data analysis. Comparing these two approaches, the article suggests that social science approaches are often strongly reliable – but can sacrifice validity to this end. Textual analysis is much less reliable, but has the capacity to be strongly valid. Statistical methods tend to produce a picture of human beings as groups, in terms of what they have in common, whereas humanities approaches often seek out uniqueness. Social science approaches have asked a more limited range of questions than have the humanities. The article ends with a call to mix up the kinds of research methods that are applied to various objects of study.