Building indicators in media assistance; four ways evaluation reports present “change”

The international aid and development community has supported programs that aim to build the capacity of media professionals or contribute to an enabling environment throughout the past 20 years. However, two decades on from the first modern media assistance programs, the sector is still struggling to identify, measure and understand the changes effected by their programs. There are questions raised as to whether it is even feasible to identify impacts on society and governance. This paper draws on some preliminary findings from a comparative thematic analysis of 47 evaluation documents of media assistance programs. The aim of this analysis is to identify trends in impact evaluation practice in the media assistance field, as well as the strengths and weaknesses of different evaluation approaches. This paper presents four types of social change claims commonly presented in reports; hypothetical changes, introduction of new opportunities, concrete examples of immediate impacts, and analysis of ongoing social and political changes. Although these types may appear as a spectrum from weak to strong, the interactions are perhaps more accurately understood using metaphors such as building blocks. This paper explores these types in more detail and suggests that a robust set of impacts-types could be useful in developing more grounded theories of change and indicators.

Specification & design of safety technologies for complex socio-technical systems : low-cost level crossings case study

The introduction of safety technologies into complex socio-technical systems requires an integrated and holistic approach to HF and engineering, considering the effects of failures not only within system boundaries, but also at the interfaces with other systems and humans. Level crossing warning devices are examples of such systems where technically safe states within the system boundary can influence road user performance, giving rise to other hazards that degrade safety of the system. Chris will discuss the challenges that have been encountered to date in developing a safety argument in support of low-cost level crossing warning devices. The design and failure modes of level crossing warning devices are known to have a significant influence on road user performance; however, quantifying this effect is one of the ongoing challenges in determining appropriate reliability and availability targets for low-cost level crossing warning devices.

Technical report : a study of ranking paradigms and their integrations for subtopic retrieval

In this paper, we consider the problem of document ranking in a non-traditional retrieval task, called subtopic retrieval. This task involves promoting relevant documents that cover many subtopics of a query at early ranks, providing thus diversity within the ranking. In the past years, several approaches have been proposed to diversify retrieval results. These approaches can be classified into two main paradigms, depending upon how the ranks of documents are revised for promoting diversity. In the first approach subtopic diversification is achieved implicitly, by choosing documents that are different from each other, while in the second approach this is done explicitly, by estimating the subtopics covered by documents. Within this context, we compare methods belonging to the two paradigms. Furthermore, we investigate possible strategies for integrating the two paradigms with the aim of formulating a new ranking method for subtopic retrieval. We conduct a number of experiments to empirically validate and contrast the state-of-the-art approaches as well as instantiations of our integration approach. The results show that the integration approach outperforms state-of-the-art strategies with respect to a number of measures.

The role of the market sub-system and the socio-technical sub-system in innovation and firm performance : a dynamic capabilities approach

Organizational learning has been studied as a key factor in firm performance and internationalization. Moving beyond the past emphasis on market learning, we develop a more complete explanation of learning, its relationship to innovation, and their joint effect on early internationalization. We theorize that, driven by the founders’ international vision, early internationalizing firms employ a dual subsystem of dynamic capabilities: a market subsystem consisting of market-focused learning capability and marketing capability, and a socio-technical subsystem comprised of network learning capability and internally focused learning capability. We argue that innovation mediates the proposed relationship between the dynamic capability structure and early internationalization. We conduct case studies to develop the conceptual framework and test it in a field survey of early internationalizing firms from Australia and the United States. Our findings indicate a complex interplay of capabilities driving innovation and early internationalization. We provide theoretical and practical implications and offer insights for future research.

State of Energy Efficiency Education in Australian Technical & Further Education (TAFE) : A Report to the Australian Government Skills for the Carbon Challenge Initiative, The Natural Edge Project (TNEP), Queensland University of Technology

The Australian Government’s Skills for the Carbon Challenge (SCC) initiative aims to accelerate industry and the education sectors response to climate change. As part of the SCC initiative, the Department of Industry, Innovation, Climate Change, Science, Research and Tertiary Education (DIICCSRTE) provided funding to investigate the state of energy efficiency education in engineering-related Australian Technical and Further Education (TAFE) Programs. The following document reports on the outcomes of a multi-stage consultation project that engaged with participants from over 80% of TAFE institutions across Australia with the aim of supporting and enhancing future critical skills development in this area. Specifically, this report presents the findings of a national survey, based on a series of TAFE educator focus groups, conducted in May 2013 aimed at understanding the experiences and insights of Australian TAFE educators teaching engineering-related courses. Responses were received from 224 TAFE Educators across 50 of the 61 TAFE institutions in Australia (82% response rate).

Environmental indicators for sustainable road development and operation

Road construction, maintenance and operation are activities that impact the environment by way of energy use, resource consumption and emission. Components such as construction material, transportation, street lighting, rolling resistance, traffic congestion during works, albedo and end-of-life processing impact the environment at different phases of the life of a road. With a view to promote sustainable development, a few sustainability rating schemes, e.g. Infrastructure Sustainability and Invest (Australia), Envision and Greenroads (USA), and CEEQUAL (UK) have been developed, that can assess road projects. These schemes address environmental areas such as: energy and emission, land, water, materials, discharges into surroundings, waste and ecology as factors for sustainable development. This paper assesses different rating schemes based on a defined comprehensive life cycle assessment (LCA) system boundary for road projects to identify different environmental indicators that address sustainable road development and operation. The findings indicate that new indicators are required to address different environmental components during the operation phase of roads.

Measures of nutrient processes as indicators of stream ecosystem health

To better understand how freshwater ecosystems respond to changes in catchment land-use, it is important to develop measures of ecological health that include aspects of both ecosystem structure and function. This study investigated measures of nutrient processes as potential indicators of stream ecosystem health across a land-use gradient from relatively undisturbed to highly modified. A total of seven indicators (potential denitrification; an index of denitrification potential relative to sediment organic matter; benthic algal growth on artificial substrates amended with (a) N only, (b) P only, and (c) N and P; and δ15N of aquatic plants and benthic sediment) were measured at 53 streams in southeast Queensland, Australia. The indicators were evaluated by their response to a defined gradient of agricultural land-use disturbance as well as practical aspects of using the indicators as part of a monitoring program. Regression models based on descriptors of the disturbance gradient explained a large proportion of the variation in six of the seven indicators. Denitrification index, algal growth in N amended substrate, and δ15N of aquatic plants demonstrated the best regression. However, the δ15N value of benthic sediment was found to be the best indicator overall for incorporation into a monitoring program, as samples were relatively easy to collect and process, and were successfully collected at more than 90% of the study sites.

Exploring subscription renewal intention of operational cloud enterprise systems-a socio-technical approach

Despite the fact that customer retention is crucial for providers of cloud enterprise systems, only little attention has been directed towards investigating the antecedents of subscription renewal in an organizational context. This is even more surprising, as cloud services are usually offered as subscription-based pricing models with the (theoretical) possibility of immediate service cancellation, strongly opposing classical long-term IT-Outsourcing contracts or license-based payment plans of on premise enterprise systems. To close this research gap an empirical study was undertaken. Firstly, a conceptual model was drawn from theories of social psychology, organizational system continuance and IS success. The model was subsequently tested using survey responses of senior management within companies which adopted cloud enterprise systems. Gathered data was then analysed using PLS. The results indicate that subscription renewal intention is influenced by both – social-related and technology-specific factors – which are able to explain 50.4% of the variance in the dependent variable. Beneath the cloud enterprise systems specific contributions, the work advances knowledge in the area of organizational system continuance, as well as IS success.

Study Protocol - Alcohol Management Plans (AMPs) in remote indigenous communities in Queensland: their impacts on injury, violence, health and social indicators and their cost-effectiveness

Background In 2002/03 the Queensland Government responded to high rates of alcohol-related harm in discrete Indigenous communities by implementing alcohol management plans (AMPs), designed to include supply and harm reduction and treatment measures. Tighter alcohol supply and carriage restrictions followed in 2008 following indications of reductions in violence and injury. Despite the plans being in place for over a decade, no comprehensive independent review has assessed to what level the designed aims were achieved and what effect the plans have had on Indigenous community residents and service providers. This study will describe the long-term impacts on important health, economic and social outcomes of Queensland’s AMPs. Methods/Design The project has two main studies, 1) outcome evaluation using de-identified epidemiological data on injury, violence and other health and social indicators for across Queensland, including de-identified databases compiled from relevant routinely-available administrative data sets, and 2) a process evaluation to map the nature, timing and content of intervention components targeting alcohol. Process evaluation will also be used to assess the fidelity with which the designed intervention components have been implemented, their uptake and community responses to them and their perceived impacts on alcohol supply and consumption, injury, violence and community health. Interviews and focus groups with Indigenous residents and service providers will be used. The study will be conducted in all 24 of Queensland’s Indigenous communities affected by alcohol management plans. Discussion This evaluation will report on the impacts of the original aims for AMPs, what impact they have had on Indigenous residents and service providers. A central outcome will be the establishment of relevant databases describing the parameters of the changes seen. This will permit comprehensive and rigorous surveillance systems to be put in place and provided to communities empowering them with the best credible evidence to judge future policy and program requirements for themselves. The project will inform impending alcohol policy and program adjustments in Queensland and other Australian jurisdictions. The project has been approved by the James Cook University Human Research Ethics Committee (approval number H4967 & H5241).

Improving the railway’s understanding of accident causation through an integrated approach to human factors analysis and technical safety data recording

This paper describes a safety data recording and analysis system that has been developed to capture safety occurrences including precursors using high-definition forward-facing video from train cabs and data from other train-borne systems. The paper describes the data processing model and how events detected through data analysis are related to an underlying socio-technical model of accident causation. The integrated approach to safety data recording and analysis insures systemic factors that condition, influence or potentially contribute to an occurrence are captured both for safety occurrences and precursor events, providing a rich tapestry of antecedent causal factors that can significantly improve learning around accident causation. This can ultimately provide benefit to railways through the development of targeted and more effective countermeasures, better risk models and more effective use and prioritization of safety funds. Level crossing occurrences are a key focus in this paper with data analysis scenarios describing causal factors around near-miss occurrences. The paper concludes with a discussion on how the system can also be applied to other types of railway safety occurrences.

Public preferences for biodiversity conservation and climate-change mitigation: A choice experiment using ecosystem services indicators

Potential conflicts exist between biodiversity conservation and climate-change mitigation as trade-offs in multiple-use land management. This study aims to evaluate public preferences for biodiversity conservation and climate-change mitigation policy considering respondents’ uncertainty on their choice. We conducted a choice experiment using land-use scenarios in the rural Kushiro watershed in northern Japan. The results showed that the public strongly wish to avoid the extinction of endangered species in preference to climate-change mitigation in the form of carbon sequestration by increasing the area of managed forest. Knowledge of the site and the respondents’ awareness of the personal benefits associated with supporting and regulating services had a positive effect on their preference for conservation plans. Thus, decision-makers should be careful about how they provide ecological information for informed choices concerning ecosystem services tradeoffs. Suggesting targets with explicit indicators will affect public preferences, as well as the willingness of the public to pay for such measures. Furthermore, the elicited-choice probabilities approach is useful for revealing the distribution of relative preferences for incomplete scenarios, thus verifying the effectiveness of indicators introduced in the experiment.

The technical efficiency of the Japanese banks : non-radial directional performance measurement with undesirable output

The paper analyses technical efficiency of the Japanese banks from 2000 to 2007. The estimation technique is based on the Russell directional distance function that takes into consideration not only desirable outputs but also an undesirable output that is represented by non-performing loans (NPLs). The results indicate that NPLs remain a significant burden as for banks' performance. We show that banks' inputs have to be utilised more efficiently, particularly labour and premises. We also argue that a further restructuring process is needed in the segment of Regional Banks. We conclude that the Japanese banking system is still far away from being fully consolidated and restructured.

Heterogeneity on the technical efficiency in Japanese airports

This paper evaluates the production activities of Japanese airports by using a finite mixture model that allows controlling for unobserved heterogeneity. In doing so, a stochastic frontier latent class model, which allows the existence of different technologies, is adopted to estimate production frontiers. This procedure not only enables the identification of different groups of Japanese airports but also permits the analysis of their production efficiency. The main result is that there are two groups of Japanese airports, both following completely different "technologies" to obtain passengers and cargo, suggesting that business strategies need to be adapted to the characteristics of the airports. Some managerial implications are developed.