The evaluation of time series: their scientific value and contribution to policy needs. Occasional Publication of the Marine Biological Association 22

In 2000 a Review of Current Marine Observations in relation to present and future needs was undertaken by the Inter-Agency Committee for Marine Science and Technology (IACMST). The Marine Environmental Change Network (MECN) was initiated in 2002 as a direct response to the recommendations of the report. A key part of the current phase of the MECN is to ensure that information from the network is provided to policy makers and other end-users to enable them to produce more accurate assessments of ecosystem state and gain a clearer understanding of factors influencing change in marine ecosystems. The MECN holds workshops on an annual basis, bringing together partners maintaining time-series and long-term datasets as well as end-users interested in outputs from the network. It was decided that the first workshop of the MECN continuation phase should consist of an evaluation of the time series and data sets maintained by partners in the MECN with regard to their ‘fit for purpose’ for answering key science questions and informing policy development. This report is based on the outcomes of the workshop. Section one of the report contains a brief introduction to monitoring, time series and long-term datasets. The various terms are defined and the need for MECN type data to complement compliance monitoring programmes is discussed. Outlines are also given of initiatives such as the United Kingdom Marine Monitoring and Assessment Strategy (UKMMAS) and Oceans 2025. Section two contains detailed information for each of the MECN time series / long-term datasets including information on scientific outputs and current objectives. This information is mainly based on the presentations given at the workshop and therefore follows a format whereby the following headings are addressed: Origin of time series including original objectives; current objectives; policy relevance; products (advice, publications, science and society). Section three consists of comments made by the review panel concerning all the time series and the network. Needs or issues highlighted by the panel with regard to the future of long-term datasets and time-series in the UK are shown along with advice and potential solutions where offered. The recommendations are divided into 4 categories; ‘The MECN and end-user requirements’; ‘Procedures & protocols’; ‘Securing data series’ and ‘Future developments’. Ever since marine environmental protection issues really came to the fore in the 1960s, it has been recognised that there is a requirement for a suitable evidence base on environmental change in order to support policy and management for UK waters. Section four gives a brief summary of the development of marine policy in the UK along with comments on the availability and necessity of long-term marine observations for the implementation of this policy. Policy relating to three main areas is discussed; Marine Conservation (protecting biodiversity and marine ecosystems); Marine Pollution and Fisheries. The conclusion of this section is that there has always been a specific requirement for information on long-term change in marine ecosystems around the UK in order to address concerns over pollution, fishing and general conservation. It is now imperative that this need is addressed in order for the UK to be able to fulfil its policy commitments and manage marine ecosystems in the light of climate change and other factors.

Foreign Policy as Ethics: Toward a Re-Evaluation of Values

This article notes that while ethics is increasingly talked of in foreign policy, it remains a blind-spot for FPA. It argues that this must be rectified through a critical approach which conceptualises foreign policy as ethics. The first section examines how even constructivist approaches, which are highly attuned to the intersubjective sphere, still generally avoid dealing with morality. The second section looks at the possibilities and limits of one piece of constructivist theorizing that explores the translation of morality into foreign policy via ‘norms’. This demonstrates the problems that a constructivist account, with its tendency toward explanatory description without evaluation, will always face. The final section argues, through an examination of EU foreign policy (from 1999-2004) and its innovative use of ‘hospitality’, that FPA must critically reassess the value of the norms and principles by which foreign policy operates in order to suggest potentially more ethical modes of encounter.

Mid-term evaluation of African Technology Policy Studies Network Phase VI Strategic Plan: for the period January 1, 2009 to December 31, 2010

The African Technology Policy Studies Network (ATPS) is a multidisciplinary network of researchers, private sector actors, policymakers and civil society. ATPS has the vision to become the leading international centre of excellence and reference in science, technology and innovation (STI) systems research, training and capacity building, communication and sensitization, knowledge brokerage, policy advocacy and outreach in Africa. It has a Regional Secretariat in Nairobi Kenya, and operates through national chapters in 29 countries (including 27 in Africa and two Chapters in the United Kingdom and USA for Africans in the Diaspora) with an expansion plan to cover the entire continent by 2015. The ATPS Phase VI Strategic Plan aims to improve the understanding and functioning of STI processes and systems to strengthen the learning capacity, social responses, and governance of STI for addressing Africa's development challenges, with a specific focus on the Millennium Development Goals (MDGs). A team of external evaluators carried out a midterm review to assess the effectiveness and efficiency of the implementation of the Strategic Plan for the period January 1, 2009 to December 31, 2010. The evaluation methodology involved multiple quantitative and qualitative methods to assess the qualitative and quantitative inputs (human resources, financial resources, time, etc.) into ATPS activities (both thematic and facilitative) and their tangible and intangible outputs, outcomes and impacts. Methods included a questionnaire survey of ATPS members and stakeholders, key informant interviews, and focus group discussions (FGDs) with members in six countries. Effectiveness of Programmes Under all six strategic goals, very good progress has been made towards planned outputs and outcomes. This is evidenced by key performance indicators (KPIs) generated from desk review, ratings from the survey respondents, and the themes that run through the FGDs. Institutional and Programme Cost Effectiveness Institutional Effectiveness: assessment of institutional effectiveness suggests that adequate management frameworks are in place and are being used effectively and transparently. Also technical and financial accounting mechanisms are being followed in accordance with grant agreements and with global good practice. This is evidenced by KPIs generated from desk review. Programme Cost Effectiveness: assessment of cost-effectiveness of execution of programmes shows that organisational structure is efficient, delivering high quality, relevant research at relatively low cost by international standards. The evidence includes KPIs from desk review: administrative costs to programme cost ratio has fallen steadily, to around 10%; average size of research grants is modest, without compromising quality. There is high level of pro bono input by ATPS members. ATPS Programmes Strategic Evaluation ATPS research and STI related activities are indeed unique and well aligned with STI issues and needs facing Africa and globally. The multi-disciplinary and trans-boundary nature of the research activities are creating a unique group of research scientists. The ATPS approach to research and STI issues is paving the way for the so called Third Generation University (3GU). Understanding this unique positioning, an increasing number of international multilateral agencies are seeking partnership with ATPS. ATPS is seeing an increasing level of funding commitments by Donor Partners. Recommendations for ATPS Continued Growth and Effectiveness On-going reform of ATPS administrative structure to continue The on-going reforms that have taken place within the Board, Regional Secretariat, and at the National Chapter coordination levels are welcomed. Such reform should continue until fully functional corporate governance policy and practices are fully established and implemented across the ATPS governance structures. This will further strengthen ATPS to achieve the vision of being the leading STI policy brokerage organization in Africa. Although training in corporate governance has been carried out for all sectors of ATPS leadership structure in recent time, there is some evidence that these systems have not yet been fully implemented effectively within all the governance structures of the organization, especially at the Board and National chapter levels. Future training should emphasize practical application with exercises relevant to ATPS leadership structure from the Board to the National Chapter levels. Training on Transformational Leadership - Leading a Change Though a subject of intense debate amongst economists and social scientists, it is generally agreed that cultural mindsets and attitudes could enhance and/or hinder organizational progress. ATPS’s vision demands transformational leadership skills amongst its leaders from the Board members to the National Chapter Coordinators. To lead such a change, ATPS leaders must understand and avoid personal and cultural mindsets and value systems that hinder change, while embracing those that enhance it. It requires deliberate assessment of cultural, behavioural patterns that could hinder progress and the willingness to be recast into cultural and personal habits that make for progress. Improvement of relationship amongst the Board, Secretariat, and National Chapters A large number of ATPS members and stakeholders feel they do not have effective communications and/or access to Board, National Chapter Coordinators and Regional Secretariat activities. Effort should be made to improve the implementation of ATPS communication strategy to improve on information flows amongst the ATPS management and the members. The results of the survey and the FGDs suggest that progress has been made during the past two years in this direction, but more could be done to ensure effective flow of pertinent information to members following ATPS communications channels. Strategies for Increased Funding for National Chapters There is a big gap between the fundraising skills of the Regional Secretariat and those of the National Coordinators. In some cases, funds successfully raised by the Secretariat and disbursed to national chapters were not followed up with timely progress and financial reports by some national chapters. Adequate training in relevant skills required for effective interactions with STI key policy players should be conducted regularly for National Chapter coordinators and ATPS members. The ongoing training in grant writing should continue and be made continent-wide if funding permits. Funding of National Chapters should be strategic such that capacity in a specific area of research is built which, with time, will not only lead to a strong research capacity in that area, but also strengthen academic programmes. For example, a strong climate change programme is emerging at University of Nigeria Nsukka (UNN), with strong collaborations with Universities from neighbouring States. Strategies to Increase National Government buy-in and support for STI Translating STI research outcomes into policies requires a great deal of emotional intelligence, skills which are often lacking in the first and second generation universities. In the epoch of the science-based or 2GUs, governments were content with universities carrying out scientific research and providing scientific education. Now they desire to see universities as incubators of new science- or technology-based commercial activities, whether by existing firms or start-ups. Hence, governments demand that universities take an active and leading role in the exploitation of their knowledge and they are willing to make funds available to support such activities. Thus, for universities to gain the attention of national leadership they must become centres of excellence and explicit instruments of economic development in the knowledge-based economy. The universities must do this while working collaboratively with government departments, parastatals, and institutions and dedicated research establishments. ATPS should anticipate these shifting changes and devise programmes to assist both government and universities to relate effectively. New administrative structures in member organizations to sustain and manage the emerging STI multidisciplinary teams Second Generation universities (2GUs) tend to focus on pure science and often do not regard the application of their know-how as their task. In contrast, Third Generation Universities (3GUs) objectively stimulate techno-starters – students or academics – to pursue the exploitation or commercialisation of the knowledge they generate. They view this as being equal in importance to the objectives of scientific research and education. Administratively, research in the 2GU era was mainly monodisciplinary and departments were structured along disciplines. The emerging interdisciplinary scientific teams with focus on specific research areas functionally work against the current mono-disciplinary faculty-based, administrative structure of 2GUs. For interdisciplinary teams, the current faculty system is an obstacle. There is a need for new organisational forms for university management that can create responsibilities for the task of know-how exploitation. ATPS must anticipate this and begin to strategize solutions for their member institutions to transition to 3Gus administrative structure, otherwise ATPS growth will plateau, and progress achieved so far may be stunted.

Evidence-based clinical policy: case report of a reproducible process to encourage understanding and evaluation of evidence

We report within a case study a reproducible process to facilitate the explicit incorporation of evidence by a multidisciplinary group into clinical policy development. To support the decision-making of a multidisciplinary Intersectoral Advisory Group (IAG) convened by the Royal Australasian College of Physicians Health Policy Unit, a systematic review of randomized controlled trials about environmental tobacco smoke and smoking cessation interventions in paediatric settings was first undertaken. As reported in detail here, IAG members were then formally engaged in a transparent and replicable process to understand and interpret the synthesized evidence and to proffer their independent reactions regarding policy, practice and research. Our intention was to ensure that all IAG members were democratically engaged and made aware of the available evidence. As clinical policy must engage stakeholder representatives from diverse backgrounds, a process to equalize understanding of the evidence and 'democratize' judgment about its implications is needed. Future research must then examine the benefits of such explicit steps when guidelines, in turn, are implemented. We hypothesize that changes to future practice will be more likely if processes undertaken to develop guidelines are transparent to clinicians and other target groups.

Evaluation of the implementation of a state government community design policy aimed at increasing local walking : design issues and baseline results from RESIDE, Perth Western Australia

Objectives.
To describe the design and baseline results of an evaluation of the Western Australian government's pedestrian-friendly subdivision design code (Liveable Neighborhood (LN) Guidelines).
Methods.

Baseline results (2003–2005) from a longitudinal study of people (n = 1813) moving into new housing developments: 18 Liveable, 11 Hybrid and 45 Conventional (i.e., LDs, HDs and CDs respectively) are presented including usual recreational and transport-related walking undertaken within and outside the neighborhood, and 7-day pedometer steps.
Results.

At baseline, more participants walked for recreation and transport within the neighborhood (52.6%; 36.1% respectively), than outside the neighborhood (17.7%; 13.2% respectively). Notably, only 20% of average total duration of walking (128.4 min/week (SD159.8)) was transport related and within the neighborhood. There were few differences between the groups' demographic, psychosocial and perceived neighborhood environmental characteristics, pedometer steps, or the type, amount and location of self-reported walking (p > 0.05). However, asked what factors influenced their choice of housing development, more participants moving into LDs reported aspects of their new neighborhood's walkability as important (p < 0.05).
Conclusions.

The baseline results underscore the desirability of incorporating behavior and context-specific measures and value of longitudinal designs to enable changes in behavior, attitudes, and urban form to be monitored, while adjusting for baseline residential location preferences.

Scaling up diabetes prevention in Victoria, Australia: policy development, implementation and evaluation

Objective
The Australian lifestyle intervention program Life! is only the second reported, large-scale diabetes prevention program. This paper describes the genesis and the successful establishment of Life! and its key outcomes for participants and implementation.

Research
Design and Methods Life!, a behavior change intervention, comprises six group sessions over eight months. The Victorian Department of Health funded Diabetes Australia-Victoria to implement the program. Experience of the Greater Green Triangle diabetes prevention implementation trial was used for intervention design, workforce development, training and infrastructure. Clinical and anthropometric data from participants, used for program evaluation, was recorded on a central database.

Results
Life! has a state-wide workforce of 302 trained facilitators within 137 organizations. 29,000 Victorians showed interest in Life! and 15,000 individuals have been referred to the program. In total, 8,412 participants commenced a Life! program between October 2007 and June 2011. 37% of the original participants completed the eight month program. Participants completing sessions one to five lost an average of 1·4 kg weight (p<0·001) and waist circumference of 2·5cm (p<0.001). Those completing six sessions lost an average of 2·4 kg weight (p<0·001) and waist circumference of 3·8 cm (p<0·001). The weight loss of 2.4 kg represents 2.7% of participants’ starting body weight.

Conclusion
The impact of Life! is attributable to applying available evidence for the systems design of the intervention, and collaboration between policy makers, implementers and evaluators using the principles of continuous quality improvement to support successful, large scale recruitment and implementation.

Impact of policy changes on the efficiency and returns-to-scale of Japanese financial institutions: an evaluation

This paper examines the impact of FSA's (Financial Services Agency) recent policy changes on the efficiency and returns-to-scale (RTS) of Japanese financial institutions including banks, securities companies and bank holding companies. Three kinds of efficiency are investigated namely, technical efficiency (TE), pure technical efficiency (PTE) and scale efficiency (SE) using the non-parametric methodology named data envelopment analysis (DEA). The DEA analysis shows a substantial improvement in the overall efficiency of Japanese banks, albeit a significant difference of efficiency scores between the major/city banks and the regional banks. Results are robust to alternative specifications of efficiency and scale changes.