Tracing the Evidence: The Use of Evaluation Results in Direct-Democratic Campaigns

Although research on direct-democratic campaigns in Switzerland has intensified in the last decade, detailed information on the use of evidence in campaigns is still lacking. Our research aims to contribute both to research on direct democracy and to research on evidence-based policy making, by analyzing how evaluation results are used in directdemocratic campaigns. In this conceptual paper, the formulation of our hypothesis is based on a model of evaluation influence that traces the different uses of evaluation results in the process of a direct-democratic campaign. We assume that the policy analytical capacity of individual members in parliament, government and administration in the (pre)-parliamentary process fosters the use of evidence in campaigns. In the course of the campaign, symbolic use of evaluation in the form of justification, persuasion or mobilization prevails. We assume that the media is an important player in making transparent how political actors use evidence to support their positions. Evidence itself often remains ambiguous and uncertain, and evaluations are influenced by the values of the evaluator. To be able to make the right decisions, therefore, citizens should learn about possible interpretations in argumentative processes. For us, the context of direct democracy in Switzerland provides the setting for such a discourse that, besides evidence, brings up different opinions, values and beliefs.

UTILIZATION OF EVALUATION RESULTS

The issue over utilization of evaluation results has been receiving increasing attention lately. However, a continuing problem has been the lack of knowledge of the specific determinants of the utilization of evaluation results, the extent that these results are used, and the absence in the literature of empirical investigations of those determinants. The purposes of the current study were to examine the patterns of utilization of the recommendations made to an organization following an extensive evaluation, and to quantitatively examine some determinants of that utilization. During the course of the ten-month study, a number of important points regarding evaluation studies, and the utilization of their results were identified. Primary among these was the fact that a definition of utilization that requires adoption of recommendations is limited. Tremendous amounts of organizational activity may accrue from the results of an evaluation regardless of whether the results are adopted. In addition, none of the characteristics of the recommendations that were examined proved to be significant predictors of the extent of their utilization other than whether adoption was considered an authority decision or the results of staff concensus. ^

Analytical study and evaluation results of power optimizers for distributed power conditioning in PV arrays

The use of modular or ‘micro’ maximum power point tracking (MPPT) converters at module level in series association, commercially known as “power optimizers”, allows the individual adaptation of each panel to the load, solving part of the problems related to partial shadows and different tilt and/or orientation angles of the photovoltaic (PV) modules. This is particularly relevant in building integrated PV systems. This paper presents useful behavioural analytical studies of cascade MPPT converters and evaluation test results of a prototype developed under a Spanish national research project. On the one hand, this work focuses on the development of new useful expressions which can be used to identify the behaviour of individual MPPT converters applied to each module and connected in series, in a typical grid-connected PV system. On the other hand, a novel characterization method of MPPT converters is developed, and experimental results of the prototype are obtained: when individual partial shading is applied, and they are connected in a typical grid connected PV array

Query-by-Example Spoken Term Detection ALBAYZIN 2012 evaluation: overview, systems, results, and discussion

Query-by-Example Spoken Term Detection (QbE STD) aims at retrieving data from a speech data repository given an acoustic query containing the term of interest as input. Nowadays, it has been receiving much interest due to the high volume of information stored in audio or audiovisual format. QbE STD differs from automatic speech recognition (ASR) and keyword spotting (KWS)/spoken term detection (STD) since ASR is interested in all the terms/words that appear in the speech signal and KWS/STD relies on a textual transcription of the search term to retrieve the speech data. This paper presents the systems submitted to the ALBAYZIN 2012 QbE STD evaluation held as a part of ALBAYZIN 2012 evaluation campaign within the context of the IberSPEECH 2012 Conference(a). The evaluation consists of retrieving the speech files that contain the input queries, indicating their start and end timestamps within the appropriate speech file. Evaluation is conducted on a Spanish spontaneous speech database containing a set of talks from MAVIR workshops(b), which amount at about 7 h of speech in total. We present the database metric systems submitted along with all results and some discussion. Four different research groups took part in the evaluation. Evaluation results show the difficulty of this task and the limited performance indicates there is still a lot of room for improvement. The best result is achieved by a dynamic time warping-based search over Gaussian posteriorgrams/posterior phoneme probabilities. This paper also compares the systems aiming at establishing the best technique dealing with that difficult task and looking for defining promising directions for this relatively novel task.

Public library consumer health information pilot project: results of a National Library of Medicine evaluation

In October 1998, the National Library of Medicine (NLM) launched a pilot project to learn about the role of public libraries in providing health information to the public and to generate information that would assist NLM and the National Network of Libraries of Medicine (NN/LM) in learning how best to work with public libraries in the future. Three regional medical libraries (RMLs), eight resource libraries, and forty-one public libraries or library systems from nine states and the District of Columbia were selected for participation. The pilot project included an evaluation component that was carried out in parallel with project implementation. The evaluation ran through September 1999. The results of the evaluation indicated that participating public librarians were enthusiastic about the training and information materials provided as part of the project and that many public libraries used the materials and conducted their own outreach to local communities and groups. Most libraries applied the modest funds to purchase additional Internet-accessible computers and/or upgrade their health-reference materials. However, few of the participating public libraries had health information centers (although health information was perceived as a top-ten or top-five topic of interest to patrons). Also, the project generated only minimal usage of NLM's consumer health database, known as MEDLINEplus, from the premises of the monitored libraries (patron usage from home or office locations was not tracked). The evaluation results suggested a balanced follow-up by NLM and the NN/LM, with a few carefully selected national activities, complemented by a package of targeted activities that, as of January 2000, are being planned, developed, or implemented. The results also highlighted the importance of building an evaluation component into projects like this one from the outset, to assure that objectives were met and that evaluative information was available on a timely basis, as was the case here.

Evaluation of the Type I child car restraints fitting service in WA

Child passenger injury remains a major road safety issue despite advances in biomechanical understanding and child restraint design. In Australia, one intervention with parents to encourage universal and consistent use of the most appropriate restraint as well as draw their attention to critical aspects of installation is the RoadWise Type 1 Child Car Restraints Fitting Service, WA. A mixed methods evaluation of this service was conducted in early 2010. Evaluation results suggest that it has been effective in ensuring good quality training of child restraint fitters. In addition, stakeholder and user satisfaction with the Service is high, with participants agreeing that the Service is valuable to the community, and fitters regarding the training course, materials and post-training support as effective. However, a continuing issue for interventions of this type is whether the parents who need them perceive this need. Evidence from the evaluation suggests that only about 25% of parents who could benefit from the Service actually use it. This may be partly due to parental perceptions that such services are not necessary or relevant to them, or to overconfidence about the ease of installing restraints correctly. Thus there is scope for improving awareness of the Service amongst groups most likely to benefit from it (e.g. new parents) and for alerting parents to the importance of correct installation and getting their self-installed restraints checked. Efforts to inform and influence parents should begin when their children are very young, preferably at or prior to birth and/or before the parent installs the first restraint.

Will the application of spatial multi criteria evaluation technique enhance the quality of decision-making to resolve boundary conflicts in the Philippines?

Systematic studies that evaluate the quality of decision-making processes are relatively rare. Using the literature on decision quality, this research develops a framework to assess the quality of decision-making processes for resolving boundary conflicts in the Philippines. The evaluation framework breaks down the decision-making process into three components (the decision procedure, the decision method, and the decision unit) and is applied to two ex-post (one resolved and one unresolved) and one ex-ante cases. The evaluation results from the resolved and the unresolved cases show that the choice of decision method plays a minor role in resolving boundary conflicts whereas the choice of decision procedure is more influential. In the end, a decision unit can choose a simple method to resolve the conflict. The ex-ante case presents a follow-up intended to resolve the unresolved case for a changing decision-making process in which the associated decision unit plans to apply the spatial multi criteria evaluation (SMCE) tool as a decision method. The evaluation results from the ex-ante case confirm that the SMCE has the potential to enhance the decision quality because: a) it provides high quality as a decision method in this changing process, and b) the weaknesses associated with the decision unit and the decision procedure of the unresolved case were found to be eliminated in this process.

Formalised peer mentoring pilot evaluation

Over the past ten years, mentoring of children and young people has become an increasingly important feature of social policy in the UK. This has been mirrored in the rapid growth in the number of mentoring schemes operating. However, it is widely acknowledged that no one single definition or model of mentoring exists; rather there are a number of different models providing support to young people in a range of settings. This research was undertaken during the autumn term of 2006 and the summer term of 2007. The methodology comprised an analysis of mentoring models in the 180 participating schools; questionnaires sent to all co-ordinators and to mentors/proteges in 40 schools; interviews with co-ordinators, pupils and support agents in 8 case study schools. Includes: •Introduction •Evaluation methodology •Analysis of school pilot application forms •Evaluation results •Conclusions •Recommendations •Bibliography •Appendices

How training evaluation can be used to potentiate employee development in an organization

A Work Project, presented as part of the requirements for the Award of a Masters Degree in Management from the NOVA – School of Business and Economics

Evaluation system in the European Commission : DEVCO’S evaluation methodology

Mestrado em Economia e Políticas Públicas

HIDING IN PLAIN SIGHT- Sustainable Physical Activity Program Development and Evaluation for Youth with Special Needs: An Evaluative Case Study

The purpose of my research was to contribute to the improvement and sustainability of the Special Needs Activity Program, and develop program implementation strategies that had practical outcomes. I conducted an evaluative case study of S.N.A.P in order to determine what a quality adapted physical activity (APA) program is, why S.N.A.P is considered a quality APA program, and what institutional policies and practices exist to support it. Data was collected via interviews, questionnaires, and observations. Data analysis involved inductive and deductive methods, and a SWOTAR evaluation. Results indicate that quality APA programs include: ‘people’, ‘environment’, and ‘expectations’; there are benefits of experiential learning; activity stations that promote creativity are valuable; several stakeholders do not know the details about S.N.A.P but recognize its value; the institution values what S.N.A.P provides, yet, there is nothing being done to sustain it. Future research should investigate the feasibility of implementing S.N.A.P in various contexts.

Development & evaluation of different acoustic models for Malayalam continuous speech recognition

Performance of any continuous speech recognition system is dependent on the accuracy of its acoustic model. Hence, preparation of a robust and accurate acoustic model lead to satisfactory recognition performance for a speech recognizer. In acoustic modeling of phonetic unit, context information is of prime importance as the phonemes are found to vary according to the place of occurrence in a word. In this paper we compare and evaluate the effect of context dependent tied (CD tied) models, context dependent (CD) and context independent (CI) models in the perspective of continuous speech recognition of Malayalam language. The database for the speech recognition system has utterance from 21 speakers including 11 female and 10 males. Our evaluation results show that CD tied models outperforms CI models over 21%.

Evaluation of ozone and water vapor fields from the ECMWF reanalysis ERA-40 during 1991-1999 in comparison with UARS satellite and MOZAIC aircraft observations

[ 1] The European Centre for Medium-Range Weather Forecasts (ECMWF) 40-year Reanalysis (ERA-40) ozone and water vapor reanalysis fields during the 1990s have been compared with independent satellite data from the Halogen Occultation Experiment (HALOE) and Microwave Limb Sounder (MLS) instruments on board the Upper Atmosphere Research Satellite (UARS). In addition, ERA-40 has been compared with aircraft data from the Measurements of Ozone and Water Vapour by Airbus In-Service Aircraft (MOZAIC) program. Overall, in comparison with the values derived from the independent observations, the upper stratosphere in ERA-40 has about 5 - 10% more ozone and 15 - 20% less water vapor. This dry bias in the reanalysis appears to be global and extends into the middle stratosphere down to 40 hPa. Most of the discrepancies and seasonal variations between ERA-40 and the independent observations occur within the upper troposphere over the tropics and the lower stratosphere over the high latitudes. ERA-40 reproduces a weaker Antarctic ozone hole, and of less vertical extent, than the independent observations; values in the ozone maximum in the tropical stratosphere are lower for the reanalysis. ERA-40 mixing ratios of water vapor are considerably larger than those for MOZAIC, typically by 20% in the tropical upper troposphere, and they may exceed 60% in the lower stratosphere over high latitudes. The results imply that the Brewer-Dobson circulation in the ECMWF reanalysis system is too fast, as is also evidenced by deficiencies in the way ERA-40 reproduces the water vapor "tape recorder'' signal in the tropical stratosphere. Finally, the paper examines the biases and their temporal variation during the 1990s in the way ERA-40 compares to the independent observations. We also discuss how the evaluation results depend on the instrument used, as well as on the version of the data.

Post-occupancy evaluation studies in recently refurbished office building: energy performance and employees' satisfaction

Existing buildings contribute greatly to global energy use and greenhouse gas emissions. In the UK, about 18% of carbon emissions are generated by non-domestic buildings; sustainable building refurbishment can play an important role in reducing carbon emissions. This paper looks at the performance of a recently refurbished 5-storey office building in London, in terms of energy consumption as well as occupants’ satisfaction. Pre- and post-occupancy evaluation studies were conducted using online questionnaire surveys and energy consumption evaluation. Results from pre-occupancy and post-occupancy evaluation studies showed that employees, in general, were more satisfied with their work environment at the refurbished building than with that of their previous office. Employees’ self-reported productivity improved after the move to Elms House. These surveys showed a positive relationship between employees’ satisfaction with their work environment and their self-reported productivity, well-being and enjoyment at work. The factor that contributed to increasing employee satisfaction the most was: better use of interior space. Although the refurbishment was a success in terms of reducing energy consumption per m2, the performance gap was almost 3 times greater than that estimated. Unregulated loads, problems with building control, ineffective use of space and occupants’ behaviour are argued to be reasons for this gap.

Tracking performance evaluation on PETS 2015 Challenge datasets

This paper presents a quantitative evaluation of a tracking system on PETS 2015 Challenge datasets using well-established performance measures. Using the existing tools, the tracking system implements an end-to-end pipeline that include object detection, tracking and post- processing stages. The evaluation results are presented on the provided sequences of both ARENA and P5 datasets of PETS 2015 Challenge. The results show an encouraging performance of the tracker in terms of accuracy but a greater tendency of being prone to cardinality error and ID changes on both datasets. Moreover, the analysis show a better performance of the tracker on visible imagery than on thermal imagery.