Sensemaking tools for understanding research literatures:design, implementation and user evaluation

This paper describes the work undertaken in the Scholarly Ontologies Project. The aim of the project has been to develop a computational approach to support scholarly sensemaking, through interpretation and argumentation, enabling researchers to make claims: to describe and debate their view of a document's key contributions and relationships to the literature. The project has investigated the technicalities and practicalities of capturing conceptual relations, within and between conventional documents in terms of abstract ontological structures. In this way, we have developed a new kind of index to distributed digital library systems. This paper reports a case study undertaken to test the sensemaking tools developed by the Scholarly Ontologies project. The tools used were ClaiMapper, which allows the user to sketch argument maps of individual papers and their connections, ClaiMaker, a server on which such models can be stored and saved, which provides interpretative services to assist the querying of argument maps across multiple papers and ClaimFinder, a novice interface to the search services in ClaiMaker.

GPs' perspectives on managing the NHS Health Check in primary care:a qualitative evaluation of implementation in one area of England

OBJECTIVES: To evaluate the implementation of the National Health Service (NHS) Health Check programme in one area of England from the perspective of general practitioners (GPs). DESIGN: A qualitative exploratory study was conducted with GPs and other healthcare professionals involved in delivering the NHS Health Check and with patients. This paper reports the experience of GPs and focuses on the management of the Heath Check programme in primary care. SETTING: Primary care surgeries in the Heart of Birmingham region (now under the auspices of the Birmingham Cross City Clinical Commissioning Group) were invited to take part in the larger scale evaluation. This study focuses on a subset of those surgeries whose GPs were willing to participate. PARTICIPANTS: 9 GPs from different practices volunteered. GPs served an ethnically diverse region with areas of socioeconomic deprivation. Ethnicities of participant GPs included South Asian, South Asian British, white, black British and Chinese. METHODS: Individual semistructured interviews were conducted with GPs face to face or via telephone. Thematic analysis was used to analyse verbatim transcripts. RESULTS: Themes were generated which represent GPs' experiences of managing the NHS Health Check: primary care as a commercial enterprise; 'buy in' to concordance in preventive healthcare; following protocol and support provision. These themes represent the key issues raised by GPs. They reveal variability in the implementation of NHS Health Checks. GPs also need support in allocating resources to the Health Check including training on how to conduct checks in a concordant (or collaborative) way. CONCLUSIONS: The variability observed in this small-scale evaluation corroborates existing findings suggesting a need for more standardisation. Further large-scale research is needed to determine how that could be achieved. Work needs to be done to further develop a concordant approach to lifestyle advice which involves tailored individual goal setting rather than a paternalistic advice-giving model.

A study of the implementation of junior college *evaluation system in Taiwan

Since the establishment of the evaluation system in 1975, the junior colleges in the Republic of China (Taiwan), have gone through six formal evaluations. We know that evaluation in schooling, like quality control in businesses, should be a systematic, formal, and a continual process. It can doubtless serve as a strategy to refine the quality of education. The purpose of this research is to explore the current practice of junior college evaluation in Taiwan. This provides insight into the development of and quality of the current evaluation system. Moreover, this study also identified the source of problems with the current evaluation system and provided suggestion for improvements.^ In order to attain the above purposes, this research was undertaken in both theoretical and practical ways. First, theoretically, on the basis of a literature review, the theories of educational evaluation and, according to the course and principles of development, a view of the current practice in Taiwan. Secondly, in practice, by means of questionnaires, an analysis of the views of evaluation committeemen, junior college presidents, and administrators were obtained on evaluation models, methods, contents, organization, functions, criteria, grades reports, and others with suggestions for improvement. The summary of findings concludes that most evaluators and evaluatees think the purpose of evaluation can help the colleges explore their difficulties and problems. In addition, it was found that there is significant difference between the two groups regarding the evaluation methods, contents, organization, functions, criteria, grades reports and others, while analyzing these objective data forms the basis for an improved method of evaluation for Junior Colleges in Taiwan. ^

TEACHNJ: An Evaluation of Two Years Implementation

The Teacher Effectiveness and Accountability for the Children of New Jersey (TEACHNJ) Act was adopted by the New Jersey legislature in August 2012 with the intent to raise student achievement by improving the overall quality of instruction. As a result of this act, new teacher evaluation systems are being introduced in school districts across the state in an effort to more accurately assess teacher performance. The new teacher evaluations will be based on multiple classroom observations as well as the academic achievement of their students as measured on standardized tests. In addition, professional development opportunities are likely to change under this legislation, with schools customizing professional development programs to more effectively meet the needs of their teachers. The overarching question that informs our research is what impact will TEACH NJ have on the overall value of teacher evaluations and the quality of professional development opportunities offered to teachers. Data collected through survey research presents the pre-implementation practices (2011-2012 school year) as well as one year post-implementation practices (2013-2014) taking place in school districts throughout New Jersey. The findings reflect teachers’ perceptions of the value of the current teacher evaluation practices, the quality of the current professional development opportunities and the value the school administration places on teacher evaluations.

Evaluation, Selection and Planning the Implementation of a Pavement Management Optimization Model: Optimization Recommendations, 1994

This document briefly summarizes the pavement management activities under the existing Iowa Department of Transportation (DOT) Pavement Management System. The second part of the document provides projected increase in use due to the implementation of the Iowa DOT Pavement Management Optimization System. All estimates of existing time devoted to the Pavement Management System and project increases in time requirements are estimates made by the appropriate Iowa DOT office director or function manager. Included is the new Pavement Management Optimization Structure for the three main offices which will work most closely with the Pavement Management Optimization System (Materials, Design, and Program Management).

Evaluation, Selection and Planning the Implementation of a Pavement Management Optimization Model, Phase II Report, 1994

The missions of the research are to assist the Iowa Department of Transortation (Iowa DOT) to: Define pavement management (PM) optimization; Identify the characteristics of PM optimization systems being developed or implemented; Identify specific and achievable objectives for the Iowa DOT pavement management optimization; Evaluate different PM optimization methodologies; Identify a methodology to perform PM optimization that best satisfies the Iowa DOT's objectives; Develop a plan for the implementation of the PM optimization selected. The project is divided into three (3) phases. The first phase has been completed and accomplished the first three missions (identified above). The second phase has been completed and accomplished the next two missions. Phase three will accomplish the last mission.

Increasing the power of genome wide association studies in natural populations using repeated measures : evaluation and implementation

1. Genomewide association studies (GWAS) enable detailed dissections of the genetic basis for organisms' ability to adapt to a changing environment. In long-term studies of natural populations, individuals are often marked at one point in their life and then repeatedly recaptured. It is therefore essential that a method for GWAS includes the process of repeated sampling. In a GWAS, the effects of thousands of single-nucleotide polymorphisms (SNPs) need to be fitted and any model development is constrained by the computational requirements. A method is therefore required that can fit a highly hierarchical model and at the same time is computationally fast enough to be useful. 2. Our method fits fixed SNP effects in a linear mixed model that can include both random polygenic effects and permanent environmental effects. In this way, the model can correct for population structure and model repeated measures. The covariance structure of the linear mixed model is first estimated and subsequently used in a generalized least squares setting to fit the SNP effects. The method was evaluated in a simulation study based on observed genotypes from a long-term study of collared flycatchers in Sweden. 3. The method we present here was successful in estimating permanent environmental effects from simulated repeated measures data. Additionally, we found that especially for variable phenotypes having large variation between years, the repeated measurements model has a substantial increase in power compared to a model using average phenotypes as a response. 4. The method is available in the R package RepeatABEL. It increases the power in GWAS having repeated measures, especially for long-term studies of natural populations, and the R implementation is expected to facilitate modelling of longitudinal data for studies of both animal and human populations.

Developing leadership in managers to facilitate the implementation of national guideline recommendations : a process evaluation of feasibility and usefulness

Background: Previous research supports the claim that managers are vital players in the implementation of clinical practice guidelines (CPGs), yet little is known about interventions aiming to develop managers’ leadership in facilitating implementation. In this pilot study, process evaluation was employed to study the feasibility and usefulness of a leadership intervention by exploring the intervention’s potential to support managers in the implementation of national guideline recommendations for stroke care in outpatient rehabilitation. Methods: Eleven senior and frontline managers from five outpatient stroke rehabilitation centers participated in a four-month leadership intervention that included workshops, seminars, and teleconferences. The focus was on developing knowledge and skills to enhance the implementation of CPG recommendations, with a particular focus on leadership behaviors. Each dyad of managers was assigned to develop a leadership plan with specific goals and leadership behaviors for implementing three rehabilitation recommendations. Feasibility and usefulness were explored through observations and interviews with the managers and staff members prior to the intervention, and then one month and one year after the intervention. Results: Managers considered the intervention beneficial, particularly the participation of both senior and frontline managers and the focus on leadership knowledge and skills for implementing CPG recommendations. All the managers developed a leadership plan, but only two units identified goals specific to implementing the three stroke rehabilitation recommendations. Of these, only one identified leadership behaviors that support implementation. Conclusion: Managers found that the intervention was delivered in a feasible way and appreciated the focus on leadership to facilitate implementation. However, the intervention appeared to have limited impact on managers’ behaviors or clinical practice at the units. Future interventions directed towards managers should have a stronger focus on developing leadership skills and behaviors to tailor implementation plans and support implementation of CPG recommendations.

"Learning together, growing with family": the implementation and evaluation of a family support programme

The "Learning together, growing with family" programme is targeted to at-risk parents and children from 6 to 11 years old, with a preventive focus on promoting positive parent-child relationships. In this study, we examined the quality of the programme implementation and its influence on the programme results in a sample of 425 parents and 138 facilitators drawn from the first trial. Mixed methods were used, consisting of: parental self-reports on parenting dimensions, professionals' records on parental attendance and appraisals on six topics of the implementation process, and focus group discussions in which facilitators reported on the initial steps of the implementation. Results showed a high quality of implementation with respect to the group facilitator and the programme organization factors, followed by the coordination with services and the support facilities offered to participants and, finally, by the factors of fidelity and prior organization steps. Results of the focus groups confirmed that the prior steps were challenging and offered the more effective strategies. Better quality in the implementation factors predicted better parenting styles and parental competencies after the programme, as well as a higher attendance rate. In sum, this study demonstrates the importance of good implementation in at-risk contexts and provides some clues as to the key elements that moderate programme effectiveness.