External quality assessment in the voluntary counseling and testing centers in the Brazilian Amazon using dried tube specimens: results of an effectiveness evaluation

INTRODUCTION : In 2011, the Brazilian Ministry of Health rolled out a program for the external quality assessment of rapid human immunodeficiency virus (HIV) tests using the dried tube specimen (DTS) method (EQA-RT/DTS-HIV). Our objective was to evaluate the implementation of this program at 71 voluntary counseling and testing centers (VCTCs) in the Brazilian Legal Amazonian area one year after its introduction. METHODS : Quantitative and qualitative study that analyzed secondary data and interviews with healthcare workers (HCWs) (n=39) and VCTC coordinators (n=32) were performed. The assessment used 18 key indicators to evaluate the three dimensions of the program's logical framework: structure, process, and result. Each indicator was scored from 1-4, and the aggregate results corresponding to the dimensions were expressed as proportions. The results were compared to the perceptions of the HCWs and coordinators regarding the EQA-RT/DTS-HIV program. RESULTS: The aggregate scores for the three dimensions of structure, process, and result were 91.7%, 78.6%, and 95%, respectively. The lowest score in each dimension corresponded to a different indicator: access to Quali-TR online system 39% (structure), registration in Quali-TR online system 38.7% (process), and VCTC completed the full process in the program's first round 63.4% (result). Approximately 36% of the HCWs and 52% of the coordinators reported enhanced trust in the program for its rapid HIV testing performance. CONCLUSIONS: All three program dimensions exhibited satisfactory results (>75%). Nevertheless, the study findings highlight the need to improve certain program components. Additionally, long-term follow-ups is needed to provide a more thorough picture of the process for external quality assessment.

Effectiveness Evaluation: Health and Social Care

Effectiveness Evaluation: Health and Social Care

Application of ionic liquids and enzymes for the removal of proteinaceous layers from polychrome of works of art and evaluation of the cleaning effectiveness

Dissertação Apresentada na Faculdade de Ciências e Tecnologia da Universidade Nova de Lisboa para obtenção do grau de Mestre em Ciências da Conservação, especialização em Pintura

Evaluating End-User Training Effectiveness in ERP System Implementation

Today’s business world demands more and more internal and external integration and transparency among companies at all fields. Integrated ERP (enterprise resource planning) systems offer a possibility to improve business practices and procedures by providing a unified view on the business including all functions and departments. Due to the obvious benefits, the popularity of integrated ERP systems keeps growing. The implementation of ERP systems has however proven risky. The implementation projects tend to be long, extensive, and costly – and often they end up in a failure. Due to the significant task and role changes ERP implementation brings to almost everybody in the company, training has been identified as one of the most critical success factors of an ERP implementation. To ensure that the training is conducted in the most effective and successful manner, the training outcomes should be evaluated. So far, training evaluation has however gained only limited attention at most companies investing in different training programs. Uponor corporation has initiated a large ERP implementation and process harmonization program in 2004. Thousands of end-users have been trained during this project so far, and the work still continues until the project is completed in 2010. In this thesis, the evaluation of end-user training in Uponor’s ERP program is brought further from the current state of performing the basic participant satisfaction survey in the end of each class. The results show that in order to reach reliable training effectiveness evaluation results, not only the reaction towards training but also transfer of skills and attitudes and the final results of the training program should be evaluated.

Critical success factors for improving societal effectiveness of transport sector's R&D

This study investigates societal effectiveness of transport sector’s Research & Development (R&D) operations. In this study effectiveness refers to organization’s capability to produce the intended and desired impacts through its operations. The aim of this study is to identify the motives for evaluating societal effectiveness and recognize the critical success factors for improving effectiveness. The theoretical framework focuses first in the policy context of effectiveness evaluation in public sector and secondly the framework introduces the concept and process of effectiveness evaluation. The empirical part is carried out as a case study, which investigates societal effectiveness of Finnish Transport Agency’s (FTA’s) R&D. The aim is to recognize FTA’s critical success factors for improving R&D operations’ societal effectiveness. Based on these factors, the organization is able to define indicators for measuring effectiveness in the future operations. In this study societal effectiveness is investigated from R&D purchasers’ and R&D end- users’ points of views according to Purchaser-Provider-model. The results indicate that societal effectiveness evaluation is important part of R&D operations, but the implementation of the evaluation as part of daily operations is challenging. Because of limited resources, the organization is forced to strong priorization and therefore R&D tasks are secondary after the operational tasks. Based on the results the critical success factors can be recognized as resources and priorization, clear strategy and objectives, internal communications, cooperation between public and private sector and R&D implementation and dissemination.

The effectiveness of a needleless intravenous system in prevention of percutaneous injury in two hospitals

This study assessed if hospital-wide implementation of a needleless intravenous connection system reduces the number of reported percutaneous injuries, overall and those specifically due to intravenous connection activities.^ Incidence rates were compared before and after hospital-wide implementation of a needleless intravenous system at two hospitals, a full service general hospital and a pediatric hospital. The years 1989-1991 were designated as pre-implementation and 1993 was designated as post-implementation. Data from 1992 were not included in the effectiveness evaluation to allow employees to become familiar with use of the new device. The two hospitals showed rate ratios of 1.37 (95% CI = 1.22-1.54, p $\le$.0001) and 1.63 (95% CI = 1.34-1.97, p $\le$.0001), or a 27.1% and a 38.6% reduction in overall injury rate, respectively. Rate ratios for intravenous connection injuries were 2.67 (95% CI = 1.89-3.78, p $\le$.0001) and 3.35 (95% CI = 1.87-6.02, p $\le$.0001), or a 62.5% and a 69.9% reduction in injury rate, respectively. Rate ratios for all non-intravenous connection injuries were calculated to control for factors other than device implementation that may have been operating to reduce the injury rate. These rate ratios were lower, 1.21 and 1.44, demonstrating the magnitude of injury reduction due to factors other than device implementation. It was concluded that the device was effective in reduction of numbers of reported percutaneous injuries.^ Use-effectiveness of the system was also assessed by a survey of randomly selected device users to determine satisfaction with the device, frequency of use and barriers to use. Four hundred seventy-eight surveys were returned for a response rate of 50.9%. Approximately 94% of respondents at both hospitals expressed satisfaction with the needleless system and recommended continued use. The survey also revealed that even though over 50% of respondents report using the device "always" or "most of the time" for intravenous medication administration, flushing lines, and connecting secondary intravenous lines, needles were still being used for these same activities. Compatibility, accessibility and other technical problems were reported as reasons for using needles for these activities. These problems must be addressed, by both manufacturers and users, before the needleless system will be effective in prevention of all intravenous connection injuries. ^

An evaluation of the personal response system program for the elderly in Harris County, Texas

The Personal Response System Program at Huffington Center on Aging, Baylor College of Medicine, provides emergency call systems for elderly people living independently in Houston, Texas. The goal of the project was to complete a formative evaluation of the Personal Response System Program. The specific aims of the evaluation were three-fold. One aim was to evaluate participant health status and level of disability. The second aim was to develop a health care cost estimation strategy. Finally, a preliminary cost-effectiveness analysis was completed to evaluate the program's impact on health care costs and health status among the elderly target population. ^ The evaluation was a longitudinal, randomized experimental design. After the screening of 120 volunteers for eligibility, clients were asked to complete a written questionnaire and a monthly health service contact diary. Volunteers were contacted by telephone interviewers to collect health status information from 100 eligible clients (83%) on three occasions during the six months of follow-up. ^ Initially, volunteers were randomized to two experimental groups. The two groups were found to be comparable at the beginning of the study. No significant differences were detected related to health status, level of disability, or history of physician visits at baseline. However, the group with the Personal Response System (PRS) device had more adverse health events, higher IADL scores, more frequent use of walkers, lower average health status scores, and fewer community volunteers hours than the usual care comparison group. ^ The health care costs were estimated based on an algorithm adapted from the American Medical Association guidelines. Average total health care costs for the group with the PRS device ($912) were greater than the usual care group ($464). However, median health care values for the PRS group ($263) were similar to the usual care comparison group ($234). The preliminary findings indicated that the use of the PRS device was not associated with health care cost savings. ^ In the preliminary cost-effectiveness analysis, use of the personal response system was found to be associated with increased mental health status among elderly clients. The cost-effectiveness evaluation indicated that the associated cost for six months was $710 per unit increase in mental component score when the $150 PRS subscription was included. However, clients with the PRS device were found to have a greater decline in physical health status during the six-month follow-up. The beneficial effect on mental health status was found to be in contrast to negative findings associated with changes in physical health status. The implications for future research relate to the need to identify risk factors among geriatric populations to better target groups that would most likely benefit from PRS Program enrollment. ^

Evaluation plan for Federal Motor Vehicle Safety Standard 208 occupant crash protection.

Mode of access: Internet.

Wisconsin Alcohol Safety Action Project final report. Volume I - project description and evaluation. Part 1 - executive summary.

National Highway Traffic Safety Administration, Office of Alcohol Countermeasures, Washington, D.C.

Juvenile court alcohol school evaluation. Interim report, September 1, 1977.

National Highway Traffic Safety Administration, Washington, D.C.

Design of field passive restraint evaluation. Final report.

National Highway Traffic Safety Administration, Washington, D.C.