The Problem with Value-Added Measurement

Measuring student learning through standardized tests is a lot harder than modern education reformers would have you believe.

A costing exercise of provision of prevention of HIV transmission from mother to child services in Vietnam

Objectives. This dissertation focuses on estimating the cost of providing a minimum package of prevention of mother-to-child HIV transmission (PMTCT) in Vietnam from a societal perspective and discussing the issues of scaling-up the minimum package nationwide. ^ Methods. Through collection of cost-related data of PMTCT services at 22 PMTCT sites in 5 provinces (Hanoi, Quang Ninh, Thai Nguyen, Hochiminh City, and An Giang) in Vietnam, the research investigates the item cost of each service in minimum PMTCT packages and the actual cost per PMTCT site at different organizational levels including central, provincial, and district. Next, the actual cost per site at each organizational level is standardized by adjusting for HIV prevalence rate to arrive at standardized costs per site. This study then uses the standardized costs per site to project, by different scenarios, the total cost to scale-up the PMTCT program in Vietnam. ^ Results. The cost for HIV tests, infant formula, and salary of health workers are consistently found to be the biggest expenditures in the PMTCT minimum package program across all organizational levels. Annual cost for drugs for prophylaxis treatment, operating and capital, and training costs are not substantial (less than 5% of total costs at all levels). The actual annual estimated cost for a PMTCT site at the central level is nearly VND 1.9 billion or US$ 107,650 (exchange rate US$ 1 = VND 17,500) while the annual cost for a provincial site is VND 375 million or US$ 21,400. The annual cost for a district site is VND 139 million (∼US$ 8,000). ^ The estimated total annual cost to roll out the PMTCT minimum package to the 5 studied provinces is approximately US$ 1.1 million. If the PMTCT program is to be scaled-up to 14 provinces until 2008 and up to 40 provinces through the end of 2010 as planned by the Ministry of Health, it would cost the health system an approximate annual amount of US$ 2.1 million and US$ 5.04 million, respectively. The annual cost for scaling-up the PMTCT minimum package nationwide is around US$ 7.6 million. Meanwhile, the total annual cost to implement PMTCT minimum packages to achieve PMTCT national targets in 2010 (providing counseling service to 90% of all pregnant women; 60% of them will receive HIV tests and 100% of HIV (+) mother and their newborn will receive prophylaxis treatment) would be US$ 6.1 million. ^ Recommendations. This study recommends: (1) the Ministry of Health of Vietnam should adjust its short-term national targets to a more feasible and achievable level given the current level of available resources; (2) a detailed budget for scaling-up the PMTCT program should be developed together with the national PMTCT action plan; (3) the PMTCT scaling-up plan developed by the Ministry of Health should focus on coverage of high prevalence population and quality of services provided rather than number of physical provinces reached; (4) exclusive breastfeeding strategy should be promoted as part of the PMTCT program; and (5) for a smooth and effective rolling out of PMTCT services nationwide, development of a national training plan and execution of this plan must precede any other initiations of the PMTCT scaling-up plan. ^

The assessment of standardized training programs in public health preparedness

The Texas Bioterrorism Continuing Education Consortium (BCE) provided National Disaster Life Support (NDLS) training courses throughout the state of Texas in 2005, to help improve knowledge and skills pertaining to bioterrorism and other public health emergencies. The NDLS training courses include curriculum in Basic Disaster Life Support (BDLS) and Core Disaster Life Support (CDLS). A course evaluation which included items assessing ability and willingness of training participants, role of responders, and other variables was mailed to all NDLS participants who provided contact information. An analysis was conducted to determine whether the survey respondents participated in the Hurricanes Katrina and/or Rita relief efforts, as well as to evaluate the impact of the NDLS training courses on the participant's ability and willingness to respond during a disaster. The study population (n = 2150) consisted mostly of nurses (50%) (n=1074). A chi-square test of analysis indicated the following results. Among the survey respondents who took the CDLS course, there was no statically significant difference by occupation pertaining to ability or willingness to respond (x2 [df = 5] = 4.02, p= 0.546); (x2 [df = 5] = 2.45, p = .783). However, there was a statistically significant difference among those respondents who took the BDLS course with respect to ability, and a slightly significant difference with respect to willingness (x2 [df = 5] = 13.35, p = .020 and (x2 = [df = 5] = 10.299, p = .067). These findings are similar to previous studies assessing willingness to respond to a disaster.^ A second analysis was conducted with these survey data to evaluate the implications for disaster response training for the NDLS courses. Results indicated that the majority of disaster responders served in the role for which they were professionally trained (Physicians=68%; Nurses = 50.4%). Nurses, EMT, and Fire professionals served in multiple roles. These results suggest the importance of developing training programs that will prepare professionals to serve in multiple roles. The development of standardized evaluation methods would fill an important gap in assessing impact of national training programs. ^

The impact of traditional psychiatric services and case management services on the functioning of people with schizophrenia: A cross-national study in Nova Scotia and Texas

The purpose of this study was to determine the impact of traditional psychiatric services with case management services on the functioning of people with schizophrenia. Traditional services were defined as routine clinic services consisting of medication follow-along, psychotherapy, and support services. Case management consisted of activities involved in linking, planning, and monitoring services for the outpatient client who has schizophrenia. The target population was adult schizophrenics who had been receiving outpatient clinic services for a minimum of six months. Structured interviews were conducted using standardized scales (e.g., Quality of Life, Self-Efficacy, and Brief Symptom Inventory) with 78 outpatient client volunteers from two sites: Nova Scotia (Canada) and Texas (USA). The researcher tested for differences in psychiatric symptomatology, recidivism, and quality of life for persons with schizophrenia receiving traditional psychiatric services in Nova Scotia and traditional plus case management services in Texas. Data were collected from the structured interviews and medical records review forms. Types of services were blocked into low and high levels of Intensity (frequency x minutes) and compared to determine the relative contribution of each. Finally, the role of clients' self-efficacy was tested as an intervening variable. Although the findings did not support the hypotheses in the direction anticipated, there were some interesting and useful results. From the Nova Scotia site, clients who received low levels of services were hospitalized less compared to the Texas site. The more psychotic a patient was the higher their involvement in medication follow-along and the more monitoring they received. The more psychotherapy received, the lower the reported satisfaction with social relationships. Of particular interest is the role that self-efficacy played in improved client outcomes. Although self-efficacy scores were related to improved functioning, the mechanism for this still needs to be clarified through subsequent research. ^