Can accreditation work as a tool for quality improvement in public health? A critical review

Public health departments play an important role in promoting and preserving the health of communities. The lack of a system to ensure their quality and accountability led to the development of a national voluntary accreditation program by Public Health Accreditation Board (PHAB). The concept that accreditation will lead to quality improvement in public health which will ultimately lead to healthy communities seems intuitive but lacks a robust body of evidence. A critical review of literature was conducted to explore if accreditation can lead to quality improvement in public health. The articles were selected from publically available databases using a specific set of criteria for inclusion, exclusion, and appraisal. To understand the relationship between accreditation and quality improvement, the potential strengths and limitations of accreditation process were evaluated. Recommendations for best practices are suggested so that public health accreditation can yield maximum benefits. A logic model framework to help depict the impact of accreditation on various levels of public health outcomes is also discussed in this thesis. The literature review shows that existing accreditation programs in other industries show limited but encouraging evidence that accreditation will improve quality and strengthen the delivery of public health services. While progress in introducing accreditation in public health can be informed by other accredited industries, the public health field has its own set of challenges. Providing incentives, creating financing strategies, and having a strong leadership will allow greater access to accreditation by all public health departments. The suggested recommendations include that continuous evaluation, public participation, systems approach, clear vision, and dynamic standards should become hallmarks of the accreditation process. Understanding the link between accreditation, quality improvement, and health outcomes will influence the successful adoption and implementation of the public health accreditation program. This review of literature suggests that accreditation is an important step in improving the quality of public health departments and in ultimately improving the health of communities. However, accreditation should be considered in an integrated system of tools and approaches to improve the public health practice. Hence, it is a means to an end - not an end unto itself.^

A qualitative analysis of leadership styles and the selection of quality improvement in primary care practice

In the Practice Change Model, physicians act as key stakeholders, people who have both an investment in the practice and the capacity to influence how the practice performs. This leadership role is critical to the development and change of the practice. Leadership roles and effectiveness are an important factor in quality improvement in primary care practices.^ The study conducted involved a comparative case study analysis to identify leadership roles and the relationship between leadership roles and the number and type of quality improvement strategies adopted during a Practice Change Model-based intervention study. The research utilized secondary data from four primary care practices with various leadership styles. The practices are located in the San Antonio region and serve a large Hispanic population. The data was collected by two ABC Project Facilitators from each practice during a 12-month period including Key Informant Interviews (all staff members), MAP (Multi-method Assessment Process), and Practice Facilitation field notes. This data was used to evaluate leadership styles, management within the practice, and intervention tools that were implemented. The chief steps will be (1) to analyze if the leader-member relations contribute to the type of quality improvement strategy or strategies selected (2) to investigate if leader-position power contributes to the number of strategies selected and the type of strategy selected (3) and to explore whether the task structure varies across the four primary care practices.^ The research found that involving more members of the clinic staff in decision-making, building bridges between organizational staff and clinical staff, and task structure are all associated with the direct influence on the number and type of quality improvement strategies implemented in primary care practice.^ Although this research only investigated leadership styles of four different practices, it will offer future guidance on how to establish the priorities and implementation of quality improvement strategies that will have the greatest impact on patient care improvement. ^

Health outcomes, quality improvement and cost-effectiveness of the Community Diabetes Education (CoDE) program: Results of a randomized controlled trial

The objectives of this dissertation were to evaluate health outcomes, quality improvement measures, and the long-term cost-effectiveness and impact on diabetes-related microvascular and macrovascular complications of a community health worker-led culturally tailored diabetes education and management intervention provided to uninsured Mexican Americans in an urban faith-based clinic. A prospective, randomized controlled repeated measures design was employed to compare the intervention effects between: (1) an intervention group (n=90) that participated in the Community Diabetes Education (CoDE) program along with usual medical care; and (2) a wait-listed comparison group (n=90) that received only usual medical care. Changes in hemoglobin A1c (HbA1c) and secondary outcomes (lipid status, blood pressure and body mass index) were assessed using linear mixed-models and an intention-to-treat approach. The CoDE group experienced greater reduction in HbA1c (-1.6%, p<.001) than the control group (-.9%, p<.001) over the 12 month study period. After adjusting for group-by-time interaction, antidiabetic medication use at baseline, changes made to the antidiabetic regime over the study period, duration of diabetes and baseline HbA1c, a statistically significant intervention effect on HbA1c (-.7%, p=.02) was observed for CoDE participants. Process and outcome quality measures were evaluated using multiple mixed-effects logistic regression models. Assessment of quality indicators revealed that the CoDE intervention group was significantly more likely to have received a dilated retinal examination than the control group, and 53% achieved a HbA1c below 7% compared with 38% of control group subjects. Long-term cost-effectiveness and impact on diabetes-related health outcomes were estimated through simulation modeling using the rigorously validated Archimedes Model. Over a 20 year time horizon, CoDE participants were forecasted to have less proliferative diabetic retinopathy, fewer foot ulcers, and reduced numbers of foot amputations than control group subjects who received usual medical care. An incremental cost-effectiveness ratio of $355 per quality-adjusted life-year gained was estimated for CoDE intervention participants over the same time period. The results from the three areas of program evaluation: impact on short-term health outcomes, quantification of improvement in quality of diabetes care, and projection of long-term cost-effectiveness and impact on diabetes-related health outcomes provide evidence that a community health worker can be a valuable resource to reduce diabetes disparities for uninsured Mexican Americans. This evidence supports formal integration of community health workers as members of the diabetes care team.^

Health information exchange: Using metrics to address quality of care and return on investment

Health Information Exchange (HIE) will play a key part in our nation’s effort to improve healthcare. The evidence of HIEs transformational role in healthcare delivery systems is quite limited. The lack of such evidence led us to explore what exists in the healthcare industry that may provide evidence of effectiveness and efficiency of HIEs. The objective of the study was to find out how many fully functional HIEs are using any measurements or metrics to gauge impact of HIE on quality improvement (QI) and on return on investment (ROI).^ A web-based survey was used to determine the number of operational HIEs using metrics for QI and ROI. Our study highlights the fact that only 50 percent of the HIEs who responded use or plan to use metrics. However, 95 percent of the respondents believed HIEs improve quality of care while only 56 percent believed HIE showed positive ROI. Although operational HIEs present numerous opportunities to demonstrate the business model for improving health care quality, evidence to document the impact of HIEs is lacking. ^

The role of a nursing home administrator's education in influencing quality of care in US nursing homes

Nursing home literature links poor management practices to poor quality of care and resident outcomes. Since Nursing Home Administrators (NHAs) require an array of skills to perform their role, it is important to explore what makes a NHA effective. This research fills a gap in the literature and provides a possible option to improve the quality of care in nursing homes. Purpose of the study. The study examines whether NHAs with advanced education (defined as a Masters degree or more) are associated with better quality of care in licensed nursing homes (NHs). Design and Methods. Data was derived from the CDC’s 2004 National Nursing Home Survey, which is a representative sample of NHs across the US. A Donabedian- inspired structure-process-outcomes study model was created to explain how education relates to quality of care. Quality of care was defined as onsite oral care, employee influenza vaccination rates and staff recognition programs. Statistical analyses included multivariate logistic regression; covariates included facility-level variables used in similar peer-reviewed research but also included select measures from the Area Resource File to control for county-level factors. Results. Descriptive and analytical analyses confirm that NHAs with a Bachelor’s degree, Associate degree or high school diploma perform less well than NHAs with a Masters degree or more. NHAs with advanced education are more likely to have onsite dental care and recognition programs for staff than NHAs with a Bachelor’s degree (or less). Also NHAs with less than graduate education are more likely to provide off-site dental care. Employee vaccination rates are not impacted by education. Adding certification, tenure or years of experience to a NHA with advanced education gives them an advantage. In fact, certification and experience alone do not have a positive relationship to care indicators; however adding these to advanced education produces a significant result. Implications. This research provides preliminary evidence that advanced education for the NHA is associated with better quality of care. If future research can confirm these findings, there is merit in revisiting the qualifications. Education can be a legitimate option to support quality improvement efforts in US nursing homes. ^

Quality assessment in radiation oncology

Oncologic specialty societies and multidisciplinary collaborative groups have dedicated considerable effort to developing evidence-based quality indicators (QIs) to facilitate quality improvement, accreditation, benchmarking, reimbursement, maintenance of certification, and regulatory reporting. In particular, radiation oncology as a field has a long history of organized quality assessment efforts, and continues to work toward developing consensus quality standards in the face of continually evolving technologies and standards of care. The present report provides a comprehensive review of the current state of quality assessment in radiation oncology, with an emphasis on recent quality improvement efforts. Specifically, this report aims to highlight implications of the healthcare quality movement for radiation oncology and review existing efforts to define and measure quality in the field, with particular focus on dimensions of quality that are specific to radiation oncology within the "big picture" of oncologic quality improvement efforts.^

Everyone is; should healthcare? Outsourcing: Issues in strategic planning, organizational culture, and organizational ethics

Expenditures for personal health services in the United States have doubled over the last decade. They continue to outpace the growth rate of the gross national product. Costs for medical care have steadily increased at an annual rate well above the rate of inflation and have gradually outstripped payers' ability to meet their premiums. This limitation of resources justifies the ongoing healthcare reform strategies to maximize utilization and minimize costs. The majority of the cost-containment effort has focused on hospitals, as they account for about 40 percent of total health expenditures. Although good patient outcomes have long been identified as healthcare's central concern, continuing cost pressures from both regulatory reforms and the restructuring of healthcare financing have recently made improving fiscal performance an essential goal for healthcare organizations. ^ The search for financial performance, quality improvement, and fiscal accountability has led to outsourcing, which is the hiring of a third party to perform a task previously and traditionally done in-house. The incomparable nature and overwhelming dissimilarities between health and other commodities raise numerous administrative, organizational, policy and ethical issues for administrators who contemplate outsourcing. This evaluation of the outsourcing phenomenon, how it has developed and is currently practiced in healthcare, will explore the reasons that healthcare organizations gravitate toward outsourcing as a strategic management tool to cut costs in an environment of continuing escalating spending. ^ This dissertation has four major findings. First, it suggests that U.S. hospitals in FY2000 spent an estimated $61 billion in outsourcing. Second, it finds that the proportion of healthcare outsourcing highly correlates with several types of hospital controlling authorities and specialties. Third, it argues that healthcare outsourcing has implications in strategic organizational issues, professionalism, and organizational ethics that warrant further public policy discussions before expanding its limited use beyond hospital “hotel functions” and back office business processes. Finally, it devises an outsourcing suitability scale that organizations can utilize to ensure the most strategic option for outsourcing and concludes with some public policy implications and recommendations for its limited use. ^

Exploring race/ethnicity as a risk factor for mortality in newborns following congenital heart surgery at a center of excellence

The purpose of this study was to determine if race/ethnicity was a significant risk factor for hospital mortality in children following congenital heart surgery in a contemporary sample of newborns with congenital heart disease. Unlike previous studies that utilized administrative databases, this study utilized clinical data collected at the point of care to examine racial/ethnic outcome differences in the context of the patients' clinical condition and their overall perioperative experience. A retrospective cohort design was used. The study sample consisted of 316 newborns (<31 days of age) who underwent congenital heart surgery between January 2007 through December 2009. A multivariate logistic regression model was used to determine the impact of race/ethnicity, insurance status, presence of a spatial anomaly, prenatal diagnosis, postoperative sepsis, cardiac arrest, respiratory failure, unplanned reoperation, and total length of stay in the intensive care unit on outcomes following congenital heart surgery in newborns. The study findings showed that the strongest predictors of hospital mortality following congenital heart surgery in this cohort were postoperative cardiac arrest, postoperative respiratory failure, having a spatial anomaly, and total ICU LOS. Race/ethnicity and insurance status were not significant risk factors. The institution where this study was conducted is designated as a center of excellence for congenital heart disease. These centers have state-of-the-art facilities, extensive experience in caring for children with congenital heart disease, and superior outcomes. This study suggests that optimal care delivery for newborns requiring congenital heart surgery at a center of excellence portends exceptional outcomes and this benefit is conferred upon the entire patient population despite the race/ethnicity of the patients. From a public health and health services view, this study also contributes to the overall body of knowledge on racial/ethnic disparities in children with congenital heart defects and puts forward the possibility of a relationship between quality of care and racial/ethnic disparities. Further study is required to examine the impact of race/ethnicity on the long-term outcomes of these children as they encounter the disparate components of the health care delivery system. There is also opportunity to study the role of race/ethnicity on the hospital morbidity in these patients considering current expectations for hospital survival are very high, and much of the current focus for quality improvement rests in minimizing the development of patient morbidities.^

Data Accuracy in Medical Record Abstraction

Clinical Research Data Quality Literature Review and Pooled Analysis We present a literature review and secondary analysis of data accuracy in clinical research and related secondary data uses. A total of 93 papers meeting our inclusion criteria were categorized according to the data processing methods. Quantitative data accuracy information was abstracted from the articles and pooled. Our analysis demonstrates that the accuracy associated with data processing methods varies widely, with error rates ranging from 2 errors per 10,000 files to 5019 errors per 10,000 fields. Medical record abstraction was associated with the highest error rates (70–5019 errors per 10,000 fields). Data entered and processed at healthcare facilities had comparable error rates to data processed at central data processing centers. Error rates for data processed with single entry in the presence of on-screen checks were comparable to double entered data. While data processing and cleaning methods may explain a significant amount of the variability in data accuracy, additional factors not resolvable here likely exist. Defining Data Quality for Clinical Research: A Concept Analysis Despite notable previous attempts by experts to define data quality, the concept remains ambiguous and subject to the vagaries of natural language. This current lack of clarity continues to hamper research related to data quality issues. We present a formal concept analysis of data quality, which builds on and synthesizes previously published work. We further posit that discipline-level specificity may be required to achieve the desired definitional clarity. To this end, we combine work from the clinical research domain with findings from the general data quality literature to produce a discipline-specific definition and operationalization for data quality in clinical research. While the results are helpful to clinical research, the methodology of concept analysis may be useful in other fields to clarify data quality attributes and to achieve operational definitions. Medical Record Abstractor’s Perceptions of Factors Impacting the Accuracy of Abstracted Data Medical record abstraction (MRA) is known to be a significant source of data errors in secondary data uses. Factors impacting the accuracy of abstracted data are not reported consistently in the literature. Two Delphi processes were conducted with experienced medical record abstractors to assess abstractor’s perceptions about the factors. The Delphi process identified 9 factors that were not found in the literature, and differed with the literature by 5 factors in the top 25%. The Delphi results refuted seven factors reported in the literature as impacting the quality of abstracted data. The results provide insight into and indicate content validity of a significant number of the factors reported in the literature. Further, the results indicate general consistency between the perceptions of clinical research medical record abstractors and registry and quality improvement abstractors. Distributed Cognition Artifacts on Clinical Research Data Collection Forms Medical record abstraction, a primary mode of data collection in secondary data use, is associated with high error rates. Distributed cognition in medical record abstraction has not been studied as a possible explanation for abstraction errors. We employed the theory of distributed representation and representational analysis to systematically evaluate cognitive demands in medical record abstraction and the extent of external cognitive support employed in a sample of clinical research data collection forms. We show that the cognitive load required for abstraction in 61% of the sampled data elements was high, exceedingly so in 9%. Further, the data collection forms did not support external cognition for the most complex data elements. High working memory demands are a possible explanation for the association of data errors with data elements requiring abstractor interpretation, comparison, mapping or calculation. The representational analysis used here can be used to identify data elements with high cognitive demands.

Debriefing after resuscitations in a pediatric emergency department

Multiple guidelines recommend debriefing of actual resuscitations to improve clinical performance. We implemented a novel standardized debriefing program using a Debriefing In Situ Conversation after Emergent Resuscitations Now (DISCERN) tool. Following the development of the evidence-based DISCERN tool, we conducted an observational study of all resuscitations (intubation, CPR, and/or defibrillation) at a pediatric emergency department (ED) over one year. Resuscitation interventions, patient survival, and physician team leader characteristics were analyzed as predictors for debriefing. Each debriefing's participants, time duration, and content were recorded. Thematic content of debriefings was categorized by framework approach into Team Emergency Assessment Measure (TEAM) elements. There were 241 resuscitations and 63 (26%) debriefings. A higher proportion of debriefings occurred after CPR (p<0.001) or ED death (p<0.001). Debriefing participants always included an attending and nurse; the median number of staff roles present was six. Median interval (from resuscitation end to start of debriefing) & debriefing durations were 33 (IQR 15,67) and 10 minutes (IQR 5,12), respectively. Common TEAM themes included co-operation/coordination (30%), communication (22%), and situational awareness (15%). Stated reasons for not debriefing included: unnecessary (78%), time constraints (19%), or other reasons (3%). Debriefings with the DISCERN tool usually involved higher acuity resuscitations, involved most of the indicated personnel, and lasted less than 10 minutes. This qualitative tool could be adapted to other settings. Future studies are needed to evaluate for potential impacts on education, quality improvement programming, and staff emotional well-being.^

Risk factors for surgical site infections among patients undergoing major colon surgery in the United States 2007-2009

Background: Surgical site infections (SSIs) after abdominal surgeries account for approximately 26% of all reported SSIs. The Center for Disease Control and Prevention (CDC) defines 3 types of SSIs: superficial incisional, deep incisional, and organ/space. Preventing SSIs has become a national focus. This dissertation assesses several associations with the individual types of SSI in patients that have undergone colon surgery. ^ Methods: Data for this dissertation was obtained from the American College of Surgeons' National Surgical Quality Improvement Program (NSQIP); major colon surgeries were identified in the database that occurred between the time period of 2007 and 2009. NSQIP data includes more than 50 preoperative and 30 intraoperative factors; 40 collected postoperative occurrences are based on a follow-up period of 30 days from surgery. Initially, four individual logistic regressions were modeled to compare the associations between risk factors and each of the SSI groups: superficial, deep, organ/space and a composite of any single SSI. A second analysis used polytomous regression to assess simultaneously the associations between risk factors and the different types of SSIs, as well as, formally test the different effect estimates of 13 common risk factors for SSIs. The final analysis explored the association between venous thromboembolism (VTEs) and the different types of SSIs and risk factors. ^ Results: A total of 59,365 colon surgeries were included in the study. Overall, 13% of colon cases developed a single type of SSI; 8% of these were superficial SSIs, 1.4% was deep SSIs, and 3.8% were organ/space SSIs. The first article identifies the unique set of risk factors associated with each of the 4 SSI models. Distinct risk factors for superficial SSIs included factors, such as alcohol, chronic obstructive pulmonary disease, dyspnea and diabetes. Organ/space SSIs were uniquely associated with disseminated cancer, preoperative dialysis, preoperative radiation treatment, bleeding disorder and prior surgery. Risk factors that were significant in all models had different effect estimates. The second article assesses 13 common SSI risk factors simultaneously across the 3 different types of SSIs using polytomous regression. Then each risk factor was formally tested for the effect heterogeneity exhibited. If the test was significant the final model would allow for the effect estimations for that risk factor to vary across each type of SSI; if the test was not significant, the effect estimate would remain constant across the types of SSIs using the aggregate SSI value. The third article explored the relationship of venous thromboembolism (VTE) and the individual types of SSIs and risk factors. The overall incidence of VTEs after the 59,365 colon cases was 2.4%. All 3 types of SSIs and several risk factors were independently associated with the development of VTEs. ^ Conclusions: Risk factors associated with each type of SSI were different in patients that have undergone colon surgery. Each model had a unique cluster of risk factors. Several risk factors, including increased BMI, duration of surgery, wound class, and laparoscopic approach, were significant across all 4 models but no statistical inferences can be made about their different effect estimates. These results suggest that aggregating SSIs may misattribute and hide true associations with risk factors. Using polytomous regression to assess multiple risk factors with the multiple types of SSI, this study was able to identify several risk factors that had significant effect heterogeneity across the 3 types of SSI challenging the use of aggregate SSI outcomes. The third article recognizes the strong association between VTEs and the 3 types of SSIs. Clinicians understand the difference between superficial, deep and organ/space SSIs. Our results indicate that they should be considered individually in future studies.^

A comparative analysis of hospital -based physician monitoring systems

The purpose of the multiple case-study was to determine how hospital subsystems (such as physician monitoring and credentialing; quality assurance; risk management; and peer review) were supporting the monitoring of physicians? Three large metropolitan hospitals in Texas were studied and designated as hospitals #1, #2, and #3. Realizing that hospital subsystems are a unique entity and part of a larger system, conclusions were made on the premises of a quality control system, in relation to the tools of government (particularly the Health Care Quality Improvement Act (HCQIA)), and in relation to itself as a tool of a hospital.^ Three major analytical assessments were performed. First, the subsystems were analyzed as to their "completeness"; secondly, the subsystems were analyzed for "performance"; and thirdly, the subsystems were analyzed in reference to the interaction of completeness and performance.^ The physician credentialing and monitoring and the peer review subsystems as quality control systems were most complete, efficient, and effective in hospitals #1 and #3. The HCQIA did not seem to be an influencing factor in the completeness of the subsystem in hospital #1. The quality assurance and risk management subsystem in hospital #2 was not representative of completeness and performance and the HCQIA was not an influencing factor in the completeness of the Q.A. or R.M. systems in any hospital. The efficiency (computerization) of the physician credentialing, quality assurance and peer review subsystems in hospitals #1 and #3 seemed to contribute to their effectiveness (system-wide effect).^ The results indicated that the more complete, effective, and efficient subsystems were characterized by (1) all defined activities being met, (2) the HCQIA being an influencing factor, (3) a decentralized administrative structure, (4) computerization an important element, and (5) staff was sophisticated in subsystem operations. However, other variables were identified which deserve further research as to their effect on completeness and performance of subsystems. They include (1) medical staff affiliations, (2) system funding levels, (3) the system's administrative structure, and (4) the physician staff "cultural" characteristics. Perhaps by understanding other influencing factors, health care administrators may plan subsystems that will be compatible with legislative requirements and administrative objectives. ^

Quality Data is Key to Improving Education

The Data Quality Campaign (DQC) has been focused since 2005 on advocating for states to build robust state longitudinal data systems (SLDS). While states have made great progress in their data infrastructure, and should continue to emphasize this work, t data systems alone will not improve outcomes. It is time for both DQC and states to focus on building capacity to use the information that these systems are producing at every level – from classrooms to state houses. To impact system performance and student achievement, the ingrained culture must be replaced with one that focuses on data use for continuous improvement. The effective use of data to inform decisions, provide transparency, improve the measurement of outcomes, and fuel continuous improvement will not come to fruition unless there is a system wide focus on building capacity around the collection, analysis, dissemination, and use of this data, including through research.