Preliminary Evaluation of a Guideline Classification System

In a previous paper, we presented a proposed expansion of the National Guideline Clearing-house (NGC) classification1. We performed a preliminary evaluation of the classification based on 100 guidelines randomly selected from the NGC collection. We found that 89 of the 100 guidelines could be assigned to a single guideline category. To test inter-observer agreement, twenty guidelines were also categorized by a second investigator. Agreement was found to be 40-90% depending on the axis, which compares favorably with agreement among MeSH indexers (30-60%)2. We conclude that categorization is feasible. Further research is needed to clarify axes with poor inter-observer agreement.

New Name, New Format, New Publisher, Same Principles and Values

This issue of the Journal of Family Strengths is an opportunity for a fresh start, as the Family Preservation Journal is renewed and revived under a new name and a new format. Still keen on being a definitive record on developments in family strengths and parenting, the Journal is devoted to presenting theory, practice and evaluation articles on the strengths perspective in family preservation practice, all to assure and improve services and programs that promote and sustain family systems.

Outcomes assessment of a pediatric practice guideline

Objective. This study examines the structure, processes, and data necessary to assess the outcome variables, length of stay and total cost, for a pediatric practice guideline. The guideline was developed by a group of physicians and ancillary staff members representing the services that most commonly provide treatment for asthma patients at Texas Children's Hospital, as a means of standardizing care. Outcomes have needed to be assessed to determine the practice guideline's effectiveness.^ Data sources and study design. Data for the study were collected retrospectively from multiple hospital data bases and from inpatient chart reviews. All patients in this quasi-experimental study had a diagnosis of Asthma (ICD-9-CM Code 493.91) at the time of admission.^ The study examined data for 100 patients admitted between September 15, 1995 and November 15, 1995, whose physician had elected to apply the asthma practice guideline at the time of the patient's admission. The study examined data for 66 inpatients admitted between September 15, 1995 and November 15, 1995, whose physician elected not to apply the asthma practice guideline. The principal outcome variables were identified as "Length of Stay" and "Cost".^ Principal findings. The mean length of stay for the group in which the practice guideline was applied was 2.3 days, and 3.1 days for the comparison group, who did not receive care directed by the practice guideline. The difference was statistically significant (p value = 0.008). There was not a demonstrable difference in risk factors, health status, or quality of care between the groups. Although not showing statistical significance in the univariate analysis, private insurance showed a significant difference in the logistic regression model presenting an elevated odds ratio (odds ratio = 2.2 for a hospital stay $\le$2 days to an odds ratio = 4.7 for a hospital stay $\le$3 days) showing that patients with private insurance experienced greater risk of a shorter hospital stay than the patients with public insurance in each of the logistic regression models. Public insurance included; Medicaid, Medicare, and charity cases. Private insurance included; private insurance policies whether group, individual, or managed care. The cost of an admission was significantly less for the group in which the practice guideline was applied, with a mean difference between the two groups of $1307 per patient.^ Conclusion. The implementation and utilization of a pediatric practice guideline for asthma inpatients at Texas Children's Hospital has a significant impact in terms of reducing the total cost of the hospital stay and length of the hospital stay for asthma patients admitted to Texas Children's Hospital. ^

Physician adoption of a practice guideline: Effect on the cost of medical care for adult patients with diabetes

In the demanding environment of healthcare reform, reduction of unwanted physician practice variation is promoted, often through evidence-based guidelines. Guidelines represent innovations that direct change(s) in physician practice; however, compliance has been disappointing. Numerous studies have analyzed guideline development and dissemination, while few have evaluated the consequences of guideline adoption. The primary purpose of this study was to explore and analyze the relationship between physician adoption of the glycated hemoglobin test guideline for management of adult patients with diabetes, and the cost of medical care. The study also examined six personal and organizational characteristics of physicians and their association with innovativeness, or adoption of the guideline. ^ Cost was represented by approved charges from a managed care claims database. Total cost, and diabetes and related complications cost, first were compared for all patients of adopter physicians with those of non-adopter physicians. Then, data were analyzed controlling for disease severity based on insulin dependency, and for high cost cases. There was no statistically significant difference in any of eight cost categories analyzed. This study represented a twelve-month period, and did not reflect cost associated with future complications known to result from inadequate management of glycemia. Guideline compliance did not increase annual cost, which, combined with the future benefit of glycemic control, lends support to the cost effectiveness of the guideline in the long term. Physician adoption of the guideline was recommended to reduce the future personal and economic burden of this chronic disease. ^ Only half of physicians studied had adopted the glycated hemoglobin test guideline for at least 75% of their diabetic patients. No statistically significant relationship was found between any physician characteristic and guideline adoption. Instead, it was likely that the innovation-decision process and guideline dissemination methods were most influential. ^ A multidisciplinary, multi-faceted approach, including interventions for each stage of the innovation-decision process, was proposed to diffuse practice guidelines more effectively. Further, it was recommended that Organized Delivery Systems expand existing administrative databases to include clinical information, decision support systems, and reminder mechanisms, to promote and support physician compliance with this and other evidence-based guidelines. ^

Motivational interviewing and feedback for college drinkers: Handling missing values with complete case analysis and multiple imputation

Objective: In this secondary data analysis, three statistical methodologies were implemented to handle cases with missing data in a motivational interviewing and feedback study. The aim was to evaluate the impact that these methodologies have on the data analysis. ^ Methods: We first evaluated whether the assumption of missing completely at random held for this study. We then proceeded to conduct a secondary data analysis using a mixed linear model to handle missing data with three methodologies (a) complete case analysis, (b) multiple imputation with explicit model containing outcome variables, time, and the interaction of time and treatment, and (c) multiple imputation with explicit model containing outcome variables, time, the interaction of time and treatment, and additional covariates (e.g., age, gender, smoke, years in school, marital status, housing, race/ethnicity, and if participants play on athletic team). Several comparisons were conducted including the following ones: 1) the motivation interviewing with feedback group (MIF) vs. the assessment only group (AO), the motivation interviewing group (MIO) vs. AO, and the intervention of the feedback only group (FBO) vs. AO, 2) MIF vs. FBO, and 3) MIF vs. MIO.^ Results: We first evaluated the patterns of missingness in this study, which indicated that about 13% of participants showed monotone missing patterns, and about 3.5% showed non-monotone missing patterns. Then we evaluated the assumption of missing completely at random by Little's missing completely at random (MCAR) test, in which the Chi-Square test statistic was 167.8 with 125 degrees of freedom, and its associated p-value was p=0.006, which indicated that the data could not be assumed to be missing completely at random. After that, we compared if the three different strategies reached the same results. For the comparison between MIF and AO as well as the comparison between MIF and FBO, only the multiple imputation with additional covariates by uncongenial and congenial models reached different results. For the comparison between MIF and MIO, all the methodologies for handling missing values obtained different results. ^ Discussions: The study indicated that, first, missingness was crucial in this study. Second, to understand the assumptions of the model was important since we could not identify if the data were missing at random or missing not at random. Therefore, future researches should focus on exploring more sensitivity analyses under missing not at random assumption.^