The performance of human papillomavirus high-risk DNA testing in the screening and diagnostic settings.

OBJECTIVE: We sought to evaluate the performance of the human papillomavirus high-risk DNA test in patients 30 years and older. MATERIALS AND METHODS: Screening (n=835) and diagnosis (n=518) groups were defined based on prior Papanicolaou smear results as part of a clinical trial for cervical cancer detection. We compared the Hybrid Capture II (HCII) test result with the worst histologic report. We used cervical intraepithelial neoplasia (CIN) 2/3 or worse as the reference of disease. We calculated sensitivities, specificities, positive and negative likelihood ratios (LR+ and LR-), receiver operating characteristic (ROC) curves, and areas under the ROC curves for the HCII test. We also considered alternative strategies, including Papanicolaou smear, a combination of Papanicolaou smear and the HCII test, a sequence of Papanicolaou smear followed by the HCII test, and a sequence of the HCII test followed by Papanicolaou smear. RESULTS: For the screening group, the sensitivity was 0.69 and the specificity was 0.93; the area under the ROC curve was 0.81. The LR+ and LR- were 10.24 and 0.34, respectively. For the diagnosis group, the sensitivity was 0.88 and the specificity was 0.78; the area under the ROC curve was 0.83. The LR+ and LR- were 4.06 and 0.14, respectively. Sequential testing showed little or no improvement over the combination testing. CONCLUSIONS: The HCII test in the screening group had a greater LR+ for the detection of CIN 2/3 or worse. HCII testing may be an additional screening tool for cervical cancer in women 30 years and older.

The population health performance of medical students at two medical schools

Public Health and medicine are complimentary disciplines dedicated to the health and well-being of humankind. Worldwide, medical school accreditation bodies require the inclusion of population health in medical education. In 2003, the Institutes of Medicine (IOM) recommended that all medical students receive basic public health training in population-based prevention. The purpose of this study was to (1) examine the public health clinical performance of third-year medical students at two independent medical schools, (2) compare the public health clinical practice performance of the schools, and (3) identify underlying predictors of high and low public health clinical performance at one of the medical schools. ^ This study is unique in its analysis and report of observed medical student public health clinical practices. The cohort consisted of 751 third-year medical students who completed a required clinical performance exam using trained standardized patients. Medical student performance scores on 24 consensus public health items derived from nine patient cases were analyzed.^ The analysis showed nearly identical results for both medical schools at the 60%, 65%, and 70% pass rate. Students performed poorly on items associated with prevention, behavioral science, and surveillance. Factors associated with high student performance included being from an underrepresented minority, matching to a primary care residency, and high class ranking. A review of medical school curriculum at both schools revealed a lack of training in four public health domains. Nationally, 32% of medical students reported inadequate training in public health in the year 2006.^ These findings suggest more dedicated teaching time for public health domains is needed at the medical schools represented in this study. Finally, more research is needed to assess attainment of public health knowledge and skills for medical students nationwide if we are to meet the recommendations of the IOM. ^

Financial impact of the Medicare prospective payment system on long term acute care hospitals

Objective. Long Term Acute Care Hospitals (LTACs) are subject to Medicare rules because they accept Medicare and Medicaid patients. In October 2002, Medicare changed the LTAC reimbursement formulas, from a cost basis system to a Prospective Payment System (PPS). This study examines whether the PPS has negatively affected the financial performance of the LTAC hospitals in the period following the reimbursement change (2003-2006), as compared to the period prior to the change (1999-2003), and if so, to what extent. This study will also examine whether the PPS has resulted in a decreased average patient length of stay (LOS) in the LTAC hospitals for the period of 2003-2006 as compared to the prior period of 1999-2003, and if so, to what extent. ^ Methods. The study group consists of two large LTAC hospital systems, Kindred Healthcare Inc. and Select Specialty Hospitals of Select Medical Corporation. Financial data and operational indicators were reviewed, tabulated and dichotomized into two groups, covering the two periods: 1999-2002 and 2003-2006. The financial data included net annual revenues, net income, revenue per patient per day and profit margins. It was hypothesized that the profit margins for the LTAC hospitals were reduced because of the new PPS. Operational indicators, such as annual admissions, annual patient days, and average LOS were analyzed. It was hypothesized that LOS for the LTAC hospitals would have decreased. Case mix index, defined as the weighted average of patients’ DRGs for each hospital system, was not available to cast more light on the direction of LOS. ^ Results. This assessment found that the negative financial impacts did not materialize; instead, financial performance improved during the PPS period (2003-2006). The income margin percentage under the PPS increased for Kindred by 24%, and for Select by 77%. Thus, the study’s working hypothesis of reduced income margins for the LTACs under the PPS was contradicted. As to the average patient length of stay, LOS decreased from 34.7 days to 29.4 days for Kindred, and from 30.5 days to 25.3 days for Select. Thus, on the issue of LTAC shorter length of stay, the study’s working hypothesis was confirmed. ^ Conclusion. Overall, there was no negative financial effect on the LTAC hospitals during the period of 2003-2006 following Medicare implementation of the PPS in October 2002. On the contrary, the income margins improved significantly. ^ During the same period, LOS decreased following the implementation of the PPS. This was consistent with the LTAC hospitals’ pursuit of financial incentives.^

Financial impact of the Medicare prospective payment system on long term acute care hospitals

Objective. Long Term Acute Care Hospitals (LTACs) are subject to Medicare rules because they accept Medicare and Medicaid patients. In October 2002, Medicare changed the LTAC reimbursement formulas, from a cost basis system to a Prospective Payment System (PPS). This study examines whether the PPS has negatively affected the financial performance of the LTAC hospitals in the period following the reimbursement change (2003–2006), as compared to the period prior to the change (1999–2003), and if so, to what extent. This study will also examine whether the PPS has resulted in a decreased average patient length of stay (LOS) in the LTAC hospitals for the period of 2003–2006 as compared to the prior period of 1999-2003, and if so, to what extent. ^ Methods. The study group consists of two large LTAC hospital systems, Kindred Healthcare Inc. and Select Specialty Hospitals of Select Medical Corporation. Financial data and operational indicators were reviewed, tabulated and dichotomized into two groups, covering the two periods: 1999–2002 and 2003–2006. The financial data included net annual revenues, net income, revenue per patient per day and profit margins. It was hypothesized that the profit margins for the LTAC hospitals were reduced because of the new PPS. Operational indicators, such as annual admissions, annual patient days, and average LOS were analyzed. It was hypothesized that LOS for the LTAC hospitals would have decreased. Case mix index, defined as the weighted average of patients’ DRGs for each hospital system, was not available to cast more light on the direction of LOS. ^ Results. This assessment found that the negative financial impacts did not materialize; instead, financial performance improved during the PPS period (2003–2006). The income margin percentage under the PPS increased for Kindred by 24%, and for Select by 77%. Thus, the study’s working hypothesis of reduced income margins for the LTACs under the PPS was contradicted. As to the average patient length of stay, LOS decreased from 34.7 days to 29.4 days for Kindred, and from 30.5 days to 25.3 days for Select. Thus, on the issue of LTAC shorter length of stay, the study’s working hypothesis was confirmed. ^ Conclusion. Overall, there was no negative financial effect on the LTAC hospitals during the period of 2003–2006 following Medicare implementation of the PPS in October 2002. On the contrary, the income margins improved significantly. ^ During the same period, LOS decreased following the implementation of the PPS. This was consistent with the LTAC hospitals’ pursuit of financial incentives. ^

A simulation study of the standard design, the rolling six design, the CRM, and the modified CRM in Phase I clinical trials

The Phase I clinical trial is considered the "first in human" study in medical research to examine the toxicity of a new agent. It determines the maximum tolerable dose (MTD) of a new agent, i.e., the highest dose in which toxicity is still acceptable. Several phase I clinical trial designs have been proposed in the past 30 years. The well known standard method, so called the 3+3 design, is widely accepted by clinicians since it is the easiest to implement and it does not need a statistical calculation. Continual reassessment method (CRM), a design uses Bayesian method, has been rising in popularity in the last two decades. Several variants of the CRM design have also been suggested in numerous statistical literatures. Rolling six is a new method introduced in pediatric oncology in 2008, which claims to shorten the trial duration as compared to the 3+3 design. The goal of the present research was to simulate clinical trials and compare these phase I clinical trial designs. Patient population was created by discrete event simulation (DES) method. The characteristics of the patients were generated by several distributions with the parameters derived from a historical phase I clinical trial data review. Patients were then selected and enrolled in clinical trials, each of which uses the 3+3 design, the rolling six, or the CRM design. Five scenarios of dose-toxicity relationship were used to compare the performance of the phase I clinical trial designs. One thousand trials were simulated per phase I clinical trial design per dose-toxicity scenario. The results showed the rolling six design was not superior to the 3+3 design in terms of trial duration. The time to trial completion was comparable between the rolling six and the 3+3 design. However, they both shorten the duration as compared to the two CRM designs. Both CRMs were superior to the 3+3 design and the rolling six in accuracy of MTD estimation. The 3+3 design and rolling six tended to assign more patients to undesired lower dose levels. The toxicities were slightly greater in the CRMs.^

AN EVALUATION OF THE CONSISTENCY OF IMRT PATIENT-SPECIFIC QA TECHNIQUES

To ensure the integrity of an intensity modulated radiation therapy (IMRT) treatment, each plan must be validated through a measurement-based quality assurance (QA) procedure, known as patient specific IMRT QA. Many methods of measurement and analysis have evolved for this QA. There is not a standard among clinical institutions, and many devices and action levels are used. Since the acceptance criteria determines if the dosimetric tools’ output passes the patient plan, it is important to see how these parameters influence the performance of the QA device. While analyzing the results of IMRT QA, it is important to understand the variability in the measurements. Due to the different form factors of the many QA methods, this reproducibility can be device dependent. These questions of patient-specific IMRT QA reproducibility and performance were investigated across five dosimeter systems: a helical diode array, radiographic film, ion chamber, diode array (AP field-by-field, AP composite, and rotational composite), and an in-house designed multiple ion chamber phantom. The reproducibility was gauged for each device by comparing the coefficients of variation (CV) across six patient plans. The performance of each device was determined by comparing each one’s ability to accurately label a plan as acceptable or unacceptable compared to a gold standard. All methods demonstrated a CV of less than 4%. Film proved to have the highest variability in QA measurement, likely due to the high level of user involvement in the readout and analysis. This is further shown by how the setup contributed more variation than the readout and analysis for all of the methods, except film. When evaluated for ability to correctly label acceptable and unacceptable plans, two distinct performance groups emerged with the helical diode array, AP composite diode array, film, and ion chamber in the better group; and the rotational composite and AP field-by-field diode array in the poorer group. Additionally, optimal threshold cutoffs were determined for each of the dosimetry systems. These findings, combined with practical considerations for factors such as labor and cost, can aid a clinic in its choice of an effective and safe patient-specific IMRT QA implementation.

Bench-scale evaluation of the activated sludge process for treatment of a high -strength chemical plant wastewater

A bench-scale treatability study was conducted on a high-strength wastewater from a chemical plant to develop an alternative for the existing waste stabilization pond treatment system. The objective of this study was to determine the treatability of the wastewater by the activated sludge process and, if treatable, to determine appropriate operating conditions, and to evaluate the degradability of bis(2-chloroethyl)ether (Chlorex) and benzene in the activated sludge system. Four 4-L Plexi-glass, complete mixing, continuous flow activated sludge reactors were operated in parallel under different operating conditions over a 6-month period. The operating conditions examined were hydraulic retention time (HRT), sludge retention time (SRT), nutrient supplement, and Chlorex/benzene spikes. Generally the activated sludge system treating high-strength wastewater was stable under large variations of organic loading and operating conditions. At an HRT of 2 days, more than 90% removal efficiency with good sludge settleability was achieved when the organic loading was less than 0.4 g BOD$\sb5$/g MLVSS/d or 0.8 g COD/g MLVSS/d. At least 20 days of SRT was required to maintain steady operation. Phosphorus addition enhanced the performance of the system especially during stressed operation. On the average, removals of benzene and Chlorex were 73-86% and 37-65%, respectively. In addition, the low-strength wastewater was treatable by activated sludge process, showing more than 90% BOD removal at a HRT of 0.5 days. In general, the sludge had poor settling characteristics. The aerated lagoon process treating high-strength wastewater also provided significant organic reduction, but did not produce an acceptable effluent concentration. ^

Evaluation of the Hosmer -Lemeshow global goodness -of-fit statistic for mixed variable logistic regression models

The performance of the Hosmer-Lemeshow global goodness-of-fit statistic for logistic regression models was explored in a wide variety of conditions not previously fully investigated. Computer simulations, each consisting of 500 regression models, were run to assess the statistic in 23 different situations. The items which varied among the situations included the number of observations used in each regression, the number of covariates, the degree of dependence among the covariates, the combinations of continuous and discrete variables, and the generation of the values of the dependent variable for model fit or lack of fit.^ The study found that the $\rm\ C$g* statistic was adequate in tests of significance for most situations. However, when testing data which deviate from a logistic model, the statistic has low power to detect such deviation. Although grouping of the estimated probabilities into quantiles from 8 to 30 was studied, the deciles of risk approach was generally sufficient. Subdividing the estimated probabilities into more than 10 quantiles when there are many covariates in the model is not necessary, despite theoretical reasons which suggest otherwise. Because it does not follow a X$\sp2$ distribution, the statistic is not recommended for use in models containing only categorical variables with a limited number of covariate patterns.^ The statistic performed adequately when there were at least 10 observations per quantile. Large numbers of observations per quantile did not lead to incorrect conclusions that the model did not fit the data when it actually did. However, the statistic failed to detect lack of fit when it existed and should be supplemented with further tests for the influence of individual observations. Careful examination of the parameter estimates is also essential since the statistic did not perform as desired when there was moderate to severe collinearity among covariates.^ Two methods studied for handling tied values of the estimated probabilities made only a slight difference in conclusions about model fit. Neither method split observations with identical probabilities into different quantiles. Approaches which create equal size groups by separating ties should be avoided. ^

HEALTH MAINTENANCE ORGANIZATION ENVIRONMENT: AN EMPIRICAL STUDY OF THE RELATIONSHIP OF EXTERNAL CONTEXT AND PERFORMANCE

The research project is an extension of a series of administrative science and health care research projects evaluating the influence of external context, organizational strategy, and organizational structure upon organizational success or performance. The research will rely on the assumption that there is not one single best approach to the management of organizations (the contingency theory). As organizational effectiveness is dependent on an appropriate mix of factors, organizations may be equally effective based on differing combinations of factors. The external context of the organization is expected to influence internal organizational strategy and structure and in turn the internal measures affect performance (discriminant theory). The research considers the relationship of external context and organization performance.^ The unit of study for the research will be the health maintenance organization (HMO); an organization the accepts in exchange for a fixed, advance capitation payment, contractual responsibility to assure the delivery of a stated range of health sevices to a voluntary enrolled population. With the current Federal resurgence of interest in the Health Maintenance Organization (HMO) as a major component in the health care system, attention must be directed at maximizing development of HMOs from the limited resources available. Increased skills are needed in both Federal and private evaluation of HMO feasibility in order to prevent resource investment and in projects that will fail while concurrently identifying potentially successful projects that will not be considered using current standards.^ The research considers 192 factors measuring contextual milieu (social, educational, economic, legal, demographic, health and technological factors). Through intercorrelation and principle components data reduction techniques this was reduced to 12 variables. Two measures of HMO performance were identified, they are (1) HMO status (operational or defunct), and (2) a principle components factor score considering eight measures of performance. The relationship between HMO context and performance was analysed using correlation and stepwise multiple regression methods. In each case it has been concluded that the external contextual variables are not predictive of success or failure of study Health Maintenance Organizations. This suggests that performance of an HMO may rely on internal organizational factors. These findings have policy implications as contextual measures are used as a major determinant in HMO feasibility analysis, and as a factor in the allocation of limited Federal funds. ^