Critical indicators associated with negative performance in a selectively manned unit

Introduction. Selectively manned units have a long, international history, both military and civilian. Some examples include SWAT teams, firefighters, the FBI, the DEA, the CIA, and military Special Operations. These special duty operators are individuals who perform a highly skilled and dangerous job in a unique environment. A significant amount of money is spent by the Department of Defense (DoD) and other federal agencies to recruit, select, train, equip and support these operators. When a critical incident or significant life event occurs, that jeopardizes an operator's performance; there can be heavy losses in terms of training, time, money, and potentially, lives. In order to limit the number of critical incidents, selection processes have been developed over time to “select out” those individuals most likely to perform below desired performance standards under pressure or stress and to "select in" those with the "right stuff". This study is part of a larger program evaluation to assess markers that identify whether a person will fail under the stresses in a selectively manned unit. The primary question of the study is whether there are indicators in the selection process that signify potential negative performance at a later date. ^ Methods. The population being studied included applicants to a selectively manned DoD organization between 1993 and 2001 as part of a unit assessment and selection process (A&S). Approximately 1900 A&S records were included in the analysis. Over this nine year period, seventy-two individuals were determined to have had a critical incident. A critical incident can come in the form of problems with the law, personal, behavioral or family problems, integrity issues, and skills deficit. Of the seventy-two individuals, fifty-four of these had full assessment data and subsequent supervisor performance ratings which assessed how an individual performed while on the job. This group was compared across a variety of variables including demographics and psychometric testing with a group of 178 individuals who did not have a critical incident and had been determined to be good performers with positive ratings by their supervisors.^ Results. In approximately 2004, an online pre-screen survey was developed in the hopes of preselecting out those individuals with items that would potentially make them ineligible for selection to this organization. This survey has aided the organization to increase its selection rates and save resources in the process. (Patterson, Howard Smith, & Fisher, Unit Assessment and Selection Project, 2008) When the same prescreen was used on the critical incident individuals, it was found that over 60% of the individuals would have been flagged as unacceptable. This would have saved the organization valuable resources and heartache.^ There were some subtle demographic differences between the two groups (i.e. those with critical incidents were almost twice as likely to be divorced compared with the positive performers). Upon comparison of Psychometric testing several items were noted to be different. The two groups were similar when their IQ levels were compared using the Multidimensional Aptitude Battery (MAB). When looking at the Minnesota Multiphasic Personality Inventory (MMPI), there appeared to be a difference on the MMPI Social Introversion; the Critical Incidence group scored somewhat higher. When analysis was done, the number of MMPI Critical Items between the two groups was similar as well. When scores on the NEO Personality Inventory (NEO) were compared, the critical incident individuals tended to score higher on Openness and on its subscales (Ideas, Actions, and Feelings). There was a positive correlation between Total Neuroticism T Score and number of MMPI critical items.^ Conclusions. This study shows that the current pre-screening process is working and would have saved the organization significant resources. ^ If one was to develop a profile of a candidate who potentially could suffer a critical incident and subsequently jeopardize the unit, mission and the safety of the public they would look like the following: either divorced or never married, score high on the MMPI in Social Introversion, score low on MMPI with an "excessive" amount of MMPI critical items; and finally scores high on the NEO Openness and subscales Ideas, Feelings, and Actions.^ Based on the results gleaned from the analysis in this study there seems to be several factors, within psychometric testing, that when taken together, will aid the evaluators in selecting only the highest quality operators in order to save resources and to help protect the public from unfortunate critical incidents which may adversely affect our health and safety.^

The impact of Medicare, Medicaid and Schip Extension Act of 2007 (MMSEA) on the long term acute care hospitals

The Long Term Acute Care Hospitals (LTACH), which serve medically complex patients, have grown tremendously in recent years, by expanding the number of Medicare patient admissions and thus increasing Medicare expenditures (Stark 2004). In an attempt to mitigate the rapid growth of the LTACHs and reduce related Medicare expenditures, Congress enacted Section 114 of P.L. 110-173 (§114) of the Medicare, Medicaid and SCHIP Extension Act (MMSEA) in December 29, 2007 to regulate the LTCAHs industry. MMSEA increased the medical necessity reviews for Medicare admissions, imposed a moratorium on new LTCAHs, and allowed the Centers for Medicare and Medicaid Services (CMS) to recoup Medicare overpayments for unnecessary admissions. ^ This study examines whether MMSEA impacted LTACH admissions, operating margins and efficiency. These objectives were analyzed by comparing LTACH data for 2008 (post MMSEA) and data for 2006-2007 (pre-MMSEA). Secondary data were utilized from the American Hospital Association (AHA) database and the American Hospital Directory (AHD).^ This is a longitudinal retrospective study with a total sample of 55 LTACHs, selected from 396 LTACHs facilities that were fully operational during the study period of 2006-2008. The results of the research found no statistically significant change in total Medicare admissions; instead there was a small but not statistically significant reduction of 5% in Medicare admissions for 2008 in comparison to those for 2006. A statistically significant decrease in mean operating margins was confirmed between the years 2006 and 2008. The LTACHs' Technical Efficiency (TE), as computed by Data Envelopment Analysis (DEA), showed significant decrease in efficiency over the same period. Thirteen of the 55 LTACHs in the sample (24%) in 2006 were calculated as “efficient” utilizing the DEA analysis. This dropped to 13% (7/55) in 2008. Longitudinally, the decrease in efficiency using the DEA extension technique (Malmquist Index or MI) indicated a deterioration of 10% in efficiency over the same period. Interestingly, however, when the sample was stratified into high efficient versus low efficient subgroups (approximately 25% in each group), a comparison of the MIs suggested a significant improvement in Efficiency Change (EC) for the least efficient (MI 0.92022) and reduction in efficiency for the most efficient LTACHs (MI = 1.38761) over same period. While a reduction in efficiency for the most efficient is unexpected, it is not particularly surprising, since efficiency measure can vary over time. An improvement in efficiency, however, for the least efficient should be expected as those LTACHs begin to manage expenses (and controllable resources) more carefully to offset the payment/reimbursement pressures on their margins from MMSEA.^

Performance tiers: Implementing comparative effectiveness analysis in the health care setting through operations research and spatial methods

This dissertation develops and tests a comparative effectiveness methodology utilizing a novel approach to the application of Data Envelopment Analysis (DEA) in health studies. The concept of performance tiers (PerT) is introduced as terminology to express a relative risk class for individuals within a peer group and the PerT calculation is implemented with operations research (DEA) and spatial algorithms. The analysis results in the discrimination of the individual data observations into a relative risk classification by the DEA-PerT methodology. The performance of two distance measures, kNN (k-nearest neighbor) and Mahalanobis, was subsequently tested to classify new entrants into the appropriate tier. The methods were applied to subject data for the 14 year old cohort in the Project HeartBeat! study.^ The concepts presented herein represent a paradigm shift in the potential for public health applications to identify and respond to individual health status. The resultant classification scheme provides descriptive, and potentially prescriptive, guidance to assess and implement treatments and strategies to improve the delivery and performance of health systems. ^

A comprehensive review of the environmental impacts and human health risks associated with the occurrence of waste pharmaceuticals in water sources of the United States, and policy implications

The occurrence of waste pharmaceuticals has been identified and well documented in water sources throughout North America and Europe. Many studies have been conducted which identify the occurrence of various pharmaceutical compounds in these waters. This project is an extensive review of the documented evidence of this occurrence published in the scientific literature. This review was performed to determine if this occurrence has a significant impact on the environment and public health. This project and review found that pharmaceuticals such as sex hormone drugs, antibiotic drugs and antineoplastic/cytostatic agents as well as their metabolites have been found to occur in water sources throughout the United States at levels high enough to have noticeable impacts on human health and the environment. It was determined that the primary sources of this occurrence of pharmaceuticals were waste water effluent and solid wastes from sewage treatment plants, pharmaceutical manufacturing plants, healthcare and biomedical research facilities, as well as runoff from veterinary medicine applications (including aquaculture). ^ In addition, current public policies of US governmental agencies such as the Environmental Protection Agency (EPA), Food and Drug Administration (FDA), and Drug Enforcement Agency (DEA) have been evaluated to see if they are doing a sufficient job at controlling this issue. Specific recommendations for developing these EPA, FDA, and DEA policies have been made to mitigate, prevent, or eliminate this issue.^ Other possible interventions such as implementing engineering controls were also evaluated in order to mitigate, prevent and eliminate this issue. These engineering controls include implementing improved current treatment technologies such as the advancement and improvement of waste water treatment processes utilized by conventional sewage treatment and pharmaceutical manufacturing plants. In addition, administrative controls such as the use of “green chemistry” in drug synthesis and design were also explored and evaluated as possible alternatives to mitigate, prevent, or eliminate this issue. Specific recommendations for incorporating these engineering and administrative controls into the applicable EPA, FDA, and DEA policies have also been made.^