Critical indicators associated with negative performance in a selectively manned unit

Introduction. Selectively manned units have a long, international history, both military and civilian. Some examples include SWAT teams, firefighters, the FBI, the DEA, the CIA, and military Special Operations. These special duty operators are individuals who perform a highly skilled and dangerous job in a unique environment. A significant amount of money is spent by the Department of Defense (DoD) and other federal agencies to recruit, select, train, equip and support these operators. When a critical incident or significant life event occurs, that jeopardizes an operator's performance; there can be heavy losses in terms of training, time, money, and potentially, lives. In order to limit the number of critical incidents, selection processes have been developed over time to “select out” those individuals most likely to perform below desired performance standards under pressure or stress and to "select in" those with the "right stuff". This study is part of a larger program evaluation to assess markers that identify whether a person will fail under the stresses in a selectively manned unit. The primary question of the study is whether there are indicators in the selection process that signify potential negative performance at a later date. ^ Methods. The population being studied included applicants to a selectively manned DoD organization between 1993 and 2001 as part of a unit assessment and selection process (A&S). Approximately 1900 A&S records were included in the analysis. Over this nine year period, seventy-two individuals were determined to have had a critical incident. A critical incident can come in the form of problems with the law, personal, behavioral or family problems, integrity issues, and skills deficit. Of the seventy-two individuals, fifty-four of these had full assessment data and subsequent supervisor performance ratings which assessed how an individual performed while on the job. This group was compared across a variety of variables including demographics and psychometric testing with a group of 178 individuals who did not have a critical incident and had been determined to be good performers with positive ratings by their supervisors.^ Results. In approximately 2004, an online pre-screen survey was developed in the hopes of preselecting out those individuals with items that would potentially make them ineligible for selection to this organization. This survey has aided the organization to increase its selection rates and save resources in the process. (Patterson, Howard Smith, & Fisher, Unit Assessment and Selection Project, 2008) When the same prescreen was used on the critical incident individuals, it was found that over 60% of the individuals would have been flagged as unacceptable. This would have saved the organization valuable resources and heartache.^ There were some subtle demographic differences between the two groups (i.e. those with critical incidents were almost twice as likely to be divorced compared with the positive performers). Upon comparison of Psychometric testing several items were noted to be different. The two groups were similar when their IQ levels were compared using the Multidimensional Aptitude Battery (MAB). When looking at the Minnesota Multiphasic Personality Inventory (MMPI), there appeared to be a difference on the MMPI Social Introversion; the Critical Incidence group scored somewhat higher. When analysis was done, the number of MMPI Critical Items between the two groups was similar as well. When scores on the NEO Personality Inventory (NEO) were compared, the critical incident individuals tended to score higher on Openness and on its subscales (Ideas, Actions, and Feelings). There was a positive correlation between Total Neuroticism T Score and number of MMPI critical items.^ Conclusions. This study shows that the current pre-screening process is working and would have saved the organization significant resources. ^ If one was to develop a profile of a candidate who potentially could suffer a critical incident and subsequently jeopardize the unit, mission and the safety of the public they would look like the following: either divorced or never married, score high on the MMPI in Social Introversion, score low on MMPI with an "excessive" amount of MMPI critical items; and finally scores high on the NEO Openness and subscales Ideas, Feelings, and Actions.^ Based on the results gleaned from the analysis in this study there seems to be several factors, within psychometric testing, that when taken together, will aid the evaluators in selecting only the highest quality operators in order to save resources and to help protect the public from unfortunate critical incidents which may adversely affect our health and safety.^

Targeting Special Populations for Family Preservation: The Influence of Worker Competence and Organizational Culture

Today there are approximately 581,000 children in the United States foster care system. Children of color, one special population group, are disproportionately represented in the foster care system. Family preservation, a program that aims to improve family functioning and thus decrease the need for foster care, has been examined closely. Some researchers believe that family preservation programs have failed partly due to practitioners' inability to target appropriate families (Feldman, 1990; Schuerman, Rzepnicki & Littell, 1994). Additionally, research confirms that children of color are not the target of family preservation services (Denby, Curtis, & Alford, 1998). Improvements in the effectiveness of family preservation will require many types of reform both internal and external to the program. Among the types of internal reform needed is accurate "targeting of services. " Given the overrepresentation of children of color in the foster care system, this group must be among those who are targeted for services. The results of a national survey of 254 family preservation workers reveal a "profile" of the worker who is likely to target special populations, including children of color, for family preservation services. A case is made for service improvements and training to facilitate the "profiled" workers' competencies.

Sociodemographic characteristics as predictors of successful smoking cessation among a group of Hispanic Spanish speaking smokers

Few studies have examined predictors of smoking abstinence among Hispanic groups. The purpose of this dissertation was to examine the relations of sociodemographic characteristics and smoking related factors with smoking abstinence among a group of Hispanic Spanish speaking smokers. This study utilized previously collected data from Hispanic Spanish-speaking smokers (N = 246) who participated in a study entitled Smoking Cessation Services for Hispanic Smokers in Texas. ^ The first study examined sociodemographic characteristics and smoking related mechanisms that predicted smoking abstinence among this group. Two of the characteristics were related to smoking abstinence, marital status and acculturation level. Being unmarried increased the likelihood of being abstinent at the 12 week assessment (OR = 1.80). Those in the high acculturation group were twice as likely to be abstinent (OR = 2.24). Of the smoking related mechanisms, those with higher positive reinforcement expectancies were less likely to be abstinent (OR = .86), as were those with a higher level of affiliative attachment (OR = .86), a higher level of craving (OR = .78) and a higher tolerance to the effect of smoking (OR = .74). The second study was to examine the relationship of objective measures of socioeconomic status (SES) (income, education, or employment) with smoking abstinence among this group. This study also compared the relationship of a subjective measure of SES (Social Status Ladder) to smoking abstinence. None of the objective measures of SES were related to smoking abstinence at the 12 week assessment. The subjective measure of SES did predict smoking abstinence (OR = 1.9) indicting that those that rated themselves ≤4 on the SES scale were more likely to be abstinent. ^ Although this group was recruited using various methods across the state of Texas, the fact that they preferred to interact with the counselor in Spanish may limit the study findings. The results of this study highlight the need for research to examine specific subgroups of people and understand the special circumstances that influence their health behaviors. Furthering our knowledge of the relations between sociodemographic characteristics and smoking cessation could lead to interventions that reduce disparities in smoking cessation. ^

Performance tiers: Implementing comparative effectiveness analysis in the health care setting through operations research and spatial methods

This dissertation develops and tests a comparative effectiveness methodology utilizing a novel approach to the application of Data Envelopment Analysis (DEA) in health studies. The concept of performance tiers (PerT) is introduced as terminology to express a relative risk class for individuals within a peer group and the PerT calculation is implemented with operations research (DEA) and spatial algorithms. The analysis results in the discrimination of the individual data observations into a relative risk classification by the DEA-PerT methodology. The performance of two distance measures, kNN (k-nearest neighbor) and Mahalanobis, was subsequently tested to classify new entrants into the appropriate tier. The methods were applied to subject data for the 14 year old cohort in the Project HeartBeat! study.^ The concepts presented herein represent a paradigm shift in the potential for public health applications to identify and respond to individual health status. The resultant classification scheme provides descriptive, and potentially prescriptive, guidance to assess and implement treatments and strategies to improve the delivery and performance of health systems. ^