Critical indicators associated with negative performance in a selectively manned unit

Introduction. Selectively manned units have a long, international history, both military and civilian. Some examples include SWAT teams, firefighters, the FBI, the DEA, the CIA, and military Special Operations. These special duty operators are individuals who perform a highly skilled and dangerous job in a unique environment. A significant amount of money is spent by the Department of Defense (DoD) and other federal agencies to recruit, select, train, equip and support these operators. When a critical incident or significant life event occurs, that jeopardizes an operator's performance; there can be heavy losses in terms of training, time, money, and potentially, lives. In order to limit the number of critical incidents, selection processes have been developed over time to “select out” those individuals most likely to perform below desired performance standards under pressure or stress and to "select in" those with the "right stuff". This study is part of a larger program evaluation to assess markers that identify whether a person will fail under the stresses in a selectively manned unit. The primary question of the study is whether there are indicators in the selection process that signify potential negative performance at a later date. ^ Methods. The population being studied included applicants to a selectively manned DoD organization between 1993 and 2001 as part of a unit assessment and selection process (A&S). Approximately 1900 A&S records were included in the analysis. Over this nine year period, seventy-two individuals were determined to have had a critical incident. A critical incident can come in the form of problems with the law, personal, behavioral or family problems, integrity issues, and skills deficit. Of the seventy-two individuals, fifty-four of these had full assessment data and subsequent supervisor performance ratings which assessed how an individual performed while on the job. This group was compared across a variety of variables including demographics and psychometric testing with a group of 178 individuals who did not have a critical incident and had been determined to be good performers with positive ratings by their supervisors.^ Results. In approximately 2004, an online pre-screen survey was developed in the hopes of preselecting out those individuals with items that would potentially make them ineligible for selection to this organization. This survey has aided the organization to increase its selection rates and save resources in the process. (Patterson, Howard Smith, & Fisher, Unit Assessment and Selection Project, 2008) When the same prescreen was used on the critical incident individuals, it was found that over 60% of the individuals would have been flagged as unacceptable. This would have saved the organization valuable resources and heartache.^ There were some subtle demographic differences between the two groups (i.e. those with critical incidents were almost twice as likely to be divorced compared with the positive performers). Upon comparison of Psychometric testing several items were noted to be different. The two groups were similar when their IQ levels were compared using the Multidimensional Aptitude Battery (MAB). When looking at the Minnesota Multiphasic Personality Inventory (MMPI), there appeared to be a difference on the MMPI Social Introversion; the Critical Incidence group scored somewhat higher. When analysis was done, the number of MMPI Critical Items between the two groups was similar as well. When scores on the NEO Personality Inventory (NEO) were compared, the critical incident individuals tended to score higher on Openness and on its subscales (Ideas, Actions, and Feelings). There was a positive correlation between Total Neuroticism T Score and number of MMPI critical items.^ Conclusions. This study shows that the current pre-screening process is working and would have saved the organization significant resources. ^ If one was to develop a profile of a candidate who potentially could suffer a critical incident and subsequently jeopardize the unit, mission and the safety of the public they would look like the following: either divorced or never married, score high on the MMPI in Social Introversion, score low on MMPI with an "excessive" amount of MMPI critical items; and finally scores high on the NEO Openness and subscales Ideas, Feelings, and Actions.^ Based on the results gleaned from the analysis in this study there seems to be several factors, within psychometric testing, that when taken together, will aid the evaluators in selecting only the highest quality operators in order to save resources and to help protect the public from unfortunate critical incidents which may adversely affect our health and safety.^

Workers and respirators: What factors influence medical clearance? Experience in the petrochemical industry 2004--2008

This retrospective cohort study analyzed data from more than 2200 OSHA-mandated respirator medical evaluations performed between 2004 and 2008, with information initially obtained using an online questionnaire, to determine what factors influence medical clearance and the ability to safely wear respiratory protection in a large petrochemical company.^ The employees were mostly white males with a high school education, ranging in age from 25 to 60 years of age, who had been employed with the company an average of eight years. Their work was typically performed outdoors in a rural or offshore setting. Respirators were typically required for emergency response – escape or rescue only – and/or limited to less than four hours per month.^ Approximately 90% of the population achieved medical clearance by utilizing the online questionnaire. Of the remaining 10%, 66% were cleared after additional "hands-on" medical examination exam; 28% of the individuals' jobs were modified by their supervisor in order to not use a respirator, and 6% of the individuals (n=13) were excluded from wearing a respirator on the basis of the medical examination. The primary causes for exclusion from respirator use were cardiovascular (37.5%) and respiratory (31.3%) issues, followed by psychological (18.8%) and musculoskeletal (12.5%) concerns. Ultimately, over 99% of workers evaluated under this system were found capable of using respiratory protection safely. This questionnaire has proven to be an excellent health screening tool capable of initiating early detection and further investigation of potentially serious medical conditions within a large and diverse population in multiple locations. ^

THE EFFECT OF PERSON-ENVIRONMENT FIT ON THE PSYCHOLOGICAL WELL-BEING OF PSYCHIATRIC AIDES WORKING IN A STATE HOSPITAL (COPING RESOURCES, SOCIAL SUPPORT, OCCUPATIONAL STRESS, LOCUS-OF-CONTROL)

This study addressed two purposes: (1) to determine the effect of person-environment fit on the psychological well-being of psychiatric aides and (2) to determine what role the coping resources of social support and control have on the above relationship. Two hundred and ten psychiatric aides working in a state hospital in Texas responded to a questionnaire pertaining to these issues.^ Person-environment fit, as a measure of occupational stress, was assessed through a modified version of the Work Environment Scale (WES). The WES subscales used in this study were: involvement, autonomy, job pressure, job clarity, and physical comfort. Psychological well-being was measured with the General Well-Being Schedule which was developed by the National Center for Health Statistics. Co-worker and supervisor support were measured through the WES and finally, control was assessed through Rotter's Locus of Control Scale.^ The results of this study were as follows: (1) all person-environment (p-e) dimensions appeared to have linear relationships with psychological well-being; (2) the p-e fit - well-being relationship did not appear to be confounded by demographic factors; (3) all p-e fit dimensions were significantly related to well-being except for autonomy; (4) p-e fit was more strongly related to well-being than the environmental measure alone; (5) supervisor support and non-work related support were found to have additive effects on the relationship between p-e fit and well-being, however no interaction or buffering effects were observed; (6) locus of control was found to have additive effects in the prediction of well-being and showed interactive effects with work pressure, involvement and physical comfort; and (7) the testing of the overall study model which included many of the components mentioned above yielded an R('2) = .27.^ Implications of these findings are discussed, future research suggested and applications proposed. ^

A multi-site pilot test study to measure safety climate in the university work setting

Next to leisure, sport, and household activities, the most common activity resulting in medically consulted injuries and poisonings in the United States is work, with an estimated 4 million workplace related episodes reported in 2008 (U.S. Department of Health and Human Services, 2009). To address the risks inherent to various occupations, risk management programs are typically put in place that include worker training, engineering controls, and personal protective equipment. Recent studies have shown that such interventions alone are insufficient to adequately manage workplace risks, and that the climate in which the workers and safety program exist (known as the "safety climate") is an equally important consideration. The organizational safety climate is so important that many studies have focused on developing means of measuring it in various work settings. While safety climate studies have been reported for several industrial settings, published studies on assessing safety climate in the university work setting are largely absent. Universities are particularly unique workplaces because of the potential exposure to a diversity of agents representing both acute and chronic risks. Universities are also unique because readily detectable health and safety outcomes are relatively rare. The ability to measure safety climate in a work setting with rarely observed systemic outcome measures could serve as a powerful means of measure for the evaluation of safety risk management programs. ^ The goal of this research study was the development of a survey tool to measure safety climate specifically in the university work setting. The use of a standardized tool also allows for comparisons among universities throughout the United States. A specific study objective was accomplished to quantitatively assess safety climate at five universities across the United States. At five universities, 971 participants completed an online questionnaire to measure the safety climate. The average safety climate score across the five universities was 3.92 on a scale of 1 to 5, with 5 indicating very high perceptions of safety at these universities. The two lowest overall dimensions of university safety climate were "acknowledgement of safety performance" and "department and supervisor's safety commitment". The results underscore how the perception of safety climate is significantly influenced at the local level. A second study objective regarding evaluating the reliability and validity of the safety climate questionnaire was accomplished. A third objective fulfilled was to provide executive summaries resulting from the questionnaire to the participating universities' health & safety professionals and collect feedback on usefulness, relevance and perceived accuracy. Overall, the professionals found the survey and results to be very useful, relevant and accurate. Finally, the safety climate questionnaire will be offered to other universities for benchmarking purposes at the annual meeting of a nationally recognized university health and safety organization. The ultimate goal of the project was accomplished and was the creation of a standardized tool that can be used for measuring safety climate in the university work setting and can facilitate meaningful comparisons amongst institutions.^

Developing a Framework for Child Welfare Supervision

The roles of the child welfare supervisor in guiding practice and in retaining child welfare workers are well established in the literature. In this article, we discuss a framework for child welfare supervision that was developed and implemented in the state of Iowa with support from the Children’s Bureau through a five-year grant to improve recruitment and retention in public child welfare. The framework supports family centered practice through a parallel process of supervision reflecting these guiding principles: strength-based, competency-based, culturally competent, reflective, individualized to workers’ learning styles and stages of development, and aimed at enhancing worker skill, autonomy, teamwork, and commitment to the organization. We present key elements of the framework, an overview of implementation, and evaluation results regarding knowledge gain, use of skills, and rates of worker retention.

Family Preservation: Perceptions of Effectiveness

This qualitative study examines the attributes or perceptions of service providers and overseers as to the effectiveness of intensive family preservation services provided by a social services agency in Tucson, Arizona. The services provided are patterned after the Homebuilders' model developed in 1974 in Tacoma, Washington. Data collection was generated from interviews and focus groups with the in-home service providers, the program supervisor, and investigators and case managers with Child Protective Services (CPS). Although placement prevention rates (PPR) are the dependent variable in most studies on this form of intervention, this study seeks to understand those characteristics of the model that contribute to successful outcomes with client families. Those appear to be the short-term intervention coupled with a non-judgmental approach to client families and the clinical supervision provided by the program supervisor.