The Comprehensive Assessment of Leadership for Learning: A Next Generation Formative Evaluation and Feedback System

Recent developments in federal policy have prompted the creation of state evaluation frameworks for principals and teachers that hold educators accountable for effective practices and student outcomes. These changes have created a demand for formative evaluation instruments that reflect current accountability pressures and can be used by schools to focus school improvement and leadership development efforts. The Comprehensive Assessment of Leadership for Learning (CALL) is a next generation, 360-degree on-line assessment and feedback system that reflect best practices in feedback design. Some unique characteristics of CALL include a focus on: leadership distributed throughout the school rather than as carried out by an individual leader; assessment of leadership tasks rather than perceptions of leadership practice; a focus on larger complex systems of middle and high school; and transparency of assessment design. This paper describes research contributing to the design and validation of the CALL survey instrument.

Validity assessment of the Breast Cancer Risk Reduction Health Belief scale.

BACKGROUND: : Women at increased risk of breast cancer (BC) are not widely accepting of chemopreventive interventions, and ethnic minorities are underrepresented in related trials. Furthermore, there is no validated instrument to assess the health-seeking behavior of these women with respect to these interventions. METHODS: : By using constructs from the Health Belief Model, the authors developed and refined, based on pilot data, the Breast Cancer Risk Reduction Health Belief (BCRRHB) scale using a population of 265 women at increased risk of BC who were largely medically underserved, of low socioeconomic status (SES), and ethnic minorities. Construct validity was assessed using principal components analysis with oblique rotation to extract factors, and generate and interpret summary scales. Internal consistency was determined using Cronbach alpha coefficients. RESULTS: : Test-retest reliability for the pilot and final data was calculated to be r = 0.85. Principal components analysis yielded 16 components that explained 64% of the total variance, with communalities ranging from 0.50-0.75. Cronbach alpha coefficients for the extracted factors ranged from 0.45-0.77. CONCLUSIONS: : Evidence suggests that the BCRRHB yields reliable and valid data that allows for the identification of barriers and enhancing factors associated with use of breast cancer chemoprevention in the study population. These findings allow for tailoring treatment plans and intervention strategies to the individual. Future research is needed to validate the scale for use in other female populations. Cancer 2009. (c) 2009 American Cancer Society.

An assessment of post-disaster psychological stress in hazardous waste operations and emergency response (HAZWOPER) workers

Personnel involved in natural or man-made disaster response and recovery efforts may be exposed to a wide variety of physical and mental stressors that can exhibit long-lasting and detrimental psychopathological outcomes. In a disaster situation, huge numbers of "secondary" responders can be involved in contaminant clean-up and debris removal and can be at risk of developing stress-related mental health outcomes. The Occupational Safety and Health Administration (OSHA) worker training hierarchy typically required for response workers, known as "Hazardous Waste Operations and Emergency Response" (HAZWOPER), does not address the mental health and safety concerns of workers. This study focused on the prevalence of traumatic stress experienced by secondary responders that had received or expressed interest in receiving HAZWOPER training through the National Institute of Environmental Health Sciences Worker Education and Training Program (NIEHS WETP). ^ The study involved the modification of two preexisting and validated survey tools to assess secondary responder awareness of physical, mental, and traumatic stressors on mental health and sought to determine if a need existed to include traumatic stress-related mental health education in the current HAZWOPER training regimen. The study evaluated post-traumatic stress disorder (PTSD), resiliency, mental distress, and negative effects within a secondary responder population of 176 respondents. Elevated PTSD levels were seen in the study population as compared to a general responder population (32.9% positive vs. 8%-22.5% positive). Results indicated that HAZWOPER-trained disaster responders were likely to test positive for PTSD, whereas, untrained responders with no disaster experience and responders who possessed either training or disaster experience only were likely to test PTSD negative. A majority (68.75%) of the population tested below the mean resiliency to cope score (80.4) of the average worker population. Results indicated that those who were trained only or who possessed both training and disaster work experience were more likely to have lower resiliency scores than those with no training or experience. There were direct correlations between being PTSD positive and having worked at a disaster site and experiencing mental distress and negative effects. However, HAZWOPER training status does not significantly correlate with mental distress or negative effect. ^ The survey indicated clear support (91% of respondents) for mental health education. The development of a pre- and post-deployment training module is recommended. Such training could provide responders with the necessary knowledge and skills to recognize the symptomology of PTSD, mental stressors, and physical and traumatic stressors, thus empowering them to employ protective strategies or seek professional help if needed. It is further recommended that pre-deployment mental health education be included in the current HAZWOPER 24- and 40-hour course curriculums, as well as, consideration be given towards integrating a stand-alone post-deployment mental health education training course into the current HAZWOPER hierarchy.^

Outcomes assessment of a pediatric practice guideline

Objective. This study examines the structure, processes, and data necessary to assess the outcome variables, length of stay and total cost, for a pediatric practice guideline. The guideline was developed by a group of physicians and ancillary staff members representing the services that most commonly provide treatment for asthma patients at Texas Children's Hospital, as a means of standardizing care. Outcomes have needed to be assessed to determine the practice guideline's effectiveness.^ Data sources and study design. Data for the study were collected retrospectively from multiple hospital data bases and from inpatient chart reviews. All patients in this quasi-experimental study had a diagnosis of Asthma (ICD-9-CM Code 493.91) at the time of admission.^ The study examined data for 100 patients admitted between September 15, 1995 and November 15, 1995, whose physician had elected to apply the asthma practice guideline at the time of the patient's admission. The study examined data for 66 inpatients admitted between September 15, 1995 and November 15, 1995, whose physician elected not to apply the asthma practice guideline. The principal outcome variables were identified as "Length of Stay" and "Cost".^ Principal findings. The mean length of stay for the group in which the practice guideline was applied was 2.3 days, and 3.1 days for the comparison group, who did not receive care directed by the practice guideline. The difference was statistically significant (p value = 0.008). There was not a demonstrable difference in risk factors, health status, or quality of care between the groups. Although not showing statistical significance in the univariate analysis, private insurance showed a significant difference in the logistic regression model presenting an elevated odds ratio (odds ratio = 2.2 for a hospital stay $\le$2 days to an odds ratio = 4.7 for a hospital stay $\le$3 days) showing that patients with private insurance experienced greater risk of a shorter hospital stay than the patients with public insurance in each of the logistic regression models. Public insurance included; Medicaid, Medicare, and charity cases. Private insurance included; private insurance policies whether group, individual, or managed care. The cost of an admission was significantly less for the group in which the practice guideline was applied, with a mean difference between the two groups of $1307 per patient.^ Conclusion. The implementation and utilization of a pediatric practice guideline for asthma inpatients at Texas Children's Hospital has a significant impact in terms of reducing the total cost of the hospital stay and length of the hospital stay for asthma patients admitted to Texas Children's Hospital. ^

THE DESIGN AND DEVELOPMENT OF A SURVEY INSTRUMENT FOR THE ASSESSMENT OF OCCUPATIONAL STRESS

Using stress and coping as a unifying theoretical concept, a series of five models was developed in order to synthesize the survey questions and to classify information. These models identified the question, listed the research study, described measurements, listed workplace data, and listed industry and national reference data.^ A set of 38 instrument questions was developed within the five coping correlate categories. In addition, a set of 22 stress symptoms was also developed. The study was conducted within two groups, police and professors, on a large university campus. The groups were selected because their occupations were diverse, but they were a part of the same macroenvironment. The premise was that police officers would be more highly stressed than professors.^ Of a total study group of 80, there were 37 respondents. The difference in the mean stress responses was observable between the two groups. Not only were the responses similar within each group, but the stress level of response was also similar within each group. While the response to the survey instrument was good, only 3 respondents answered the stress symptom survey properly. It was determined that none of the 37 respondents believed that they were ill. This perception of being well was also evidenced by the grand mean of the stress scores of 2.76 (3.0 = moderate stress). This also caused fewer independent variables to be entered in the multiple regression model.^ The survey instrument was carefully designed to be universal. Universality is the ability to transcend occupational or regional definitions as applied to stress. It is the ability to measure responses within broad categories such as physiological, emotional, behavioral, social, and cognitive functions without losing the ability to measure the detail within the individual questions, or the relationships between questions and categories.^ Replication is much easier to achieve with standardized categories, questions, and measurement procedures such as those developed for the universal survey instrument. Because the survey instrument is universal it can be used as an analytical device, an assessment device, a basic tool for planning and a follow-up instrument to measure individual response to planned reductions in occupational stress. (Abstract shortened with permission of author.) ^

Assessment of readiness to initiate antiretroviral therapy

An important factor in determining a patient's adherence to antiretroviral therapy is the patient's commitment to follow the regimen. This suggests that therapy should be initiated when the patient is willing to commit to the regimen. Starting when the patient is ready may be more important than the laboratory values suggested by various guidelines. In order to increase understanding of patient readiness for antiretroviral therapy HIV infected patients were surveyed to determine the factors that influenced their decision to initiate antiretroviral therapy and to continue to adhere to therapy once started. A sample of 83 HIV infected patients who were currently on antiretroviral regimens completed a 25-item investigator-developed questionnaire. The questionnaire sought information on the length of time from learning of HIV positive status and readiness to initiate therapy. The questionnaire also addressed demographic, psychological and social factors thought to be associated with readiness for adhering to therapy. (Abstract shortened by UMI.)^

A qualitative assessment of multi-level nutrition strategies for reducing racial and ethnic disparities in diabetes

The purpose of this study is to examine the stages of program realization of the interventions that the Bronx Health REACH program initiated at various levels to improve nutrition as a means for reducing racial and ethnic disparities in diabetes. This study was based on secondary analyses of qualitative data collected through the Bronx Health REACH Nutrition Project, a project conducted under the auspices of the Institute on Urban Family Health, with support from the Centers for Disease Control and Prevention (CDC). Local human subjects' review and approval through the Institute on Urban Family Health was required and obtained in order to conduct the Bronx Health REACH Nutrition Project. ^ The study drew from two theoretical models—Glanz and colleagues' nutrition environments model and Shediac-Rizkallah and Bone's sustainability model. The specific study objectives were two-fold: (1) to categorize each nutrition activity to a specific dimension (i.e. consumer, organizational or community nutrition environment); and (2) to evaluate the stage at which the program has been realized (i.e. development, implementation or sustainability). ^ A case study approach was applied and a constant comparative method was used to analyze the data. Triangulation of data based was also conducted. Qualitative data from this study revealed the following principal findings: (1) communities of color are disproportionately experiencing numerous individual and environmental factors contributing to the disparities in diabetes; (2) multi-level strategies that targeted the individual, organizational and community nutrition environments can appropriately address these contributing factors; (3) the nutrition strategies greatly varied in their ability to appropriately meet criteria for the three program stages; and (4) those nutrition strategies most likely to succeed (a) conveyed consistent and culturally relevant messages, (b) had continued involvement from program staff and partners, (c) were able to adapt over time or setting, (d) had a program champion and a training component, (e) were integrated into partnering organizations, and (f) were perceived to be successful by program staff and partners in their efforts to create individual, organizational and community/policy change. As a result of the criteria-based assessment and qualitative findings, an ecological framework elaborating on Glanz and colleagues model was developed. The qualitative findings and the resulting ecological framework developed from this study will help public health professionals and community leaders to develop and implement sustainable multi-level nutrition strategies for addressing racial and ethnic disparities in diabetes. ^

Air Force Web Preventive Health Assessment (AF WEBPHA) mental health screening effectiveness

The U.S. Air Force assesses Active Duty Air Force (ADAF) health annually using the Air Force Web-based Preventative Health Assessment (AF WebPHA). The assessment is based on a self-administered survey used to determine the overall Air Force health and readiness, as well as, the individual health of each airman. Individual survey responses as well as groups of responses generate further computer generated assessment and result in a classification of 'Critical', 'Priority', or 'Routine', depending on the need and urgency for further evaluation by a health care provider. The importance of the 'Priority' and 'Critical' classifications is to provide timely intervention to prevent or limit unfavorable outcomes that may threaten an airman. Though the USAF has been transitioning from a paper form to the online WebPHA survey for the last three years it was not made mandatory for all airmen until 2009. The survey covers many health aspects including family history, tobacco use, exercise, alcohol use, and mental health. ^ Military stressors such as deployment, change of station, and the trauma of war can aggravate and intensify the common baseline worries experienced by the general population and place airmen at additional risks for mental health concerns and illness. This study assesses the effectiveness of the AF WebPHA mental health screening questions in predicting a mental health disorder diagnosis according to International Classification of Diseases, 9th Revision, Clinical Modification (ICD-9-CM) codes generated by physicians or their surrogates. In order to assess the sensitivity, specificity, and positive predictive value of the AF WebPHA as a screening tool for mental health, survey results were compared to ascertain if they generated any mental health disorder related diagnosis for the period from January 1, 2009 to March 31, 2010. ^ Statistical analysis of the AF WebPHA mental health responses when compared with matching ICD-9-CM codes found that the sensitivity for 'Critical' or 'Priority' responses was only 3.4% and that it would correctly predict those who had the selected mental health diagnosis 9% of the time.^

Improving the transitional experience of previously incarcerated women a nutritional needs assessment at a transitional home in Houston, Texas

Transitional homes present a window of opportunity to address the nutrition-related chronic diseases of previously incarcerated women. However, few transitional facilities offer nutrition education programs. This study assesses the nutritional status of 9 previously incarcerated women living at a transitional home in Houston, Texas and makes recommendations for effective nutrition education programs. Data was collected through individual interviews, questionnaires and a 24-hour dietary recall. Participants differed significantly from national nutrition recommendations when comparing BMI values and fruit, vegetable and fiber intake. Qualitative interview themes concerned key barriers to healthful dietary intake such as inadequate food storage and inconvenient cooking environment. Nutrition education programs at transitional homes should focus on healthy meals and snacks that can be quickly prepared and easily stored in small spaces. ^

An evaluation of sleep hypnotic and stimulant effect on human performance using a computerized psychological test battery

This study evaluated the administration-time-dependent effects of a stimulant (Dexedrine 5-mg), a sleep-inducer (Halcion 0.25-mg) and placebo (control) on human performance. The investigation was conducted on 12 diurnally active (0700-2300) male adults (23-38 yrs) using a double-blind, randomized sixway-crossover three-treatment, two-timepoint (0830 vs 2030) design. Performance tests were conducted hourly during sleepless 13-hour studies using a computer generated, controlled and scored multi-task cognitive performance assessment battery (PAB) developed at the Walter Reed Army Institute of Research. Specific tests were Simple and Choice Reaction Time, Serial Addition/Subtraction, Spatial Orientation, Logical Reasoning, Time Estimation, Response Timing and the Stanford Sleepiness Scale. The major index of performance was "Throughput", a combined measure of speed and accuracy.^ For the Placebo condition, Single and Group Cosinor Analysis documented circadian rhythms in cognitive performance for the majority of tests, both for individuals and for the group. Performance was best around 1830-2030 and most variable around 0530-0700 when sleepiness was greatest (0300).^ Morning Dexedrine dosing marginally enhanced performance an average of 3% with reference to the corresponding in time control level. Dexedrine AM also increased alertness by 10% over the AM control. Dexedrine PM failed to improve performance with reference to the corresponding PM control baseline. With regard to AM and PM Dexedrine administrations, AM performance was 6% better with subjects 25% more alert.^ Morning Halcion administration caused a 7% performance decrement and 16% increase in sleepiness and a 13% decrement and 10% increase in sleepiness when administered in the evening compared to corresponding in time control data. Performance was 9% worse and sleepiness 24% greater after evening versus morning Halcion administration.^ These results suggest that for evening Halcion dosing, the overnight sleep deprivation occurring in coincidence with the nadir in performance due to circadian rhythmicity together with the CNS depressant effects combine to produce performance degradation. For Dexedrine, morning administration resulted in only marginal performance enhancement; Dexedrine in the evening was less effective, suggesting the 5-mg dose level may be too low to counteract the partial sleep deprivation and nocturnal nadir in performance. ^

COSTS AND EFFECTS OF ARKANSAS' LONG-TERM CARE DEMONSTRATION PROJECT (MEDICAID, CHANELLING, COMMUNITY ASSESSMENT)

The purpose of this study was to assess the impact of the Arkansas Long-Term Care Demonstration Project upon Arkansas' Medicaid expenditures and upon the clients it serves. A Retrospective Medicaid expenditure study component used analyses of variance techniques to test for the Project's effects upon aggregated expenditures for 28 demonstration and control counties representing 25 percent of the State's population over four years, 1979-1982.^ A second approach to the study question utilized a 1982 prospective sample of 458 demonstration and control clients from the same 28 counties. The disability level or need for care of each patient was established a priori. The extent to which an individual's variation in Medicaid utilization and costs was explained by patient need, presence or absence of the channeling project's placement decision or some other patient characteristic was examined by multiple regression analysis. Long-term and acute care Medicaid, Medicare, third party, self-pay and the grand total of all Medicaid claims were analyzed for project effects and explanatory relationships.^ The main project effect was to increase personal care costs without reducing nursing home or acute care costs (Prospective Study). Expansion of clients appeared to occur in personal care (Prospective Study) and minimum care nursing home (Retrospective Study) for the project areas. Cost-shifting between Medicaid and Medicare in the project areas and two different patterns of utilization in the North and South projects tended to offset each other such that no differences in total costs between the project areas and demonstration areas occurred. The project was significant ((beta) = .22, p < .001) only for personal care costs. The explanatory power of this personal care regression model (R('2) = .36) was comparable to other reported health services utilization models. Other variables (Medicare buy-in, level of disability, Social Security Supplemental Income (SSI), net monthly income, North/South areas and age) explained more variation in the other twelve cost regression models. ^

A STUDY OF THE RELATIONSHIP BETWEEN SELF-ASSESSMENT AND CLINICAL EVALUATION OF HEARING STATUS

The relationship was explored between a subjective measure of hearing status, derived from a functional self-assessment expressed in terms of ability to hear and understand spoken words, and a comparable objective measure of hearing status, obtained from a speech reception test. The Augmentation Survey of the Health and Nutrition Examination Survey of the National Center for Health Statistics provided the necessary data for a sample of 3059 adults. Using chi-square tests for the subsample with the highest level of objectively assessed hearing status, favorable subjective assessments were found to be significantly associated with higher income, lower age group, higher level of educational attainment, greater psychological adjustment, fewer symptoms of depression, and higher self-ratings of overall health. In a linear regression with self-assessment of hearing status as the dependent variable, less than one-quarter of the variation could be explained by objective status and the six explanatory variables.^

AN INVESTIGATION OF THE POSSIBLE RELATIONSHIP BETWEEN CERTAIN PHYSIOLOGICAL AND PSYCHOLOGICAL MEASURES AND SMOKING CESSATION IN A SELF - SELECTED POPULATION

This study focused on the possible relationship between certain physiological and psychological variables and the cessation of smoking. The population studied was employees enrolled in a multimodality smoking cessation program at the local offices of a major American corporation. In order to be eligible to participate, each individual must have become a non-smoker by the end of the smoking cessation program.^ Three physiological measures were taken on each individual while performing a relaxation exercise; (1) Electromyogram (EMG), (2) Galvanic Skin Response (GSR), and (3) Skin Temperature. The psychological measure consisted of the variable "anxiety" in the Cattell 16-PF personality inventory. Individual's self report of their smoking status was verified through a test for expired carbon monoxide levels.^ For the total population (N-31) no significant relationships were found between the physiological and psychological variable measured and cessation; however, with the removal of two cases discovered during the post-test interview to be influenced by external factors of high caffeine level and a severe family crisis, the measure of EMG, attained significance in discriminating between the successful and unsuccessful in Smoking Cessation. ^

RESPIRATORY COMPENSATION MECHANISMS IN THE UPPER AND LOWER RESPIRATORY TRACTS OF AN ANIMAL MODEL AFTER SUBCHRONIC INHALATION EXPOSURE TO FORMALDEHYDE: IMPLICATIONS FOR TOXICOLOGY RISK ASSESSMENT (DEPOSITION, DOSE RECEIVED, RESPONSE)

The potential for significant human populations to experience long-term inhalation of formaldehyde and reports of symptomatology due to this exposure has led to a considerable interest in the toxicologic assessment of risk from subchronic formaldehyde exposures using animal models. Since formaldehyde inhalation depresses certain respiratory parameters in addition to its other forms of toxicity, there is a potential for the alteration of the actual dose received by the exposed individual (and the resulting toxicity) due to this respiratory effect. The respiratory responses to formaldehyde inhalation and the subsequent pattern of deposition were therefore investigated in animals that had received subchronic exposure to the compound, and the potential for changes in the formaldehyde dose received due to long-term inhalation evaluated. Male Sprague-Dawley rats were exposed to either 0, 0.5, 3, or 15 ppm formaldehyde for 6 hours/day, 5 days/week for up to 6 months. The patterns of respiratory response, deposition and the compensation mechanisms involved were then determined in a series of formaldehyde test challenges to both the upper and to the lower respiratory tracts in separate groups of subchronically exposed animals and age-specific controls (four concentration groups, two time points). In both the control and pre-exposed animals, there was a characteristic recovery of respiratory parameters initially depressed by formaldehyde inhalation to at or approaching pre-exposure levels within 10 minutes of the initiation of exposure. Also, formaldehyde deposition was found to remain very high in the upper and lower tracts after long-term exposure. Therefore, there was probably little subsequent effect on the dose received by the exposed individual that was attributable to the repeated exposures. There was a diminished initial minute volume response in test challenges of both the upper and lower tracts of animals that had received at least 16 weeks of exposure to 15 ppm, with compensatory increases in tidal volume in the upper tract and respiratory rate in the lower tract. However, this dose-related effect was probably not relevant to human risk estimation because this formaldehyde dose is in excess of that experienced by human populations. ^

THE RELATIONSHIP BETWEEN ATTITUDE ASSESSMENT/ROLE PERCEPTION AND THE FINANCIAL PERFORMANCE OF HOSPITAL DEPARTMENT MANAGERS

Much of the current healthcare financial literature addresses the concern of government officials, the public, and healthcare providers regarding the need for control of health care costs. The literature suggests that attitudes of hospital department managers toward their role in financial management affects their ability to effect favorable financial results.^ There were several objectives of the dissertation: (1) To identify whether or not there exists a relationship between the attitude/role perception of hospital managers and the financial performance of their departments. (2) To compile a descriptive survey data base of key factors identified in the financial literature from individual hospitals. (3) To compile a brief descriptive survey of hospital managers' financial management background and training (both formal and informal). (4) To conduct an attitude assessment/role perception survey regarding the importance or relevance of a suggested financial management role set (i.e., issues discussed in the current literature) as viewed by the selected hospital managers and their matched administrators. (5) To propose plausible theoretical models and statistical tests of seven proposed hypotheses.^ The statistical results of a variety of methods generally suggested, for the sample population, that the null hypothesis should not be rejected concerning the relationships between a department manager's financial attitudes and role perceptions and the resultant financial performance.^ The fact that the results of this study did not suggest that there was a significant relationship which existed between role perception and financial performance does not necessarily indicate that the theories supporting such a relationship in literature are false, not that such a relationship does not exist. Several alternative theories were postulated to explain the apparent lack of statistical relationship, and suggestions for refinement and/or improvement of further research were discussed. ^