Appraisal ratings, halo, and selection: A study using sales staff

Supervisor ratings are useful criteria for the validation of selection instruments but maybe limited because of the presence of rating errors, such as halo. This study set out to show that supervisor ratings which are high in halo remain successful criteria in selection. Following a thorough job analysis, a customer service questionnaire was designed to assess the potential of retail sales staff on three orthogonal subscales labelled Dealing with people, Emotions and energy, and Solitary style. These subscales were uncorrelated with supervisor ratings made about 8 weeks later. However, the supervisor ratings were correlated with an overall scale derived from the three scales of the customer service questionnaire. These results support the view that supervisor ratings generally consist of global impressions and suggest that these global impressions are useful measures of overall performances. This field study confirms laboratory results that halo does not necessarily reduce rating accuracy.

A parent-completed developmental questionnaire: Follow up of ex-premature infants

Objective: premature infants are at increased risk of developmental disability. Early identification of problems allows intervention to ameliorate or attenuate problems. A reliable screening tool allows triage of children in this high-risk population by identifying those unlikely to need full developmental assessment. To explore the test characteristics of an established parent-completed developmental assessment questionnaire 'Ages and Stages Questionnaire' (ASQ) in follow up of an Australian population of premature infants. Methodology: One hundred and sixty-seven children born prematurely with corrected ages 12- to 48-months attending the Growth and Development Clinic at the Mater Children's Hospital in Brisbane, Queensland, Australia; 136 questionnaires 'ASQ' were returned completed (81%) and were compared to formal psychometric assessment (Griffith Mental Development Scales for 12- and 24-months, Bayley Mental Development Intelligence Scale for 18-months, McCarthy General Cognitive Intelligence Scale for 18-months). Developmental delay was considered to be present if any of the above psychometric assessments fell below 1.0 standard deviations (SD). The ASQ cut-off used was 2.0 SD (US data derived means and SD). Results: Aggregate results for all age groups comparing ASQ to psychometric assessments as 'gold standards' found the ASQ to have the following test characteristics: sensitivity (90%); specificity (77%); positive predictive value (40%); negative predictive value (98%): % over-referred (20%); % under-referred (1%); % agreement (79%). likelihood ratio for children failing the ASQ was 3.8 and for passing the ASQ was 0.13. Twenty-one children with known disabilities were included in the study and in 14 of these, the ASQ overall score agreed with the psychometric assessment (67%). Conclusion: The high negative predictive value of the ASQ supports its use as a screening tool for cognitive and motor delays in the follow up of ex-premature infants. This would need to be combined with other strategies as part of a comprehensive follow up program for ex-premature infants.

The validity of an Australian modification of the AUDIT questionnaire

The Alcohol Use Disorders Identification Test (AUDIT) has been used widely and is reported to be superior to conventional questionnaires in detection of current hazardous and harmful alcohol use. We assessed the validity of an Australian modification of the AUDIT (the AusAUDIT), which has been employed widely in Australian and New Zealand early intervention programmes. We used a cross-sectional study of 370 subjects from the follow-up phase of a randomized controlled trial of early intervention to reduce hazardous alcohol consumption. Scores on the AusAUDIT were compared against 12-month ICD-10 diagnoses of harmful alcohol use and dependence, as determined by the Composite International Diagnostic Interview, and against self-report of alcohol consumption exceeding Australian National Health and Medical Research Council (NH&MRC) recommended limits. AusAUDIT had good internal consistency and discriminated significantly between persons meeting criteria for ICD-10 alcohol use disorders, and drinkers who did not. At currently recommended cut-off scores, AusAUDIT detected more than 85% of people meeting criteria for ICD-10 alcohol use disorders, or drinking over NH&MRC recommended limits, but its specificity was limited (29% in men, and 58% in women for drinking over NH&MRC limits). No subset of questions performed as well as the full AusAUDIT in detection of drinking problems, but the alcohol consumption items provided a reasonable screen for drinking over NH&MRC limits. We conclude that AusAUDIT is effective in detecting problematic drinking, but positive cases should be confirmed by clinical assessment. The findings illustrate the need for validation of questionnaire modifications, and the difficulty in increasing test sensitivity without reducing specificity.

Treatment outcome in individuals with chronic pain: is the Pain Stages of Change Questionnaire (PSOCQ) a useful tool? Jenny StrongCorresponding Author Contact Information, E-mail The Corresponding Author, a, Kym Westburya, Glen Smithb, Ian McKenziec and William Ryan

The efficacy of psychological treatments emphasising a self-management approach to chronic pain has been demonstrated by substantial empirical research. Nevertheless, high drop-out and relapse rates and low or unsuccessful engagement in self-management pain rehabilitation programs have prompted the suggestion that people vary in their readiness to adopt a self-management approach to their pain. The Pain Stages of Change Questionnaire (PSOCQ) was developed to assess a patient's readiness to adopt a self-management approach to their chronic pain. Preliminary evidence has supported the PSOCQ's psychometric properties. The current study was designed to further examine the psychometric properties of the PSOCQ, including its reliability, factorial structure and predictive validity. A total of 107 patients with an average age of 36.2 years (SD = 10.63) attending a multi-disciplinary pain management program completed the PSOCQ, the Pain Self-Efficacy Questionnaire (PSEQ) and the West Haven-Yale Multidimensional Pain Inventory (WHYMPI) pre-admission and at discharge from the program. Initial data analysis found inadequate internal consistencies of the precontemplation and action scales of the PSOCQ and a high correlation (r = 0.66, P < 0.01) between the action and maintenance scales. Principal component analysis supported a two-factor structure: 'Contemplation' and 'Engagement'. Subsequent analyses revealed that the PSEQ was a better predictor of treatment outcome than the PSOCQ scales. Discussion centres upon the utility of the PSOCQ in a clinical pain setting in light of the above findings, and a need for further research. (C) 2002 International Association for the Study of Pain. Published by Elsevier Science B.V. All rights reserved.

Personality and the genetic risk for alcohol dependence

The extent to which the genetic risk for alcohol dependence (AD) and conduct disorder (CD) and their common genetic risk overlap with genetic factors contributing to variation in dimensions of personality was examined in a study of 6,453 individuals from 3,383 adult male and female same-sex and unlike-sex twin pairs from the Australian Twin Registry. The associations between the personality dimensions of positive emotionality, negative emotionality, and AD and CD risk were modest. whereas the associations between behavioral undercontrol and AD and CD risk were substantially higher. Genetic influences contributing to variation in behavioral undercontrol accounted for about 40% of the genetic variation in AD and CD risk and about 90% of the common genetic risk for AD and CD. These results suggest that genetic factors contributing to variation in dimensions of personality, particularly behavioral undercontrol. account for a substantial proportion of the genetic diathesis for AD and most of the common genetic diathesis for AD and CD among both men and women.

Affective and evaluative descriptors of pain in the McGill Pain Questionnaire: reduction and reorganization

Recent reports indicate that several descriptors of pain sensations in the McGill Pain Questionnaire (MPQ) are difficult to classify within MPQ sensory subcategories because of incomprehension, underuse, or ambiguity of usage. Adopting the same methodology of recent studies, the present investigation focused on the affective and evaluative subcategories of the MPQ. A decision rule revealed that only 6 of 18 words met criteria for the affective category and 5 of 11 words met criteria for the evaluative category, thus warranting a reduced list of words in these categories. This reduction, however, led to negligible loss of information transmitted. Despite notable changes in classification, the intensity ratings of the retained words correlated very highly with those originally reported for the MPQ. In conclusion, although the intensity ratings of MPQ affective and evaluative descriptors need no revision, selective reduction and reorganization of these descriptors can enhance the efficiency of this approach to pain assessment. [copy ] 2001 by the American Pain Society

Characterisation of chronic lateral epicondylalgia using the McGill pain questionnaire, visual analog scales, and quantitative sensory tests

Aims: To characterise chronic lateral epicondylalgia using the McGill Pain Questionnaire, Visual Analog Scales for pain and function, and Quantitative Sensory Tests; and to examine the relationship between these tests in a population with chronic lateral epicondylalgia. Method: Fifty-six patients (29 female, 27 male) diagnosed with unilateral lateral epicondylalgia of 18.7 months (mean) duration (range 1-300), with a mean age of 50.7 years (range 27-73) participated in this study. Each participant underwent assessment with the McGill Pain Questionnaire (MPQ), Visual Analog Scales (VAS) for pain and function. and Quantitative Sensory Tests (QST) including thermal and pressure pain thresholds, pain free grip strength, and neuromeningeal tissue testing via the upper limb tension test 2b (ULTT 2b). Results: Moderate correlation (r = .338-.514, p = .000-.013) was found between all indices of the MPQ and VAS for pain experienced in the previous 24 hours and week. Thermal pain threshold was found to be significantly higher in males. A significant poor to moderate correlation was found between the Pain Rating Index (PRI) in the sensory category of the MPQ and ULTT2b scores (r = .353, p = .038). There was no other significant correlation between MPQ and QST data. Pain free grip strength was poorly yet significantly correlated with duration of pathology (r = 318, p = .038). Conclusion: The findings of this study are in agreement with others (Melzack and Katz, 1994) regarding the multidimensional nature of pain, in a condition conventionally conceived as a musculoskeletal pain state. The findings also suggest that utilisation of only one pain measurement tool is unlikely to provide a thorough clinical picture of pain experienced with chronic lateral epicondylalgia.

Direction of Causation Modeling Between Cross-Sectional Measures of Parenting and Psychological Distress in Female Twins

Under certain conditions, cross-sectional analysis of cross-twin intertrait correlations can provide important information about the direction of causation (DOC) between two variables. A community-based sample of Australian female twins aged 18 to 45 years was mailed an extensive Health and Lifestyle Questionnaire (HLQ) that covered a wide range of personality and behavioral measures. Included were self-report measures of recent psychological distress and perceived childhood environment (PBI). Factor analysis of the PBI yielded three interpretable dimensions: Coldness, Overprotection, and Autonomy. Univariate analysis revealed that parental Overprotection and Autonomy were best explained by additive genetic, shared, and nonshared environmental effects (ACE), whereas the best-fitting model for PBI Coldness and the three measures of psychological distress (Depression, Phobic Anxiety, and Somatic Distress) included only additive genetic and nonshared environmental effects (AE). A common pathway model best explained the covariation between (1) the three PBI dimensions and (2) the three measures of psychological distress. DOC modeling between latent constructs of parenting and psychological distress revealed that a model which specified recollected parental behavior as the cause of psychological distress provided a better fit than a model which specified psychological distress as the cause of recollected parental behavior. Power analyses and limitations of the findings are discussed.