Exploring the experience of stigma in severe mental illness : a Portuguese contribution to the validation of a psychometric instrument

RESUMO: Fizemos uma análise da evolução do conceito de estigma, das suas correlações e das suas consequências e analisámos os instrumentos psicométricos utilizados para estudar experiências pessoais de estigma. Revimos os principais estudos de investigação sobre estigma em Portugal. Revimos, igualmente, os estudos relevantes utilizando o “Consumer Experiences of Stigma Questionnaire” (CESQ) e as propriedades psicométricas já documentadas. O nosso estudo teve como objetivos: explorar as experiências de estigma numa amostra portuguesa de pessoas com perturbação mental grave e contribuir para a documentação das propriedades psicométricas do “Consumer Experiences of Stigma Questionnaire” e para a validação da sua versão portuguesa. Fizemos um estudo transversal, descritivo e analítico, recolhemos dados sociodemográficos e clínicos e medimos as experiências de estigma e o funcionamento global. A frequência das respostas da secção de estigma foi semelhante à dos restantes estudos utilizando a CESQ. A frequência das respostas na secção de discriminação foi ligeiramente inferior à reportada noutros estudos. Verificámos a existência de uma associação entre a pontuação da subescala de discriminação, o sexo masculino e o facto de se viver na comunidade. A pontuação da subescala de discriminação está também correlacionada de forma positiva com o funcionamento global. Os alfas de Cronbach para a CESQ e para as suas subescalas foram considerados bons. Os coeficientes de correlação intraclasse foram igualmente considerados igualmente bons. Utilizando técnicas de análise fatorial, verificámos que a maior parte dos itens da CESQ se enquadrava em dois fatores, correspondendo sensivelmente às subescalas definidas previamente. Concluímos que o presente estudo explorou com sucesso a questão do estigma em Portugal, contribuindo em simultâneo para a validação do “Consumer Experiences of Stigma Questionnaire.--------------ABSTRACT: We reviewed the evolution of concept of stigma, its correlates and consequences, and analysed psychometric instruments that were used to study personal experiences of stigma. We provided an insight over research of stigma in Portugal. We reviewed relevant studies that use Consumer Experiences of Stigma Questionnaire and documented psychometric properties of this instrument. Our study aimed both to explore experiences of stigma in a Portuguese sample of people with severe mental illness and to contribute to the assessment of the psychometric properties of Consumer Experiences of Stigma Questionnaire and to the validation of its Portuguese translation. We performed a cross sectional descriptive and analytic study, collected socio-demographic data and measured experiences of stigma and global functioning. Frequency of responses regarding stigma section of CESQ matched previous studies using that scale. Frequency of responses in discrimination section was slightly lower than previously reported studies. We found an association between the discrimination score of CESQ and both male gender and living in the community. The discrimination score also positively correlated with global functioning. Cronbach alphas for CESQ and its subscales were good. Intraclass correlation coefficients for CESQ and stigma subscale were also good. Using factor analysis we found most of the items in CESQ would fit 2 factors, grossly corresponding to the previously defined subscales. We conclude that this study successfully explored stigma in Portugal, contributing in simultaneous to the validation of Consumer Experiences Questionnaire.

Development and psychometric properties of ECPICID-AVC to measure informal caregivers’ skills when caring for older stroke survivors at home

Introduction: Informal caregivers provide a significant part of the total care needed by dependent older people poststroke. Although informal care is often the preferred option of those who provide and those who receive informal care, informal caregivers often report lack of preparation to take care of older dependent people. This article outlines the development and psychometric testing of informal caregivers’ skills when providing care to older people after a stroke – ECPICID-AVC. Design: Prospective psychometric instrument validation study. Methods: Eleven experts participated in a focus group in order to delineate, develop and validate the instrument. Data were gathered among adult informal caregivers (n = 186) living in the community in Northern Portugal from August 2013 to January 2014. Results: The 32-item scale describes several aspects of informal caregiver’s skills. The scale has eight factors: skill to feed/hydrate by nasogastric feeding, skill to assist the person in personal hygiene, skill to assist the person for transferring, skill to assist the person for positioning, skill to provide technical aids, skill to assist the person to use the toilet, skill to feed/hydrate and skill to provide technical aids for dressing/undressing. Analysis demonstrated adequate internal consistency (Cronbach’s alpha = 0.83) and good temporal stability 0.988 (0.984–0.991). Conclusion: The psychometric properties of the measurement tool showed acceptable results allowing its implementation in clinical practice by the nursing community staff for evaluating practical skills in informal caregivers when providing care to older stroke survivors living at home.

Psychometric properties of the Beck Depression Inventory-II: a comprehensive review

OBJECTIVE: To review the psychometric properties of the Beck Depression Inventory-II (BDI-II) as a self-report measure of depression in a variety of settings and populations. METHODS: Relevant studies of the BDI-II were retrieved through a search of electronic databases, a hand search, and contact with authors. Retained studies (k = 118) were allocated into three groups: non-clinical, psychiatric/institutionalized, and medical samples. RESULTS: The internal consistency was described as around 0.9 and the retest reliability ranged from 0.73 to 0.96. The correlation between BDI-II and the Beck Depression Inventory (BDI-I) was high and substantial overlap with measures of depression and anxiety was reported. The criterion-based validity showed good sensitivity and specificity for detecting depression in comparison to the adopted gold standard. However, the cutoff score to screen for depression varied according to the type of sample. Factor analysis showed a robust dimension of general depression composed by two constructs: cognitive-affective and somatic-vegetative. CONCLUSIONS: The BDI-II is a relevant psychometric instrument, showing high reliability, capacity to discriminate between depressed and non-depressed subjects, and improved concurrent, content, and structural validity. Based on available psychometric evidence, the BDI-II can be viewed as a cost-effective questionnaire for measuring the severity of depression, with broad applicability for research and clinical practice worldwide.

At risk or not at risk? A meta-analysis of the prognostic accuracy of psychometric interviews for psychosis prediction

An accurate detection of individuals at clinical high risk (CHR) for psychosis is a prerequisite for effective preventive interventions. Several psychometric interviews are available, but their prognostic accuracy is unknown. We conducted a prognostic accuracy meta-analysis of psychometric interviews used to examine referrals to high risk services. The index test was an established CHR psychometric instrument used to identify subjects with and without CHR (CHR+ and CHR-). The reference index was psychosis onset over time in both CHR+ and CHR- subjects. Data were analyzed with MIDAS (STATA13). Area under the curve (AUC), summary receiver operating characteristic curves, quality assessment, likelihood ratios, Fagan's nomogram and probability modified plots were computed. Eleven independent studies were included, with a total of 2,519 help-seeking, predominately adult subjects (CHR+: N=1,359; CHR-: N=1,160) referred to high risk services. The mean follow-up duration was 38 months. The AUC was excellent (0.90; 95% CI: 0.87-0.93), and comparable to other tests in preventive medicine, suggesting clinical utility in subjects referred to high risk services. Meta-regression analyses revealed an effect for exposure to antipsychotics and no effects for type of instrument, age, gender, follow-up time, sample size, quality assessment, proportion of CHR+ subjects in the total sample. Fagan's nomogram indicated a low positive predictive value (5.74%) in the general non-help-seeking population. Albeit the clear need to further improve prediction of psychosis, these findings support the use of psychometric prognostic interviews for CHR as clinical tools for an indicated prevention in subjects seeking help at high risk services worldwide.

Du bien-être psychologique au travail : fondements théoriques, conceptualisation et instrumentation du construit

Malgré la préoccupation croissante des chercheurs et praticiens pour la santé psychologique au travail, le concept de bien-être vécu au travail est encore mal compris de la communauté scientifique. En effet, peu d’efforts ont été consacrés à ce jour pour développer des connaissances sur le bien-être psychologique au travail arrimées à la réalité des employés. Cette thèse a donc pour objectif de développer une conceptualisation du bien-être psychologique au travail et une instrumentation psychométriquement fiable lui étant rattachée. Pour ce faire, deux études ont été réalisées. La première, de nature qualitative et exploratoire, fut menée auprès de 20 travailleurs canadiens francophones afin de répertorier, à partir d’incidents critiques vécus par ceux-ci, des manifestations de bien-être psychologique au travail. Celles-ci ont pu être classifiées selon un modèle en 2 axes, soit la sphère de référence dans laquelle le bien-être psychologique au travail se vit et la directionnalité selon laquelle il se développe. Ce modèle a ensuite été comparé aux conceptualisations génériques du bien-être psychologique existantes, et cette analyse a permis d’étayer la validité convergente et divergente du modèle. Dans un deuxième temps, l’Indice de bien-être psychologique au travail (IBEPT) a été créé sur la base des manifestations relevées lors de l’étude qualitative, afin d’en assurer la validité de contenu. Une version expérimentale de l’instrument a ensuite été soumise à une expérimentation auprès de 1080 travailleurs québécois. Les analyses factorielles exploratoires révèlent une structure interne en 25 items reflétant 5 dimensions, représentant elles-mêmes un construit de second ordre. La validité de construit de cette conceptualisation a ensuite été étudiée par l’analyse des intercorrélations avec une série de mesures du bien-être et de la détresse psychologique génériques. Les résultats appuient la validité convergente de l’instrument, et démontrent également sa validité divergente. Enfin, l’instrument affiche une cohérence interne satisfaisante. Au terme de cette recherche doctorale, les résultats des deux études sont interprétés en fonction de l’état actuel des connaissances sur le bien-être psychologique, les limites des études sont énoncées, et des pistes de recherche future sont avancées.

Questionnaire d'attitudes et de préférences éducatives des intervenants (QAPÉI) : structure factorielle et relations avec les traits de personnalité

La psychoéducation de même que plusieurs approches théoriques en psychologie clinique suggèrent que l’intervenant constitue un élément actif fondamental des interventions auprès des individus en difficulté. Parmi l’ensemble des caractéristiques des intervenants qui sont utiles de considérer, les attitudes et préférences éducatives des intervenants apparaissent importantes puisqu’elles peuvent être reliées à un bon appariement avec un milieu d’intervention donné, au sentiment d’efficacité professionnelle et, ultimement, à l’efficacité d’une intervention. Or, très peu d’instruments psychométriques d’évaluation validés existent pour évaluer ces construits importants. Cette étude visait principalement à effectuer un examen préliminaire des propriétés psychométriques de la version française du Questionnaire d’attitudes et de préférences des intervenants (QAPÉI; Jesness & Wedge, 1983; Le Blanc, Trudeau-Le Blanc, & Lanctôt, 1999). Le premier objectif de la présente étude était d’évaluer si la structure théorique originale était reproductible empiriquement ou si une structure factorielle alternative était nécessaire. Le deuxième objectif était d’évaluer si les attitudes et préférences éducatives des intervenants étaient reliées à leurs traits de personnalité. L’échantillon utilisé était composé d’intervenants faisant partie de Boscoville2000, un projet d’intervention cognitive-comportementale en milieu résidentiel pour les adolescents en difficulté. Des analyses factorielles exploratoires ont démontré que la structure théorique originale n’était pas reproduite empiriquement. Une structure alternative en cinq facteurs a été recouvrée. Cette structure alternative était plus cohérente sur le plan conceptuel et démontrait une bonne adéquation aux données. Les facteurs identifiés ont été nommés Distance affective, Évitement thérapeutique, Exaspération, Permissivité et Coercition. Des analyses corrélationnelles ont démontré que ces échelles d’attitudes et de préférences éducatives étaient reliées de façon conceptuellement cohérente aux traits de personnalité des intervenants, ce qui appuie la validité de critère de la nouvelle structure de l’instrument.

Drinking refusal self-efficacy questionnaire-revised (DRSEQ-R): a new factor structure with confirmatory factor analysis

The drinking refusal self-efficacy questionnaire (DRSEQ: Young, R.M., Oei, T.P.S., 1996. Drinking expectancy profile: test manual. Behaviour Research and Therapy Centre, University of Queensland, Australia Young, R.M., Oei, T.P.S., Crook, G.M., 1991. Development of a drinking refusal self-efficacy questionnaire. J. Psychopathol. Behav. Assess., 13, 1-15) assesses a person's belief in their ability to resist alcohol. The DRSEQ is a sound psychometric instrument based on exploratory factor analyses, but has not been subjected to confirmatory factor analysis. In total 2773 participants were used to confirm the factor structure of the DRSEQ. Initial analyses revealed that the original structure was not confirmed in the current study. Subsequent analyses resulted in a revised factor structure (DRSEQ-R) being confirmed in community, student and clinical samples. The DRSEQ-R was also found to have good construct and concurrent validity. The factor structure of the DRSEQ-R is more stable than the original structure of the DRSEQ and the revised scale has considerable potential in future alcohol-related research. (c) 2004 Elsevier Ireland Ltd. All rights reserved.

Psychometric characteristics of the Rivermead Behavioural Memory Test (RBMT) as an early detection instrument for dementia and mild cognitive impairment in Brazil

Background: The Rivermead Behavioural Memory Test (RBMT) assesses everyday memory by means of tasks which mimic daily challenges. The objective was to examine the validity of the Brazilian version of the RBMT to detect cognitive decline. Methods: 195 older adults were diagnosed as normal controls (NC) or with mild cognitive impairment (MCI) or Alzheimer`s disease (AD) by a multidisciplinary team, after participants completed clinical and neuropsychological protocols. Results: Cronbach`s alpha was high for the total sample for the RBMT profile (PS) and screening scores (SS) (PS=0.91, SS=0.87) and for the AD group (PS=0.84, SS=0.85), and moderate for the MCI (PS=0.62, SS=0.55)and NC (PS=0.62, SS=0.60) groups. RBMT total scores, Appointment, Pictures, Immediate and Delayed Story, Immediate and Delayed Route, Delayed Message and Date contributed to differentiate NC from MCI. ROC curve analyses indicated high accuracy to differentiate NC from AD patients, and, moderate accuracy to differentiate NC from MCI. Conclusions: The Brazilian version of the RBMT seems to be an appropriate instrument to identify memory decline in Brazilian older adults.

Explicit discrimination and health: development and psychometric properties of an assessment instrument

OBJECTIVE: To develop an instrument to assess discrimination effects on health outcomes and behaviors, capable of distinguishing harmful differential treatment effects from their interpretation as discriminatory events. METHODS: Successive versions of an instrument were developed based on a systematic review of instruments assessing racial discrimination, focus groups and review by a panel comprising seven experts. The instrument was refined using cognitive interviews and pilot-testing. The final version of the instrument was administered to 424 undergraduate college students in the city of Rio de Janeiro, Southeastern Brazil, in 2010. Structural dimensionality, two types of reliability and construct validity were analyzed. RESULTS: Exploratory factor analysis corroborated the hypothesis of the instrument's unidimensionality, and seven experts verified its face and content validity. The internal consistency was 0.8, and test-retest reliability was higher than 0.5 for 14 out of 18 items. The overall score was higher among socially disadvantaged individuals and correlated with adverse health behaviors/conditions, particularly when differential treatments were attributed to discrimination. CONCLUSIONS: These findings indicate the validity and reliability of the instrument developed. The proposed instrument enables the investigation of novel aspects of the relationship between discrimination and health.

Student's academic efficacy or Inefficacy? an example on how to evaluate the psychometric properties of a measuring instrument and evaluate the effects of item wording

This study evaluated the effect of item inversion on the construct validity and reliability of psychometric scales and proposed a theoretical framework for the evaluation of the psychometric properties of data gathered with psychometric instruments. To this propose, we used the Maslach Burnout Inventory, which is the most used psychometric inventory to measure burnout in different professional context (Students, Teachers, Police, Doctors, Nurses, etc…). The version of the MBI used was the MBI-Student Survey (MBI-SS). This inventory is composed of three key dimensions: Exhaustion, Cynicism and Professional Efficacy. The two first dimensions—which have positive formulated items—are moderate to strong positive correlated, and show moderate to strong negative correlations with the 3rd dimension—which has negative formulated items. We tested the hypothesis that, in college students, formulating the 3rd dimension of burnout as Inefficacy (reverting the negatively worded items in the Efficacy dimension) improves the correlation of the 3rd dimension with the other two dimensions, improves its internal consistency, and the overall MBI-SS’ construct validity and reliability. Confirmatory factor analysis results, estimated by Maximum Likelihood, revealed adequate factorial fit for both forms of the MBI-SS (with Efficacy) vs. the MBI-SSi (with Inefficacy). Also both forms showed adequate convergent and discriminant related validity. However, reliability and convergent validity were higher for the MBI-SSi. There were also stronger (positive) correlations between the 3 factors in MBI-SSi than the ones observed in MBI-SS. Results show that positively rewording of the 3rd dimension of the MBI-SS improves its validity and reliability. We therefore propose that the 3rd dimension of the MBI-SS should be named Professional Inefficacy and its items should be positively worded.

Psychometric properties of the MacNew heart disease health-related quality of life instrument in patients with heart failure

RATIONALE, AIMS AND OBJECTIVES: Heart failure (HF) is a severe chronic disease and impairs health-related quality of life (HRQL). While validated specific HRQL instruments are required for evaluation of treatment and rehabilitation in patients with HF, a single validated measure to document changes in HRQL for patients with different heart disease diagnoses would be invaluable. The purpose of this analysis was the psychometric analysis of the German MacNew Heart Disease Questionnaire (MacNew) in HF patients, which has previously been shown to be reliable and valid in patients with myocardial infarction, angina pectoris and arrhythmia. METHODS: We recruited 89 patients (61.7+/-11.5 years; 84.3% male) in two Austrian and one Swiss cardiology department with documented HF (effect sizes 28.9+/-10.1%). The self-administered MacNew, the Short Form-36 (SF-36) and the Hospital Anxiety and Depression Scale were completed. Internal consistency reliability (Cronbach's alpha), discriminative and evaluative validity were assessed. RESULTS: Cronbach's alpha exceeded 0.80. Each MacNew scale differentiated between patients with and without anxiety (3.9+/-1.0 vs. 5.3+/-0.8, all P<0.001), with and without depression (4.2+/-1.2 vs. 5.2+/-0.9 all P<0.03) and by the SF-36 health transition item (deteriorate=4.39, no change=4.95, improve=5.45, all P<0.02). Evaluative validity was demonstrated with effect sizes >0.70 for a subsample attending a 12-week outpatient rehabilitation programme. CONCLUSIONS: The German language version of the MacNew demonstrates consistently acceptable psychometric properties of reliability, validity and responsiveness in patients with documented HF. Together with previous documentation of reliability, validity and responsive, these findings strengthen the argument for the MacNew as a potential 'core' HRQL measure, at least in the German language.

Self-Reported Capabilities Among Young Male Adults in Switzerland: Translation and Psychometric Evaluation of a German, French and Italian Version of a Closed Survey Instrument

There is a shortage of empirical applications of the capability approach that employ closed survey instruments to assess self-reported capabilities. However, for those few instruments that have been designed and administered through surveys until now, no psychometric properties (reliability, validity, and factor structure) were reported. The purpose of this study is the assessment of the psychometric properties of three new language versions (German, French, and Italian) of an established (English) set of eight self-reported capability items. The set of items is taken from a previously published British study by Anand and van Hees (J Soc Econ 35(2):268–284, 2006). Our sample consists of 17,152 young male adults aged 18–25 years from the three major language regions in Switzerland. The results indicate good reliability of the three language versions. The results from the exploratory factor analyses suggest a one-dimensional factor structure for seven domain specific items. Furthermore, the results from multiple regression analyses suggest that a global summary item on overall capabilities represents a measurement alternative to the set of seven domain specific capability items. Finally, the results confirm the applicability of the closed capability instrument in a large scale survey questionnaire and represent the first attempt to measure self-reported capabilities in Switzerland.

The Health Behavior Change Competency Checklist (HBCCC): Instrument development and psychometric evaluation.

More than half of morbidity and mortality in the United States can be attributed to behavior-related disease, such as tobacco use, physical inactivity, poor diet and alcohol consumption. Given the increased prevalence of behaviorally related medical health concerns, physician competence in the implementation of effective behavior change strategies is quickly becoming an essential skill. However, only recently have primary care residency programs begun to systematically teach and evaluate motivational interviewing skills critical to influencing health behavior, and use of standardized, objective assessment tools to assess skillfulness has been largely absent. This paper reports the development of a checklist, the Health Behavior Change Competency Checklist (HBCCC). The instrument captures the theoretical model of behavior change, motivational interviewing, in a practical and versatile manner. Psychometric evaluation demonstrated moderate efficacy. Namely, results indicated the HBCCC possesses good reliability, as evidenced by high internal consistency, and adequate construct validity. It also displayed considerable utility and practical application. While these results provide several reasons for confidence in the HBCCC, item revision and additional testing are required in order to establish it as a meaningful and valuable instrument.

Psychometric Properties Evaluation Of A New Ergonomics-related Job Factors Questionnaire Developed For Nursing Workers.

The objectives of this study were to develop a questionnaire that evaluates the perception of nursing workers to job factors that may contribute to musculoskeletal symptoms, and to evaluate its psychometric properties. Internationally recommended methodology was followed: construction of domains, items and the instrument as a whole, content validity, and pre-test. Psychometric properties were evaluated among 370 nursing workers. Construct validity was analyzed by the factorial analysis, known-groups technique, and convergent validity. Reliability was assessed through internal consistency and stability. Results indicated satisfactory fit indices during confirmatory factor analysis, significant difference (p < 0.01) between the responses of nursing and office workers, and moderate correlations between the new questionnaire and Numeric Pain Scale, SF-36 and WRFQ. Cronbach's alpha was close to 0.90 and ICC values ranged from 0.64 to 0.76. Therefore, results indicated that the new questionnaire had good psychometric properties for use in studies involving nursing workers.