Teaching Motivational Interviewing to Medical Students to Improve Behavior Change Counseling Skills - Results of a Pilot Test

BACKGROUND: Patient behavior accounts for half or more of the variance in health, disease, mortality and treatment outcome and costs. Counseling using motivational interviewing (MI) effectively improves the substance use and medical compliance behavior of patients. Medical training should include substantial focus on this key issue of health promotion. The objective of the study is to test the efficacy of teaching MI to medical students. METHODS: Thirteen fourth-year medical students volunteered to participate. Seven days before and after an 8-hour interactive MI training workshop, each student performed a video-recorded interview with two standardized patients: a 60 year-old alcohol dependent female consulting a primary care physician for the first time about fatigue and depression symptoms; and a 50 year-old male cigarette smoker hospitalized for myocardial infarction. All 52 videos (13 students×2 interviews before and after training) were independently coded by two blinded clinicians using the Motivational Interviewing Training Integrity (MITI, 3.0). MITI scores consist of global spirit (Evocation, Collaboration, Autonomy/Support), global Empathy and Direction, and behavior count summary scores (% Open questions, Reflection to question ratio, % Complex reflections, % MI-adherent behaviors). A "beginning proficiency" threshold (BPT) is defined for each of these 9 scores. The proportion of students reaching BPT before and after training was compared using McNemar exact tests. Inter-rater reliability was evaluated by comparing double coding, and test-retest analyses were conducted on a sub-sample of 10 consecutive interviews by each coder. Weighted Kappas were used for global rating scales and intra-class correlations (ICC) were computed for behavior count summary scores. RESULTS: The percent of counselors reaching BPT before and after MI training increased significantly for Evocation (15% to 65%, p<.001), Collaboration (27% to 77%, p=.001), Autonomy/Support (15% to 54%, p=.006), and % Open questions (4% to 38%, p=.004). Proportions increased, but were not statistically significant for Empathy (38% to 58%, p=.18), Reflection to question ratio (0% to 15%, p=.12), % Complex reflection (35% to 54%, p=.23), and % MI-adherent behaviors (8% to 15%, p=.69). There was virtually no change for the Direction scale (92% to 88%, p=1.00). The reliability analyses produced mixed results. Weighted kappas for inter-rater reliability ranged from .14 for Direction to .51 for Collaboration, and from .27 for Direction to .80 for Empathy for test-retest. ICCs ranged from .20 for Complex reflections to .89 for Open questions (inter-rater), and from .67 for Complex reflections to .99 for Reflection to question ratio (test-retest). CONCLUSION: This pilot study indicates that a single 8-hour training in motivational interviewing for voluntary fourth-year medical students results in significant improvement of some MI skills. A larger sample of randomly selected medical students observed over longer periods should be studied to test if MI training generalizes to medical students. Inter-rater reliability and test-retest findings indicate a need for caution when interpreting the present results, as well as for more intensive training to help appropriately capture more dimensions of the process in future studies.

The challenge of validation: assessing the performance of a test of productive vocabulary

This paper assesses the performance of a vocabulary test designed to measure second language productive vocabulary knowledge.The test, Lex30, uses a word association task to elicit vocabulary, and uses word frequency data to measure the vocabulary produced. Here we report firstly on the reliability of the test as measured by a test-retest study, a parallel test forms experiment and an internal consistency measure. We then investigate the construct validity of the test by looking at changes in test performance over time, analyses of correlations with scores on similar tests, and comparison of spoken and written test performance. Last, we examine the theoretical bases of the two main test components: eliciting vocabulary and measuring vocabulary. Interpretations of our findings are discussed in the context of test validation research literature. We conclude that the findings reported here present a robust argument for the validity of the test as a research tool, and encourage further investigation of its validity in an instructional context

Validity of the running anaerobic sprint test for assessing anaerobic power and predicting short-distance performances

Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)

Reliability and validation of a Brazilian version of the Oral Health Impact Profile for assessing edentulous subjects

The aims of this study were to evaluate the reliability and to validate a Brazilian version of Oral Health Impact Profile for assessing edentulous subjects (OHIP-EDENT), an inventory for measuring oral health-related quality of life of edentulous subjects. The sample comprised 65 complete denture wearers (23 men, mean age of 69.1 +/- 10.3 years). The translated OHIP-EDENT was applied on two occasions with a washout period of 3 months. Reliability was assessed by an internal consistency analysis and a test-retest approach. A preliminary validation process was conducted by a qualitative approach/interview. Results of internal consistency showed a Cronbach's alpha of 0.86 or 0.90 for the first or second appointment respectively. Through the test-retest analysis, an intra-class correlation coefficient of 0.57 was found, and individual answers reflected a broad range of agreement. Interviewed volunteers (n = 6) comprehended most questions well. In conclusion, the Brazilian version of OHIP-EDENT is adequate for assessing the oral health-related quality of life for edentulous subjects.

Fit-climbing test: a field test for indoor rock climbing

Bertuzzi, R, Franchini, E, Tricoli, V, Lima-Silva, AE, Pires, FDO, Okuno, NM, and Kiss, MAPDM. Fit-climbing test: A field test for indoor rock climbing. J Strength Cond Res 26(6): 1558-1563, 2012-The aim of this study was to develop an indoor rock-climbing test on an artificial wall (Fit-climbing test). Thirteen climbers (elite group [EG] = 6; recreational group [RG] = 7) performed the following tests: (a) familiarization in the Fitclimbing test, (b) the Fit-climbing test, and (c) a retest to evaluate the Fit-climbing test's reliability. Gas exchange, blood lactate concentration, handgrip strength, and heart rate were measured during the test. Oxygen uptake during the Fit-climbing test was not different between groups (EG = 8.4 +/- 1.1 L; RG = 7.9 +/- 1.5 L, p > 0.05). The EG performance (120 +/- 7 movements) was statistically higher than the RG climbers' performance (78 +/- 13 movements) during the Fit-climbing test. Consequently, the oxygen cost per movement during the Fit-climbing test of the EG was significantly lower than that of the RG (p < 0.05). Handgrip strength was higher in the EG when compared with that in the RG in both pre-Fit- and post-Fit-climbing test (p < 0.05). There were no significant differences in any other variables analyzed during the Fit-climbing test (p > 0.05). Furthermore, the performance in the Fit-climbing test presented high reliability (intraclass correlation coefficient = 0.97). Therefore, the performance during the Fit-climbing test may be an alternative to evaluate rock climbers because of its specificity and relation to oxygen cost per movement during climbing.

Reliability in kimono grip strength tests and comparison between elite and non-elite Brazilian jiu-jitsu players

Background and Study Aim: The grip strength endurance is important for Brazilian Jiu-Jitsu (BJJ). Thus, the aims of this study were: a) to test the reliability of two kimono grip strength tests named maximum static lift (MSL) and maximum number of repetitions (MNR) and b) to examine differences between elite and non-elite BJJ players in these tests. Material/Methods: Thirty BJJ players participated into two phases: "A" to test reliability and "B" to compare elite and non-elite. In phase A, twenty participants performed the MSL and, 15 min later, the MNR in two occasions with 24-h interval. In phase B, ten other BJJ practitioners (non-elite) and ten athletes (elite) performed the same tests. The intraclass correlation coefficient (ICC) two way fixed model (3,1), Bland-Altman plot and the limits of agreement were used to test reliability, correlation between the tests were evaluated by Pearson correlations and independent T test (P<0.05) was utilized to compare elite vs. non-elite. Results: The ICC was high for repeated measurements on different days of phase A (MSL: r=0.99 and MNR: r=0.97). Limits of agreement for time of suspension were -6.9 to 2.4-s, with a mean difference of -2.3 s (CI: -3.3 to -1.2-s), while for number of repetitions the limits of agreement were -2.9 to 2.3-rep, with a mean difference of -0.3-rep (CI: -0.9 to 0.3-rep). In phase B, elite presented better performance for both tests (P<0.05) compared to non-elite (56 +/- 10-s vs. 37 +/- 11-s in MSL and 15 +/- 4-rep vs. 8 +/- 3-rep in MNR). Moderate correlation were found between MSL and MNR for absolute values during test (r=0.475; p=0.034), and retest phases (r=0.489; p=0.029), while moderate and high correlations in the test (r=0.615; p=0.004) and retest phases (r=0.716; p=0.001) were found for relative values, respectively. Conclusions: These proposed tests are reliable and both static and dynamic grip strength endurance tests seem to differentiate BJJ athletes from different levels.

The development and evaluation of a computer-based program to test and to teach the recognition of facial affect

Autism is a chronic pervasive neurodevelopmental disorder characterized by the early onset of social and communicative impairments as well as restricted, ritualized, stereotypic behavior. The endophenotype of autism includes neuropsychological deficits, for instance a lack of "Theory of Mind" and problems recognizing facial affect. In this study, we report the development and evaluation of a computer-based program to teach and test the ability to identify basic facially expressed emotions. 10 adolescent or adult subjects with high-functioning autism or Asperger-syndrome were included in the investigation. A priori the facial affect recognition test had shown good psychometric properties in a normative sample (internal consistency: rtt=.91-.95; retest reliability: rtt=.89-.92). In a prepost design, one half of the sample was randomly assigned to receive computer treatment while the other half of the sample served as control group. The training was conducted for five weeks, consisting of two hours training a week. The trained individuals improved significantly on the affect recognition task, but not on any other measure. Results support the usefulness of the program to teach the detection of facial affect. However, the improvement found is limited to a circumscribed area of social-communicative function and generalization is not ensured.

The dementia cognitive fluctuation scale, a new psychometric test for clinicians to identify cognitive fluctuations in people with dementia.

OBJECTIVES Cognitive fluctuation (CF) is a common feature of dementia and a core diagnostic symptom for dementia with Lewy bodies (DLB). CF remains difficult to accurately and reliably detect clinically. This study aimed to develop a psychometric test that could be used by clinicians to facilitate the identification of CF and improve the recognition and diagnosis of DLB and Parkinson disease, and to improve differential diagnosis of other dementias. METHODS We compiled a 17-item psychometric test for identifying CF and applied this measure in a cross-sectional design. Participants were recruited from the North East of England, and assessments were made in individuals' homes. We recruited people with four subtypes of dementia and a healthy comparison group, and all subjects were administered this pilot scale together with other standard ratings. The psychometric properties of the scale were examined with exploratory factor analysis. We also examined the ability of individual items to identify CF to discriminate between dementia subtypes. The sensitivity and specificity of discriminating items were explored along with validity and reliability analyses. RESULTS Participants comprised 32 comparison subjects, 30 people with Alzheimer disease, 30 with vascular dementia, 29 with DLB, and 32 with dementia associated with Parkinson disease. Four items significantly discriminated between dementia groups and showed good levels of sensitivity (range: 78.6%-80.3%) and specificity (range: 73.9%-79.3%). The scale had very good levels of test-retest (Cronbach's alpha: 0.82) and interrater (0.81) reliabilities. The four items loaded onto three different factors. These items were: 1) marked differences in functioning during the daytime; 2) daytime somnolence; 3) daytime drowsiness; and 4) altered levels of consciousness during the day. CONCLUSIONS We identified four items that provide valid, sensitive, and specific questions for reliably identifying CF and distinguishing the Lewy body dementias from other major causes of dementia (Alzheimer disease and vascular dementia).

Functional connectivity in BOLD and CBF data: similarity and reliability of resting brain networks

Resting-state functional connectivity (FC) fMRI (rs-fcMRI) offers an appealing approach to mapping the brain's intrinsic functional organization. Blood oxygen level dependent (BOLD) and arterial spin labeling (ASL) are the two main rs-fcMRI approaches to assess alterations in brain networks associated with individual differences, behavior and psychopathology. While the BOLD signal is stronger with a higher temporal resolution, ASL provides quantitative, direct measures of the physiology and metabolism of specific networks. This study systematically investigated the similarity and reliability of resting brain networks (RBNs) in BOLD and ASL. A 2×2×2 factorial design was employed where each subject underwent repeated BOLD and ASL rs-fcMRI scans on two occasions on two MRI scanners respectively. Both independent and joint FC analyses revealed common RBNs in ASL and BOLD rs-fcMRI with a moderate to high level of spatial overlap, verified by Dice Similarity Coefficients. Test-retest analyses indicated more reliable spatial network patterns in BOLD (average modal Intraclass Correlation Coefficients: 0.905±0.033 between-sessions; 0.885±0.052 between-scanners) than ASL (0.545±0.048; 0.575±0.059). Nevertheless, ASL provided highly reproducible (0.955±0.021; 0.970±0.011) network-specific CBF measurements. Moreover, we observed positive correlations between regional CBF and FC in core areas of all RBNs indicating a relationship between network connectivity and its baseline metabolism. Taken together, the combination of ASL and BOLD rs-fcMRI provides a powerful tool for characterizing the spatiotemporal and quantitative properties of RBNs. These findings pave the way for future BOLD and ASL rs-fcMRI studies in clinical populations that are carried out across time and scanners.

Test of Emotion Comprehension: Exploring the underlying structure through Confirmatory Factor Analysis and Similarity Structure Analysis

Some decades of research on emotional development have underlined the contribution of several domains to emotional understanding in childhood. Based on this research, Pons and colleagues (Pons & Harris, 2002; Pons, Harris & Rosnay, 2004) have proposed the Test of Emotion Comprehension (TEC) which assesses nine domains of emotional understanding, namely the recognition of emotions, based on facial expressions; the comprehension of external emotional causes; impact of desire on emotions; emotions based on beliefs; memory influence on emotions; possibility of emotional regulation; possibility of hiding an emotional state; having mixed emotions; contribution of morality to emotional experiences. This instrument was administered individually to 182 Portuguese children aged between 8 and 11 years, of 3rd and 4th grades, in public schools. Additionally, we used the Socially in Action-Peers (SAp) (Rocha, Candeias & Lopes da Silva, 2012) to assess TEC’s criterion-related validity. Mean differences results in TEC by gender and by socio-economic status (SES) were analyzed. The results of the TEC’s psychometric analysis were performed in terms of items’ sensitivity and reliability (stability, test-retest). Finally, in order to explore the theoretical structure underlying TEC a Confirmatory Factor Analysis and a Similarity Structure Analysis were computed. Implications of these findings for emotional understanding assessment and intervention in childhood are discussed.

Estudo de validação e reprodutibilidade de uma escala de silhueta para adolescentes

O objetivo deste estudo foi validar e confirmar a reprodutibilidade de uma escala de silhueta para adolescentes. Para tanto, pesquisou-se 386 jovens de uma Escola Particular de Ensino. Desenvolveram-se análises de validação de construto e reprodutibilidade. O instrumento foi capaz de discriminar os quatro grupos segundo estado nutricional (α2=30,5, p<0,001; α2=19,3, p<0,001), correlacionou-se com as três medidas (IMC, RCQ e CC) pesquisadas (r=-0,61, p<0,001, r=-0,49, p<0,001, r=-0,54, p<0,001; r=-0,52, p<0,001, r=-0,23, p=0,001, r=-0,42, p<0,001) e confirmou a reprodutibilidade por meio da correlação intra-classe (r icc=0,86, p<0,001; r icc=0,80, p<0,001) para meninos e meninas, respectivamente. Na comparação das médias dos escores da escala (teste-reteste) confirmou-se a reprodutibilidade somente para o grupo dos meninos (p=0,86). O instrumento apresentou boa compreensão verbal e bom tempo de conclusão. Conclui-se que a escala de silhueta demonstrou bons resultados nas análises de validação e de reprodutibilidade.

Análise psicométrica da escala de impacto na autonomia e participação, em pessoas com esclerose múltipla

A avaliação da Autonomia e funcionalidade das pessoas com esclerose múltipla é fundamental para a compreensão das limitações e necessidades destas pessoas. O presente estudo tem como objectivo estudar as propriedades psicométricas da Escala de Impacto Autonomia e Participação em doentes com esclerose múltipla. Participaram neste estudo 280 indivíduos com diagnóstico de esclerose múltipla, 71,4% mulheres com idade média de 39,23 anos. Procedeu-se à análise factorial exploratória, consistência interna, teste-reteste, validade convergente e discriminante. Os resultados demonstram valores psicométricos apropriados para a versão de língua portuguesa semelhantes às versões de língua alemã e de língua inglesa. Concluímos que esta escala tem boas condições psicométricas para avaliar a autonomia funcional em indivíduos com esclerose múltipla. ABSTRACT: Assessment of Autonomy and participation of patients with multiple sclerosis is essential to understand the limitations and necessities of these patients. The present study aims to examine the psychometric proprieties of the Impact on Participation and Autonomy Questionnaire (IPA) in patient with multiple sclerosis. Participants are 280 patients with a diagnostic of multiple sclerosis, 71.4% females, mean age of 39.23 years. We inspect metric properties namely, validity, construt validity and convergent and discriminant validity, and reliability, internal consistency and test-retest. The results show that IPA is a reliable and valid instrument for assessment autonomy and participation in Portuguese language, with similar sensibility than the Germany and English version. In conclusion these instruments have psychometric conditions for assessment the functional autonomy of people with multiple sclerosis.

Impacto da síncope na qualidade de vida: validação duma escala de avaliação em doentes submetidos a teste de inclinação em mesa basculante

Introdução e objetivos: A síncope recorrente tem um impacto significativo na qualidade de vida. O desenvolvimento de escalas de medida de fácil aplicabilidade clínica para avaliar este impacto é fundamental. O objetivo do presente estudo é a validação preliminar da escala Impact of Syncope on Quality of Life, para a população portuguesa. Métodos: O instrumento foi submetido a um processo de tradução, validação, adequação cultural e cognitive debriefing. Participaram 39 doentes com história de síncopes recorrentes (>1 ano de evolução), submetidos a teste de inclinação em mesa basculante (teste de tilt), que constitui uma amostra de conveniência, com idade de 52,1±16,4 anos (21-83; 43,5% do sexo masculino), a maioria com uma situação profissional ativa (n=18) ou reformados (n=13). A versão portuguesa resultou numa versão semelhante unidimensional à original com 12 itens agregados num único somatório, tendo passado por validação estatística, com avaliação da fidelidade, validade e estabilidade no tempo. Resultados: Em relação à fidelidade, a consistência interna da escala é de 0,9. Avaliámos a validade convergente, tendo obtido resultados estatisticamente significativos (p<0,01). Avaliámos a validade divergente tendo obtido resultados estatisticamente significativos. Relativamente à estabilidade no tempo foi efetuado um teste-reteste do instrumento aos seis meses após o teste de inclinação com 22 doentes desta amostra não submetidos a intervenção clínica, que não mostrou alterações estatisticamente significativas da qualidade de vida. Conclusões: Os resultados obtidos indicam a pertinência da utilização deste instrumento em contexto português na avaliação da qualidade de vida de doentes com síncope recorrente.

Impact of Syncope on Quality of Life: Validation of a Measure in Patients Undergoing Tilt Testing

INTRODUCTION AND OBJECTIVES: Recurrent syncope has a significant impact on quality of life. The development of measurement scales to assess this impact that are easy to use in clinical settings is crucial. The objective of the present study is a preliminary validation of the Impact of Syncope on Quality of Life questionnaire for the Portuguese population. METHODS: The instrument underwent a process of translation, validation, analysis of cultural appropriateness and cognitive debriefing. A population of 39 patients with a history of recurrent syncope (>1 year) who underwent tilt testing, aged 52.1 ± 16.4 years (21-83), 43.5% male, most in active employment (n=18) or retired (n=13), constituted a convenience sample. The resulting Portuguese version is similar to the original, with 12 items in a single aggregate score, and underwent statistical validation, with assessment of reliability, validity and stability over time. RESULTS: With regard to reliability, the internal consistency of the scale is 0.9. Assessment of convergent and discriminant validity showed statistically significant results (p<0.01). Regarding stability over time, a test-retest of this instrument at six months after tilt testing with 22 patients of the sample who had not undergone any clinical intervention found no statistically significant changes in quality of life. CONCLUSIONS: The results indicate that this instrument is of value for assessing quality of life in patients with recurrent syncope in Portugal.

Psychometric properties of assessment instruments for autism spectrum disorder: a systematic review of Brazilian studies

Objective To systematically review the scientific literature on the psychometric properties of international instruments for the assessment of autism spectrum disorder (ASD) in the Brazilian population. Methods A search of bibliographic references was conducted in six electronic databases: PsycINFO, PubMed, IndexPsi, Lilacs, Capes (theses and dissertations) and SciELO. The studies were selected by two independent researchers. Results The procedure identified 11 studies of the Brazilian population that encompassed six ASD assessment tools. Given the information provided, the adaptation of the M-CHAT, a screening instrument, was the best conducted. All steps of the adaptation process were described and the changes made to the final version of the instrument were presented, which was not addressed in other studies. In terms of reliability, all of the instruments that assessed internal consistency showed adequate values. In addition, the ADI-R and the CARS adaptations also satisfactorily contemplated inter-rater reliability and test-retest indices, respectively. Finally, all studies aiming to validate instruments showed evidence of validity and sensitivity, and specificity values above 0.90 were observed in the ASQ, ADI-R and ABC. Conclusion Considering both the psychometric aspects and the copyright information, the screening instrument that currently appears to be best indicated for clinical and research use is the M-CHAT. It was also noticed that there are still no specific ASD diagnostic tools available for use in Brazil. This lack of diagnostic instruments consists in a critical situation for the improvement of clinical practice and the development of research in this area.