Exploring the validity and reliability of a questionnaire for evaluating virtual patient design with a special emphasis on fostering clinical reasoning

Background: The design of Virtual Patients (VPs) is essential. So far there are no validated evaluation instruments for VP design published. Summary of work: We examined three sources of validity evidence of an instrument to be filled out by students aimed at measuring the quality of VPs with a special emphasis on fostering clinical reasoning: (1) Content was examined based on theory of clinical reasoning and an international VP expert team. (2) Response process was explored in think aloud pilot studies with students and content analysis of free text questions accompanying each item of the instrument. (3) Internal structure was assessed by confirmatory factor analysis (CFA) using 2547 student evaluations and reliability was examined utilizing generalizability analysis. Summary of results: Content analysis was supported by theory underlying Gruppen and Frohna’s clinical reasoning model on which the instrument is based and an international VP expert team. The pilot study and analysis of free text comments supported the validity of the instrument. The CFA indicated that a three factor model comprising 6 items showed a good fit with the data. Alpha coefficients per factor were 0,74 - 0,82. The findings of the generalizability studies indicated that 40-200 student responses are needed in order to obtain reliable data on one VP. Conclusions: The described instrument has the potential to provide faculty with reliable and valid information about VP design. Take-home messages: We present a short instrument which can be of help in evaluating the design of VPs.

Cigarette smoking and Ecuadorian adolescents: A cross-sectional survey and policy review

This study investigates the relationship between cigarette smoking and adolescents in Ecuador, South America. Using the Social Learning Theory as a basis, the cross-sectional survey focuses attention on such social influences as the smoking habits of family members and peers as well as, the role of cigarette advertisements. Actual use prevalence, access to cigarettes and knowledge and attitudes about smoking are also obtained.^ The survey was conducted in both urban and rural areas, with 50 schools in 40 different communities participating. Two thousand four hundred and fifty-seven adolescents aged 9 to 15 years completed a self-administered questionnaire. This part of the study was conducted in collaboration with the international health organization Amigos de las Americas (AMIGOS). Staff assigned to the AMIGOS Ecuador projects worked with local health and education officials to implement the cross-sectional survey in the field.^ The key informant survey and subsequent policy review were designed to illuminate the social, cultural and institutional environment for anti-smoking activities and interventions in Ecuador. Key individuals involved with this issue on both national and local levels were interviewed. A review of past legislative efforts and present anti-smoking laws was also conducted.^ The current smoking prevalence among the study population was 8.6 percent. Findings from the cross-sectional survey revealed significant positive associations between the smoking habits of siblings and peers and the smoking behavior of the adolescents surveyed. Significant age and gender differences were also found in association with several different variables.^ The policy review found an unfavorable environment for anti-smoking efforts. Several factors contribute to this including, most importantly, lack of funding and lack of public support. The present anti-smoking law is often vague and lacks important provisions, such as a prohibition on selling tobacco products to minors.^ Together, the two surveys provide comprehensive information for the purpose of designing smoking prevention interventions. Using the results from the two surveys, recommendations for intervention are proposed. ^

Coloured Letters and Numbers (CLaN): A reliable factor-analysis based synaesthesia questionnaire

Synaesthesia is a heterogeneous phenomenon, even when considering one particular sub-type. The purpose of this study was to design a reliable and valid questionnaire for grapheme-colour synaesthesia that captures this heterogeneity. By the means of a large sample of 628 synaesthetes and a factor analysis, we created the Coloured Letters and Numbers (CLaN) questionnaire with 16 items loading on 4 different factors (i.e., localisation, automaticity/attention, deliberate use, and longitudinal changes). These factors were externally validated with tests which are widely used in the field of synaesthesia research. The questionnaire showed good test–retest reliability and construct validity (i.e., internally and externally). Our findings are discussed in the light of current theories and new ideas in synaesthesia research. More generally, the questionnaire is a useful tool which can be widely used in synaesthesia research to reveal the influence of individual differences on various performance measures and will be useful in generating new hypotheses.

Assessment of smoking behaviour in a dental setting: a 1-year follow-up study using self-reported questionnaire data and exhaled carbon monoxide levels.

OBJECTIVES This study analyses the changes in smoking habits over the course of 1 year in a group of patients referred to an oral medicine unit. MATERIALS AND METHODS Smoking history and behaviour were analysed at baseline and after 1 year based on a self-reported questionnaire and on exhaled carbon monoxide levels [in parts per million (ppm)]. During the initial examination, all smokers underwent tobacco use prevention and cessation counselling. RESULTS Of the initial group of 121 patients, 98 were examined at the follow-up visit. At the baseline examination, 33 patients (33.67 %) indicated that they were current smokers. One year later, 14 patients (42.24 % out of the 33 smokers of the initial examination) indicated that they had attempted to stop smoking at least once over the follow-up period and 15.15 % (5 patients) had quit smoking. The mean number of cigarettes smoked per day by current smokers decreased from 13.10 to 12.18 (p = 0.04). The exhaled CO level measurements showed very good correlation with a Spearman's coefficient 0.9880 for the initial visit, and 0.9909 for the follow-up examination. For current smokers, the consumption of one additional cigarette per day elevated the CO measurements by 0.77 ppm (p < 0.0001) at the baseline examination and by 0.84 ppm (p < 0.0001) at the 1-year follow-up. CONCLUSIONS In oral health care, where smoking cessation is an important aspect of the treatment strategy, the measurement of exhaled carbon monoxide shows a very good correlation with a self-reported smoking habit. CLINICAL RELEVANCE Measurement of exhaled carbon monoxide is a non-invasive, simple and objective measurement technique for documenting and monitoring smoking cessation and reduction.

The VEINES-QOL/Sym questionnaire is a reliable and valid disease-specific quality of life measure for deep vein thrombosis in elderly patients.

PURPOSE To prospectively evaluate the psychometric properties of the Venous Insufficiency Epidemiological and Economic Study (VEINES-QOL/Sym) questionnaire, an instrument to measure disease-specific quality of life and symptoms in elderly patients with deep vein thrombosis (DVT), and to validate a German version of the questionnaire. METHODS In a prospective multicenter cohort study of patients aged ≥ 65 years with acute venous thromboembolism, we used standard psychometric tests and criteria to evaluate the reliability, validity, and responsiveness of the VEINES-QOL/Sym in patients with acute symptomatic DVT. We also performed an exploratory factor analysis. RESULTS Overall, 352 French- and German-speaking patients were enrolled (response rate of 87 %). Both language versions of the VEINES-QOL/Sym showed good acceptability (missing data, floor and ceiling effects), reliability (internal consistency, item-total and inter-item correlations), validity (convergent, discriminant, known-groups differences), and responsiveness to clinical change over time in elderly patients with DVT. The exploratory factor analysis of the VEINES-QOL/Sym suggested three underlying dimensions: limitations in daily activities, DVT-related symptoms, and psychological impact. CONCLUSIONS The VEINES-QOL/Sym questionnaire is a practical, reliable, valid, and responsive instrument to measure quality of life and symptoms in elderly patients with DVT and can be used with confidence in prospective studies to measure outcomes in such patients.

Quality of life after pulmonary embolism: validation of the French version of the PEmb-QoL questionnaire.

BackgroundThe PEmb-QoL is a validated 40-item questionnaire to quantify health-related quality of life in patients having experienced pulmonary embolism (PE). It covers six health dimensions: frequency of complaints, activities of daily living limitations, work-related problems, social limitations, intensity of complaints, and emotional complaints. Originally developed in Dutch and English, we sought to prospectively validate the psychometric properties of a French version of the PEmb-QoL.MethodsWe performed a forward and backward translation of the English version of the PEmb-QoL into French. French-speaking consecutive adult patients with an acute, objectively confirmed PE admitted to the emergency department of a Swiss university hospital between 08/2009 and 09/2011 were recruited telephonically. We used standard psychometric tests and criteria to evaluate the acceptability, reliability, and validity of the French version of the PEmb-QoL. We also performed an exploratory factor analysis.ResultsOverall, 102 patients were enrolled in the study. The French version of the PEmb-QoL showed good reliability (internal consistency, item¿total and inter-item correlations), reproducibility (test-retest reliability), and validity (convergent, discriminant) in French-speaking patients with PE. The exploratory factor analysis suggested three underlying dimensions: limitations in daily activity (items 4b-m, 5a-d), symptoms (items 1a-h and 7), and emotional complaints (items 9a-f and j).ConclusionWe successfully validated the French version of the PEmb-QoL questionnaire in patients with PE. Our results show that the PEmb-QoL is a valuable tool for assessing health-related quality of life after PE in French-speaking patients.

Patient and Informant Views on Visual Hallucinations in Parkinson Disease.

OBJECTIVE Visual hallucinations (VHs) are a very personal experience, and it is not clear whether information about them is best provided by informants or patients. Some patients may not share their hallucinatory experiences with caregivers to avoid distress or for fear of being labeled insane, and others do not have informants at all, which limits the use of informant-based questionnaires. The aim of this study was to compare patient and caregiver views about VHs in Parkinson disease (PD), using the North-East Visual Hallucinations Interview (NEVHI). METHODS Fifty-nine PD patient-informant pairs were included. PD patients and informants were interviewed separately about VHs using the NEVHI. Informants were additionally interviewed using the four-item version of the Neuropsychiatric Inventory. Inter-reliability and concurrent validity of the different measures were compared. RESULTS VHs were more commonly reported by patients than informants. The inter-rater agreement between NEVHI-patient and NEVHI-informant was moderate for complex VHs (Cohen's kappa = 0.44; 95% confidence interval [CI]: 0.13-0.75; t = 3.43, df = 58, p = 0.001) and feeling of presence (Cohen's kappa = 0.35; 95% CI: 0.00-0.70; t = 2.75, df = 58, p = 0.006), but agreement was poor for illusions (Cohen's kappa = 0.25; 95% CI: -0.07-0.57; t = 2.36, df = 58, p = 0.018) and passage hallucinations (Cohen's kappa = 0.16; 95% CI: -0.04-0.36; t = 2.26, df = 58, p = 0.024). CONCLUSION When assessing VHs in PD patients, it is best to rely on patient information, because not all patients share the details of their hallucinations with their caregivers.

Validation of the IMPACT-III quality of life questionnaire in Swiss children with inflammatory bowel disease

BACKGROUND AND AIMS Inflammatory bowel disease (IBD) frequently manifests during childhood and adolescence. For providing and understanding a comprehensive picture of a patients' health status, health-related quality of life (HRQoL) instruments are an essential complement to clinical symptoms and functional limitations. Currently, the IMPACT-III questionnaire is one of the most frequently used disease-specific HRQoL instrument among patients with IBD. However, there is a lack of studies examining the validation and reliability of this instrument. METHODS 146 paediatric IBD patients from the multicenter Swiss IBD paediatric cohort study database were included in the study. Medical and laboratory data were extracted from the hospital records. HRQoL data were assessed by means of standardized questionnaires filled out by the patients in a face-to-face interview. RESULTS The original six IMPACT-III domain scales could not be replicated in the current sample. A principal component analysis with the extraction of four factor scores revealed the most robust solution. The four factors indicated good internal reliability (Cronbach's alpha=.64-.86), good concurrent validity measured by correlations with the generic KIDSCREEN-27 scales and excellent discriminant validity for the dimension of physical functioning measured by HRQoL differences for active and inactive severity groups (p<.001, d=1.04). CONCLUSIONS This study with Swiss children with IBD indicates good validity and reliability for the IMPACT-III questionnaire. However, our findings suggest a slightly different factor structure than originally proposed. The IMPACT-III questionnaire can be recommended for its use in clinical practice. The factor structure should be further examined in other samples.

Ein Vergleich verschiedener Kurzversionen des Depressive Experiences Questionnaire (DEQ) zur Erhebung von Selbstkritik und Abhängigkeit

Der Depressive Experiences Questionnaire (DEQ) ist ein Fragebogen zur Erfassung der Persönlichkeitsmerkmale Selbstkritik und Abhängigkeit, die als Vulnerabilitätsfaktoren für Depression gelten. Aufgrund seiner Länge und seiner komplexen Auswertungsprozedur wurden im englischsprachigen Raum verschiedene Kurzversionen des DEQ entwickelt. Das Ziel dieser Studie war die psychometrische Überprüfung der verschiedenen DEQ-Versionen in deutscher Sprache sowie die Validierung einer geeigneten Kurzversion. An insgesamt 708 Personen (404 Patienten und 304 nicht-klinische Personen) wurden die psychometrischen Eigenschaften der verschiedenen Versionen verglichen. Es zeigte sich, dass der Theoretische Depressive Experiences Questionnaire–12 Item Version (TDEQ-12) insbesondere aufgrund seiner faktoriellen Validität die besten psychometrischen Eigenschaften aufwies. Zusätzliche Hinweise für die Validität und Reliabilität des TDEQ-12 konnten in vier weiteren Stichproben (436 nicht-klinische Personen, 23 nicht-depressive Personen, 64 depressive Patienten, 74 Studierende) gewonnen werden. Die vorliegende Studie legt nahe, dass der TDEQ-12 eine reliable, valide und ökonomische Alternative zum DEQ für die Erfassung von Selbstkritik und Abhängigkeit darstellt.

Exploring the validity and reliability of a questionnaire for evaluating virtual patient design with a special emphasis on fostering clinical reasoning

Background: Virtual patients (VPs) are increasingly used to train clinical reasoning. So far, no validated evaluation instruments for VP design are available. Aims: We examined the validity of an instrument for assessing the perception of VP design by learners. Methods: Three sources of validity evidence were examined: (i) Content was examined based on theory of clinical reasoning and an international VP expert team. (ii) The response process was explored in think-aloud pilot studies with medical students and in content analyses of free text questions accompanying each item of the instrument. (iii) Internal structure was assessed by exploratory factor analysis (EFA) and inter-rater reliability by generalizability analysis. Results: Content analysis was reasonably supported by the theoretical foundation and the VP expert team. The think-aloud studies and analysis of free text comments supported the validity of the instrument. In the EFA, using 2547 student evaluations of a total of 78 VPs, a three-factor model showed a reasonable fit with the data. At least 200 student responses are needed to obtain a reliable evaluation of a VP on all three factors. Conclusion: The instrument has the potential to provide valid information about VP design, provided that many responses per VP are available.

Development of a novel driving behavior adaptations questionnaire

ABSTRACT Background: Driving a car requires adapting one's behavior to current task demands taking into account one's capacities. With increasing age, driving-relevant cognitive performance may decrease, creating a need for risk-reducing behavioral adaptations. Three different kinds of behavioral adaptations are known: selection, optimization, and compensation. These can occur on the tactical and the strategic level. Risk-reducing behavioral adaptations should be considered when evaluating older drivers' traffic-related risks. Methods: A questionnaire to assess driving-related behavioral adaptations in older drivers was created. The questionnaire was administered to 61 years older (age 65-87 years; mean age = 70.2 years; SD = 5.5 years; 30 female, 31 male) and 31 younger participants (age 22-55 years; mean age = 30.5 years; SD = 6.3 years; 16 female and 15 male) to explore age and gender differences in behavioral adaptations. Results: Two factors were extracted from the questionnaire, a risk-increasing factor and a risk-reducing factor. Group comparisons revealed significantly more risk-reducing behaviors in older participants (t(84.5) = 2.21, p = 0.013) and females (t(90) = 2.52, p = 0.014) compared, respectively, to younger participants and males. No differences for the risk-increasing factor were found (p > 0.05). Conclusions: The questionnaire seems to be a useful tool to assess driving-related behavioral adaptations aimed at decreasing the risk while driving. The possibility to assess driving-related behavioral adaptations in a systematic way enables a more resource-oriented approach in the evaluation of fitness to drive in older drivers.