Comprehensive assessment of gesture production: a new test of upper limb apraxia (TULIA)

BACKGROUND: Only few standardized apraxia scales are available and they do not cover all domains and semantic features of gesture production. Therefore, the objective of the present study was to evaluate the reliability and validity of a newly developed test of upper limb apraxia (TULIA), which is comprehensive and still short to administer. METHODS: The TULIA consists of 48 items including imitation and pantomime domain of non-symbolic (meaningless), intransitive (communicative) and transitive (tool related) gestures corresponding to 6 subtests. A 6-point scoring method (0-5) was used (score range 0-240). Performance was assessed by blinded raters based on videos in 133 stroke patients, 84 with left hemisphere damage (LHD) and 49 with right hemisphere damage (RHD), as well as 50 healthy subjects (HS). RESULTS: The clinimetric findings demonstrated mostly good to excellent internal consistency, inter- and intra-rater (test-retest) reliability, both at the level of the six subtests and at individual item level. Criterion validity was evaluated by confirming hypotheses based on the literature. Construct validity was demonstrated by a high correlation (r = 0.82) with the De Renzi-test. CONCLUSION: These results show that the TULIA is both a reliable and valid test to systematically assess gesture production. The test can be easily applied and is therefore useful for both research purposes and clinical practice.

'A rose is a rose is a rose', but at-risk criteria differ

Background: Over the last 15 years, efforts to detect psychoses early in their prodromal states have greatly progressed; meanwhile, ultra-high risk (UHR) criteria have been the subject of such consensus that parts of them have been proposed for inclusion in DSM-5 in terms of an attenuated psychosis syndrome. However, it is frequently unacknowledged that the definitions and operationalizations of UHR-related at-risk criteria, including the relevant attenuated psychotic symptoms, vary considerably across centers and time and, thus, between prediction studies. Methods: These variations in UHR criteria are described and discussed with reference to the rates of transition to psychosis, their prevalence in the general population and the proposed new operationalization of the attenuated psychosis syndrome. Results: A comparison of samples recruited according to different UHR operationalizations reveals differences in the distribution of UHR criteria and transition rates as well as in the prevalence rates of at-risk criteria in the general population. Conclusion: The evidence base for the introduction of such a new syndrome is weaker than the number of studies using supposedly equal UHR criteria would at first suggest. Thus, studies comparing the effects of different (sub-)criteria not only on transition rates and outcomes but also on other important aspects, such as neurocognitive performance and brain imaging results, are necessary. Meanwhile, the preliminary attenuated psychosis syndrome in DSM-5 should not follow an altogether new definition but, rather, the currently most reliable UHR definition, which must still demonstrate its reliability and validity outside specialized psychiatric services.

Measuring finger joint cartilage by ultrasound as a promising alternative to conventional radiograph imaging

OBJECTIVE: To evaluate the reliability and validity of a novel ultrasound (US) imaging method to measure metacarpophalangeal (MCP) and proximal interphalangeal (PIP) finger joint cartilage. METHODS: We examined 48 patients with rheumatoid arthritis (RA), 18 patients with osteoarthritis (OA), 24 patients with unclassified arthritis of the finger joints, and 34 healthy volunteers. The proximal cartilage layer of MCP and PIP joints for fingers 2-5 was bilaterally visualized from a posterior view, with joints in approximately 90 degrees flexion. Cartilage thickness was measured with integrated tools on static images. External validity was assessed by measuring radiologic joint space width (JSW) and a numeric joint space narrowing (JSN) score in patients with RA. RESULTS: Precise measurement was possible for 97.5% of MCP and 94.2% of PIP joints. Intraclass correlation coefficients for bilateral total joint US scores were 0.844 (95% confidence interval [95% CI] 0.648-0.935) for interobserver comparisons and 0.928 (95% CI 0.826-0.971) for intraobserver comparisons (using different US devices). The US score correlated with JSN for both hands (adjusted R(2) = 0.513, P < 0.001) and JSW of the same finger joints (adjusted R(2) = 0.635, P < 0.001). Reduced cartilage shown by US allowed discrimination of early symptomatic OA versus early RA and healthy joints. In patients with RA, US scores correlated with duration of treatment-resistant, progressive RA. CONCLUSION: The US method of direct visualization and quantification of cartilage in MCP and PIP joints is objective, reliable, valid, and can be useful for diagnostic purposes in patients with arthritis.

Measuring mindfulness: first steps towards the development of a comprehensive mindfulness scale

The present study describes the development of and results obtained from the first version of a new mindfulness scale: the Comprehensive Inventory of Mindfulness Experiences beta (CHIME-β). The aim of the present analysis was to investigate two relevant open questions in mindfulness assessment: (1) the coverage of aspects of mindfulness and (2) the type of interrelationships among these aspects. A review of the aspects of mindfulness assessed by eight currently available mindfulness questionnaires led to the identification of nine aspects of mindfulness. The CHIME-β was constructed in order to cover each of these aspects in a balanced way. Initially, principal component and confirmatory factor analyses, as well as reliability and validity analyses, were performed in the entire sample (n = 313) of individuals from the general population and mindfulness-based stress reduction (MBSR) groups. The factor structure that emerged from this analysis was further investigated in meditation-trained individuals (n = 144) who had just completed an MBSR intervention. Results suggested a four-factor structure underlying the nine aspects proposed. The relationship between these mindfulness factors appears to be influenced by the degree of meditation experience. In fact, the mindfulness factors showed a greater interconnectedness among mediation-trained participants. Finally, data suggest that a non-avoidant stance plays a central role in mindfulness, while the capacity to put inner experiences into words may be related to mindfulness rather than a component of the construct.

Konstruktion und erste Validierung eines Fragebogens zur umfassenden Erfassung von Achtsamkeit: Das Comprehensive Inventory of Mindfulness Experiences

In der vorliegenden Arbeit werden Entwicklung und Validierung eines Fragebogens zur umfassenden Erfassung der Achtsamkeit, des Comprehensive Inventory of Mindfulness Experiences (CHIME), beschrieben. An einer Allgemeinbevölkerungs-Stichprobe (N = 298) und einer Stichprobe von TeilnehmerInnen an MBSR-Kursen (N = 161) wurde die Faktorenstruktur des CHIME ermittelt und seine Reliabilität und Validität geprüft. Faktorenanalytische Verfahren ergaben eine achtfaktorielle Struktur. Die Struktur wurde in einer zusätzlichen konfirmatorischen Stichprobe (N = 202) überprüft. Der Fragebogen sowie seine Unterskalen weisen gute Reliabilitätswerte auf (interne Konsistenz und Retest-Reliabilität). Analysen zur Messinvarianz der einzelnen Items über Gruppen, die sich bezüglich Meditationserfahrung, Alter, Geschlecht und Symptombelastung unterschieden, zeigten keine systematischen Unterschiede im Verständnis der Items. Die Kennwerte zur Konstrukt-, Kriterium-, und inkrementellen Validität sowie zur Veränderungssensitivität waren alle mindestens zufriedenstellend. Mit dem CHIME steht somit ein Fragebogen mit guten psychometrischen Eigenschaften zur Selbsteinschätzung der Achtsamkeit zur Verfügung. Der CHIME basiert auf allen in den aktuellen Instrumenten enthaltenen Aspekten des Achtsamkeitskonstrukts.

Quality of life after pulmonary embolism: validation of the French version of the PEmb-QoL questionnaire.

BackgroundThe PEmb-QoL is a validated 40-item questionnaire to quantify health-related quality of life in patients having experienced pulmonary embolism (PE). It covers six health dimensions: frequency of complaints, activities of daily living limitations, work-related problems, social limitations, intensity of complaints, and emotional complaints. Originally developed in Dutch and English, we sought to prospectively validate the psychometric properties of a French version of the PEmb-QoL.MethodsWe performed a forward and backward translation of the English version of the PEmb-QoL into French. French-speaking consecutive adult patients with an acute, objectively confirmed PE admitted to the emergency department of a Swiss university hospital between 08/2009 and 09/2011 were recruited telephonically. We used standard psychometric tests and criteria to evaluate the acceptability, reliability, and validity of the French version of the PEmb-QoL. We also performed an exploratory factor analysis.ResultsOverall, 102 patients were enrolled in the study. The French version of the PEmb-QoL showed good reliability (internal consistency, item¿total and inter-item correlations), reproducibility (test-retest reliability), and validity (convergent, discriminant) in French-speaking patients with PE. The exploratory factor analysis suggested three underlying dimensions: limitations in daily activity (items 4b-m, 5a-d), symptoms (items 1a-h and 7), and emotional complaints (items 9a-f and j).ConclusionWe successfully validated the French version of the PEmb-QoL questionnaire in patients with PE. Our results show that the PEmb-QoL is a valuable tool for assessing health-related quality of life after PE in French-speaking patients.

Messung dispositioneller Selbstkontroll-Kapazität: Eine deutsche Adaptation der Kurzform der Self-Control Scale (SCS-K-D)

Self-control is defined as the overriding or modification of one’s own response tendencies. Dispositional self control capacity is positively linked to various kinds of adaptive behavior. In order to economically measure self-control capacity in German-speaking samples, the brief version of the Self-Control Scale by Tangney, Baumeister and Boone (2004) was adapted into German. The translated entire Self-Control Scale consisting of 36 items was administered to university students (N = 316, study 1) and secondary school students (N = 335, study 2). The brief version consisting of 13 items, which were included in the entire scale, proved to be one-dimensional, reliable, and valid in terms of expected correlations with criteria. The comparison between the brief and the entire scale showed that the costs of the more economical brief measure with regard to reliability and validity are low.

Quality Control for SP Performance Regarding Patient Portrayal in a High-Stakes OSCE

Introduction Since the quality of patient portrayal of standardized patients (SPs) during an Objective Structured Clinical Exam (OSCE) has a major impact on the reliability and validity of the exam, quality control should be initiated. Literature about quality control of SP’s performance focuses on feedback [1, 2] or completion of checklists [3, 4]. Since we did not find a published instrument meeting our needs for the assessment of patient portrayal, we developed such an instrument after being inspired by others [5] and used it in our high-stakes exam. Methods SP trainers from all five Swiss medical faculties collected and prioritized quality criteria for patient portrayal. Items were revised with the partners twice, based on experiences during OSCEs. The final instrument contains 14 criteria for acting (i.e. adequate verbal and non-verbal expression) and standardization (i.e. verbatim delivery of the first sentence). All partners used the instrument during a high-stakes OSCE. Both, SPs and trainers were introduced to the instrument. The tool was used in training (more than 100 observations) and during the exam (more than 250 observations). FAIR_OSCE The list of items to assess the quality of the simulation by SPs was primarily developed and used to provide formative feedback to the SPs in order to help them to improve their performance. It was therefore named “Feedbackstruckture for the Assessment of Interactive Role play in Objective Structured Clinical Exams (FAIR_OSCE). It was also used to assess the quality of patient portrayal during the exam. The results were calculated for each of the five faculties individually. Formative evaluation was given to the five faculties with individual feedback without revealing results of other faculties other than overall results. Results High quality of patient portrayal during the exam was documented. More than 90% of SP performances were rated to be completely correct or sufficient. An increase in quality of performance between training and exam was noted. In example the rate of completely correct reaction in medical tests increased from 88% to 95%. 95% completely correct reactions together with 4% sufficient reactions add up to 99% of the reactions meeting the requirements of the exam. SP educators using the instrument reported an augmentation of SPs performance induced by the use of the instrument. Disadvantages mentioned were high concentration needed to explicitly observe all criteria and cumbersome handling of the paper-based forms. Conclusion We were able to document a very high quality of SP performance in our exam. The data also indicate that our training is effective. We believe that the high concentration needed using the instrument is well invested, considering the observed augmentation of performance. The development of an iPad based application for the form is planned to address the cumbersome handling of the paper.

FAIR_OSCE – Feedback structure for assessment of interactive roleplay in Objective Structured Clinical Exams

Introduction Since the quality of patient portrayal of standardized patients (SPs) during an Objective Structured Clinical Exam (OSCE) has a major impact on the reliability and validity of the exam, quality control should be initiated. Literature about quality control of SPs’ performance focuses on feedback [1, 2] or completion of checklists [3, 4]. Since we did not find a published instrument meeting our needs for the assessment of patient portrayal, we developed such an instrument after being inspired by others [5] and used it in our high-stakes exam. Project description SP trainers from five medical faculties collected and prioritized quality criteria for patient portrayal. Items were revised twice, based on experiences during OSCEs. The final instrument contains 14 criteria for acting (i.e. adequate verbal and non-verbal expression) and standardization (i.e. verbatim delivery of the first sentence). All partners used the instrument during a high-stakes OSCE. SPs and trainers were introduced to the instrument. The tool was used in training (more than 100 observations) and during the exam (more than 250 observations). Outcome High quality of SPs’ patient portrayal during the exam was documented. More than 90% of SP performances were rated to be completely correct or sufficient. An increase in quality of performance between training and exam was noted. For example, the rate of completely correct reaction in medical tests increased from 88% to 95%. Together with 4% of sufficient performances these 95% add up to 99% of the reactions in medical tests meeting the standards of the exam. SP educators using the instrument reported an augmentation of SPs’ performance induced by the use of the instrument. Disadvantages mentioned were the high concentration needed to observe all criteria and the cumbersome handling of the paper-based forms. Discussion We were able to document a very high quality of SP performance in our exam. The data also indicates that our training is effective. We believe that the high concentration needed using the instrument is well invested, considering the observed enhancement of performance. The development of an iPad-based application for the form is planned to address the cumbersome handling of the paper.

Quality of life after pulmonary embolism: Prospective validation of the German version of the PEmb-QoL questionnaire.

BACKGROUND The Pulmonary Embolism Quality of Life questionnaire (PEmb-QoL) is a 40-item questionnaire to measure health-related quality of life in patients with pulmonary embolism. It covers six 6 dimensions: frequency of complaints, limitations in activities of daily living, work-related problems, social limitations, intensity of complaints, and emotional complaints. Originally developed in Dutch and English, we prospectively validated a German version of the PEmb-QoL. METHODS A forward-backward translation of the English version of the PEmb-QoL into German was performed. German-speaking consecutive adult patients aged ≥18 years with an acute, objectively confirmed pulmonary embolism discharged from a Swiss university hospital (01/2011-06/2013) were recruited telephonically. Established psychometric tests and criteria were used to evaluate the acceptability, reliability, and validity of the German PEmb-QoL questionnaire. To assess the underlying dimensions, an exploratory factor analysis was performed. RESULTS Overall, 102 patients were enrolled in the study. The German version of the PEmb-QoL showed a good internal consistency (Cronbach's alpha ranging from 0.72 to 0.96), item-total (0.53-0.95) and inter-item correlations (>0.4), and test-retest reliability (intra-class correlation coefficients 0.59-0.89) for the dimension scores. A moderate correlation of the PEmb-QoL with SF-36 dimension and summary scores (0.21-0.83) indicated convergent validity, while low correlations of PEmb-QoL dimensions with clinical characteristics (-0.16-0.37) supported discriminant validity. The exploratory factor analysis suggested four underlying dimensions: limitations in daily activities, symptoms, work-related problems, and emotional complaints. CONCLUSION The German version of the PEmb-QoL questionnaire is a valid and reliable disease-specific measure for quality of life in patients with pulmonary embolism.

Measuring health state preferences for hemophilia: Development of a disease-specific utility instrument

Research has shown that disease-specific health related quality of life (HRQoL) instruments are more responsive than generic instruments to particular disease conditions. However, only a few studies have used disease-specific instruments to measure HRQoL in hemophilia. The goal of this project was to develop a disease-specific utility instrument that measures patient preferences for various hemophilia health states. The visual analog scale (VAS), a ranking method, and the standard gamble (SG), a choice-based method incorporating risk, were used to measure patient preferences. Study participants (n = 128) were recruited from the UT/Gulf States Hemophilia and Thrombophilia Center and stratified by age: 0–18 years and 19+. ^ Test retest reliability was demonstrated for both VAS and SG instruments: overall within-subject correlation coefficients were 0.91 and 0.79, respectively. Results showed statistically significant differences in responses between pediatric and adult participants when using the SG (p = .045). However, no significant differences were shown between these groups when using the VAS (p = .636). When responses to VAS and SG instruments were compared, statistically significant differences in both pediatric (p < .0001) and adult (p < .0001) groups were observed. Data from this study also demonstrated that persons with hemophilia with varying severity of disease, as well as those who were HIV infected, were able to evaluate a range of health states for hemophilia. This has important implications for the study of quality of life in hemophilia and the development of disease-specific HRQoL instruments. ^ The utility measures obtained from this study can be applied in economic evaluations that analyze the cost/utility of alternative hemophilia treatments. Results derived from the SG indicate that age can influence patients' preferences regarding their state of health. This may have implications for considering treatment options based on the mean age of the population under consideration. Although both instruments independently demonstrated reliability and validity, results indicate that the two measures may not be interchangeable. ^

The coordinated approach to child health in underserved population (CATCH UP) curriculum: A quantitative evaluation of an innovative preschool obesity prevention program

Obesity has been on the rise in the United States over the last 30 years for all populations, including preschoolers. The purpose of the project was to develop an observation tool to measure physical activity levels in preschool children and use the tool in a pilot test of the CATCH UP curriculum at two Head Start Centers in Houston. Pretest and posttest interobserver agreements were all above 0.60 for physical activity level and physical activity type. Preschoolers spent the majority of their time in light physical activity (75.33% pretest, 87.77% posttest), and spent little time in moderate to vigorous physical activity (MVPA) (24.67% pretest, 12.23% posttest). Percent time spent in MVPA decreased significantly pretest to posttest from (F=5.738, p=0.043). While the pilot testing of the CATCH UP curriculum did not show an increase in MVPA, the SOFIT-P tool did show promising results as being a new method for collecting physical activity level data for preschoolers. Once the new tool has undergone more reliability and validity testing, it could allow for a more convenient method of collecting physical activity levels for preschoolers. ^

Health status of Saudi women, the case of Yanbu al-Sinaiya

Detailed data on the health status of Saudi women are lacking. This cross sectional study attempts to provide a comprehensive description of the health status of Saudi females between the ages of 15-45 residing in Yanbu Al-Siniyah. The purpose is to assess women's needs for health services. The health status indicators are chronic tracer conditions, reported symptoms and multidimensional functioning levels. The generic functioning instrument of the Medical Outcome Study was used to estimate physical, social, and role functioning; degree of pain and health perceptions. The information was obtained by interviewing subjects and abstracting facts from their medical records. The results show functioning scores are in the "well health" range for physical, social, role and pain. Crowding and education have an equal or stronger effect of reducing functioning levels than the diagnosed tracer conditions. The highest prevalence conditions having a definite functional impact and diagnosed adequately in primary care are anemia, urinary tract infection, hemorrhoids, rheumatoid arthritis, caries and gingivitis. Reported symptoms strongly reducing function levels in this study are dyspnea, heart pain, incontinence, eye and skin problems, and joint ache. The impact of the reliability and validity of the measures used and other limitations of the results are discussed. Finally, some policy implications and suggestions for future study are presented. ^

A multi-site pilot test study to measure safety climate in the university work setting

Next to leisure, sport, and household activities, the most common activity resulting in medically consulted injuries and poisonings in the United States is work, with an estimated 4 million workplace related episodes reported in 2008 (U.S. Department of Health and Human Services, 2009). To address the risks inherent to various occupations, risk management programs are typically put in place that include worker training, engineering controls, and personal protective equipment. Recent studies have shown that such interventions alone are insufficient to adequately manage workplace risks, and that the climate in which the workers and safety program exist (known as the "safety climate") is an equally important consideration. The organizational safety climate is so important that many studies have focused on developing means of measuring it in various work settings. While safety climate studies have been reported for several industrial settings, published studies on assessing safety climate in the university work setting are largely absent. Universities are particularly unique workplaces because of the potential exposure to a diversity of agents representing both acute and chronic risks. Universities are also unique because readily detectable health and safety outcomes are relatively rare. The ability to measure safety climate in a work setting with rarely observed systemic outcome measures could serve as a powerful means of measure for the evaluation of safety risk management programs. ^ The goal of this research study was the development of a survey tool to measure safety climate specifically in the university work setting. The use of a standardized tool also allows for comparisons among universities throughout the United States. A specific study objective was accomplished to quantitatively assess safety climate at five universities across the United States. At five universities, 971 participants completed an online questionnaire to measure the safety climate. The average safety climate score across the five universities was 3.92 on a scale of 1 to 5, with 5 indicating very high perceptions of safety at these universities. The two lowest overall dimensions of university safety climate were "acknowledgement of safety performance" and "department and supervisor's safety commitment". The results underscore how the perception of safety climate is significantly influenced at the local level. A second study objective regarding evaluating the reliability and validity of the safety climate questionnaire was accomplished. A third objective fulfilled was to provide executive summaries resulting from the questionnaire to the participating universities' health & safety professionals and collect feedback on usefulness, relevance and perceived accuracy. Overall, the professionals found the survey and results to be very useful, relevant and accurate. Finally, the safety climate questionnaire will be offered to other universities for benchmarking purposes at the annual meeting of a nationally recognized university health and safety organization. The ultimate goal of the project was accomplished and was the creation of a standardized tool that can be used for measuring safety climate in the university work setting and can facilitate meaningful comparisons amongst institutions.^

Assessment of transferable competences in computing

The European Credit Transfer and Accumulation System (ECTS) is the credit system for higher education used in the European Higher Education Area (EHEA), which involves all the countries engaged in the Bologna Process. This paper describes a study which is part of the project of the Bologna Experts Team-Spain and was carried out with the following aims: 1) designing some procedures for the assessment of transferable competences; and 2) testing some basic psychometric features that an assessment device with some consequences for the subjects being evaluated needs to prove. We will focus on the degrees of Computing. The sample of students (20) includes first year students from the Technical University of Madrid. In this paper, we will report some results of data analyses carried out to this moment on reliability and validity of the task designed to measure problem solving.