Validity evidence and reliability of a Simulated Patient Feedback Instrument

In the training of healthcare professionals, one of the advantages of communication training with simulated patients (SPs) is the SP's ability to provide direct feedback to students after a simulated clinical encounter. The quality of SP feedback must be monitored, especially because it is well known that feedback can have a profound effect on student performance. Due to the current lack of valid and reliable instruments to assess the quality of SP feedback, our study examined the validity and reliability of one potential instrument, the 'modified Quality of Simulated Patient Feedback Form' (mQSF). Methods Content validity of the mQSF was assessed by inviting experts in the area of simulated clinical encounters to rate the importance of the mQSF items. Moreover, generalizability theory was used to examine the reliability of the mQSF. Our data came from videotapes of clinical encounters between six simulated patients and six students and the ensuing feedback from the SPs to the students. Ten faculty members judged the SP feedback according to the items on the mQSF. Three weeks later, this procedure was repeated with the same faculty members and recordings. Results All but two items of the mQSF received importance ratings of > 2.5 on a four-point rating scale. A generalizability coefficient of 0.77 was established with two judges observing one encounter. Conclusions The findings for content validity and reliability with two judges suggest that the mQSF is a valid and reliable instrument to assess the quality of feedback provided by simulated patients.

Psychometric properties of the MacNew heart disease health-related quality of life instrument in patients with heart failure

RATIONALE, AIMS AND OBJECTIVES: Heart failure (HF) is a severe chronic disease and impairs health-related quality of life (HRQL). While validated specific HRQL instruments are required for evaluation of treatment and rehabilitation in patients with HF, a single validated measure to document changes in HRQL for patients with different heart disease diagnoses would be invaluable. The purpose of this analysis was the psychometric analysis of the German MacNew Heart Disease Questionnaire (MacNew) in HF patients, which has previously been shown to be reliable and valid in patients with myocardial infarction, angina pectoris and arrhythmia. METHODS: We recruited 89 patients (61.7+/-11.5 years; 84.3% male) in two Austrian and one Swiss cardiology department with documented HF (effect sizes 28.9+/-10.1%). The self-administered MacNew, the Short Form-36 (SF-36) and the Hospital Anxiety and Depression Scale were completed. Internal consistency reliability (Cronbach's alpha), discriminative and evaluative validity were assessed. RESULTS: Cronbach's alpha exceeded 0.80. Each MacNew scale differentiated between patients with and without anxiety (3.9+/-1.0 vs. 5.3+/-0.8, all P<0.001), with and without depression (4.2+/-1.2 vs. 5.2+/-0.9 all P<0.03) and by the SF-36 health transition item (deteriorate=4.39, no change=4.95, improve=5.45, all P<0.02). Evaluative validity was demonstrated with effect sizes >0.70 for a subsample attending a 12-week outpatient rehabilitation programme. CONCLUSIONS: The German language version of the MacNew demonstrates consistently acceptable psychometric properties of reliability, validity and responsiveness in patients with documented HF. Together with previous documentation of reliability, validity and responsive, these findings strengthen the argument for the MacNew as a potential 'core' HRQL measure, at least in the German language.

Content comparison of health-related quality of life instruments for obstructive sleep apnea

BACKGROUND AND PURPOSE: Due to the increasing importance of quality of life assessments in obstructive sleep apnea (OSA) patients and due to an increased use of the International Classification of Functioning, Disability and Health (ICF), for comparative purposes it is essential to understand the relationship between health-related quality of life (HRQOL) instruments and the ICF. The purpose of this study was to compare the content covered by OSA-specific instruments using the ICF. PATIENTS AND METHODS: OSA-specific instruments were identified, including the Calgary Sleep Apnea Quality of Life Index, the Functional Outcomes of Sleep Questionnaire, the Obstructive Sleep Apnea Patient-Oriented Severity Index, and the Quebec Sleep Questionnaire, and linked to the ICF by six health professionals according to standardized guidelines. The degree of agreement between health professionals was calculated by means of the kappa statistic. RESULTS: A total of 308 concepts were identified and linked to 78 different ICF categories; 35 categories of the component body function, one category of the component body structure, 38 categories of the component activities and participation, and four categories of the component environmental factors. Only contents within the chapters mental functions, mobility and social life were addressed by all instruments. Forty-seven categories were covered by only one instrument. CONCLUSION: The ICF proved highly useful for the comparison of HRQOL instruments. This analysis may help researchers and clinicians to choose the most appropriate HRQOL instrument for a specific purpose as well as help to compare study outcomes of studies using different instruments for HRQOL assessment.

Self-Reported Capabilities Among Young Male Adults in Switzerland: Translation and Psychometric Evaluation of a German, French and Italian Version of a Closed Survey Instrument

There is a shortage of empirical applications of the capability approach that employ closed survey instruments to assess self-reported capabilities. However, for those few instruments that have been designed and administered through surveys until now, no psychometric properties (reliability, validity, and factor structure) were reported. The purpose of this study is the assessment of the psychometric properties of three new language versions (German, French, and Italian) of an established (English) set of eight self-reported capability items. The set of items is taken from a previously published British study by Anand and van Hees (J Soc Econ 35(2):268–284, 2006). Our sample consists of 17,152 young male adults aged 18–25 years from the three major language regions in Switzerland. The results indicate good reliability of the three language versions. The results from the exploratory factor analyses suggest a one-dimensional factor structure for seven domain specific items. Furthermore, the results from multiple regression analyses suggest that a global summary item on overall capabilities represents a measurement alternative to the set of seven domain specific capability items. Finally, the results confirm the applicability of the closed capability instrument in a large scale survey questionnaire and represent the first attempt to measure self-reported capabilities in Switzerland.

Entwicklung eines Screening-Instruments zu Rumination und Suppression RS-8

Rumination und Suppression sind 2 maladaptive Emotionsregulationsstrategien, die im Zusammenhang mit pathologischem Verhalten wie übermäßigem Essen oder Trinken stehen. Ein Messinstrument, welches beide Strategien in Kurzform erfasst, fehlt bisher. Der RS-8 erfasst mit 8 Items die beiden Dimensionen Rumination und Suppression. Anhand von 2 klinischen (Patienten mit Alkoholabhängigkeit [n = 79], Patienten mit Adipositas [n = 53]) und einer nichtklinischen Stichprobe (n = 133) wurde die psychometrische Qualität der Skala überprüft. Die Ergebnisse zeigen, dass der RS-8 ein valides und reliables Messinstrument ist. Die interne Konsistenz kann als gut und die faktorielle Validität als sehr gut bewertet werden. Der RS-8 ist ein ökonomisches Screening-Instrument, welches bei klinischen und nicht-klinischen Stichproben eingesetzt werden kann.

Development of a documentation instrument for the conservative treatment of spinal disorders in the International Spine Registry, Spine Tango

Spine Tango is the first and only International Spine Registry in operation to date. So far, only surgical spinal interventions have been recorded and no comparable structured and comprehensive documentation instrument for conservative treatments of spinal disorders is available. This study reports on the development of a documentation instrument for the conservative treatment of spinal disorders by using the Delphi consensus method. It was conducted with a group of international experts in the field. We also assessed the usability of this new assessment tool with a prospective feasibility study on 97 outpatients and inpatients with low back or neck pain undergoing conservative treatment. The new 'Spine Tango conservative' questionnaire proved useful and suitable for the documentation of pathologies, conservative treatments and outcomes of patients with low back or neck problems. A follow-up questionnaire seemed less important in the predominantly outpatient setting. In the feasibility study, between 43 and 63% of patients reached the minimal clinically important difference in pain relief and Core Outcome Measures Index at 3 months after therapy; 87% of patients with back pain and 85% with neck pain were satisfied with the received treatment. With 'Spine Tango conservative' a first step has been taken to develop and implement a complementary system for documentation and evaluation of non-surgical spinal interventions and outcomes within the framework of the International Spine Registry. It proved useful and feasible in a first pilot study, but it will take the experience of many more cases and therapists to develop a version similarly mature as the surgical instruments of Spine Tango.

Measurement issues in trials of pediatric acute diarrheal diseases: a systematic review

BACKGROUND: Worldwide, diarrheal diseases rank second among conditions that afflict children. Despite the disease burden, there is limited consensus on how to define and measure pediatric acute diarrhea in trials. OBJECTIVES: In RCTs of children involving acute diarrhea as the primary outcome, we documented (1) how acute diarrhea and its resolution were defined, (2) all primary outcomes, (3) the psychometric properties of instruments used to measure acute diarrhea and (4) the methodologic quality of included trials, as reported. METHODS: We searched CENTRAL, Embase, Global Health, and Medline from inception to February 2009. English-language RCTs of children younger than 19 years that measured acute diarrhea as a primary outcome were chosen. RESULTS: We identified 138 RCTs reporting on 1 or more primary outcomes related to pediatric acute diarrhea/diseases. Included trials used 64 unique definitions of diarrhea, 69 unique definitions of diarrhea resolution, and 46 unique primary outcomes. The majority of included trials evaluated short-term clinical disease activity (incidence and duration of diarrhea), laboratory outcomes, or a composite of these end points. Thirty-two trials used instruments (eg, single and multidomain scoring systems) to support assessment of disease activity. Of these, 3 trials stated that their instrument was valid; however, none of the trials (or their citations) reported evidence of this validity. The overall methodologic quality of included trials was good. CONCLUSIONS: Even in what would be considered methodologically sound clinical trials, definitions of diarrhea, primary outcomes, and instruments employed in RCTs of pediatric acute diarrhea are heterogeneous, lack evidence of validity, and focus on indices that may not be important to participants.

Improving cup positioning using a mechanical navigation instrument

Although surgical navigation reduces the rate of malpositioned acetabular cups in total hip arthroplasty (THA), its use has not been widely adopted. As a result of our perceived need for simple and efficient methods of navigation, we developed a mechanical navigation device for acetabular cup orientation.

Quality evaluation of tandem mass spectral libraries

Tandem mass spectral libraries are gaining more and more importance for the identification of unknowns in different fields of research, including metabolomics, forensics, toxicology, and environmental analysis. Particularly, the recent invention of reliable, robust, and transferable libraries has increased the general acceptance of these tools. Herein, we report on results obtained from thorough evaluation of the match reliabilities of two tandem mass spectral libraries: the MSforID library established by the Oberacher group in Innsbruck and the Weinmann library established by the Weinmann group in Freiburg. Three different experiments were performed: (1) Spectra of the libraries were searched against their corresponding library after excluding either this single compound-specific spectrum or all compound-specific spectra prior to searching; (2) the libraries were searched against each other using either library as reference set or sample set; (3) spectra acquired on different mass spectrometric instruments were matched to both libraries. Almost 13,000 tandem mass spectra were included in this study. The MSforID search algorithm was used for spectral matching. Statistical evaluation of the library search results revealed that principally both libraries enable the sensitive and specific identification of compounds. Due to higher mass accuracy of the QqTOF compared with the QTrap instrument, matches to the MSforID library were more reliable when comparing spectra with both libraries. Furthermore, only the MSforID library was shown to be efficiently transferable to different kinds of tandem mass spectrometers, including "tandem-in-time" instruments; this is due to the coverage of a large range of different collision energy settings-including the very low range-which is an outstanding characteristics of the MSforID library.

Characterisation and optimisation of the new Prompt Gamma-ray Activation Analysis (PGAA) facility at FRM II

At the research reactor Forschungs-Neutronenquelle Heinz Maier-Leibnitz (FRM II) a new Prompt Gamma-ray Activation Analysis (PGAA) facility was installed. The instrument was originally built and operating at the spallation source at the Paul Scherrer Institute in Switzerland. After a careful re-design in 2004–2006, the new PGAA instrument was ready for operation at FRM II. In this paper the main characteristics and the current operation conditions of the facility are described. The neutron flux at the sample position can reach up 6.07×1010 [cm−2 s−1], thus the optimisation of some parameters, e.g. the beam background, was necessary in order to achieve a satisfactory analytical sensitivity for routine measurements. Once the optimal conditions were reached, detection limits and sensitivities for some elements, like for example H, B, C, Si, or Pb, were calculated and compared with other PGAA facilities. A standard reference material was also measured in order to show the reliability of the analysis under different conditions at this instrument.

First middle-atmospheric zonal wind profile measurements with a new ground-based microwave Doppler-spectro-radiometer

We report on the wind radiometer WIRA, a new ground-based microwave Doppler-spectro-radiometer specifically designed for the measurement of middle-atmospheric horizontal wind by observing ozone emission spectra at 142.17504 GHz. Currently, wind speeds in five levels between 30 and 79 km can be retrieved which makes WIRA the first instrument able to continuously measure horizontal wind in this altitude range. For an integration time of one day the measurement error on each level lies at around 25 m s−1. With a planned upgrade this value is expected to be reduced by a factor of 2 in the near future. On the altitude levels where our measurement can be compared to wind data from the European Centre for Medium-Range Weather Forecasts (ECMWF) very good agreement in the long-term statistics as well as in short time structures with a duration of a few days has been found. WIRA uses a passive double sideband heterodyne receiver together with a digital Fourier transform spectrometer for the data acquisition. A big advantage of the radiometric approach is that such instruments can also operate under adverse weather conditions and thus provide a continuous time series for the given location. The optics enables the instrument to scan a wide range of azimuth angles including the directions east, west, north, and south for zonal and meridional wind measurements. The design of the radiometer is fairly compact and its calibration does not rely on liquid nitrogen which makes it transportable and suitable for campaign use. WIRA is conceived in a way that it can be operated remotely and does hardly require any maintenance. In the present paper, a description of the instrument is given, and the techniques used for the wind retrieval based on the determination of the Doppler shift of the measured atmospheric ozone emission spectra are outlined. Their reliability was tested using Monte Carlo simulations. Finally, a time series of 11 months of zonal wind measurements over Bern (46°57′ N, 7°26′ E) is presented and compared to ECMWF wind data.