Basic life support teaching in the second year pregraduate medical curriculum: quality of acquisition after 6 months

Purpose of the study: Basic life support (BLS) and automated externaldefibrillation (AED) represent important skills to be acquired duringpregraduate medical training. Since 3 years, our medical school hasintroduced a BLS-AED course (with certification) for all second yearmedical students. Few reports about quality and persistence over timeof BLS-AED learning are available to date in the medical literature.Comprehensive evaluation of students' acquired skills was performedat the end of the 2008 academic year, 6 month after certification.Materials and methods: The students (N = 142) were evaluated duringa 9 minutes «objective structured clinical examination» (OSCE) station.Out of a standardized scenario, they had to recognize a cardiac arrestsituation and start a resuscitation process. Their performance wererecorded on a PC using an Ambuman(TM) mannequin and the AmbuCPR software kit(TM) during a minimum of 8 cycles (30 compressions:2 ventilations each). BLS parameters were systematically checked. Nostudent-rater interactions were allowed during the whole evaluation.Results: Response of the victim was checked by 99% of the students(N = 140), 96% (N = 136) called for an ambulance and/or an AED. Openthe airway and check breathing were done by 96% (N = 137), 92% (N =132) gave 2 rescue breaths. Pulse was checked by 95% (N=135), 100%(N = 142) begun chest compression, 96% (N = 136) within 1 minute.Chest compression rate was 101 ± 18 per minute (mean ± SD), depthcompression 43 ± 8 mm, 97% (N = 138) respected a compressionventilationratio of 30:2.Conclusions: Quality of BLS skills acquisition is maintained during a6-month period after a BLS-AED certification. Main targets of 2005 AHAguidelines were well respected. This analysis represents one of thelargest evaluations of specific BLS teaching efficiency reported. Furtherfollow-up is needed to control the persistence of these skills during alonger time period and noteworthy at the end of the pregraduatemedical curriculum.

Training effects with the observer-rated cognitive errors and the coping action patterns scales

The use of observer-rated scales requires that raters be trained until they have become reliable in using the scales. However, few studies properly report how training in using a given rating scale is conducted or indeed how it should be conducted. This study examined progress in interrater reliability over 6 months of training with two observer-rated scales, the Cognitive Errors Rating Scale and the Coping Action Patterns Rating Scale. The evolution of the intraclass correlation coefficients was modeled using hierarchical linear modeling. Results showed an overall training effect as well as effects of the basic training phase and of the rater calibration phase, the latter being smaller than the former. The results are discussed in terms of implications for rater training in psychotherapy research.

Protocol of the COSMIN study: consensus-based standards for the selection of health measurement instruments

Background: Choosing an adequate measurement instrument depends on the proposed use of the instrument, the concept to be measured, the measurement properties (e.g. internal consistency, reproducibility, content and construct validity, responsiveness, and interpretability), the requirements, the burden for subjects, and costs of the available instruments. As far as measurement properties are concerned, there are no sufficiently specific standards for the evaluation of measurement properties of instruments to measure health status, and also no explicit criteria for what constitutes good measurement properties. In this paper we describe the protocol for the COSMIN study, the objective of which is to develop a checklist that contains COnsensus-based Standards for the selection of health Measurement INstruments, including explicit criteria for satisfying these standards. We will focus on evaluative health related patient-reported outcomes (HR-PROs), i.e. patient-reported health measurement instruments used in a longitudinal design as an outcome measure, excluding health care related PROs, such as satisfaction with care or adherence. The COSMIN standards will be made available in the form of an easily applicable checklist.Method: An international Delphi study will be performed to reach consensus on which and how measurement properties should be assessed, and on criteria for good measurement properties. Two sources of input will be used for the Delphi study: (1) a systematic review of properties, standards and criteria of measurement properties found in systematic reviews of measurement instruments, and (2) an additional literature search of methodological articles presenting a comprehensive checklist of standards and criteria. The Delphi study will consist of four (written) Delphi rounds, with approximately 30 expert panel members with different backgrounds in clinical medicine, biostatistics, psychology, and epidemiology. The final checklist will subsequently be field-tested by assessing the inter-rater reproducibility of the checklist.Discussion: Since the study will mainly be anonymous, problems that are commonly encountered in face-to-face group meetings, such as the dominance of certain persons in the communication process, will be avoided. By performing a Delphi study and involving many experts, the likelihood that the checklist will have sufficient credibility to be accepted and implemented will increase.

Teaching motivational interviewing to medical students : a pre-post test pilot study

Objective: To test the efficacy of teaching motivational interviewing (MI) to medical students. Methods: Thirteen 4th year medical students volunteered to participate. Seven days before and 7 days after an 8-hour interactive training MI workshop, each student performed a videorecorded interview with two standardized patients: a 60 year old alcohol dependent woman and a 50 year old cigarette smoking man. Students' counseling skills were coded by two blinded clinicians using the Motivational Interviewing Treatment Integrity 3.0 (MITI). Inter-rater reliability was calculated for all interviews and a test-retest was completed in a sub-sample of 10 consecutive interviews three days apart. Difference between MITI scores before and after training were calculated and tested using non-parametric tests. Effect size was approximated by calculating the probability that posttest scores are greater than pretest scores (P*=P(Pre<Post)+1/2P(Pre=Post)), P*>1/2 indicating greater scores in posttest, P*=1/2 no effect, and P*<1/2 smaller scores in posttest. Results: Median differences between MITI scores before and after MI training indicated a general progression in MI skills: MI spirit global score (median difference=1.5, Inter quartile range=1.5, p<0.001, P*=0.90); Empathy global score (med diff=1, IQR=0.5, p<0.001, P*=0.85); Percentage of MI adherent skills (med diff=36.6, IQR=50.5, p<0.001, P*=0.85); Percentage of open questions (med diff=18.6, IQR=21.6, p<0.001, P*=0.96); reflections/ questions ratio (med diff=0.2, IQR=0.4, p<0.001, P*=0.81). Only Direction global score and the percentage of complex reflections were not significantly improved (med diff=0, IQR=1, p=0.53, P*=0.44, and med diff=4.3, IQR=24.8, p=0.48, P*=0.62, respectively). Inter-rater reliability indicated weighted kappa ranged between 0.14 for Direction to 0.51 for Collaboration and ICC ranged between 0.28 for Simple reflection to 0.95 for Closed question. Test-retests indicated weighted kappa ranged between 0.27 for Direction to 0.80 for Empathy and ICC ranged between 0.87 for Complex reflection to 0.98 for Closed question. Conclusion: This pilot study indicated that an 8-hour training in MI for voluntary 4th year medical students resulted in significant improvement of MI skills. Larger sample of unselected medical students should be studied to generalize the benefit of MI training to medical students. Interrater reliability and test-retests suggested that coders' training should be intensified.

Modelos estadísticos y evaluación: tres estudios en educación

The educational system in Spain is undergoing a reorganization. At present, high-school graduates who want to enroll at a public university must take a set of examinations Pruebas de Aptitud para el Acceso a la Universidad (PAAU). A "new formula" (components, weights, type of exam,...) for university admission is been discussed. The present paper summarizes part of the research done by the author in her PhD. The context for this thesis is the evaluation of large-scale and complex systems of assessment. The main objectives were: to achieve a deep knowledge of the entire university admissions process in Spain, to discover the main sources of uncertainty and topromote empirical research in a continual improvement of the entire process. Focusing in the suitable statistical models and strategies which allow to high-light the imperfections of the system and reduce them, the paper develops, among other approaches, some applications of multilevel modeling.

Early change in defence mechanisms and coping in short-term dynamic psychotherapy: relations with symptoms and alliance.

Several patient-related variables have already been investigated as predictors of change in psychodynamic psychotherapy. Defensive functioning is one of them. However, few studies have investigated adaptational processes, encompassing defence mechanisms and coping, from an integrative or comparative viewpoint. This study includes 32 patients, mainly diagnosed with adjustment disorder and undergoing time-limited psychodynamic psychotherapy lasting up to 40 sessions, and will focus on early change in defence and coping. Observer-rater methodology was applied to the transcripts of two sessions of the first part of the psychotherapeutic process. It is assumed that the contextual-relational variable of therapeutic alliance intervenes as moderator on change in adaptational processes. Results corroborated the hypothesis, but only for coping, whereas for defences, overall functioning remained stable over the first 20 sessions of psychotherapy. These results are discussed within the framework of disentangling processes underlying adaptation, i.e., related to issues on trait and state aspects, as well as the role of the therapeutic alliance.

Algunos factores que inciden en el rendimiento y en la evaluación de los alumnos en las PAAU

The context where the university admissions exams are performed is presented and the main concerns about this exams are outlined and discussed from a statistical point of view. The paper offers an illustration of the use of random coefficient models in the study of educational data. The association between two individual scores (one internal and the other external to the school) and the effect of the school in the external exam is analized by a regression model with random intercept and fixed slope. A variance component model for the analysis of the grading process is also presented. The paper ends with an outline of the main findings and the presentation of some specific proposals to improve and control the equity of the system. Some pedagogic reflections are also included.

Monitoring the university admissions process in Spain

The examinations taken by high-school graduates in Spain and the role ofthe examination in the university admissions process are described. Thefollowing issues arising in the assessment of the process are discussed:reliability of grading, comparability of the grades and scores(equating),maintenance of standards, and compilation and use of the grading process,and their integration in the operational grading are proposed. Variousschemes for score adjustment are reviewed and feasibility of theirimplementation discussed. The advantages of pretesting of items and ofempirical checks of experts' judgements are pointed out. The paperconcludes with an outline of a planned reorganisation of the highereducation in Spain, and with a call for a comprehensive programme ofempirical research concurrent with the operation of the examination andscoring system.

Reliability of the image evaluation system PGMI

Purpose: Many countries used the PGMI (P=perfect, G=good, M=moderate, I=inadequate) classification system for assessing the quality of mammograms. Limits inherent to the subjectivity of this classification have been shown. Prior to introducing this system in Switzerland, we wanted to better understand the origin of this subjectivity in order to minimize it. Our study aimed at identifying the main determinants of the variability of the PGMI system and which criteria are the most subjected to subjectivity. Methods and Materials: A focus group composed of 2 experienced radiographers and 2 radiologists specified each PGMI criterion. Ten raters (6 radiographers and 4 radiologists) evaluated twice a panel of 40 randomly selected mammograms (20 analogic and 20 digital) according to these specified PGMI criteria. The PGMI classification was assessed and the intra- and inter-rater reliability was tested for each professional group (radiographer vs radiologist), image technology (analogic vs digital) and PGMI criterion. Results: Some 3,200 images were assessed. The intra-rater reliability appears to be weak, particularly in respect to inter-rater variability. Subjectivity appears to be largely independent of the professional group and image technology. Aspects of the PGMI classification criteria most subjected to variability were identified. Conclusion: Post-test discussions enabled to specify more precisely some criteria. This should reduce subjectivity when applying the PGMI classification system. A concomitant, important effort in training radiographers is also necessary.

Evaluation of the Adolescent Drug Abuse Diagnosis instrument in a Swiss sample of drug abusers.

OBJECTIVE: The aim of this study was to evaluate a French language version of the Adolescent Drug Abuse Diagnosis (ADAD) instrument in a Swiss sample of adolescent illicit drug and/or alcohol users. PARTICIPANTS AND SETTING: The participants in the study were 102 French-speaking adolescents aged 13-19 years who fitted the criteria of illicit drug or alcohol use (at least one substance--except tobacco--once a week during the last 3 months). They were recruited in hospitals, institutions and leisure places. Procedure. The ADAD was administered individually by trained psychologists. It was integrated into a broader protocol including alcohol and drug abuse DSM-IV diagnoses, the BDI-13 (Beck Depression Inventory), life events and treatment trajectories. RESULTS: The ADAD appears to show good inter-rater reliability; the subscales showed good internal coherence and the correlations between the composite scores and the severity ratings were moderate to high. Finally, the results confirmed good concurrent validity for three out of eight ADAD dimensions. CONCLUSIONS: The French language version of the ADAD appears to be an adequate instrument for assessing drug use and associated problems in adolescents. Despite its complexity, the instrument has acceptable validity, reliability and usefulness criteria, enabling international and transcultural comparisons.

Psychotherapeutic case conceptualization using plan analysis for bipolar affective disorder.

Valid individualized case conceptualization methodologies, such as plan analysis, are rarely used for the psychotherapeutic treatment conceptualization and planning of bipolar affective disorder (BD), even if data do exist showing that psychotherapy interventions might be enhanced by applying such analyses for treatment planning for several groups of patients. We applied plan analysis as a research tool (Caspar, 1995) to N=30 inpatients presenting BD, who were interviewed twice. Our study aimed at producing a prototypical plan structure encompassing the most relevant data from the 30 individual case conceptualizations. Special focus was given to links with emotions and coping plans. Inter-rater reliability of these plan analyses was considered sufficient. Results suggest the presence of two subtypes based on plananalytic principles: emotion control and relationship control, along with a mixed form. These subtypes are discussed with regard to inherent plananalytic conflicts, specific emotions and coping plans, as well as symptom level and type. Finally, conclusions are drawn for enhancing psychotherapeutic practice with BD patients, based on the motive-oriented therapeutic relationship.

Electroencephalography (EEG) for neurological prognostication after cardiac arrest and targeted temperature management; rationale and study design.

BACKGROUND: Electroencephalography (EEG) is widely used to assess neurological prognosis in patients who are comatose after cardiac arrest, but its value is limited by varying definitions of pathological patterns and by inter-rater variability. The American Clinical Neurophysiology Society (ACNS) has recently proposed a standardized EEG-terminology for critical care to address these limitations. METHODS/DESIGN: In the TTM-trial, 399 post cardiac arrest patients who remained comatose after rewarming underwent a routine EEG. The presence of clinical seizures, use of sedatives and antiepileptic drugs during the EEG-registration were prospectively documented. DISCUSSION: A well-defined terminology for interpreting post cardiac arrest EEGs is critical for the use of EEG as a prognostic tool. TRIAL REGISTRATION: The TTM-trial is registered at ClinicalTrials.gov (NCT01020916).

Observer-rated Coping Associated with Borderline Personality Disorder: An Exploratory Study.

BACKGROUND: Little is known about coping specificities, as operationalization of the concept of affect regulation, in borderline personality disorder (BPD). It is most important to take into account methodological criticisms addressed to the self-report questionnaire approach and to compare BPD coping specificities to the ones of neighbouring diagnostic categories, such as bipolar disorder (BD). SAMPLING AND METHODS: The present exploratory study compared the coping profiles of N = 25 patients presenting BPD to those of N = 25 patients presenting BD and to those of N = 25 healthy controls. All participants underwent a clinical interview that was transcribed and rated using the Coping Patterns observer-rater system. RESULTS: Results partially confirmed study hypotheses and showed differences between BPD patients and healthy controls in all coping domains (competence, resources and autonomy), whereas the only coping domain presenting a BPD-specific lack of skills, compared with the BD patients, was autonomy, a set of coping strategies facing stress appraised as challenge. These coping processes were linked to general and BPD symptomatology. CONCLUSIONS: These results extend conclusions of earlier studies on affect regulation processes in BPD and bear important clinical implications, in the context of dialectical behavior therapy and other therapeutic approaches. Limitations of this exploratory study, such as the small sample size, are acknowledged. Copyright © 2012 John Wiley & Sons, Ltd. KEY PRACTITIONER MESSAGE: Coping can be reliably assessed in the narrative process in an non-structured interview frame. Patients with borderline personality disorder present with a specific lack of skills in affect regulation related to autonomy issues, compared to patients with bipolar disorder and healthy controls. Lack of skills in accommodation to distressing emotions in borderline personality disorder is related to symptom gravity and may be treated using radical acceptance strategies.

Cognitive errors assessed by observer ratings in bipolar affective disorder: relationship with symptoms and therapeutic alliance

The construct of cognitive errors is clinically relevant for cognitive therapy of mood disorders. Beck's universality hypothesis postulates the relevance of negative cognitions in all subtypes of mood disorders, as well as positive cognitions for manic states. This hypothesis has rarely been empirically addressed for patients presenting bipolar affective disorder (BD). In-patients (n = 30) presenting with BD were interviewed, as were 30 participants of a matched control group. Valid and reliable observer-rater methodology for cognitive errors was applied to the session transcripts. Overall, patients make more cognitive errors than controls. When manic and depressive patients were compared, parts of the universality hypothesis were confirmed. Manic symptoms are related to positive and negative cognitive errors. These results are discussed with regard to the main assumptions of the cognitive model for depression; thus adding an argument for extending it to the BD diagnostic group, taking into consideration specificities in terms of cognitive errors. Clinical implications for cognitive therapy of BD are suggested.

Test-retest reliability of thermal quantitative sensory testing on two sites within the L5 dermatome of the lumbar spine and lower extremity.

INTRODUCTION: Quantitative sensory testing (QST) is widely used in human research to investigate the integrity of the sensory function in patients with pain of neuropathic origin, or other causes such as low back pain. Reliability of QST has been evaluated on both sides of the face, hands and feet as well as on the trunk (Th3-L3). In order to apply these tests on other body-parts such as the lower lumbar spine, it is important first to establish reliability on healthy individuals. The aim of this study was to investigate intra-rater reliability of thermal QST in healthy adults, on two sites within the L5 dermatome of the lumbar spine and lower extremity. METHODS: Test-retest reliability of thermal QST was determined at the L5-level of the lumbar spine and in the same dermatome on the lower extremity in 30 healthy persons under 40 years of age. Results were analyzed using descriptive statistics and intraclass correlation coefficient (ICC). Values were compared to normative data, using Z-transformation. RESULTS: Mean intraindividual differences were small for cold and warm detection thresholds but larger for pain thresholds. ICC values showed excellent reliability for warm detection and heat pain threshold, good-to-excellent reliability for cold pain threshold and fair-to-excellent reliability for cold detection threshold. ICC had large ranges of confidence interval (95%). CONCLUSION: In healthy adults, thermal QST on the lumbar spine and lower extremity demonstrated fair-to-excellent test-retest reliability.