An electronic portfolio for quantitative assessment of surgical skills in undergraduate medical education.

BACKGROUND We evaluated a newly designed electronic portfolio (e-Portfolio) that provided quantitative evaluation of surgical skills. Medical students at the University of Seville used the e-Portfolio on a voluntary basis for evaluation of their performance in undergraduate surgical subjects. METHODS Our new web-based e-Portfolio was designed to evaluate surgical practical knowledge and skills targets. Students recorded each activity on a form, attached evidence, and added their reflections. Students self-assessed their practical knowledge using qualitative criteria (yes/no), and graded their skills according to complexity (basic/advanced) and participation (observer/assistant/independent). A numerical value was assigned to each activity, and the values of all activities were summated to obtain the total score. The application automatically displayed quantitative feedback. We performed qualitative evaluation of the perceived usefulness of the e-Portfolio and quantitative evaluation of the targets achieved. RESULTS Thirty-seven of 112 students (33%) used the e-Portfolio, of which 87% reported that they understood the methodology of the portfolio. All students reported an improved understanding of their learning objectives resulting from the numerical visualization of progress, all students reported that the quantitative feedback encouraged their learning, and 79% of students felt that their teachers were more available because they were using the e-Portfolio. Only 51.3% of students reported that the reflective aspects of learning were useful. Individual students achieved a maximum of 65% of the total targets and 87% of the skills targets. The mean total score was 345 ± 38 points. For basic skills, 92% of students achieved the maximum score for participation as an independent operator, and all achieved the maximum scores for participation as an observer and assistant. For complex skills, 62% of students achieved the maximum score for participation as an independent operator, and 98% achieved the maximum scores for participation as an observer or assistant. CONCLUSIONS Medical students reported that use of an electronic portfolio that provided quantitative feedback on their progress was useful when the number and complexity of targets were appropriate, but not when the portfolio offered only formative evaluations based on reflection. Students felt that use of the e-Portfolio guided their learning process by indicating knowledge gaps to themselves and teachers.

An electronic portfolio for quantitative assessment of surgical skills in undergraduate medical education.

BACKGROUND We evaluated a newly designed electronic portfolio (e-Portfolio) that provided quantitative evaluation of surgical skills. Medical students at the University of Seville used the e-Portfolio on a voluntary basis for evaluation of their performance in undergraduate surgical subjects. METHODS Our new web-based e-Portfolio was designed to evaluate surgical practical knowledge and skills targets. Students recorded each activity on a form, attached evidence, and added their reflections. Students self-assessed their practical knowledge using qualitative criteria (yes/no), and graded their skills according to complexity (basic/advanced) and participation (observer/assistant/independent). A numerical value was assigned to each activity, and the values of all activities were summated to obtain the total score. The application automatically displayed quantitative feedback. We performed qualitative evaluation of the perceived usefulness of the e-Portfolio and quantitative evaluation of the targets achieved. RESULTS Thirty-seven of 112 students (33%) used the e-Portfolio, of which 87% reported that they understood the methodology of the portfolio. All students reported an improved understanding of their learning objectives resulting from the numerical visualization of progress, all students reported that the quantitative feedback encouraged their learning, and 79% of students felt that their teachers were more available because they were using the e-Portfolio. Only 51.3% of students reported that the reflective aspects of learning were useful. Individual students achieved a maximum of 65% of the total targets and 87% of the skills targets. The mean total score was 345 ± 38 points. For basic skills, 92% of students achieved the maximum score for participation as an independent operator, and all achieved the maximum scores for participation as an observer and assistant. For complex skills, 62% of students achieved the maximum score for participation as an independent operator, and 98% achieved the maximum scores for participation as an observer or assistant. CONCLUSIONS Medical students reported that use of an electronic portfolio that provided quantitative feedback on their progress was useful when the number and complexity of targets were appropriate, but not when the portfolio offered only formative evaluations based on reflection. Students felt that use of the e-Portfolio guided their learning process by indicating knowledge gaps to themselves and teachers.

Effectiveness of two interventions based on improving patient-practitioner communication on diabetes self-management in patients with low educational level: study protocol of a clustered randomized trial in primary care.

BACKGROUND In the last decades the presence of social inequalities in diabetes care has been observed in multiple countries, including Spain. These inequalities have been at least partially attributed to differences in diabetes self-management behaviours. Communication problems during medical consultations occur more frequently to patients with a lower educational level. The purpose of this cluster randomized trial is to determine whether an intervention implemented in a General Surgery, based in improving patient-provider communication, results in a better diabetes self-management in patients with lower educational level. A secondary objective is to assess whether telephone reinforcement enhances the effect of such intervention. We report the design and implementation of this on-going study. METHODS/DESIGN The study is being conducted in a General Practice located in a deprived neighbourhood of Granada, Spain. Diabetic patients 18 years old or older with a low educational level and inadequate glycaemic control (HbA1c > 7%) were recruited. General Practitioners (GPs) were randomised to three groups: intervention A, intervention B and control group. GPs allocated to intervention groups A and B received training in communication skills and are providing graphic feedback about glycosylated haemoglobin levels. Patients whose GPs were allocated to group B are additionally receiving telephone reinforcement whereas patients from the control group are receiving usual care. The described interventions are being conducted during 7 consecutive medical visits which are scheduled every three months. The main outcome measure will be HbA1c; blood pressure, lipidemia, body mass index and waist circumference will be considered as secondary outcome measures. Statistical analysis to evaluate the effectiveness of the interventions will include multilevel regression analysis with three hierarchical levels: medical visit level, patient level and GP level. DISCUSSION The results of this study will provide new knowledge about possible strategies to promote a better diabetes self-management in a particularly vulnerable group. If effective, this low cost intervention will have the potential to be easily incorporated into routine clinical practice, contributing to decrease health inequalities in diabetic patients. TRIAL REGISTRATION Clinical Trials U.S. National Institutes of Health, NCT01849731.

Cluster analysis of behavioural and event-related potentials during a contingent negative variation paradigm in remitting-relapsing and benign forms of multiple sclerosis

Background: Event-related potentials (ERPs) may be used as a highly sensitive way of detecting subtle degrees of cognitive dysfunction. On the other hand, impairment of cognitive skills is increasingly recognised as a hallmark of patients suffering from multiple sclerosis (MS). We sought to determine the psychophysiological pattern of information processing among MS patients with the relapsing-remitting form of the disease and low physical disability considered as two subtypes: 'typical relapsing-remitting' (RRMS) and 'benign MS' (BMS). Furthermore, we subjected our data to a cluster analysis to determine whether MS patients and healthy controls could be differentiated in terms of their psychophysiological profile.Methods: We investigated MS patients with RRMS and BMS subtypes using event-related potentials (ERPs) acquired in the context of a Posner visual-spatial cueing paradigm. Specifically, our study aimed to assess ERP brain activity in response preparation (contingent negative variation -CNV) and stimuli processing in MS patients. Latency and amplitude of different ERP components (P1, eN1, N1, P2, N2, P3 and late negativity -LN) as well as behavioural responses (reaction time -RT; correct responses -CRs; and number of errors) were analyzed and then subjected to cluster analysis. Results: Both MS groups showed delayed behavioural responses and enhanced latency for long-latency ERP components (P2, N2, P3) as well as relatively preserved ERP amplitude, but BMS patients obtained more important performance deficits (lower CRs and higher RTs) and abnormalities related to the latency (N1, P3) and amplitude of ERPs (eCNV, eN1, LN). However, RRMS patients also demonstrated abnormally high amplitudes related to the preparation performance period of CNV (cCNV) and post-processing phase (LN). Cluster analyses revealed that RRMS patients appear to make up a relatively homogeneous group with moderate deficits mainly related to ERP latencies, whereas BMS patients appear to make up a rather more heterogeneous group with more severe information processing and attentional deficits. Conclusions: Our findings are suggestive of a slowing of information processing for MS patients that may be a consequence of demyelination and axonal degeneration, which also seems to occur in MS patients that show little or no progression in the physical severity of the disease over time.

Differential cognitive impairment for diverse forms of multiple sclerosis.

BACKGROUND Cognitive impairment is a common feature in multiple sclerosis (MS) patients and occurs in 60% of all cases. Unfortunately, neurological examination does not always agree with the neuropsychological evaluation in determining the cognitive profile of the patient. On the other hand, psychophysiological techniques such as event-related potentials (ERPs) can help in evaluating cognitive impairment in different pathologies. Behavioural responses and EEG signals were recorded during the experiment in three experimental groups: 1) a relapsing-remitting group (RRMS), 2) a benign multiple sclerosis group (BMS) and 3) a Control group. The paradigm employed was a spatial attention task with central cues (Posner experiment). The main aim was to observe the differences in the performance (behavioural variables) and in the latency and amplitude of the ERP components among these groups. RESULTS Our data indicate that both MS groups showed poorer task performance (longer reaction times and lower percentage of correct responses), a latency delay for the N1 and P300 component, and a different amplitude for the frontal N1. Moreover, the deficit in the BMS group, indexed by behavioural and pyschophysiological variables, was more pronounced compared to the RRMS group. CONCLUSION The present results suggest a cognitive impairment in the information processing in all of these patients. Comparing both pathological groups, cognitive impairment was more accentuated in the BMS group compared to the RMSS group. This suggests a silent deterioration of cognitive skills for the BMS that is not usually treated with pharmacological or neuropsychological therapy.