Further concerns about self-assessment: are medical students aware of their progress in clinical skills during clerkship

Background: Medical students do not accurately self-assess their competence. However, little is known about the awareness of change of competence over time. The aim of this study was to evaluate if students are aware of their progress. Summary of work: Twenty-two fourth year medical students had self- and expert-assessments of their clinical skills in musculoskeletal medicine in an OSCE like station (4 point Likert scale) at the beginning (t0) and end (t1) of their eight weeks clerkship in internal medicine. Thirteen students were assigned to the intervention of a 6x1 hour practical examination course; nine took part in the regular clinical clerkship activities only and served as controls. Summary of results/Conclusions: The intervention students significantly improved their skills (from 2.78 ± 0.36 to 3.30 ± 0.36, p<0.05) in contrast to the control students (from 3.11 ± 0.58 to 2.83 ± 0.49, n.s.). At t0, 19 students, at t1 21 out of 22 students underestimated their competence. Correlations between the change of self- and expert-assessment were r=0.43, p<0.05 (all), r=0.47, n.s. (control) and r=-0.12, n.s. (intervention), respectively. Take-home message: Medical students improving their clinical skills by an interactive course in addition to their regular clerkship activities are not aware of their progress

Self-assessment insufficiently predicts performance in emergency skills

Background: Residents demonstrate a broad range of performance levels for clinical skills, with some at an inadequate level. Adequate self-assessment is important for life long learning. However, its accuracy is questioned extensively. The aim of this study was to evaluate how far the residents’ self-assessment predicts their performance in an expert assessment of emergency skills. Summary of work: Twelve skills were identified as being relevant for the emergency duties of residents in smaller hospitals. Fifteen first-year residents from the departments of internal medicine and general surgery at a district hospital rated their performance on a questionnaire (self-assessment). This was followed by a structured, practical in vivo assessment by an anaesthesiologist (expert assessment). For both, a visual analogue scale from 0 to 10 was used, on which 0 stands for novice and 10 for expert. Predictive validity was described by Spearman’s correlation, which was significant in 3 out of 12 skills only. Median correlation (r) was 0.50 (range 0.16 to 0.93). Conclusion: At the beginning of postgraduate training, self-assessment alone is not sufficient to guide self-directed learning. Take-home message: At the beginning of their residency, physicians need structured feedback in emergency skills which can be offered by anaesthesiologists.

Feasibility and acceptance of electronic quality of life assessment in general practice: an implementation study

Background Patients' health related quality of life (HRQoL) has rarely been systematically monitored in general practice. Electronic tools and practice training might facilitate the routine application of HRQoL questionnaires. Thorough piloting of innovative procedures is strongly recommended before the conduction of large-scale studies. Therefore, we aimed to assess i) the feasibility and acceptance of HRQoL assessment using tablet computers in general practice, ii) the perceived practical utility of HRQoL results and iii) to identify possible barriers hindering wider application of this approach. Methods Two HRQoL questionnaires (St. George's Respiratory Questionnaire SGRQ and EORTC QLQ-C30) were electronically presented on portable tablet computers. Wireless network (WLAN) integration into practice computer systems of 14 German general practices with varying infrastructure allowed automatic data exchange and the generation of a printout or a PDF file. General practitioners (GPs) and practice assistants were trained in a 1-hour course, after which they could invite patients with chronic diseases to fill in the electronic questionnaire during their waiting time. We surveyed patients, practice assistants and GPs regarding their acceptance of this tool in semi-structured telephone interviews. The number of assessments, HRQoL results and interview responses were analysed using quantitative and qualitative methods. Results Over the course of 1 year, 523 patients filled in the electronic questionnaires (1–5 times; 664 total assessments). On average, results showed specific HRQoL impairments, e.g. with respect to fatigue, pain and sleep disturbances. The number of electronic assessments varied substantially between practices. A total of 280 patients, 27 practice assistants and 17 GPs participated in the telephone interviews. Almost all GPs (16/17 = 94%; 95% CI = 73–99%), most practice assistants (19/27 = 70%; 95% CI = 50–86%) and the majority of patients (240/280 = 86%; 95% CI = 82–91%) indicated that they would welcome the use of electronic HRQoL questionnaires in the future. GPs mentioned availability of local health services (e.g. supportive, physiotherapy) (mean: 9.4 ± 1.0 SD; scale: 1 – 10), sufficient extra time (8.9 ± 1.5) and easy interpretation of HRQoL results (8.6 ± 1.6) as the most important prerequisites for their use. They believed HRQoL assessment facilitated both communication and follow up of patients' conditions. Practice assistants emphasised that this process demonstrated an extra commitment to patient centred care; patients viewed it as a tool, which contributed to the physicians' understanding of their personal condition and circumstances. Conclusion This pilot study indicates that electronic HRQoL assessment is technically feasible in general practices. It can provide clinically significant information, which can either be used in the consultation for routine care, or for research purposes. While GPs, practice assistants and patients were generally positive about the electronic procedure, several barriers (e.g. practices' lack of time and routine in HRQoL assessment) need to be overcome to enable broader application of electronic questionnaires in every day medical practice.

Assessment of soil erosion and soil conservation practices in Angereb watershed, Ethiopia: Technological and land user context

Soil conservation technologies that fit well to local scale and are acceptable to land users are increasingly needed. To achieve this at small-holder farm level, there is a need for an understanding of specific erosion processes and indicators, the land users’ knowledge and their willingness, ability and possibilities to respond to the respective problems to decide on control options. This study was carried out to assess local erosion and performance of earlier introduced conservation terraces from both technological and land users’ points of view. The study was conducted during July to August 2008 at Angereb watershed on 58 farm plots from three selected case-study catchments. Participatory erosion assessment and evaluation were implemented along with direct field measurement procedures. Our focus was to involve the land users in the action research to explore with them the effectiveness of existing conservation measures against the erosion hazard. Terrace characteristics measured and evaluated against the terrace implementation guideline of Hurni (1986). The long-term consequences of seasonal erosion indicators had often not been known and noticed by farmers. The cause and effect relationships of the erosion indicators and conservation measures have shown the limitations and gaps to be addressed towards sustainable erosion control strategies. Less effective erosion control has been observed and participants have believed the gaps are to be the result of lack of landusers’ genuine participation. The results of both local erosion observation and assessment of conservation efficacy using different aspects show the need to promote approaches for erosion evaluation and planning of interventions by the farmers themselves. This paper describes the importance of human factor involving in the empirical erosion assessment methods towards sustainable soil conservation.

Flow-R, a model for susceptibility mapping of debris flows and other gravitational hazards at a regional scale

The development of susceptibility maps for debris flows is of primary importance due to population pressure in hazardous zones. However, hazard assessment by process-based modelling at a regional scale is difficult due to the complex nature of the phenomenon, the variability of local controlling factors, and the uncertainty in modelling parameters. A regional assessment must consider a simplified approach that is not highly parameter dependant and that can provide zonation with minimum data requirements. A distributed empirical model has thus been developed for regional susceptibility assessments using essentially a digital elevation model (DEM). The model is called Flow-R for Flow path assessment of gravitational hazards at a Regional scale (available free of charge under http://www.flow-r.org) and has been successfully applied to different case studies in various countries with variable data quality. It provides a substantial basis for a preliminary susceptibility assessment at a regional scale. The model was also found relevant to assess other natural hazards such as rockfall, snow avalanches and floods. The model allows for automatic source area delineation, given user criteria, and for the assessment of the propagation extent based on various spreading algorithms and simple frictional laws. We developed a new spreading algorithm, an improved version of Holmgren's direction algorithm, that is less sensitive to small variations of the DEM and that is avoiding over-channelization, and so produces more realistic extents. The choices of the datasets and the algorithms are open to the user, which makes it compliant for various applications and dataset availability. Amongst the possible datasets, the DEM is the only one that is really needed for both the source area delineation and the propagation assessment; its quality is of major importance for the results accuracy. We consider a 10 m DEM resolution as a good compromise between processing time and quality of results. However, valuable results have still been obtained on the basis of lower quality DEMs with 25 m resolution.

Measuring mindfulness: first steps towards the development of a comprehensive mindfulness scale

The present study describes the development of and results obtained from the first version of a new mindfulness scale: the Comprehensive Inventory of Mindfulness Experiences beta (CHIME-β). The aim of the present analysis was to investigate two relevant open questions in mindfulness assessment: (1) the coverage of aspects of mindfulness and (2) the type of interrelationships among these aspects. A review of the aspects of mindfulness assessed by eight currently available mindfulness questionnaires led to the identification of nine aspects of mindfulness. The CHIME-β was constructed in order to cover each of these aspects in a balanced way. Initially, principal component and confirmatory factor analyses, as well as reliability and validity analyses, were performed in the entire sample (n = 313) of individuals from the general population and mindfulness-based stress reduction (MBSR) groups. The factor structure that emerged from this analysis was further investigated in meditation-trained individuals (n = 144) who had just completed an MBSR intervention. Results suggested a four-factor structure underlying the nine aspects proposed. The relationship between these mindfulness factors appears to be influenced by the degree of meditation experience. In fact, the mindfulness factors showed a greater interconnectedness among mediation-trained participants. Finally, data suggest that a non-avoidant stance plays a central role in mindfulness, while the capacity to put inner experiences into words may be related to mindfulness rather than a component of the construct.

The assessment of mindfulness with self-report measures: existing scales and open issues

During recent years, mindfulness-based approaches have been gaining relevance for treatment in clinical populations. Correspondingly, the empirical study of mindfulness has steadily grown; thus, the availability of valid measures of the construct is critically important. This paper gives an overview of the current status in the field of self-report assessment of mindfulness. All eight currently available and validated mindfulness scales (for adults) are evaluated, with a particular focus on their virtues and limitations and on differences among them. It will be argued that none of these scales may be a fully adequate measure of mindfulness, as each of them offers unique advantages but also disadvantages. In particular, none of them seems to provide a comprehensive assessment of all aspects of mindfulness in samples from the general population. Moreover, some scales may be particularly indicated in investigations focusing on specific populations such as clinical samples (Cognitive and Affective Mindfulness Scale, Southampton Mindfulness Questionnaire) or meditators (Freiburg Mindfulness Inventory). Three main open issues are discussed: (1) the coverage of aspects of mindfulness in questionnaires; (2) the nature of the relationships between these aspects; and (3) the validity of self-report measures of mindfulness. These issues should be considered in future developments in the self-report assessment of mindfulness.

Assessment of the wind-up phenomenon in the equine nociceptive trigeminal system.

Repeated sub-threshold nociceptive electrical stimulation resulting in temporal summation of the limb nociceptive withdrawal reflex is a well-established non-invasive model to investigate the wind-up phenomenon in horses. Due to structural similarities of the trigeminal sensory nucleus to the dorsal horn of the spinal cord, temporal summation should be evoked by repeated transcutaneous electrical stimulation of trigeminal afferents. To evaluate this hypothesis repeated transcutaneous electrical stimulation was applied to the supraorbital and infraorbital nerves of 10 horses. Stimulation intensities varied between 0.5 and 1.3 times the trigemino-cervical reflex threshold defined for single stimulation. Evoked electromyographic activity of the orbicularis oculi, splenius and cleidomastoideus muscles was recorded and the signals analysed in the previously established epochs typical to the early and late component of the blink reflex and to the trigemino-cervical reflex. Behavioural reactions were evaluated with the aid of numerical rating scale. The nociceptive late component and the trigemino-cervical reflex were not elicited by sub-threshold intensity repeated transcutaneous electrical stimulation. Furthermore, the median reflex amplitude for the 10 horses showed a tendency to decline over the stimulation train so temporal summation of afferent trigeminal inputs could not be observed. Therefore, the modulation of trigeminal nociceptive processing attributable to repeated Aδ fibre stimulations seems to differ from spinal processing of similar inputs as it seems to have an inhibitory rather than facilitatory effect. Further evaluation is necessary to highlight the underlying mechanism.

Ecosystem service trade-offs and stakeholder claims - a meso-scale study from a Madagascar biodiversity hotspot

The north-eastern escarpment of Madagascar has been labelled a global biodiversity hotspot due to its extremely high rates of endemic species which are heavily threatened by accelerated deforestation rates and landscape change. The traditional practice of shifting cultivation or "tavy" used by the majority of land users in this area to produce subsistence rice is commonly blamed for these threats. A wide range of stakeholders ranging from conservation to development agencies, and from the private to the public sector has therefore been involved in trying to find solutions to protect the remaining forest fragments and to increase agricultural production. Consequently, provisioning, regulating and socio-cultural services of this forest-mosaic landscape are fundamentally altered leading to trade-offs between them and consequently new winners and losers amongst the stakeholders at different scales. However, despite a growing amount of evidence from case studies analysing local changes, the regional dynamics of the landscape and their contribution to such trade-offs remain poorely understood. This study therefore aims at using generalised landscape units as a base for the assessment of multi-level stakeholder claims on ecosystem services to inform negotiation, planning and decision making at a meso-scale. The presented study applies a mixed-method approach combining remote sensing, GIS and socio-economic methods to reveal current landscape dynamics, their change over time and the corresponding ecosystem service trade-offs induced by diverse stakeholder claims on the regional level. In a first step a new regional land cover classification for three points in time (1995, 2005 and 2011) was conducted including agricultural classes characteristic for shifting cultivation systems. Secondly, a novel GIS approach, termed “landscape mosaics approach” originally developed to assess dynamics of shifting cultivation landscapes in Laos was applied. Through this approach generalised landscape mosaics were generated allowing for a better understanding of changes in land use intensities instead of land cover. As a next step we will try to use these landscape units as proxies to map provisioning and regulating ecosystem services throughout the region. Through the overlay with other regional background data such as accessibility and population density and information from a region-wide stakeholder analysis, multiscale trade-offs between different services will be highlighted. The trade-offs observed on the regional scale will then be validated through a socio-economic ground-truthing within selected sites at the local scale. We propose that such meso-scale knowledge is required by all stakeholders involved in decision making towards sustainable development of north-eastern Madagascar.

Quantitative assessment of the nociceptive withdrawal reflex in healthy, non-medicated experimental sheep

This study aimed to characterize the nociceptive withdrawal reflex (NWR) and to define the nociceptive threshold in 25 healthy, non-medicated experimental sheep in standing posture. Electrical stimulation of the dorsal lateral digital nerves of the right thoracic and the pelvic limb was performed and surface-electromyography (EMG) from the deltoid (all animals) and the femoral biceps (18 animals) or the peroneus tertius muscles (7 animals) was recorded. The behavioural reaction following each stimulation was scored on a scale from 0 (no reaction) to 5 (strong whole body reaction). A train-of-five 1 ms constant-current pulse was used and current intensity was stepwise increased until NWR threshold intensity was reached. The NWR threshold intensity (It) was defined as the minimal stimulus intensity able to evoke a reflex with a minimal Root-Mean-Square amplitude (RMSA) of 20 μV, a minimal duration of 10 ms and a minimal reaction score of 1 (slight muscle contraction of the stimulated limb) within the time window of 20 to 130 ms post-stimulation. Based on this value, further stimulations were performed below (0.9It) and above threshold (1.5It and 2It). The stimulus-response curve was described. Data are reported as medians and interquartile ranges. At the deltoid muscle It was 4.4 mA (2.9–5.7) with an RMSA of 62 μV (30–102). At the biceps femoris muscle It was 7.0 mA (4.0–10.0) with an RMSA of 43 μV (34–50) and at the peroneus tertius muscle It was 3.4 mA (3.1–4.4) with an RMSA of 38 μV (32–46). Above threshold, RMSA was significantly increased at all muscles. Below threshold, RMSA was only significantly smaller than at It for the peroneus tertius muscle but not for the other muscles.

Magnitude and frequency: challenges for the assessment of vulnerability to geomorphic hazards

In natural hazard research, risk is defined as a function of (1) the probability of occurrence of a hazardous process, and (2) the assessment of the related extent of damage, defined by the value of elements at risk exposed and their physical vulnerability. Until now, various works have been undertaken to determine vulnerability values for objects exposed to geomorphic hazards such as mountain torrents. Yet, many studies only provide rough estimates for vulnerability values based on proxies for process intensities. However, the deduced vulnerability functions proposed in the literature show a wide range, in particular with respect to medium and high process magnitudes. In our study, we compare vulnerability functions for torrent processes derived from studies in test sites located in the Austrian Alps and in Taiwan. Based on this comparison we expose needs for future research in order to enhance mountain hazard risk management with a particular focus on the question of vulnerability on a catchment scale.

Assessment of interrater agreement using a binomial-based statistic: K(bin)

This project develops K(bin), a relatively simple, binomial based statistic for assessing interrater agreement in which expected agreement is calculated a priori from the number of raters involved in the study and number of categories on the rating tool. The statistic is logical in interpretation, easily calculated, stable for small sample sizes, and has application over a wide range of possible combinations from the simplest case of two raters using a binomial scale to multiple raters using a multiple level scale.^ Tables of expected agreement values and tables of critical values for K(bin) which include power to detect three levels of the population parameter K for n from 2 to 30 and observed agreement $\ge$.70 calculated at alpha =.05,.025, and.01 are included.^ An example is also included which describes the use of the tables for planning and evaluating an interrater reliability study using the statistic, K(bin). ^

Actigraphic assessment of periodic leg movements in patients with restless legs syndrome.

The diagnosis of restless legs syndrome (RLS) relies upon diagnostic criteria which are based on history only, and dopaminergic treatment is not normally the first choice of treatment for all patients. It would be worthwhile to identify patients non-responsive to dopaminergic treatment beforehand, because they may suffer from a restless legs-like syndrome and may require alternative treatment. We included retrospectively 24 adult patients fulfilling the four essential criteria for restless legs and 12 age-matched healthy controls. They were investigated by ambulatory actigraphy from both legs over three nights, and patients started treatment with dopamine agonists after this diagnostic work-up. We examined 12 responders to dopaminergic treatment and 12 non-responders and studied the association between response to dopaminergic treatment and the periodic limb movement index (PLMI) as assessed with actigraphy. Demographic characteristics, excessive daytime sleepiness and fatigue at baseline were similar in all three groups. Baseline RLS severity was similar between responders and non-responders [International Restless Legs Severity Scale (IRLS): 25 ± 9 and 24 ± 8]. Group comparisons of PLMI before treatment initiation showed significant differences between the three groups. Post-hoc pairwise comparisons revealed that healthy controls had significantly lower PLMI (4.9 ± 4.5) than responders (29.3 ± 22.7) and non-responders (13.3 ± 11.2). Similarly, the PLMI in responders was lower than in non-responders. PLMI day-to-day variability did not differ between responders and non-responders and there was no correlation between treatment effect, as assessed by the decrease of the IRLS and baseline PLMI. Our retrospective study indicates that actigraphy to assess periodic limb movements may contribute to a better diagnosis of dopamine-responsive restless legs syndrome.

Interdisciplinary assessment of complex regional water systems and their future evolution: how socioeconomic drivers can matter more than climate

Modeling of future water systems at the regional scale is a difficult task due to the complexity of current structures (multiple competing water uses, multiple actors, formal and informal rules) both temporally and spatially. Representing this complexity in the modeling process is a challenge that can be addressed by an interdisciplinary and holistic approach. The assessment of the water system of the Crans-Montana-Sierre area (Switzerland) and its evolution until 2050 were tackled by combining glaciological, hydrogeological, and hydrological measurements and modeling with the evaluation of water use through documentary, statistical and interview-based analyses. Four visions of future regional development were co-produced with a group of stakeholders and were then used as a basis for estimating future water demand. The comparison of the available water resource and the water demand at monthly time scale allowed us to conclude that for the four scenarios socioeconomic factors will impact on the future water systems more than climatic factors. An analysis of the sustainability of the current and future water systems based on four visions of regional development allowed us to identify those scenarios that will be more sustainable and that should be adopted by the decision-makers. The results were then presented to the stakeholders through five key messages. The challenges of communicating the results in such a way with stakeholders are discussed at the end of the article.

A framework for benchmarking of homogenisation algorithm performance on the global scale

The International Surface Temperature Initiative (ISTI) is striving towards substantively improving our ability to robustly understand historical land surface air temperature change at all scales. A key recently completed first step has been collating all available records into a comprehensive open access, traceable and version-controlled databank. The crucial next step is to maximise the value of the collated data through a robust international framework of benchmarking and assessment for product intercomparison and uncertainty estimation. We focus on uncertainties arising from the presence of inhomogeneities in monthly mean land surface temperature data and the varied methodological choices made by various groups in building homogeneous temperature products. The central facet of the benchmarking process is the creation of global-scale synthetic analogues to the real-world database where both the "true" series and inhomogeneities are known (a luxury the real-world data do not afford us). Hence, algorithmic strengths and weaknesses can be meaningfully quantified and conditional inferences made about the real-world climate system. Here we discuss the necessary framework for developing an international homogenisation benchmarking system on the global scale for monthly mean temperatures. The value of this framework is critically dependent upon the number of groups taking part and so we strongly advocate involvement in the benchmarking exercise from as many data analyst groups as possible to make the best use of this substantial effort.