Good practice in reviewing and publishing studies on herbal medicine, with special emphasis on traditional Chinese medicine and Chinese materia medica

Ethnopharmacological relevance: Studies on traditional Chinese medicine (TCM), like those of other systems of traditional medicine (TM), are very variable in their quality, content and focus, resulting in issues around their acceptability to the global scientific community. In an attempt to address these issues, an European Union funded FP7 consortium, composed of both Chinese and European scientists and named “Good practice in traditional Chinese medicine” (GP-TCM), has devised a series of guidelines and technical notes to facilitate good practice in collecting, assessing and publishing TCM literature as well as highlighting the scope of information that should be in future publications on TMs. This paper summarises these guidelines, together with what has been learned through GP-TCM collaborations, focusing on some common problems and proposing solutions. The recommendations also provide a template for the evaluation of other types of traditional medicine such as Ayurveda, Kampo and Unani. Materials and methods: GP-TCM provided a means by which experts in different areas relating to TCM were able to collaborate in forming a literature review good practice panel which operated through e-mail exchanges, teleconferences and focused discussions at annual meetings. The panel involved coordinators and representatives of each GP-TCM work package (WP) with the latter managing the testing and refining of such guidelines within the context of their respective WPs and providing feedback. Results: A Good Practice Handbook for Scientific Publications on TCM was drafted during the three years of the consortium, showing the value of such networks. A “deliverable – central questions – labour division” model had been established to guide the literature evaluation studies of each WP. The model investigated various scoring systems and their ability to provide consistent and reliable semi-quantitative assessments of the literature, notably in respect of the botanical ingredients involved and the scientific quality of the work described. This resulted in the compilation of (i) a robust scoring system and (ii) a set of minimum standards for publishing in the herbal medicines field, based on an analysis of the main problems identified in published TCM literature.

Bridging a yawning chasm: EEG investigations into the debate concerning the role of the human mirror neuron system in contagious yawning

Ongoing debate in the literature concerns whether there is a link between contagious yawning and the human mirror neuron system (hMNS). One way of examining this issue is with the use of the electroencephalogram (EEG) to measure changes in mu activation during the observation of yawns. Mu oscillations are seen in the alpha bandwidth of the EEG (8–12 Hz) over sensorimotor areas. Previous work has shown that mu suppression is a useful index of hMNS activation and is sensitive to individual differences in empathy. In two experiments, we presented participants with videos of either people yawning or control stimuli. We found greater mu suppression for yawns than for controls over right motor and premotor areas, particularly for those scoring higher on traits of empathy. In a third experiment, auditory recordings of yawns were compared against electronically scrambled versions of the same yawns. We observed greater mu suppression for yawns than for the controls over right lateral premotor areas. Again, these findings were driven by those scoring highly on empathy. The results from these experiments support the notion that the hMNS is involved in contagious yawning, emphasise the link between contagious yawning and empathy, and stress the importance of good control stimuli.

Reliability, sufficiency, and the decomposition of proper scores

Scoring rules are an important tool for evaluating the performance of probabilistic forecasting schemes. A scoring rule is called strictly proper if its expectation is optimal if and only if the forecast probability represents the true distribution of the target. In the binary case, strictly proper scoring rules allow for a decomposition into terms related to the resolution and the reliability of a forecast. This fact is particularly well known for the Brier Score. In this article, this result is extended to forecasts for finite-valued targets. Both resolution and reliability are shown to have a positive effect on the score. It is demonstrated that resolution and reliability are directly related to forecast attributes that are desirable on grounds independent of the notion of scores. This finding can be considered an epistemological justification of measuring forecast quality by proper scoring rules. A link is provided to the original work of DeGroot and Fienberg, extending their concepts of sufficiency and refinement. The relation to the conjectured sharpness principle of Gneiting, et al., is elucidated.

Estimating reliability and resolution of probability forecasts through decomposition of the empirical score

References (20)Cited By (1)Export CitationAboutAbstract Proper scoring rules provide a useful means to evaluate probabilistic forecasts. Independent from scoring rules, it has been argued that reliability and resolution are desirable forecast attributes. The mathematical expectation value of the score allows for a decomposition into reliability and resolution related terms, demonstrating a relationship between scoring rules and reliability/resolution. A similar decomposition holds for the empirical (i.e. sample average) score over an archive of forecast–observation pairs. This empirical decomposition though provides a too optimistic estimate of the potential score (i.e. the optimum score which could be obtained through recalibration), showing that a forecast assessment based solely on the empirical resolution and reliability terms will be misleading. The differences between the theoretical and empirical decomposition are investigated, and specific recommendations are given how to obtain better estimators of reliability and resolution in the case of the Brier and Ignorance scoring rule.

Evaluating raw ensembles with the continuous ranked probability score

The continuous ranked probability score (CRPS) is a frequently used scoring rule. In contrast with many other scoring rules, the CRPS evaluates cumulative distribution functions. An ensemble of forecasts can easily be converted into a piecewise constant cumulative distribution function with steps at the ensemble members. This renders the CRPS a convenient scoring rule for the evaluation of ‘raw’ ensembles, obviating the need for sophisticated ensemble model output statistics or dressing methods prior to evaluation. In this article, a relation between the CRPS score and the quantile score is established. The evaluation of ‘raw’ ensembles using the CRPS is discussed in this light. It is shown that latent in this evaluation is an interpretation of the ensemble as quantiles but with non-uniform levels. This needs to be taken into account if the ensemble is evaluated further, for example with rank histograms.

Ageing and taste

Taste perception has been studied frequently in young and older adult groups. This paper systematically reviews these studies to determine the effect of ageing on taste perception and establish the reported extent of sensory decline. Five databases were searched from 1900 to April 2012. Articles relating to healthy ageing in human subjects were included, reviewed and rated (Downs and Black scoring system). Sixty-nine studies investigated the effect of ageing on taste perception; forty examined detection thresholds of which twenty-three provided sufficient data for meta-analysis, eighteen reported identification thresholds and twenty-five considered supra-threshold intensity perception. Researchers investigating detection thresholds considered between one and thirteen taste compounds per paper. Overall, the consensus was that taste detection thresholds increased with age (Hedges' g = 0·91, P < 0·001), across all taste modalities. Identification thresholds were reported to be higher for older adults in seventeen out of eighteen studies. Sixteen out of twenty-five studies reported perception of taste intensity at supra-threshold levels to be significantly lower for older adults. However, six out of nine studies concerning sucrose found perceived intensity of sweet taste not to diminish with age. The findings of this systematic review suggest taste perception declines during the healthy ageing process, although the extent of decline varies between studies. Overall, the studies reviewed had low Downs and Black scores (mean 16 (SD 2)) highlighting the need for more robust large scale and longitudinal studies monitoring the impact of ageing on the sensory system, and how this influences the perception of foods and beverages.

Identifying key knowledge needs for evidence-based conservation of wild insect pollinators: a collaborative cross-sectoral exercise

In response to evidence of insect pollinator declines, organisations in many sectors, including the food and farming industry, are investing in pollinator conservation. They are keen to ensure that their efforts use the best available science. We convened a group of 32 ‘conservation practitioners’ with an active interest in pollinators and 16 insect pollinator scientists. The conservation practitioners include representatives from UK industry (including retail), environmental non-government organisations and nature conservation agencies. We collaboratively developed a long list of 246 knowledge needs relating to conservation of wild insect pollinators in the UK. We refined and selected the most important knowledge needs, through a three-stage process of voting and scoring, including discussions of each need at a workshop. We present the top 35 knowledge needs as scored by conservation practitioners or scientists. We find general agreement in priorities identified by these two groups. The priority knowledge needs will structure ongoing work to make science accessible to practitioners, and help to guide future science policy and funding. Understanding the economic benefits of crop pollination, basic pollinator ecology and impacts of pesticides on wild pollinators emerge strongly as priorities, as well as a need to monitor floral resources in the landscape.

Predicting outcomes following cognitive behavior therapy in child anxiety disorders: the influence of genetic, demographic and clinical information

Background. Within a therapeutic gene by environment (GxE) framework, we recently demonstrated that variation in the Serotonin Transporter Promoter Polymorphism; 5HTTLPR and marker rs6330 in Nerve Growth Factor gene; NGF is associated with poorer outcomes following cognitive behaviour therapy (CBT) for child anxiety disorders. The aim of this study was to explore one potential means of extending the translational reach of G×E data in a way that may be clinically informative. We describe a ‘risk-index’ approach combining genetic, demographic and clinical data and test its ability to predict diagnostic outcome following CBT in anxious children. Method. DNA and clinical data were collected from 384 children with a primary anxiety disorder undergoing CBT. We tested our risk model in five cross-validation training sets. Results. In predicting treatment outcome, six variables had a minimum mean beta value of 0.5: 5HTTLPR, NGF rs6330, gender, primary anxiety severity, comorbid mood disorder and comorbid externalising disorder. A risk index (range 0-8) constructed from these variables had moderate predictive ability (AUC = .62-.69) in this study. Children scoring high on this index (5-8) were approximately three times as likely to retain their primary anxiety disorder at follow-up as compared to those children scoring 2 or less. Conclusion. Significant genetic, demographic and clinical predictors of outcome following CBT for anxiety-disordered children were identified. Combining these predictors within a risk-index could be used to identify which children are less likely to be diagnosis free following CBT alone or thus require longer or enhanced treatment. The ‘risk-index’ approach represents one means of harnessing the translational potential of G×E data.

Shoot calcium and magnesium concentrations differ between subtaxa, are highly heritable, and associate with potentially pleiotropic loci in Brassica oleracea

Calcium (Ca) and magnesium (Mg) are the most abundant group II elements in both plants and animals. Genetic variation in shoot Ca and shoot Mg concentration (shoot Ca and Mg) in plants can be exploited to biofortify food crops and thereby increase dietary Ca and Mg intake for humans and livestock. We present a comprehensive analysis of within-species genetic variation for shoot Ca and Mg, demonstrating that shoot mineral concentration differs significantly between subtaxa (varietas). We established a structured diversity foundation set of 376 accessions to capture a high proportion of species-wide allelic diversity within domesticated Brassica oleracea, including representation of wild relatives (C genome, 1n = 9) from natural populations. These accessions and 74 modern F-1 hybrid cultivars were grown in glasshouse and field environments. Shoot Ca and Mg varied 2- and 2.3-fold, respectively, and was typically not inversely correlated with shoot biomass, within most subtaxa. The closely related capitata (cabbage) and sabauda (Savoy cabbage) subtaxa consistently had the highest mean shoot Ca and Mg. Shoot Ca and Mg in glasshouse-grown plants was highly correlated with data from the field. To understand and dissect the genetic basis of variation in shoot Ca and Mg, we studied homozygous lines from a segregating B. oleracea mapping population. Shoot Ca and Mg was highly heritable (up to 40). Quantitative trait loci (QTL) for shoot Ca and Mg were detected on chromosomes C2, C6, C7, C8, and, in particular, C9, where QTL accounted for 14 to 55 of the total genetic variance. The presence of QTL on C9 was substantiated by scoring recurrent backcross substitution lines, derived from the same parents. This also greatly increased the map resolution, with strong evidence that a 4-cM region on C9 influences shoot Ca. This region corresponds to a 0.41-Mb region on Arabidopsis (Arabidopsis thaliana) chromosome 5 that includes 106 genes. There is also evidence that pleiotropic loci on C8 and C9 affect shoot Ca and Mg. Map-based cloning of these loci will reveal how shoot-level phenotypes relate to Ca 21 and Mg 21 uptake and homeostasis at the molecular level.

Forecast encompassing tests and probability forecasts

We consider tests of forecast encompassing for probability forecasts, for both quadratic and logarithmic scoring rules. We propose test statistics for the null of forecast encompassing, present the limiting distributions of the test statistics, and investigate the impact of estimating the forecasting models' parameters on these distributions. The small-sample performance is investigated, in terms of small numbers of forecasts and model estimation sample sizes. We show the usefulness of the tests for the evaluation of recession probability forecasts from logit models with different leading indicators as explanatory variables, and for evaluating survey-based probability forecasts.

Evaluation of seven European aerosol optical depth retrieval algorithms for climate analysis

Satellite data are increasingly used to provide observation-based estimates of the effects of aerosols on climate. The Aerosol-cci project, part of the European Space Agency's Climate Change Initiative (CCI), was designed to provide essential climate variables for aerosols from satellite data. Eight algorithms, developed for the retrieval of aerosol properties using data from AATSR (4), MERIS (3) and POLDER, were evaluated to determine their suitability for climate studies. The primary result from each of these algorithms is the aerosol optical depth (AOD) at several wavelengths, together with the Ångström exponent (AE) which describes the spectral variation of the AOD for a given wavelength pair. Other aerosol parameters which are possibly retrieved from satellite observations are not considered in this paper. The AOD and AE (AE only for Level 2) were evaluated against independent collocated observations from the ground-based AERONET sun photometer network and against “reference” satellite data provided by MODIS and MISR. Tools used for the evaluation were developed for daily products as produced by the retrieval with a spatial resolution of 10 × 10 km2 (Level 2) and daily or monthly aggregates (Level 3). These tools include statistics for L2 and L3 products compared with AERONET, as well as scoring based on spatial and temporal correlations. In this paper we describe their use in a round robin (RR) evaluation of four months of data, one month for each season in 2008. The amount of data was restricted to only four months because of the large effort made to improve the algorithms, and to evaluate the improvement and current status, before larger data sets will be processed. Evaluation criteria are discussed. Results presented show the current status of the European aerosol algorithms in comparison to both AERONET and MODIS and MISR data. The comparison leads to a preliminary conclusion that the scores are similar, including those for the references, but the coverage of AATSR needs to be enhanced and further improvements are possible for most algorithms. None of the algorithms, including the references, outperforms all others everywhere. AATSR data can be used for the retrieval of AOD and AE over land and ocean. PARASOL and one of the MERIS algorithms have been evaluated over ocean only and both algorithms provide good results.

Social communication deficits: specific associations with Social Anxiety Disorder

Background Social communication deficits are prevalent amongst children with anxiety disorders; however whether they are over-represented specifically among children with Social Anxiety Disorder has not been examined. This study set out to examine social communication deficits among children with Social Anxiety Disorder in comparison to children with other forms of anxiety disorder. Methods Parents of 404 children with a diagnosed anxiety disorder completed the Social Communication Questionnaire (SCQ; Rutter, M., Bailey, A., Lord, C., 2003. The Social Communication Questionnaire – Manual. Western Psychological Services, Los Angeles, CA). Children with a diagnosis of Social Anxiety Disorder (n=262) and anxious children without Social Anxiety Disorder (n=142) were compared on SCQ total and subscale scores and the frequency of participants scoring above clinical cut-offs. Results Children with Social Anxiety Disorder scored significantly higher than anxious children without Social Anxiety Disorder on the SCQ total (t(352)=4.85, p<.001, d=.55, r=.27), Reciprocal Social Interaction (t(351)=4.73, p<.001, d=.55, r=.27), communication (t(344)=3.62, p<.001, d=.43, r=.21) and repetitive, restrictive and stereotyped behaviors subscales (t(353)=3.15, p=.002, d=.37, r=.18). Furthermore, children with Social Anxiety Disorder were three times more likely to score above clinical cut-offs. Limitations The participants were a relatively affluent group of predominantly non-minority status. The social communication difficulties measure relied on parental report which could be influenced by extraneous factors. Conclusions Treatments for Social Anxiety Disorder may benefit from a specific focus on developing social communication skills. Future research using objective assessments of underlying social communication skills is required.

Estimating age of mature adults from the degeneration of the sternal end of the clavicle

The sternal end of the clavicle has been illustrated to be useful in aging young adults, however, no studies have investigated what age-related changes occur to the sternal end post epiphyseal fusion. In this study, three morphological features (i.e., surface topography, porosity, and osteophyte formation) were examined and scored using 564 clavicles of individuals of European ancestry (n = 318 males; n = 246 females), with known ages of 40+ years, from four documented skeletal collections: Hamann-Todd, Pretoria, St. Bride's, and Coimbra. An ordinal scoring method was developed for each of the three traits. Surface topography showed the strongest correlation with age, and composite scores (formed by summing the three separate trait scores) indicated progressive degeneration of the surface with increasing chronological age. Linear regression analyses were performed on the trait scores to produce pooled-sample age estimation equations. Blind tests of the composite score method and regression formulae on 56 individuals, aged 40+ years, from Christ Church Spitalfields, suggest accuracies of 96.4% for both methods. These preliminary results display the first evidence of the utility of the sternal end of the clavicle in aging older adult individuals. However, in the current format, these criteria should only be applied to individuals already identified as over 40 years in order to refine the age ranges used for advanced age. These findings do suggest the sternal end of the clavicle has potential to aid age estimates beyond the traditional "mature adult" age category (i.e., 46+ years), and provides several suggestions for future research.

Training on the use of a bespoke continuing professional development framework improves the quality of CPD records

BACKGROUND: Using continuing professional development (CPD) as part of the revalidation of pharmacy professionals has been proposed in the UK but not implemented. We developed a CPD Outcomes Framework (‘the framework’) for scoring CPD records, where the score range was -100 to +150 based on demonstrable relevance and impact of the CPD on practice. OBJECTIVE: This exploratory study aimed to test the outcome of training people to use the framework, through distance-learning material (active intervention), by comparing CPD scores before and after training. SETTING: Pharmacy professionals were recruited in the UK in Reading, Banbury, Southampton, Kingston-upon-Thames and Guildford in 2009. METHOD: We conducted a randomised, double-blinded, parallel-group, before and after study. The control group simply received information on new CPD requirements through the post; the active intervention group also received the framework and associated training. Altogether 48 participants (25 control, 23 active) completed the study. All participants submitted CPD records to the research team before and after receiving the posted resources. The records (n=226) were scored blindly by the researchers using the framework. A subgroup of CPD records (n=96) submitted first (before-stage) and rewritten (after-stage) were analysed separately. MAIN OUTCOME MEASURE: Scores for CPD records received before and after distributing group-dependent material through the post. RESULTS: Using a linear-regression model both analyses found an increase in CPD scores in favour of the active intervention group. For the complete set of records, the effect was a mean difference of 9.9 (95% CI = 0.4 to 19.3), p-value = 0.04. For the subgroup of rewritten records, the effect was a mean difference of 17.3 (95% CI = 5.6 to 28.9), p-value = 0.0048. CONCLUSION: The intervention improved participants’ CPD behaviour. Training pharmacy professionals to use the framework resulted in better CPD activities and CPD records, potentially helpful for revalidation of pharmacy professionals. IMPACT: • Using a bespoke Continuing Professional Development outcomes framework improves the value of pharmacy professionals’ CPD activities and CPD records, with the potential to improve patient care. • The CPD outcomes framework could be helpful to pharmacy professionals internationally who want to improve the quality of their CPD activities and CPD records. • Regulators and officials across Europe and beyond can assess the suitability of the CPD outcomes framework for use in pharmacy CPD and revalidation in their own setting.

Resolution and discrimination - two sides of the same coin

The notions of resolution and discrimination of probability forecasts are revisited. It is argued that the common concept underlying both resolution and discrimination is the dependence (in the sense of probability theory) of forecasts and observations. More specifically, a forecast has no resolution if and only if it has no discrimination if and only if forecast and observation are stochastically independent. A statistical tests for independence is thus also a test for no resolution and, at the same time, for no discrimination. The resolution term in the decomposition of the logarithmic scoring rule, and the area under the Receiver Operating Characteristic will be investigated in this light.