Reliability, sufficiency, and the decomposition of proper scores

Scoring rules are an important tool for evaluating the performance of probabilistic forecasting schemes. A scoring rule is called strictly proper if its expectation is optimal if and only if the forecast probability represents the true distribution of the target. In the binary case, strictly proper scoring rules allow for a decomposition into terms related to the resolution and the reliability of a forecast. This fact is particularly well known for the Brier Score. In this article, this result is extended to forecasts for finite-valued targets. Both resolution and reliability are shown to have a positive effect on the score. It is demonstrated that resolution and reliability are directly related to forecast attributes that are desirable on grounds independent of the notion of scores. This finding can be considered an epistemological justification of measuring forecast quality by proper scoring rules. A link is provided to the original work of DeGroot and Fienberg, extending their concepts of sufficiency and refinement. The relation to the conjectured sharpness principle of Gneiting, et al., is elucidated.

Estimating reliability and resolution of probability forecasts through decomposition of the empirical score

References (20)Cited By (1)Export CitationAboutAbstract Proper scoring rules provide a useful means to evaluate probabilistic forecasts. Independent from scoring rules, it has been argued that reliability and resolution are desirable forecast attributes. The mathematical expectation value of the score allows for a decomposition into reliability and resolution related terms, demonstrating a relationship between scoring rules and reliability/resolution. A similar decomposition holds for the empirical (i.e. sample average) score over an archive of forecast–observation pairs. This empirical decomposition though provides a too optimistic estimate of the potential score (i.e. the optimum score which could be obtained through recalibration), showing that a forecast assessment based solely on the empirical resolution and reliability terms will be misleading. The differences between the theoretical and empirical decomposition are investigated, and specific recommendations are given how to obtain better estimators of reliability and resolution in the case of the Brier and Ignorance scoring rule.

Case study part 2: probabilistic modelling of long-term effects of pesticides on individual breeding success in birds and mammals

Abstract: Long-term exposure of skylarks to a fictitious insecticide and of wood mice to a fictitious fungicide were modelled probabilistically in a Monte Carlo simulation. Within the same simulation the consequences of exposure to pesticides on reproductive success were modelled using the toxicity-exposure-linking rules developed by R.S. Bennet et al. (2005) and the interspecies extrapolation factors suggested by R. Luttik et al.(2005). We built models to reflect a range of scenarios and as a result were able to show how exposure to pesticide might alter the number of individuals engaged in any given phase of the breeding cycle at any given time and predict the numbers of new adults at the season’s end.

An energy budget agent-based model of earthworm populations and its application to study the effects of pesticides

Earthworms are important organisms in soil communities and so are used as model organisms in environmental risk assessments of chemicals. However current risk assessments of soil invertebrates are based on short-term laboratory studies, of limited ecological relevance, supplemented if necessary by site-specific field trials, which sometimes are challenging to apply across the whole agricultural landscape. Here, we investigate whether population responses to environmental stressors and pesticide exposure can be accurately predicted by combining energy budget and agent-based models (ABMs), based on knowledge of how individuals respond to their local circumstances. A simple energy budget model was implemented within each earthworm Eisenia fetida in the ABM, based on a priori parameter estimates. From broadly accepted physiological principles, simple algorithms specify how energy acquisition and expenditure drive life cycle processes. Each individual allocates energy between maintenance, growth and/or reproduction under varying conditions of food density, soil temperature and soil moisture. When simulating published experiments, good model fits were obtained to experimental data on individual growth, reproduction and starvation. Using the energy budget model as a platform we developed methods to identify which of the physiological parameters in the energy budget model (rates of ingestion, maintenance, growth or reproduction) are primarily affected by pesticide applications, producing four hypotheses about how toxicity acts. We tested these hypotheses by comparing model outputs with published toxicity data on the effects of copper oxychloride and chlorpyrifos on E. fetida. Both growth and reproduction were directly affected in experiments in which sufficient food was provided, whilst maintenance was targeted under food limitation. Although we only incorporate toxic effects at the individual level we show how ABMs can readily extrapolate to larger scales by providing good model fits to field population data. The ability of the presented model to fit the available field and laboratory data for E. fetida demonstrates the promise of the agent-based approach in ecology, by showing how biological knowledge can be used to make ecological inferences. Further work is required to extend the approach to populations of more ecologically relevant species studied at the field scale. Such a model could help extrapolate from laboratory to field conditions and from one set of field conditions to another or from species to species.

Measuring and modelling mixture toxicity of imidacloprid and thiacloprid on Caenorhabditis elegans and Eisenia fetida

While the standard models of concentration addition and independent action predict overall toxicity of multicomponent mixtures reasonably, interactions may limit the predictive capability when a few compounds dominate a mixture. This study was conducted to test if statistically significant systematic deviations from concentration addition (i.e. synergism/antagonism, dose ratio- or dose level-dependency) occur when two taxonomically unrelated species, the earthworm Eisenia fetida and the nematode Caenorhabditis elegans were exposed to a full range of mixtures of the similar acting neonicotinoid pesticides imidacloprid and thiacloprid. The effect of the mixtures on C. elegans was described significantly better (p<0.01) by a dose level-dependent deviation from the concentration addition model than by the reference model alone, while the reference model description of the effects on E. fetida could not be significantly improved. These results highlight that deviations from concentration addition are possible even with similar acting compounds, but that the nature of such deviations are species dependent. For improving ecological risk assessment of simple mixtures, this implies that the concentration addition model may need to be used in a probabilistic context, rather than in its traditional deterministic manner. Crown Copyright (C) 2008 Published by Elsevier Inc. All rights reserved.

Reactions of artemisinin and arteether with acid: Implications for stability and mode of antimalarial action

The currently accepted mechanism of trioxane antimalarial action involves generation of free radicals within or near susceptible sites probably arising from the production of distonic radical anions. An alternative mechanistic proposal involving the ionic scission of the peroxide group and consequent generation of a carbocation at C-4 has been suggested to account for antimalarial activity. We have investigated this latter mechanism using DFT (B3LYP/6-31+G* level) and established the preferred Lewis acid protonation sites (artemisinin O5a >> O4a approximate to O3a > O2a > O1a; arteether O4a >= O3a > O5b >> O2a > O1a; Figure 3) and the consequent decomposition pathways and hydrolysis sites. In neither molecule is protonation likely to occur on the peroxide bond O1-O2 and therefore lead to scission. Therefore, the alternative radical pathway remains the likeliest explanation for antimalarial action.

Thermal decomposition of potassium hexanitronickelate(II) hydrate

The thermal decomposition of the complex K-4[Ni(NO2)6]center dot H2O has been investigated over the temperature range 25-600 degrees C by a combination of infrared spectroscopy, powder X-ray diffraction, FAB-mass spectrometry and elemental analysis. The first stage of reaction is loss of water and isomerisation of one of the coordinated nitro groups to form the complex K-4 [Ni(NO2)(4) (ONO)]center dot NO2. At temperatures around 200 degrees C the remaining nitro groups within the complex isomerise to the chelating nitrite form and this process acts as a precursor to the loss of NO2 gas at temperatures above 270 degrees C. The product, which is stable up to 600 degrees C, is the complex K-4[Ni(ONO)(4)]center dot NO2, where the nickel atom is formally in the +1 oxidation state. (c) 2005 Elsevier B.V. All rights reserved.

Reaping the benefits: science and the sustainable intensification of global agriculture

Food security is one of this century’s key global challenges. By 2050 the world will require increased crop production in order to feed its predicted 9 billion people. This must be done in the face of changing consumption patterns, the impacts of climate change and the growing scarcity of water and land. Crop production methods will also have to sustain the environment, preserve natural resources and support livelihoods of farmers and rural populations around the world. There is a pressing need for the ‘sustainable intensifi cation’ of global agriculture in which yields are increased without adverse environmental impact and without the cultivation of more land. Addressing the need to secure a food supply for the whole world requires an urgent international effort with a clear sense of long-term challenges and possibilities. Biological science, especially publicly funded science, must play a vital role in the sustainable intensifi cation of food crop production. The UK has a responsibility and the capacity to take a leading role in providing a range of scientifi c solutions to mitigate potential food shortages. This will require signifi cant funding of cross-disciplinary science for food security. The constraints on food crop production are well understood, but differ widely across regions. The availability of water and good soils are major limiting factors. Signifi cant losses in crop yields occur due to pests, diseases and weed competition. The effects of climate change will further exacerbate the stresses on crop plants, potentially leading to dramatic yield reductions. Maintaining and enhancing the diversity of crop genetic resources is vital to facilitate crop breeding and thereby enhance the resilience of food crop production. Addressing these constraints requires technologies and approaches that are underpinned by good science. Some of these technologies build on existing knowledge, while others are completely radical approaches, drawing on genomics and high-throughput analysis. Novel research methods have the potential to contribute to food crop production through both genetic improvement of crops and new crop and soil management practices. Genetic improvements to crops can occur through breeding or genetic modifi cation to introduce a range of desirable traits. The application of genetic methods has the potential to refi ne existing crops and provide incremental improvements. These methods also have the potential to introduce radical and highly signifi cant improvements to crops by increasing photosynthetic effi ciency, reducing the need for nitrogen or other fertilisers and unlocking some of the unrealised potential of crop genomes. The science of crop management and agricultural practice also needs to be given particular emphasis as part of a food security grand challenge. These approaches can address key constraints in existing crop varieties and can be applied widely. Current approaches to maximising production within agricultural systems are unsustainable; new methodologies that utilise all elements of the agricultural system are needed, including better soil management and enhancement and exploitation of populations of benefi cial soil microbes. Agronomy, soil science and agroecology—the relevant sciences—have been neglected in recent years. Past debates about the use of new technologies for agriculture have tended to adopt an either/or approach, emphasising the merits of particular agricultural systems or technological approaches and the downsides of others. This has been seen most obviously with respect to genetically modifi ed (GM) crops, the use of pesticides and the arguments for and against organic modes of production. These debates have failed to acknowledge that there is no technological panacea for the global challenge of sustainable and secure global food production. There will always be trade-offs and local complexities. This report considers both new crop varieties and appropriate agroecological crop and soil management practices and adopts an inclusive approach. No techniques or technologies should be ruled out. Global agriculture demands a diversity of approaches, specific to crops, localities, cultures and other circumstances. Such diversity demands that the breadth of relevant scientific enquiry is equally diverse, and that science needs to be combined with social, economic and political perspectives. In addition to supporting high-quality science, the UK needs to maintain and build its capacity to innovate, in collaboration with international and national research centres. UK scientists and agronomists have in the past played a leading role in disciplines relevant to agriculture, but training in agricultural sciences and related topics has recently suffered from a lack of policy attention and support. Agricultural extension services, connecting farmers with new innovations, have been similarly neglected in the UK and elsewhere. There is a major need to review the support for and provision of extension services, particularly in developing countries. The governance of innovation for agriculture needs to maximise opportunities for increasing production, while at the same time protecting societies, economies and the environment from negative side effects. Regulatory systems need to improve their assessment of benefits. Horizon scanning will ensure proactive consideration of technological options by governments. Assessment of benefi ts, risks and uncertainties should be seen broadly, and should include the wider impacts of new technologies and practices on economies and societies. Public and stakeholder dialogue—with NGOs, scientists and farmers in particular—needs to be a part of all governance frameworks.

Numerical computation of an analytic singular value decomposition of a matrix valued function

This paper extends the singular value decomposition to a path of matricesE(t). An analytic singular value decomposition of a path of matricesE(t) is an analytic path of factorizationsE(t)=X(t)S(t)Y(t) T whereX(t) andY(t) are orthogonal andS(t) is diagonal. To maintain differentiability the diagonal entries ofS(t) are allowed to be either positive or negative and to appear in any order. This paper investigates existence and uniqueness of analytic SVD's and develops an algorithm for computing them. We show that a real analytic pathE(t) always admits a real analytic SVD, a full-rank, smooth pathE(t) with distinct singular values admits a smooth SVD. We derive a differential equation for the left factor, develop Euler-like and extrapolated Euler-like numerical methods for approximating an analytic SVD and prove that the Euler-like method converges.

Neural correlates of true and false memory in mild cognitive impairment

The goal of this research was to investigate the changes in neural processing in mild cognitive impairment. We measured phase synchrony, amplitudes, and event-related potentials in veridical and false memory to determine whether these differed in participants with mild cognitive impairment compared with typical, age-matched controls. Empirical mode decomposition phase locking analysis was used to assess synchrony, which is the first time this analysis technique has been applied in a complex cognitive task such as memory processing. The technique allowed assessment of changes in frontal and parietal cortex connectivity over time during a memory task, without a priori selection of frequency ranges, which has been shown previously to influence synchrony detection. Phase synchrony differed significantly in its timing and degree between participant groups in the theta and alpha frequency ranges. Timing differences suggested greater dependence on gist memory in the presence of mild cognitive impairment. The group with mild cognitive impairment had significantly more frontal theta phase locking than the controls in the absence of a significant behavioural difference in the task, providing new evidence for compensatory processing in the former group. Both groups showed greater frontal phase locking during false than true memory, suggesting increased searching when no actual memory trace was found. Significant inter-group differences in frontal alpha phase locking provided support for a role for lower and upper alpha oscillations in memory processing. Finally, fronto-parietal interaction was significantly reduced in the group with mild cognitive impairment, supporting the notion that mild cognitive impairment could represent an early stage in Alzheimer’s disease, which has been described as a ‘disconnection syndrome’.

An evidence-based review on the likely economic and environmental impact of genetically modified cereals and oilseeds for UK agriculture

An evidence-based review of the potential impact that the introduction of genetically-modified (GM) cereal and oilseed crops could have for the UK was carried out. The inter-disciplinary research project addressed the key research questions using scenarios for the uptake, or not, of GM technologies. This was followed by an extensive literature review, stakeholder consultation and financial modelling. The world area of canola, oilseed rape (OSR) low in both erucic acid in the oil and glucosinolates in the meal, was 34M ha in 2012 of which 27% was GM; Canada is the lead producer but it is also grown in the USA, Australia and Chile. Farm level effects of adopting GM OSR include: lower production costs; higher yields and profits; and ease of farm management. Growing GM OSR instead of conventional OSR reduces both herbicide usage and environmental impact. Some 170M ha of maize was grown in the world in 2011 of which 28% was GM; the main producers are the USA, China and Brazil. Spain is the main EU producer of GM maize although it is also grown widely in Portugal. Insect resistant (IR) and herbicide tolerant (HT) are the GM maize traits currently available commercially. Farm level benefits of adopting GM maize are lower costs of production through reduced use of pesticides and higher profits. GM maize adoption results in less pesticide usage than on conventional counterpart crops leading to less residues in food and animal feed and allowing increasing diversity of bees and other pollinators. In the EU, well-tried coexistence measures for growing GM crops in the proximity of conventional crops have avoided gene flow issues. Scientific evidence so far seems to indicate that there has been no environmental damage from growing GM crops. They may possibly even be beneficial to the environment as they result in less pesticides and herbicides being applied and improved carbon sequestration from less tillage. A review of work on GM cereals relevant for the UK found input trait work on: herbicide and pathogen tolerance; abiotic stress such as from drought or salinity; and yield traits under different field conditions. For output traits, work has mainly focussed on modifying the nutritional components of cereals and in connection with various enzymes, diagnostics and vaccines. Scrutiny of applications submitted for field trial testing of GM cereals found around 9000 applications in the USA, 15 in Australia and 10 in the EU since 1996. There have also been many patent applications and granted patents for GM cereals in the USA for both input and output traits;an indication of the scale of such work is the fact that in a 6 week period in the spring of 2013, 12 patents were granted relating to GM cereals. A dynamic financial model has enabled us to better understand and examine the likely performance of Bt maize and HT OSR for the south of the UK, if cultivation is permitted in the future. It was found that for continuous growing of Bt maize and HT OSR, unless there was pest pressure for the former and weed pressure for the latter, the seed premia and likely coexistence costs for a buffer zone between other crops would reduce the financial returns for the GM crops compared with their conventional counterparts. When modelling HT OSR in a four crop rotation, it was found that gross margins increased significantly at the higher levels of such pest or weed pressure, particularly for farm businesses with larger fields where coexistence costs would be scaled down. The impact of the supply of UK-produced GM crops on the wider supply chain was examined through an extensive literature review and widespread stakeholder consultation with the feed supply chain. The animal feed sector would benefit from cheaper supplies of raw materials if GM crops were grown and, in the future, they might also benefit from crops with enhanced nutritional profile (such as having higher protein levels) becoming available. This would also be beneficial to livestock producers enabling lower production costs and higher margins. Whilst coexistence measures would result in increased costs, it is unlikely that these would cause substantial changes in the feed chain structure. Retailers were not concerned about a future increase in the amount of animal feed coming from GM crops. To conclude, we (the project team) feel that the adoption of currently available and appropriate GM crops in the UK in the years ahead would benefit farmers, consumers and the feed chain without causing environmental damage. Furthermore, unless British farmers are allowed to grow GM crops in the future, the competitiveness of farming in the UK is likely to decline relative to that globally.

Decomposition of surface electromyographic signal using Hidden Markov Model

The detection of physiological signals from the motor system (electromyographic signals) is being utilized in the practice clinic to guide the therapist in a more precise and accurate diagnosis of motor disorders. In this context, the process of decomposition of EMG (electromyographic) signals that includes the identification and classification of MUAP (Motor Unit Action Potential) of a EMG signal, is very important to help the therapist in the evaluation of motor disorders. The EMG decomposition is a complex task due to EMG features depend on the electrode type (needle or surface), its placement related to the muscle, the contraction level and the health of the Neuromuscular System. To date, the majority of researches on EMG decomposition utilize EMG signals acquired by needle electrodes, due to their advantages in processing this type of signal. However, relatively few researches have been conducted using surface EMG signals. Thus, this article aims to contribute to the clinical practice by presenting a technique that permit the decomposition of surface EMG signal via the use of Hidden Markov Models. This process is supported by the use of differential evolution and spectral clustering techniques. The developed system presented coherent results in: (1) identification of the number of Motor Units actives in the EMG signal; (2) presentation of the morphological patterns of MUAPs in the EMG signal; (3) identification of the firing sequence of the Motor Units. The model proposed in this work is an advance in the research area of decomposition of surface EMG signals.

Soils of contrasting pH affect the decomposition of buried mammalian (Ovis aries) skeletal muscle tissue

Little is known about the effect of edaphic conditions on the decomposition of buried mammalian tissues. To address this, we set up a replicated incubation study with three fresh soils of contrasting pH: a Podsol (acidic), a Cambisol (neutral), and a Rendzina (alkaline), in which skeletal muscle tissue (SMT) of known mass was allowed to decompose. Our results clearly demonstrated that soil type had a considerable effect on the decomposition of SMT buried in soil. Differences in the rate of decomposition were up to three times greater in the Podsol compared with the Rendzina. The rate of microbial respiration was correlated to the rate of soft tissue loss, which suggests that the decomposition of SMT is dependent on the microbial community present in the soil. Decompositional by-products caused the pH of the immediate soil environment to change, becoming more alkaline at first, before acidifying. Our results demonstrate the need for greater consideration of soil type in future taphonomic studies.