Towards accurate estimation of the proportion of true null hypotheses in multiple testing

Background

Biomedical researchers are now often faced with situations where it is necessary to test a large number of hypotheses simultaneously, eg, in comparative gene expression studies using high-throughput microarray technology. To properly control false positive errors the FDR (false discovery rate) approach has become widely used in multiple testing. The accurate estimation of FDR requires the proportion of true null hypotheses being accurately estimated. To date many methods for estimating this quantity have been proposed. Typically when a new method is introduced, some simulations are carried out to show the improved accuracy of the new method. However, the simulations are often very limited to covering only a few points in the parameter space.

Results

Here I have carried out extensive in silico experiments to compare some commonly used methods for estimating the proportion of true null hypotheses. The coverage of these simulations is unprecedented thorough over the parameter space compared to typical simulation studies in the literature. Thus this work enables us to draw conclusions globally as to the performance of these different methods. It was found that a very simple method gives the most accurate estimation in a dominantly large area of the parameter space. Given its simplicity and its overall superior accuracy I recommend its use as the first choice for estimating the proportion of true null hypotheses in multiple testing.

Monitoring and population estimation of the European badger (Meles meles) in Northern Ireland

The estimation of animal abundance has a central role in wildlife management and research, including the role of badgers Meles meles in bovine tuberculosis transmission to cattle. This is the first study to examine temporal change in the badger population of Northern Ireland over amedium- to long-term time frame of 14-18 years by repeating a national survey first conducted during 1990-1993. A total of 212 1-km2 squares were surveyed during 2007-2008 and the number, type and activity of setts therein recorded. Badgers were widespread with 75% of squares containing at least one sett. The mean density of activemain setts,which was equivalent to badger social group density, was 0.56 (95%CI: 0.46-0.67) active main setts per km2 during 2007-2008. Social group density varied significantly among landclass groups and counties. The total number of social groups was estimated at 7,600 (95%CI: 6,200-9,000) and, not withstanding probable sources of error in estimating social group size, the total abundance of badgers was estimated to be 34,100 (95% CI: 26,200-42,000). There was no significant change in the badger population from that recorded during 1990-1993. A resource selection model provided a relative probability of sett construction at a spatial scale of 25m. Sett locations were negatively associated with elevation and positively associated with slope, aspect, soil sand content, the presence of cover, and the area of improved grassland and arable agriculture within 300 m.

Estimation of survival rate and extinction probability for stage-structured populations with overlapping life stages

The development of methods providing reliable estimates of demographic parameters (e. g., survival rates, fecundity) for wild populations is essential to better understand the ecology and conservation requirements of individual species. A number of methods exist for estimating the demographics of stage-structured populations, but inherent mathematical complexity often limits their uptake by conservation practitioners. Estimating survival rates for pond-breeding amphibians is further complicated by their complex migratory and reproductive behaviours, often resulting in nonobservable states and successive cohorts of eggs and tadpoles. Here we used comprehensive data on 11 distinct breeding toad populations (Bufo calamita) to clarify and assess the suitability of a relatively simple method [the Kiritani-Nakasuji-Manly (KNM) method] to estimate the survival rates of stage-structured populations with overlapping life stages. The study shows that the KNM method is robust and provides realistic estimates of amphibian egg and larval survival rates for species in which breeding can occur as a single pulse or over a period of several weeks. The study also provides estimates of fecundity for seven distinct toad populations and indicates that it is essential to use reliable estimates of fecundity to limit the risk of under- or overestimating the survival rates when using the KNM method. Survival and fecundity rates for B. calamita populations were then used to define population matrices and make a limited exploration of their growth and viability. The findings of the study recently led to the implementation of practical conservation measures at the sites where populations were most vulnerable to extinction. © 2010 The Society of Population Ecology and Springer.

A longitudinal analysis of estimation, counting skills, and mathematical ability across the first school year

In response to claims that the quality (and in particular linearity) of children's mental representation of number acts as a constraint on number development, we carried out a longitudinal assessment of the relationships between number line estimation, counting, and mathematical abilities. Ninety-nine 5-year-olds were tested on 4 occasions at 3 monthly intervals. Correlations between the 3 types of ability were evident, but while the quality of children's estimations changed over time and performance on the mathematical tasks improved over the same period, changes in one were not associated with changes in the other. In contrast to the earlier claims that the linearity of number representation is potentially a unique contributor to children's mathematical development, the data suggest that this variable is not significantly privileged in its impact over and above simple procedural number skills. We propose that both early arithmetic success and estimating skill are bound closely to developments in counting ability.

Are there developmentally distinct motor indicators of pain in preterm infants?

The aims of this study were to examine preterm infant reactions to pain in detail over prolonged time periods using multiple measures, and to assess the value of including specific body movements of the Neonatal Individualized Developmental Care and Assessment Program (NIDCAP) system to evaluate pain. Ten preterm infants born at 31 weeks mean gestational age (GA) and mean birth weight 1676 g were studied during a routine blood collection in a Level III neonatal intensive care unit (NICU). At 32-week post-conceptional age, computerized physiologic and video recordings were obtained continuously for 60 min (prior to, during and after lance). Motor and facial behaviors were coded independently, using the NIDCAP and the NFCS (Neonatal Facial Coding System), respectively, and compared with heart rate (HR) and oxygen saturation responses. Of the movements hypothesized to be stress cues in the NIDCAP model, extension of arms and legs (80%) and finger splay (70%) were the most common following lance. Contrary to the model, most infants (70%) had lower incidence of twitches and startles post-lance compared to baseline. Whereas all infants showed some NFCS response to lance, for three infants, the magnitude was low. HR increased and oxygen saturation decreased post-lance. Infants with more prior pain exposure, lower Apgar, and lower GA at birth, displayed more motor stress cues but less facial activity post-lance. Extension of extremities and finger splay, but not twitches and startles, from the NIDCAP, appear to be stress cues and show promise as clinical pain indicators to supplement facial and physiological pain measures in preterm infants.

Nonparametric Estimation of Data Dimensionality Prior to Data Compression: the case of the Human Development Index

In many applications in applied statistics researchers reduce the complexity of a data set by combining a group of variables into a single measure using factor analysis or an index number. We argue that such compression loses information if the data actually has high dimensionality. We advocate the use of a non-parametric estimator, commonly used in physics (the Takens estimator), to estimate the correlation dimension of the data prior to compression. The advantage of this approach over traditional linear data compression approaches is that the data does not have to be linearized. Applying our ideas to the United Nations Human Development Index we find that the four variables that are used in its construction have dimension three and the index loses information.

Loss-of-Mains Protection System by Application of Phasor Measurement Unit Technology with Experimentally Assessed Threshold Settings

Loss-of-mains protection is an important component of the protection systems of embedded generation. The role of loss-of-mains is to disconnect the embedded generator from the utility grid in the event that connection to utility dispatched generation is lost. This is necessary for a number of reasons, including the safety of personnel during fault restoration and the protection of plant against out-of-synchronism reclosure to the mains supply. The incumbent methods of loss-of-mains protection were designed when the installed capacity of embedded generation was low, and known problems with nuisance tripping of the devices were considered acceptable because of the insignificant consequence to system operation. With the dramatic increase in the installed capacity of embedded generation over the last decade, the limitations of current islanding detection methods are no longer acceptable. This study describes a new method of loss-of-mains protection based on phasor measurement unit (PMU) technology, specifically using a low cost PMU device of the authors' design which has been developed for distribution network applications. The proposed method addresses the limitations of the incumbent methods, providing a solution that is free of nuisance tripping and has a zero non-detection zone. This system has been tested experimentally and is shown to be practical, feasible and effective. Threshold settings for the new method are recommended based on data acquired from both the Great Britain and Ireland power systems.

Distribution of terminal nerve entry points to the flexor and extensor groups of forearm muscles:An anatomical study

The motor points of the skeletal muscles, mainly of interest to anatomists and physiologists, have recently attracted much attention from researchers in the field of functional electrical stimulation. The muscle motor point has been defined as the entry point of the motor nerve branch into the epimysium of the muscle belly. Anatomists have pointed out that many muscles in the limbs have multiple motor points. Knowledge of the location of nerve branches and terminal nerve entry points facilitates the exact insertion and the suitable selection of the number of electrodes required for each muscle for functional electrical stimulation. The present work therefore aimed to describe the number, location, and distribution of motor points in the human forearm muscles to obtain optimal hand function in many clinical situations. Twenty three adult human cadaveric forearms were dissected. The numbers of primary nerves and motor points for each muscle were tabulated. The mean numbers and the standard deviation were calculated and grouped in tables. Data analyses were performed with the use of a statistical analysis package (SPSS 13.0). The proximal third of the muscle was the usual part of the muscle that received the motor points. Most of the forearm muscles were innervated from the lateral side and deep surface of the muscle. The information in this study may also be usefully applied in selective denervation procedures to balance muscles in spastic upper limbs. Copyright © 2007 Via Medica.

Exercise rehabilitation following intensive care unit discharge for recovery from critical illness

Background: Skeletal muscle wasting and weakness are significant complications of critical illness, associated with the degree of illness severity and periods of reduced mobility during mechanical ventilation. They contribute to the profound physical and functional deficits observed in survivors. These impairments may persist for many years following discharge from the intensive care unit (ICU) and may markedly influence health-related quality of life. Rehabilitation is a key strategy in the recovery of patients following critical illness. Exercise based interventions are aimed at targeting this muscle wasting and weakness. Physical rehabilitation delivered during ICU admission has been systematically evaluated and shown to be beneficial. However its effectiveness when initiated after ICU discharge has yet to be established. Objectives: To assess the effectiveness of exercise rehabilitation programmes, initiated after ICU discharge, on functional exercise capacity and health-related quality of life in adult ICU survivors who have been mechanically ventilated for more than 24 hours. Search methods:We searched the following databases: the Cochrane Central Register of Controlled Trials (CENTRAL) (The Cochrane Library), OvidSP MEDLINE, Ovid SP EMBASE, and CINAHL via EBSCO host to 15th May 2014. We used a specific search strategy for each database. This included synonyms for ICU and critical illness, exercise training and rehabilitation. We searched the reference lists of included studies and contacted primary authors to obtain further information regarding potentially eligible studies. We also searched major clinical trials registries (Clinical Trials and Current Controlled Trials) and the personal libraries of the review authors. We applied no language or publication restriction. We reran the search in February 2015. We will deal with any studies of interest when we update the review.  Selection criteria:We included randomized controlled trials (RCTs), quasi-RCTs, and controlled clinical trials (CCTs) that compared an exercise interventioninitiated after ICU discharge to any other intervention or a control or ‘usual care’ programme in adult (≥18years) survivors ofcritical illness. Data collection and analysis:We used standard methodological procedures expected by The Cochrane Collaboration. Main results:We included six trials (483 adult ICU participants). Exercise-based interventions were delivered on the ward in two studies; both onthe ward and in the community in one study; and in the community in three studies. The duration of the intervention varied according to the length of stay in hospital following ICU discharge (up to a fixed duration of 12 weeks).Risk of bias was variable for all domains across all trials. High risk of bias was evident in all studies for performance bias, although blinding of participants and personnel in therapeutic rehabilitation trials can be pragmatically challenging. Low risk of bias was at least 50% for all other domains across all trials, although high risk of bias was present in one study for random sequence generation (selection bias), incomplete outcome data (attrition bias) and other sources. Risk of bias was unclear for remaining studies across the domains.All six studies measured effect on the primary outcome of functional exercise capacity, although there was wide variability in natureof intervention, outcome measures and associated metrics, and data reporting. Overall quality of the evidence was very low. Only two studies using the same outcome measure for functional exercise capacity, had the potential for pooling of data and assessment of heterogeneity. On statistical advice, this was considered inappropriate to perform this analysis and study findings were therefore qualitatively described. Individually, three studies reported positive results in favour of the intervention. A small benefit (versus. control)was evident in anaerobic threshold in one study (mean difference, MD (95% confidence interval, CI), 1.8 mlO2/kg/min (0.4 to 3.2),P value = 0.02), although this effect was short-term, and in a second study, both incremental (MD 4.7 (95% CI 1.69 to 7.75) Watts, P value = 0.003) and endurance (MD 4.12 (95% CI 0.68 to 7.56) minutes, P value = 0.021) exercise testing demonstrated improvement.Finally self-reported physical function increased significantly following a rehabilitation manual (P value = 0.006). Remaining studies found no effect of the intervention.Similar variability in with regard findings for the primary outcome of health-related quality of life were also evident. Only two studies evaluated this outcome. Following statistical advice, these data again were considered inappropriate for pooling to determine overall effect and assessment of heterogeneity. Qualitative description of findings was therefore undertaken. Individually, neither study reported differences between intervention and control groups for health-related quality of life as a result of the intervention. Overall quality of the evidence was very low.Mortality was reported by all studies, ranging from 0% to 18.8%. Only one non-mortality adverse event was reported across all patients in all studies (a minor musculoskeletal injury). Withdrawals, reported in four studies, ranged from 0% to 26.5% in control groups,and 8.2% to 27.6% in intervention groups. Loss to follow-up, reported in all studies, ranged from 0% to 14% in control groups, and 0% to 12.5% in intervention groups. Authors’ conclusions:We are unable, at this time, to determine an overall effect on functional exercise capacity, or health-related quality of life, of an exercise based intervention initiated after ICU discharge in survivors of critical illness. Meta-analysis of findings was not appropriate. This was due to insufficient study number and data. Individual study findings were inconsistent. Some studies reported a beneficial effect of the intervention on functional exercise capacity, and others not. No effect was reported on health-related quality of life. Methodological rigour was lacking across a number of domains influencing quality of the evidence. There was also wide variability in the characteristics of interventions, outcome measures and associated metrics, and data reporting.If further trials are identified, we may be able to determine the effect of exercise-based interventions following ICU discharge, on functional exercise capacity and health-related quality of life in survivors of critical illness.

Molecular pedigree reconstruction and estimation of evolutionary parameters in a wild Atlantic salmon river system with incomplete sampling: a power analysis

Background: Pedigree reconstruction using genetic analysis provides a useful means to estimate fundamental population biology parameters relating to population demography, trait heritability and individual fitness when combined with other sources of data. However, there remain limitations to pedigree reconstruction in wild populations, particularly in systems where parent-offspring relationships cannot be directly observed, there is incomplete sampling of individuals, or molecular parentage inference relies on low quality DNA from archived material. While much can still be inferred from incomplete or sparse pedigrees, it is crucial to evaluate the quality and power of available genetic information a priori to testing specific biological hypotheses. Here, we used microsatellite markers to reconstruct a multi-generation pedigree of wild Atlantic salmon (Salmo salar L.) using archived scale samples collected with a total trapping system within a river over a 10 year period. Using a simulation-based approach, we determined the optimal microsatellite marker number for accurate parentage assignment, and evaluated the power of the resulting partial pedigree to investigate important evolutionary and quantitative genetic characteristics of salmon in the system.

Results: We show that at least 20 microsatellites (ave. 12 alleles/locus) are required to maximise parentage assignment and to improve the power to estimate reproductive success and heritability in this study system. We also show that 1.5 fold differences can be detected between groups simulated to have differing reproductive success, and that it is possible to detect moderate heritability values for continuous traits (h(2) similar to 0.40) with more than 80% power when using 28 moderately to highly polymorphic markers.

Conclusion: The methodologies and work flow described provide a robust approach for evaluating archived samples for pedigree-based research, even where only a proportion of the total population is sampled. The results demonstrate the feasibility of pedigree-based studies to address challenging ecological and evolutionary questions in free-living populations, where genealogies can be traced only using molecular tools, and that significant increases in pedigree assignment power can be achieved by using higher numbers of markers.

An integrated approach for real-time model-based state-of-charge estimation of lithium-ion batteries

Lithium-ion batteries have been widely adopted in electric vehicles (EVs), and accurate state of charge (SOC) estimation is of paramount importance for the EV battery management system. Though a number of methods have been proposed, the SOC estimation for Lithium-ion batteries, such as LiFePo4 battery, however, faces two key challenges: the flat open circuit voltage (OCV) vs SOC relationship for some SOC ranges and the hysteresis effect. To address these problems, an integrated approach for real-time model-based SOC estimation of Lithium-ion batteries is proposed in this paper. Firstly, an auto-regression model is adopted to reproduce the battery terminal behaviour, combined with a non-linear complementary model to capture the hysteresis effect. The model parameters, including linear parameters and non-linear parameters, are optimized off-line using a hybrid optimization method that combines a meta-heuristic method (i.e., the teaching learning based optimization method) and the least square method. Secondly, using the trained model, two real-time model-based SOC estimation methods are presented, one based on the real-time battery OCV regression model achieved through weighted recursive least square method, and the other based on the state estimation using the extended Kalman filter method (EKF). To tackle the problem caused by the flat OCV-vs-SOC segments when the OCV-based SOC estimation method is adopted, a method combining the coulombic counting and the OCV-based method is proposed. Finally, modelling results and SOC estimation results are presented and analysed using the data collected from LiFePo4 battery cell. The results confirmed the effectiveness of the proposed approach, in particular the joint-EKF method.

Rapid-bTB: a novel lateral flow test able to differentiate Mycobacterium bovis from Mycobacterium tuberculosis in sputum

Background: A novel lateral flow, immunochromatographic assay (LFD) specific for Mycobacterium bovis, the cause of bovine tuberculosis and zoonotic TB, was recently developed at Queen’s University Belfast. The LFD detects whole M. bovis cells, in contrast to other commercially available LFD tests (BD MGITTM TBc ID, SD Bioline TB Ag MPT 64, Capilia TB-Neo kit) which detect MPT64 antigen secreted during growth. The new LFD test has been evaluated in the veterinary context, and its specificity for M. bovis in the broadest sense (i.e. subsp. bovis, subsp. caprae and BCG) and sensitivity to detect M. bovis in positive MGIT™ liquid cultures was demonstrated comprehensively.
Methods: Preliminary work was carried out by researchers at Queen’s University Belfast to optimise sputum sample preparation, estimate the limit of detection (LOD) of the LFD with M. bovis-spiked sputum samples, and check LFD specificity by testing a broad range of non-tuberculous Mycobacterium spp. (NTM) and other bacterial genera commonly encountered in sputum samples (Haemophilus, Klebsiella, Pseudomonas, Staphylococcus). In the Cameroon laboratory direct detection of M. bovis in human sputa was attempted, and 50 positive sputum MGIT™ cultures and 33 cultures of various Mycobacterium spp. originally isolated from human sputa were tested.
Results: Sputum sample preparation consisted of digestion with 1% NALC for 30 min, centrifugation at 3000g for 20 min, PBS wash, centrifugation again, and pellet resuspended in KPL blocking buffer before 100 µl was applied to the LFD. The LOD of the LFD applied to M. bovis-spiked sputum was estimated to be 104 CFU/ml. A small number of confirmed Ziehl-Neelsen ‘3+’ M. bovis positive sputum samples were tested directly but no positive LFD results were obtained. All of the sputum MGIT™ cultures and mycobacterial cultures (including M. tuberculosis, M. africanum, M. bovis, M. intracellulare, M. scrofulaceum, M. fortuitum, M. peregrinum, M. interjectum) tested LFD negative when read after 15 min except for the M. bovis cultures, thereby confirming specificity of LFD for M. bovis in the clinical microbiology context.
Conclusions: Results indicate that the ‘Rapid-bTB’ LFD is a very specific test, able to differentiate M. bovis from M. tuberculosis, M. africanum, and a range of NTM isolated from human sputa in MGITTM liquid cultures. However, the LFD lacks sufficient sensitivity to be applied earlier in the diagnostic process to directly test human sputa.

Development of a Novel Assay for the Detection of Active Neutrophil Elastase in Patients with Chronic Obstructive Pulmonary Disease

Neutrophil elastase (NE), a biomarker of infection and inflammation, correlates with the severity of several respiratory diseases including chronic obstructive pulmonary disease (COPD). However, it’s detection and quantification in biological samples is confounded by a lack of reliable and robust methodologies. Standard assays using chromogenic or fluorogenic substrates are not specific when added to complex clinical samples containing multiple proteolytic and hydrolytic enzymes which have the ability to hydrolyse the substrate, thereby resulting in an over-estimation of the target protease. Furthermore, ELISA systems measure total protease levels which can be a mixture of latent, active and protease-inhibitor complexes. Therefore, we have developed a novel immunoassay (ProteaseTag™ Active NE Immunoassay) which is selective and specific for the capture of active NE in sputum and Bronchoalveolar Lavage (BAL) in patients with COPD. The objective of this study was to clinically validate ProteaseTag™ Active NE Ultra Immunoassay for the detection of NE in sputum from COPD patients. 20 matched sputum sol samples were collected from 10 COPD patients (M=6, F=4; 73 ± 6 years) during stable and exacerbation phases. Samples were assayed for NE activity utilising both ProteaseTag™ Active NE Ultra Immunoassay and a fluorogenic substrate-based kinetic activity assay. Both assays detected elevated levels of NE in the majority of patients (n=7) during an exacerbation (mean=217.2 μg/ml ±296.6) compared to their stable phase (mean=92.37 μg/ml ±259.8). However, statistical analysis did not show this difference to be significant (p=0.07, ProteaseTag™ Active NE Ultra Immunoassay; p=0.06 kinetic assay), most likely due to the low study number. A highly significant correlation was found between the 2 assay types (p≤0.0001, r=0.996). NE as a primary efficacy endpoint in clinical trials or as a marker of inflammation within the clinic has been hampered by the lack of a robust and simple to use assay. ProteaseTag™ Active NE Immunoassay specifically measures only active NE in clinical samples, is quick and easy to use (< 3 hours) and has no dependency on a kinetic readout. ProteaseTag™ technology is currently being transferred to a lateral flow device for use at Point of Care.

Lateral bias and temperament in the domestic cat (Felis silvestris)

Research points to a relationship between lateralization and emotional functioning in humans and many species of animal. The present study explored the association between paw preferences and emotional functioning, specifically temperament, in a species thus far overlooked in this area, the domestic cat. Thirty left-pawed, 30 right-pawed, and 30 ambilateral pet cats were recruited following an assessment of their paw preferences using a food-reaching challenge. The animals’ temperament was subsequently assessed using the Feline Temperament Profile (FTP). Cats’ owners also completed a purpose-designed cat temperament (CAT) scale. Analysis revealed a significant relationship between lateral bias and FTP and CAT scale scores. Ambilateral cats had lower positive (FTP+) scores, and were perceived as less affectionate, obedient, friendly, and more aggressive, than left or right-pawed animals. Left and right pawed cats differed significantly on 1 trait on the CAT scale, namely playfulness. The strength of the cats’ paw preferences was related to the animals’ FTP and CAT scores. Cats with a greater strength of paw preference had higher FTP + scores than those with a weaker strength of paw preference. Animals with stronger paw preferences were perceived as more confident, affectionate, active, and friendly than those with weaker paw preferences. Results suggest that motor laterality in the cat is strongly related to temperament and that the presence or absence of lateralization has greater implications for the expression of emotion in this species than the direction of the lateralized bias.