Reliability measures for local nodes assessment in classification trees

Most of the modem developments with classification trees are aimed at improving their predictive capacity. This article considers a curiously neglected aspect of classification trees, namely the reliability of predictions that come from a given classification tree. In the sense that a node of a tree represents a point in the predictor space in the limit, the aim of this article is the development of localized assessment of the reliability of prediction rules. A classification tree may be used either to provide a probability forecast, where for each node the membership probabilities for each class constitutes the prediction, or a true classification where each new observation is predictively assigned to a unique class. Correspondingly, two types of reliability measure will be derived-namely, prediction reliability and classification reliability. We use bootstrapping methods as the main tool to construct these measures. We also provide a suite of graphical displays by which they may be easily appreciated. In addition to providing some estimate of the reliability of specific forecasts of each type, these measures can also be used to guide future data collection to improve the effectiveness of the tree model. The motivating example we give has a binary response, namely the presence or absence of a species of Eucalypt, Eucalyptus cloeziana, at a given sampling location in response to a suite of environmental covariates, (although the methods are not restricted to binary response data).

Validation of a food-frequency questionnaire assessment of carotenoid and vitamin E intake using weighed food records and plasma biomarkers: The method of triads model

Background: Reliability or validity studies are important for the evaluation of measurement error in dietary assessment methods. An approach to validation known as the method of triads uses triangulation techniques to calculate the validity coefficient of a food-frequency questionnaire (FFQ). Objective: To assess the validity of an FFQ estimates of carotenoid and vitamin E intake against serum biomarker measurements and weighed food records (WFRs), by applying the method of triads. Design: The study population was a sub-sample of adult participants in a randomised controlled trial of beta-carotene and sunscreen in the prevention of skin cancer. Dietary intake was assessed by a self-administered FFQ and a WFR. Nonfasting blood samples were collected and plasma analysed for five carotenoids (alpha-carotene, beta-carotene, beta-cryptoxanthin, lutein, lycopene) and vitamin E. Correlation coefficients were calculated between each of the dietary methods and the validity coefficient was calculated using the method of triads. The 95% confidence intervals for the validity coefficients were estimated using bootstrap sampling. Results: The validity coefficients of the FFQ were highest for alpha-carotene (0.85) and lycopene (0.62), followed by beta- carotene (0.55) and total carotenoids (0.55), while the lowest validity coefficient was for lutein (0.19). The method of triads could not be used for b- cryptoxanthin and vitamin E, as one of the three underlying correlations was negative. Conclusions: Results were similar to other studies of validity using biomarkers and the method of triads. For many dietary factors, the upper limit of the validity coefficients was less than 0.5 and therefore only strong relationships between dietary exposure and disease will be detected.

Advantage of single-trial models for response to selection in wheat breeding multi-environment trials

An investigation was conducted to evaluate the impact of experimental designs and spatial analyses (single-trial models) of the response to selection for grain yield in the northern grains region of Australia (Queensland and northern New South Wales). Two sets of multi-environment experiments were considered. One set, based on 33 trials conducted from 1994 to 1996, was used to represent the testing system of the wheat breeding program and is referred to as the multi-environment trial (MET). The second set, based on 47 trials conducted from 1986 to 1993, sampled a more diverse set of years and management regimes and was used to represent the target population of environments (TPE). There were 18 genotypes in common between the MET and TPE sets of trials. From indirect selection theory, the phenotypic correlation coefficient between the MET and TPE single-trial adjusted genotype means [r(p(MT))] was used to determine the effect of the single-trial model on the expected indirect response to selection for grain yield in the TPE based on selection in the MET. Five single-trial models were considered: randomised complete block (RCB), incomplete block (IB), spatial analysis (SS), spatial analysis with a measurement error (SSM) and a combination of spatial analysis and experimental design information to identify the preferred (PF) model. Bootstrap-resampling methodology was used to construct multiple MET data sets, ranging in size from 2 to 20 environments per MET sample. The size and environmental composition of the MET and the single-trial model influenced the r(p(MT)). On average, the PF model resulted in a higher r(p(MT)) than the IB, SS and SSM models, which were in turn superior to the RCB model for MET sizes based on fewer than ten environments. For METs based on ten or more environments, the r(p(MT)) was similar for all single-trial models.

A time-domain test for some types of nonlinearity

The bispectrum and third-order moment can be viewed as equivalent tools for testing for the presence of nonlinearity in stationary time series. This is because the bispectrum is the Fourier transform of the third-order moment. An advantage of the bispectrum is that its estimator comprises terms that are asymptotically independent at distinct bifrequencies under the null hypothesis of linearity. An advantage of the third-order moment is that its values in any subset of joint lags can be used in the test, whereas when using the bispectrum the entire (or truncated) third-order moment is required to construct the Fourier transform. In this paper, we propose a test for nonlinearity based upon the estimated third-order moment. We use the phase scrambling bootstrap method to give a nonparametric estimate of the variance of our test statistic under the null hypothesis. Using a simulation study, we demonstrate that the test obtains its target significance level, with large power, when compared to an existing standard parametric test that uses the bispectrum. Further we show how the proposed test can be used to identify the source of nonlinearity due to interactions at specific frequencies. We also investigate implications for heuristic diagnosis of nonstationarity.

Relationships of sauries and needlefishes (Teleostei : Scomberesocoidea) to the internally fertilizing halfbeaks (Zenarchopteridae) based on the pharyngeal jaw apparatus

The 40 life history, myological, and osteological characters that Tibbetts (1992) used in his study of the hemiramphids are evaluated for both saury genera (Cololabis and Scomberesox) to determine if the Scomberesocidae are more closely related to the Zenarchopteridae, to the needlefishes (Belonidae), or to the halfbeaks (Hemiramphidae) and flyingfishes (Exocoetidae). Data were analyzed using PAUP*, and eight equally parsimonious trees were found (70 steps, CI 0.814, RI 0.938). This analysis indicates that sauries are most closely related to needlefishes, supporting the historical concept of the superfamily Scomberesocoidea as a monophyletic assemblage. A caudal displacement of the origin of the retractor dorsalis muscle is a tentative additional synapomorphy for all four saury species. Zenarchopteridae is strongly supported as a valid family sister to the Scomberesocoidea (decay index = 19, bootstrap = 100). Resolution of the internal structure of the Belonidae and the Hemiramphidae requires the identification of additional characters and examination of a greater number of taxa.

Cloning and sequence analysis of pituitary prolactin cDNA from the northern brown bandicoot (Isoodon macrourus)

The nuclectide sequence for pituitary prolactin cDNA from the marsupial bandicoot (Isoodon macrourus) was determined by reverse transcription-polymerase chain reaction and 5'/3' rapid amplification of cDNA ends. The deduced amino acid sequence showed high sequence identity with brushtail possum prolactin (95%) and all of the expected structural features of a quadruped prolactin. A prolactin gene tree was constructed and rates of evolution calculated for bandicoot, possum, opossum and several mammalian and non-mammalian prolactins. Bootstrap analysis provided strong support for marsupials as a sister group with eutherian mammals and weak support for opossum and bandicoot as an independent grouping from the brushtail possum. The rates of molecular evolution for marsupial prolactins were comparable to the slow rate seen in the majority of quadruped prolactins that have been sequenced. (c) 2005 Elsevier Inc. All rights reserved.

Determining the effective dimensionality of the genetic variance-covariance matrix

Determining the dimensionality of G provides an important perspective on the genetic basis of a multivariate suite of traits. Since the introduction of Fisher's geometric model, the number of genetically independent traits underlying a set of functionally related phenotypic traits has been recognized as an important factor influencing the response to selection. Here, we show how the effective dimensionality of G can be established, using a method for the determination of the dimensionality of the effect space from a multivariate general linear model introduced by AMEMIYA (1985). We compare this approach with two other available methods, factor-analytic modeling and bootstrapping, using a half-sib experiment that estimated G for eight cuticular hydrocarbons of Drosophila serrata. In our example, eight pheromone traits were shown to be adequately represented by only two underlying genetic dimensions by Amemiya's approach and factor-analytic modeling of the covariance structure at the sire level. In, contrast, bootstrapping identified four dimensions with significant genetic variance. A simulation study indicated that while the performance of Amemiya's method was more sensitive to power constraints, it performed as well or better than factor-analytic modeling in correctly identifying the original genetic dimensions at moderate to high levels of heritability. The bootstrap approach consistently overestimated the number of dimensions in all cases and performed less well than Amemiya's method at subspace recovery.

Small-scale randomized controlled trials need more powerful methods of mediational analysis than the Baron-Kenny method

Objective: To devise more-effective physical activity interventions, the mediating mechanisms yielding behavioral change need to be identified. The Baron-Kenny method is most commonly used. but has low statistical power and May not identify mechanisms of behavioral change in small-to-medium size Studies. More powerful statistical tests are available, Study Design and Setting: Inactive adults (N = 52) were randomized to either a print or a print-plus-telephone intervention. Walking and exercise-related social support Were assessed at baseline, after file intervention, and 4 weeks later. The Baron-Kenny and three alternative methods of mediational analysis (Freedman-Schatzkin; MacKinnon et al.: bootstrap method) were used to examine the effects of social support on initial behavior change and maintenance. Results: A significant mediational effect of social support on initial behavior change was indicated by the MacKinnon et al., bootstrap. and. marginally. Freedman-Schatzkin methods, but not by the Baron-Kenny method. No significant mediational effecl of social support on maintenance of walking was found. Conclusions: Methodologically rigorous intervention studies to identify mediators of change in physical activity are costly and labor intensive, and may not be feasible with large samples. The Use of statistically powerful tests of mediational effects in small-scale studies can inform the development of more effective interventions. (C) 2006 Elsevier Inc. All rights reserved.

Thelastomatoidea (Nematoda : Oxyurida) of the Australian giant burrowing cockroach, Macropanesthia rhinoceros (Blaberidae : Geoscapheinae)

The thelastomatoid fauna of Macropanesthia rhinoceros was examined from 13 localities across its range in Queensland, Australia. Nine species of thelastomatoids, including two representing new genera, Geoscaphenema megaovum n. g., n. sp. and Jaidenema rhinoceratum n. g., n. sp., were found. Macropanesthia rhinoceros is reported as a new host for seven species previously recorded from Panesthia cribrata (Blaberidae: Panesthiinae) and P. tryoni tryoni, viz, Blattophila sphaerolaima, Leidynemella fusiformis, Cordonicola gibsoni, Travassosinema jaidenae, Coronostoma australiae, Hammerschmidtiella hochi and Desmicola ornata. Overall estimated richness for the system ranged from 10.1-13.5 species. The high degree of parasite faunal overlap between M. rhinoceros and the two Panesthia species is surprising given the disparate ecological niches that they occupy; P. cribrata and P. tryoni tryoni burrow in, and feed upon, moist decaying wood and require a climate that is moist all year round, whereas M. rhinoceros burrows in loose soil, feeds on fallen leaf litter and is tolerant of much drier environments.

What determines the finance-growth nexus? Empirical evidence for threshold models

This paper elaborates the notion of balanced'' financial development that is contingent on a country's general level of development. We develop an empirical framework to address this point, referring to threshold regressions and a bootstrap test for structural shift in a growth equation. We find that countries gain less from financial activity, if the latter fails to keep up with or exceeds what would follow from a balanced expansion path. These analyses contribute to the finance and growth literature in providing empirical support for the balanced'' financial development hypothesis.

A new instrument for targeting falls prevention interventions was accurate and clinically applicable in a hospital setting

Background and Objective: To describe the diagnostic accuracy and practical application of the Peter James Centre Falls Risk Assessment Tool (PJC-FRAT), a multidisciplinary falls risk screening and intervention deployment instrument. Methods: In phase 1, the accuracy of the PJC-FRAT was prospectively compared to a gold standard (the STRATIFY) on a cohort of subacute hospital patients (n = 122). In phase 2, the PJC-FRAT was temporally reassessed using a subsequent cohort (n = 316), with results compared to those of phase 1. Primary outcomes were falls (events), fallers (patients who fell), and hospital completion rates of the PJC-FRAT. Results: In phase 1, PJC-FRAT accuracy of identifying falters showed sensitivity of 73% (bootstrap 95% confidence interval CI = 55, 90) and specificity of 75% (95% CI = 66, 83), compared with the STRATIFY (cutoff >= 2/5) sensitivity of 77% (95% CI = 59, 92) and specificity of 51% (95% CI = 41, 61). This difference was not significant. In phase 2, accuracy of nursing staff using the PJC-FRAT was lower. PJC-FRAT completion rates varied among disciplines over both phases: nurses and physiotherapists, >= 90%; occupational therapists, >= 82%; and medical officers, >= 57%. Conclusion: The PJC-FRAT was practical and relatively accurate as a predictor of falls and a deployment instrument for falls prevention interventions, although continued staff education may be necessary to maintain its accuracy. (c) 2006 Elsevier Inc. All rights reserved.

A D-optimal designed population pharmacokinetic study of itraconazole capsules and solution in adults with cystic fibrosis

Background: Oral itraconazole (ITRA) is used for the treatment of allergic bronchopulmonary aspergillosis in patients with cystic fibrosis (CF) because of its antifungal activity against Aspergillus species. ITRA has an active hydroxy-metabolite (OH-ITRA) which has similar antifungal activity. ITRA is a highly lipophilic drug which is available in two different oral formulations, a capsule and an oral solution. It is reported that the oral solution has a 60% higher relative bioavailability. The influence of altered gastric physiology associated with CF on the pharmacokinetics (PK) of ITRA and its metabolite has not been previously evaluated. Objectives: 1) To estimate the population (pop) PK parameters for ITRA and its active metabolite OH-ITRA including relative bioavailability of the parent after administration of the parent by both capsule and solution and 2) to assess the performance of the optimal design. Methods: The study was a cross-over design in which 30 patients received the capsule on the first occasion and 3 days later the solution formulation. The design was constrained to have a maximum of 4 blood samples per occasion for estimation of the popPK of both ITRA and OH-ITRA. The sampling times for the population model were optimized previously using POPT v.2.0.[1] POPT is a series of applications that run under MATLAB and provide an evaluation of the information matrix for a nonlinear mixed effects model given a particular design. In addition it can be used to optimize the design based on evaluation of the determinant of the information matrix. The model details for the design were based on prior information obtained from the literature, which suggested that ITRA may have either linear or non-linear elimination. The optimal sampling times were evaluated to provide information for both competing models for the parent and metabolite and for both capsule and solution simultaneously. Blood samples were assayed by validated HPLC.[2] PopPK modelling was performed using FOCE with interaction under NONMEM, version 5 (level 1.1; GloboMax LLC, Hanover, MD, USA). The PK of ITRA and OH‑ITRA was modelled simultaneously using ADVAN 5. Subsequently three methods were assessed for modelling concentrations less than the LOD (limit of detection). These methods (corresponding to methods 5, 6 & 4 from Beal[3], respectively) were (a) where all values less than LOD were assigned to half of LOD, (b) where the closest missing value that is less than LOD was assigned to half the LOD and all previous (if during absorption) or subsequent (if during elimination) missing samples were deleted, and (c) where the contribution of the expectation of each missing concentration to the likelihood is estimated. The LOD was 0.04 mg/L. The final model evaluation was performed via bootstrap with re-sampling and a visual predictive check. The optimal design and the sampling windows of the study were evaluated for execution errors and for agreement between the observed and predicted standard errors. Dosing regimens were simulated for the capsules and the oral solution to assess their ability to achieve ITRA target trough concentration (Cmin,ss of 0.5-2 mg/L) or a combined Cmin,ss for ITRA and OH-ITRA above 1.5mg/L. Results and Discussion: A total of 241 blood samples were collected and analysed, 94% of them were taken within the defined optimal sampling windows, of which 31% where taken within 5 min of the exact optimal times. Forty six per cent of the ITRA values and 28% of the OH-ITRA values were below LOD. The entire profile after administration of the capsule for five patients was below LOD and therefore the data from this occasion was omitted from estimation. A 2-compartment model with 1st order absorption and elimination best described ITRA PK, with 1st order metabolism of the parent to OH-ITRA. For ITRA the clearance (ClItra/F) was 31.5 L/h; apparent volumes of central and peripheral compartments were 56.7 L and 2090 L, respectively. Absorption rate constants for capsule (kacap) and solution (kasol) were 0.0315 h-1 and 0.125 h-1, respectively. Comparative bioavailability of the capsule was 0.82. There was no evidence of nonlinearity in the popPK of ITRA. No screened covariate significantly improved the fit to the data. The results of the parameter estimates from the final model were comparable between the different methods for accounting for missing data, (M4,5,6)[3] and provided similar parameter estimates. The prospective application of an optimal design was found to be successful. Due to the sampling windows, most of the samples could be collected within the daily hospital routine, but still at times that were near optimal for estimating the popPK parameters. The final model was one of the potential competing models considered in the original design. The asymptotic standard errors provided by NONMEM for the final model and empirical values from bootstrap were similar in magnitude to those predicted from the Fisher Information matrix associated with the D-optimal design. Simulations from the final model showed that the current dosing regimen of 200 mg twice daily (bd) would provide a target Cmin,ss (0.5-2 mg/L) for only 35% of patients when administered as the solution and 31% when administered as capsules. The optimal dosing schedule was 500mg bd for both formulations. The target success for this dosing regimen was 87% for the solution with an NNT=4 compared to capsules. This means, for every 4 patients treated with the solution one additional patient will achieve a target success compared to capsule but at an additional cost of AUD $220 per day. The therapeutic target however is still doubtful and potential risks of these dosing schedules need to be assessed on an individual basis. Conclusion: A model was developed which described the popPK of ITRA and its main active metabolite OH-ITRA in adult CF after administration of both capsule and solution. The relative bioavailability of ITRA from the capsule was 82% that of the solution, but considerably more variable. To incorporate missing data, using the simple Beal method 5 (using half LOD for all samples below LOD) provided comparable results to the more complex but theoretically better Beal method 4 (integration method). The optimal sparse design performed well for estimation of model parameters and provided a good fit to the data.

Use of routine data for determination of the population pharmacokinetics and enteral biovailability of phenytoin in neonates and infants with seizures

Objective: To investigate the population pharmacokinetics and the enteral bioavailability of phenytoin in neonates and infants with seizures. Methods: Data (5 mg kg-1 day-1) from 83 patients were obtained retrospectively from the medical records following written ethical approval. A one-compartment model was fitted to the data using NONMEM with FOCE-interaction. Between-subject variability (BSV) and interoccasion variability (IOV) were modelled exponentially together with a log transform-both-sides exponential residual unexplained variance (RUV) model. Covariates in nested models were screened for significance (X2, 1, 0.01). Model validity was determined by bootstrapping with replacement (N=500 samples) from the dataset. Results: The parameters of final pharmacokinetic were: Clearance (L h-1) = 0.826.(current Weight [kg]/70)0.75.(1+0.0692.(Postnatal age [days]-11)); Volume of distribution (L) = 74.2.(current Weight [kg]/70); Enteral bioavailability = 0.76; Absorption rate constant (h-1) = 0.167. BSV for clearance and volume of distribution were 74.2% and 65.6%, respectively. The IOV in clearance was 54.4%. The RUV was 51.1%. Final model parameters deviated from mean bootstrap estimates by