Using decision trees to understand structure in missing data

Objectives Demonstrate the application of decision trees – classification and regression trees (CARTs), and their cousins, boosted regression trees (BRTs) – to understand structure in missing data. Setting Data taken from employees at three different industry sites in Australia. Participants 7915 observations were included. Materials and Methods The approach was evaluated using an occupational health dataset comprising results of questionnaires, medical tests, and environmental monitoring. Statistical methods included standard statistical tests and the ‘rpart’ and ‘gbm’ packages for CART and BRT analyses, respectively, from the statistical software ‘R’. A simulation study was conducted to explore the capability of decision tree models in describing data with missingness artificially introduced. Results CART and BRT models were effective in highlighting a missingness structure in the data, related to the Type of data (medical or environmental), the site in which it was collected, the number of visits and the presence of extreme values. The simulation study revealed that CART models were able to identify variables and values responsible for inducing missingness. There was greater variation in variable importance for unstructured compared to structured missingness. Discussion Both CART and BRT models were effective in describing structural missingness in data. CART models may be preferred over BRT models for exploratory analysis of missing data, and selecting variables important for predicting missingness. BRT models can show how values of other variables influence missingness, which may prove useful for researchers. Conclusion Researchers are encouraged to use CART and BRT models to explore and understand missing data.

Modelling milling train performance

This paper describes recent updates to a milling train extraction model used to assess and predict the performance of a milling train. An extension was made to the milling unit model for the bagasse mills to replace the imbibition coefficient with crushing factor and mixing efficiency. New empirical relationships for reabsorption factor, imbibition coefficient, crushing factor, mixing efficiency and purity ratio were developed. The new empirical relationships were tested against factory measurements and previous model predictions. The updated model has been implemented in the SysCAD process modelling software. New additions to the model implementation include: a shredder model to assess or predict cane preparation, mill and shredder drives for power consumption and an updated imbibition control system to add allow water to be added to intermediate mills.

The paradox of creative uncertainty in learning and teaching

In an ever-changing and globalised world there is a need for higher education to adapt and evolve its models of learning and teaching. The old industrial model has lost traction, and new patterns of creative engagement are required. These new models potentially increase relevancy and better equip students for the future. Although creativity is recognised as an attribute that can contribute much to the development of these pedagogies, and creativity is valued by universities as a graduate capability, some educators understandably struggle to translate this vision into practice. This paper reports on selected survey findings from a mixed methods research project which aimed to shed light on how creativity can be designed for in higher education learning and teaching settings. A social constructivist epistemology underpinned the research and data was gathered using survey and case study methods. Descriptive statistical methods and informed grounded theory were employed for the analysis reported here. The findings confirm that creativity is valued for its contribution to the development of students’ academic work, employment opportunities and life in general; however, tensions arise between individual educator’s creative pedagogical goals and the provision of institutional support for implementation of those objectives. Designing for creativity becomes, paradoxically, a matter of navigating and limiting complexity and uncertainty, while simultaneously designing for those same states or qualities.

Brief report: Intestinal dysbiosis in ankylosing spondylitis

Objective Ankylosing spondylitis (AS) is a common, highly heritable immune-mediated arthropathy that occurs in genetically susceptible individuals exposed to an unknown but likely ubiquitous environmental trigger. There is a close relationship between the gut and spondyloarthritis, as exemplified in patients with reactive arthritis, in whom a typically self-limiting arthropathy follows either a gastrointestinal or urogenital infection. Microbial involvement in AS has been suggested; however, no definitive link has been established. The aim of this study was to determine whether the gut in patients with AS carries a distinct microbial signature compared with that in the gut of healthy control subjects. Methods Microbial profiles for terminal ileum biopsy specimens obtained from patients with recent-onset tumor necrosis factor antagonist-naive AS and from healthy control subjects were generated using culture-independent 16S ribosomal RNA gene sequencing and analysis techniques. Results Our results showed that the terminal ileum microbial communities in patients with AS differ significantly (P < 0.001) from those in healthy control subjects, driven by a higher abundance of 5 families of bacteria (Lachnospiraceae [P = 0.001], Ruminococcaceae [P = 0.012], Rikenellaceae [P = 0.004], Porphyromonadaceae [P = 0.001], and Bacteroidaceae [P = 0.001]) and a decrease in the abundance of 2 families of bacteria (Veillonellaceae [P = 0.01] and Prevotellaceae [P = 0.004]). Conclusion We show evidence for a discrete microbial signature in the terminal ileum of patients with AS compared with healthy control subjects. The microbial composition was demonstrated to correlate with disease status, and greater differences were observed between disease groups than within disease groups. These results are consistent with the hypothesis that genes associated with AS act, at least in part, through effects on the gut microbiome.

Quantifying the state of populations and effects of disturbances at large spatio-temporal scales: The case of coral populations in the great barrier reef

This project was a step forward in applying statistical methods and models to provide new insights for more informed decision-making at large spatial scales. The model has been designed to address complicated effects of ecological processes that govern the state of populations and uncertainties inherent in large spatio-temporal datasets. Specifically, the thesis contributes to better understanding and management of the Great Barrier Reef.

Biomethanation of herbaceous biomass residues using 3-zone plug flow like digesters - A case study from India

Biomethanation of herbaceous biomass feedstock has the potential to provide clean energy source for cooking and other activities in areas where such biomass availability predominates. A biomethanation concept that involves fermentation of biomass residues in three steps, occurring in three zones of the fermentor is described. This approach while attempting take advantage of multistage reactors simplifies the reactor operation and obviates the need for a high degree of process control or complex reactor design. Typical herbaceous biomass decompose with a rapid VFA flux initially (with a tendency to float) followed by a slower decomposition showing balanced process of VFA generation and its utilization by methanogens that colonize biomass slowly. The tendency to float at the initial stages is suppressed by allowing previous days feed to hold it below digester liquid which permits VFA to disperse into the digester liquid without causing process inhibition. This approach has been used to build and operate simple biomass digesters to provide cooking gas in rural areas with weed and agro-residues. With appropriate modifications, the same concept has been used for digesting municipal solid wastes in small towns where large fermentors are not viable. With further modifications this concept has been used for solid-liquid feed fermentors. Methanogen colonized leaf biomass has been used as biofilm support to treat coffee processing wastewater as well as crop litter alternately in a year. During summer it functions as a biomass based biogas plants operating in the three-zone mode while in winter, feeding biomass is suspended and high strength coffee processing wastewater is let into the fermentor achieving over 90% BOD reduction. The early field experience of these fermentors is presented.

Rank regression for analyzing ordinal qualitative data for treatment comparison

Ordinal qualitative data are often collected for phenotypical measurements in plant pathology and other biological sciences. Statistical methods, such as t tests or analysis of variance, are usually used to analyze ordinal data when comparing two groups or multiple groups. However, the underlying assumptions such as normality and homogeneous variances are often violated for qualitative data. To this end, we investigated an alternative methodology, rank regression, for analyzing the ordinal data. The rank-based methods are essentially based on pairwise comparisons and, therefore, can deal with qualitative data naturally. They require neither normality assumption nor data transformation. Apart from robustness against outliers and high efficiency, the rank regression can also incorporate covariate effects in the same way as the ordinary regression. By reanalyzing a data set from a wheat Fusarium crown rot study, we illustrated the use of the rank regression methodology and demonstrated that the rank regression models appear to be more appropriate and sensible for analyzing nonnormal data and data with outliers.

Analysing commercial catch and effort data from a penaeid trawl fishery: A comparison of linear models, mixed models, and generalised estimating equations approaches

Statistical methods are often used to analyse commercial catch and effort data to provide standardised fishing effort and/or a relative index of fish abundance for input into stock assessment models. Achieving reliable results has proved difficult in Australia's Northern Prawn Fishery (NPF), due to a combination of such factors as the biological characteristics of the animals, some aspects of the fleet dynamics, and the changes in fishing technology. For this set of data, we compared four modelling approaches (linear models, mixed models, generalised estimating equations, and generalised linear models) with respect to the outcomes of the standardised fishing effort or the relative index of abundance. We also varied the number and form of vessel covariates in the models. Within a subset of data from this fishery, modelling correlation structures did not alter the conclusions from simpler statistical models. The random-effects models also yielded similar results. This is because the estimators are all consistent even if the correlation structure is mis-specified, and the data set is very large. However, the standard errors from different models differed, suggesting that different methods have different statistical efficiency. We suggest that there is value in modelling the variance function and the correlation structure, to make valid and efficient statistical inferences and gain insight into the data. We found that fishing power was separable from the indices of prawn abundance only when we offset the impact of vessel characteristics at assumed values from external sources. This may be due to the large degree of confounding within the data, and the extreme temporal changes in certain aspects of individual vessels, the fleet and the fleet dynamics.

Design of a Multibus-compatible colour graphics subsystem

Colour graphics subsystems can be used in a variety of applications such as high-end business graphics, low-end scientific computations, and for realtime display of process control diagrams. The design of such a subsystem is shown. This subsystem can be added to any Multibus-compatible microcomputer system. The use of an NEC 7220 graphics display controller chip has simplified the design to a considerable extent. CGRAM (CORE graphics on Multibus), a comprehensive subset of the CORE graphics standard package, is supported on the subsystem.

Inferential, non-parametric statistics to assess quality of probabilistic forecast systems

Many statistical forecast systems are available to interested users. In order to be useful for decision-making, these systems must be based on evidence of underlying mechanisms. Once causal connections between the mechanism and their statistical manifestation have been firmly established, the forecasts must also provide some quantitative evidence of `quality’. However, the quality of statistical climate forecast systems (forecast quality) is an ill-defined and frequently misunderstood property. Often, providers and users of such forecast systems are unclear about what ‘quality’ entails and how to measure it, leading to confusion and misinformation. Here we present a generic framework to quantify aspects of forecast quality using an inferential approach to calculate nominal significance levels (p-values) that can be obtained either by directly applying non-parametric statistical tests such as Kruskal-Wallis (KW) or Kolmogorov-Smirnov (KS) or by using Monte-Carlo methods (in the case of forecast skill scores). Once converted to p-values, these forecast quality measures provide a means to objectively evaluate and compare temporal and spatial patterns of forecast quality across datasets and forecast systems. Our analysis demonstrates the importance of providing p-values rather than adopting some arbitrarily chosen significance levels such as p < 0.05 or p < 0.01, which is still common practice. This is illustrated by applying non-parametric tests (such as KW and KS) and skill scoring methods (LEPS and RPSS) to the 5-phase Southern Oscillation Index classification system using historical rainfall data from Australia, The Republic of South Africa and India. The selection of quality measures is solely based on their common use and does not constitute endorsement. We found that non-parametric statistical tests can be adequate proxies for skill measures such as LEPS or RPSS. The framework can be implemented anywhere, regardless of dataset, forecast system or quality measure. Eventually such inferential evidence should be complimented by descriptive statistical methods in order to fully assist in operational risk management.

Towards formal specification of a distributed computing system

Onboard spacecraft computing system is a case of a functionally distributed system that requires continuous interaction among the nodes to control the operations at different nodes. A simple and reliable protocol is desired for such an application. This paper discusses a formal approach to specify the computing system with respect to some important issues encountered in the design and development of a protocol for the onboard distributed system. The issues considered in this paper are concurrency, exclusiveness and sequencing relationships among the various processes at different nodes. A 6-tuple model is developed for the precise specification of the system. The model also enables us to check the consistency of specification and deadlock caused due to improper specification. An example is given to illustrate the use of the proposed methodology for a typical spacecraft configuration. Although the theory is motivated by a specific application the same may be applied to other distributed computing system such as those encountered in process control industries, power plant control and other similar environments.

Lens shape and refractive index distribution in type 1 diabetes

Purpose: To compare lens dimensions and refractive index distributions in type 1 diabetes and age-matched control groups. Methods: There were 17 participants with type 1 diabetes, consisting of two subgroups (7 young [23 ± 4 years] and 10 older [54 ± 4 years] participants), with 23 controls (13 young, 24 ± 4 years; 10 older, 55 ± 4 years). For each participant, one eye was tested with relaxed accommodation. A 3T clinical magnetic resonance imaging scanner was used to image the eye, employing a multiple spin echo (MSE) sequence to determine lens dimensions and refractive index profiles along the equatorial and axial directions. Results: The diabetes group had significantly smaller lens equatorial diameters and larger lens axial thicknesses than the control group (diameter mean ± 95% confidence interval [CI]: diabetes group 8.65 ± 0.26 mm, control group 9.42 ± 0.18 mm; axial thickness: diabetes group 4.33 ± 0.30 mm, control group 3.80 ± 0.14 mm). These differences were also significant within each age group. The older group had significantly greater axial thickness than the young group (older group 4.35 ± 0.26 mm, young group 3.70 ± 0.25 mm). Center refractive indices of diabetes and control groups were not significantly different. There were some statistically significant differences between the refractive index fitting parameters of young and older groups, but not between diabetes and control groups of the same age. Conclusions: Smaller lens diameters occurred in the diabetes groups than in the age-matched control groups. Differences in refractive index distribution between persons with and without diabetes are too small to have important effects on instruments measuring axial thickness.

Characterization of north-eastern Australian environments using APSIM for increasing rainfed maize production

Recurring water stresses are a major risk factor for rainfed maize cropping across the highly diverse agro-ecological environments of Queensland (Qld) and northern New South Wales (NNSW). Enhanced understanding of such agro-ecological diversity is necessary to more consistently sample target production environments for testing and targeting release of improved germplasm, and to improve the efficiency of the maize pre-breeding and breeding programs of Qld and New South Wales. Here, we used the Agricultural Production Systems Simulator (APSIM) – a well validated maize crop model to characterize the key distinctive water stress patterns and risk to production across the main maize growing regions of Qld and NNSW located between 15.8° and 31.5°S, and 144.5° and 151.8°E. APSIM was configured to simulate daily water supply demand ratios (SDRs) around anthesis as an indicator of the degree of water stress, and the final grain yield. Simulations were performed using daily climatic records during the period between 1890 and 2010 for 32 sites-soils in the target production regions. The runs were made assuming adequate nitrogen supply for mid-season maize hybrid Pioneer 3153. Hierarchical complete linkage analyses of the simulated yield resulted in five major clusters showing distinct probability distribution of the expected yields and geographic patterns. The drought stress patterns and their frequencies using SDRs were quantified using multivariate statistical methods. The identified stress patterns included no stress, mid-season (flowering) stress, and three terminal stresses differing in terms of severity. The combined frequency of flowering and terminal stresses was highest (82.9%), mainly in sites-soils combinations in the west of Qld and NNSW. Yield variability across the different sites-soils was significantly related to the variability in frequencies of water stresses. Frequencies of water stresses within each yield cluster tended to be similar, but different across clusters. Sites-soils falling within each yield cluster therefore could be treated as distinct maize production environments for testing and targeting newly developed maize cultivars and hybrids for adaptation to water stress patterns most common to those environments.

A novel approach to assessing road-curve crash severity

Curves are a common feature of road infrastructure; however crashes on road curves are associated with increased risk of injury and fatality to vehicle occupants. Countermeasures require the identification of contributing factors. However, current approaches to identifying contributors use traditional statistical methods and have not used self-reported narrative claim to identify factors related to the driver, vehicle and environment in a systemic way. Text mining of 3434 road-curve crash claim records filed between 1 January 2003 and 31 December 2005 at a major insurer in Queensland, Australia, was undertaken to identify risk levels and contributing factors. Rough set analysis was used on insurance claim narratives to identify significant contributing factors to crashes and their associated severity. New contributing factors unique to curve crashes were identified (e.g., tree, phone, over-steer) in addition to those previously identified via traditional statistical analysis of Police and licensing authority records. Text mining is a novel methodology to improve knowledge related to risk and contributing factors to road-curve crash severity. Future road-curve crash countermeasures should more fully consider the interrelationships between environment, the road, the driver and the vehicle, and education campaigns in particular could highlight the increased risk of crash on road-curves.

Chemical mass closure and source-specific composition of atmospheric particles

It has been known for decades that particles can cause adverse health effects as they are deposited within the respiratory system. Atmospheric aerosol particles influence climate by scattering solar radiation but aerosol particles act also as the nuclei around which cloud droplets form. The principal objectives of this thesis were to investigate the chemical composition and the sources of fine particles in different environments (traffic, urban background, remote) as well as during some specific air pollution situations. Quantifying the climate and health effects of atmospheric aerosols is not possible without detailed information of the aerosol chemical composition. Aerosol measurements were carried out at nine sites in six countries (Finland, Germany, Czech, Netherlands, Greece and Italy). Several different instruments were used in order to measure both the particulate matter (PM) mass and its chemical composition. In the off-line measurements the samples were collected first on a substrate or filter and gravimetric and chemical analysis were conducted in the laboratory. In the on-line measurements the sampling and analysis were either a combined procedure or performed successively within the same instrument. Results from the impactor samples were analyzed by the statistical methods. This thesis comprises also a work where a method for the determination carbonaceous matter size distribution by using a multistage impactor was developed. It was found that the chemistry of PM has usually strong spatial, temporal and size-dependent variability. In the Finnish sites most of the fine PM consisted of organic matter. However, in Greece sulfate dominated the fine PM and in Italy nitrate made the largest contribution to the fine PM. Regarding the size-dependent chemical composition, organic components were likely to be enriched in smaller particles than inorganic ions. Data analysis showed that organic carbon (OC) had four major sources in Helsinki. Secondary production was the major source in Helsinki during spring, summer and fall, whereas in winter biomass combustion dominated OC. The significant impact of biomass combustion on OC concentrations was also observed in the measurements performed in Central Europe. In this thesis aerosol samples were collected mainly by the conventional filter and impactor methods which suffered from the long integration time. However, by filter and impactor measurements chemical mass closure was achieved accurately, and a simple filter sampling was found to be useful in order to explain the sources of PM on the seasonal basis. The online instruments gave additional information related to the temporal variations of the sources and the atmospheric mixing conditions.