Conducting statistical tests of hypotheses : five common misconceptions found in transportation research

Most statistical methods use hypothesis testing. Analysis of variance, regression, discrete choice models, contingency tables, and other analysis methods commonly used in transportation research share hypothesis testing as the means of making inferences about the population of interest. Despite the fact that hypothesis testing has been a cornerstone of empirical research for many years, various aspects of hypothesis tests commonly are incorrectly applied, misinterpreted, and ignored—by novices and expert researchers alike. On initial glance, hypothesis testing appears straightforward: develop the null and alternative hypotheses, compute the test statistic to compare to a standard distribution, estimate the probability of rejecting the null hypothesis, and then make claims about the importance of the finding. This is an oversimplification of the process of hypothesis testing. Hypothesis testing as applied in empirical research is examined here. The reader is assumed to have a basic knowledge of the role of hypothesis testing in various statistical methods. Through the use of an example, the mechanics of hypothesis testing is first reviewed. Then, five precautions surrounding the use and interpretation of hypothesis tests are developed; examples of each are provided to demonstrate how errors are made, and solutions are identified so similar errors can be avoided. Remedies are provided for common errors, and conclusions are drawn on how to use the results of this paper to improve the conduct of empirical research in transportation.

Near infrared for non-destructive testing of articular cartilage

The concept of non-destructive testing (NDT) of materials and structures is of immense importance in engineering and medicine. Several NDT methods including electromagnetic (EM)-based e.g. X-ray and Infrared; ultrasound; and S-waves have been proposed for medical applications. This paper evaluates the viability of near infrared (NIR) spectroscopy, an EM method for rapid non-destructive evaluation of articular cartilage. Specifically, we tested the hypothesis that there is a correlation between the NIR spectrum and the physical and mechanical characteristics of articular cartilage such as thickness, stress and stiffness. Intact, visually normal cartilage-on-bone plugs from 2-3yr old bovine patellae were exposed to NIR light from a diffuse reflectance fibre-optic probe and tested mechanically to obtain their thickness, stress, and stiffness. Multivariate statistical analysis-based predictive models relating articular cartilage NIR spectra to these characterising parameters were developed. Our results show that there is a varying degree of correlation between the different parameters and the NIR spectra of the samples with R2 varying between 65 and 93%. We therefore conclude that NIR can be used to determine, nondestructively, the physical and functional characteristics of articular cartilage.

An analytical method for assessing stage-specific drug activity in Plasmodium vivax malaria : implications for ex vivo drug susceptibility testing

The emergence of highly chloroquine (CQ) resistant P. vivax in Southeast Asia has created an urgent need for an improved understanding of the mechanisms of drug resistance in these parasites, the development of robust tools for defining the spread of resistance, and the discovery of new antimalarial agents. The ex vivo Schizont Maturation Test (SMT), originally developed for the study of P. falciparum, has been modified for P. vivax. We retrospectively analysed the results from 760 parasite isolates assessed by the modified SMT to investigate the relationship between parasite growth dynamics and parasite susceptibility to antimalarial drugs. Previous observations of the stage-specific activity of CQ against P. vivax were confirmed, and shown to have profound consequences for interpretation of the assay. Using a nonlinear model we show increased duration of the assay and a higher proportion of ring stages in the initial blood sample were associated with decreased effective concentration (EC50) values of CQ, and identify a threshold where these associations no longer hold. Thus, starting composition of parasites in the SMT and duration of the assay can have a profound effect on the calculated EC50 for CQ. Our findings indicate that EC50 values from assays with a duration less than 34 hours do not truly reflect the sensitivity of the parasite to CQ, nor an assay where the proportion of ring stage parasites at the start of the assay does not exceed 66%. Application of this threshold modelling approach suggests that similar issues may occur for susceptibility testing of amodiaquine and mefloquine. The statistical methodology which has been developed also provides a novel means of detecting stage-specific drug activity for new antimalarials.

The effect of testing protocol on immature bovine thoracic spine segment stiffness

Introduction. In vitro spine biomechanical testing has been central to many advances in understanding the physiology and pathology of the human spine. Owing to the difficulty in obtaining sufficient numbers of human samples to conduct these studies, animal spines have been accepted as a substitute model. However, it is difficult to compare results from different studies, as they use different preparation, testing and data collection methods. The aim of this study was to identify the effect of repeated cyclic loading on bovine spine segment stiffness. It also aimed to quantify the effect of multiple freeze-thaw sequences, as many tests would be difficult to complete in a single session [1-3]. Materials and Methods. Thoracic spines from 6-8 week old calves were used. Each spine was dissected and divided into motion segments including levels T4-T11 (n=28). These were divided into two equal groups. Each segment was potted in polymethylemethacrylate. An Instron Biaxial materials testing machine with a custom made jig was used for testing. The segments were tested in flexion/extension, lateral bending and axial rotation at 37 degrees C and 100% humidity, using moment control to a maximum plus/minus 1.75 Nm with a loading rate of 0.3 Nm per second. Group (A) were tested with continuous repeated cyclic loading for 500 cycles with data recorded at cycles 3, 5, 10, 25, 100, 200, 300, 400 and 500. Group (B) were tested with 10 load cycles after each of 5 freeze thaw sequences. Data was collected from the tenth load cycle after each sequence. Statistical analysis of the data was performed using paired samples t-tests, ANOVA and generalized estimating equations. Results. The data were confirmed as having a normal distribution. 1. There were significant reductions in mean stiffness in flexion/extension (-20%; P=0.001) and lateral bending (-17%; P=0.009) over the 500 load cycles. However, there was no statistically significant change in axial rotation (P=0.152) 2. There was no statistically significant difference between mean stiffness over the five freeze-thaw sequences in flexion/extension (p=0.879) and axial rotation (p=0.07). However, there was a significant reduction in stiffness in lateral bending (-26%; p=0.007) Conclusion. Biomechanical testing of immature bovine spine motion segments requires careful interpretation. The effect of the number of load cycles as well as the number of freeze-thaw cycles on the stiffness of the motion segments depends on the axis of main movement.

Testing second order cyclostationarity in the squared envelope spectrum of non-white vibration signals

Cyclostationary models for the diagnostic signals measured on faulty rotating machineries have proved to be successful in many laboratory tests and industrial applications. The squared envelope spectrum has been pointed out as the most efficient indicator for the assessment of second order cyclostationary symptoms of damages, which are typical, for instance, of rolling element bearing faults. In an attempt to foster the spread of rotating machinery diagnostics, the current trend in the field is to reach higher levels of automation of the condition monitoring systems. For this purpose, statistical tests for the presence of cyclostationarity have been proposed during the last years. The statistical thresholds proposed in the past for the identification of cyclostationary components have been obtained under the hypothesis of having a white noise signal when the component is healthy. This need, coupled with the non-white nature of the real signals implies the necessity of pre-whitening or filtering the signal in optimal narrow-bands, increasing the complexity of the algorithm and the risk of losing diagnostic information or introducing biases on the result. In this paper, the authors introduce an original analytical derivation of the statistical tests for cyclostationarity in the squared envelope spectrum, dropping the hypothesis of white noise from the beginning. The effect of first order and second order cyclostationary components on the distribution of the squared envelope spectrum will be quantified and the effectiveness of the newly proposed threshold verified, providing a sound theoretical basis and a practical starting point for efficient automated diagnostics of machine components such as rolling element bearings. The analytical results will be verified by means of numerical simulations and by using experimental vibration data of rolling element bearings.

Performance-Based Quality Assurance/Quality Control (QA/QC) Acceptance Procedures for In-Place Soil Testing Phase 3

One of the objectives of this study was to evaluate soil testing equipment based on its capability of measuring in-place stiffness or modulus values. As design criteria transition from empirical to mechanistic-empirical, soil test methods and equipment that measure properties such as stiffness and modulus and how they relate to Florida materials are needed. Requirements for the selected equipment are that they be portable, cost effective, reliable, a ccurate, and repeatable. A second objective is that the selected equipment measures soil properties without the use of nuclear materials.The current device used to measure soil compaction is the nuclear density gauge (NDG). Equipment evaluated in this research included lightweight deflectometers (LWD) from different manufacturers, a dynamic cone penetrometer (DCP), a GeoGauge, a Clegg impact soil tester (CIST), a Briaud compaction device (BCD), and a seismic pavement analyzer (SPA). Evaluations were conducted over ranges of measured densities and moistures.Testing (Phases I and II) was conducted in a test box and test pits. Phase III testing was conducted on materials found on five construction projects located in the Jacksonville, Florida, area. Phase I analyses determined that the GeoGauge had the lowest overall coefficient of variance (COV). In ascending order of COV were the accelerometer-type LWD, the geophone-type LWD, the DCP, the BCD, and the SPA which had the highest overall COV. As a result, the BCD and the SPA were excluded from Phase II testing.In Phase II, measurements obtained from the selected equipment were compared to the modulus values obtained by the static plate load test (PLT), the resilient modulus (MR) from laboratory testing, and the NDG measurements. To minimize soil and moisture content variability, the single spot testing sequence was developed. At each location, test results obtained from the portable equipment under evaluation were compared to the values from adjacent NDG, PLT, and laboratory MR measurements. Correlations were developed through statistical analysis. Target values were developed for various soils for verification on similar soils that were field tested in Phase III. The single spot testing sequence also was employed in Phase III, field testing performed on A-3 and A-2-4 embankments, limerock-stabilized subgrade, limerock base, and graded aggregate base found on Florida Department of Transportation construction projects. The Phase II and Phase III results provided potential trend information for future research—specifically, data collection for in-depth statistical analysis for correlations with the laboratory MR for specific soil types under specific moisture conditions. With the collection of enough data, stronger relationships could be expected between measurements from the portable equipment and the MR values. Based on the statistical analyses and the experience gained from extensive use of the equipment, the combination of the DCP and the LWD was selected for in-place soil testing for compaction control acceptance. Test methods and developmental specifications were written for the DCP and the LWD. The developmental specifications include target values for the compaction control of embankment, subgrade, and base materials.

Statistical, electrical and mathematical analysis of water treed cross-linked polyethylene cable insulation

This work examined a new method of detecting small water filled cracks in underground insulation ('water trees') using data from commecially available non-destructive testing equipment. A testing facility was constructed and a computer simulation of the insulation designed in order to test the proposed ageing factor - the degree of non-linearity. This was a large industry-backed project involving an ARC linkage grant, Ergon Energy and the University of Queensland, as well as the Queensland University of Technology.

Testing approximate theories of first-order phase transitions on the two-dimensional Potts model

The two-dimensional,q-state (q>4) Potts model is used as a testing ground for approximate theories of first-order phase transitions. In particular, the predictions of a theory analogous to the Ramakrishnan-Yussouff theory of freezing are compared with those of ordinary mean-field (Curie-Wiess) theory. It is found that the Curie-Weiss theory is a better approximation than the Ramakrishnan-Yussouff theory, even though the former neglects all fluctuations. It is shown that the Ramakrishnan-Yussouff theory overestimates the effects of fluctuations in this system. The reasons behind the failure of the Ramakrishnan-Yussouff approximation and the suitability of using the two-dimensional Potts model as a testing ground for these theories are discussed.

Development and testing of an evaluation procedure for commercial manure additive products.

Manure additive products can be used to reduce odour emissions (OE) from livestock farms. The standardised evaluation of these manure additive products under specific farm conditions is important. In this study, the efficacy of a manure additive (WonderTreat(TM), CKLS, Inc., Hong-Kong) was assessed under Australian conditions utilising a combination of laboratory and field-scale evaluation techniques. As a first step, the efficacy of the manure additive was assessed in a laboratory-scale trial using a series of uniformly managed digesters and standard odour, liquor ammonia and hydrogen sulphide concentration measurement procedures. This showed that the addition of WonderTreat(TM) at the 'low dose rate' (LDR) (102.6 g m-2) used during the trial significantly, but only marginally (30%; P = 0.02) reduced the OE rate (mean 13.9 OU m-2 s-1) of anaerobic pig liquor relative to an untreated control (UC) (19.9 OU m-2 s-1). However, the 'high dose rate' (HDR) (205.3 g m-2) also assessed during the trial preformed similarly (19.7 OU m-2 s-1) to the UC. No statistically significant difference in the concentrations of a range of measured water quality variables at the 5% level was observed between the treatments or controls digesters. As a second step, a field-scale assessment of the manure additive was undertaken at a commercial piggery. Two piggery manure lagoons (each with approximately 2500 m2 surface area) were included in the study; one was treated with WonderTreat(TM) while the other was used as control. The efficacy of the treatment was assessed using olfactometric evaluation of odour samples collected from the surface of the pond using a dynamic wind tunnel and ancillary equipment. No statistically significant reduction in OE rate could be demonstrated (P = 0.35), partially due to the limited number of samples taken during the assessment. However, there was a numerical reduction in the average OE rate of the treatment pond (29 OU m-2 s-1 at 1 m s-1) compared to the control lagoon (38 OU m-2 s-1 at 1 m s-1).

Development and feasibility testing of an education program to improve knowledge and self-care among Aboriginal and Torres Strait Islander patients with heart failure

Background/Aim There is a 70% higher age-adjusted incidence of heart failure (HF) amongst Aboriginal and Torres Strait Islander people, three times more hospitalisations and twice as many deaths than non-Aboriginal people. There is a need to develop holistic yet individualised approaches in accord with the values of Aboriginal community healthcare to support patient education and self-care. The aim of this study was to re-design an existing HF educational resource (Fluid Watchers-Pacific Rim©) to be culturally safe for Aboriginal and Torres Strait Islander peoples, working in collaboration with the local community, and to conduct feasibility testing. Methods This study was conducted in two phases and utilised a mixed methods approach (qualitative and quantitative). Phase 1 of this study used action research methods to develop a culturally safe electronic resource to be provided to Aboriginal HF patients via a tablet computer. A HF expert panel adapted the existing resource to ensure it was evidence-based and contained appropriate language and images that reflects Aboriginal culture. A stakeholder group (which included Aboriginal workers and HF patients, as well as researchers and clinicians) then reviewed the resources and changes were made accordingly. In Phase 2, the new resource was tested on a sample of Aboriginal HF patients to assess feasibility and acceptability. Patient knowledge, satisfaction and self-care behaviours were measured using a before and after design with validated questionnaires. As this was a pilot test to determine feasibility, no statistical comparisons were made. Results - Phase 1: Throughout the process of resource development, two main themes emerged from the stakeholder consultation. These were the importance of identity, meaning that it was important to ensure that the resource accurately reflected the local community, with the appropriate clothing, skin tone and voice. The resource was adapted to reflect this and of the local community voiced the recordings for the resource. The other theme was comprehension; images were important and all text was converted to the first person and used plain language. - Phase 2: Five Aboriginal participants, mean age 61.6 ± 10.0 years, with NYHA Class III and IV heart failure were enrolled. Participants reported a high level of satisfaction with the resource (83.0%). HF knowledge (percentage of correct responses) increased from 48.0 ± 6.7% to 58.0 ± 9.7%, a 20.8% increase and results of the self-care index indicated that the biggest change was in patient confidence for self-care with a 95% increase in confidence score (46.7 ± 16.0 to 91.1 ± 11.5). Changes in management and maintenance scores varied between9275 patients. Conclusion By working in collaboration with HF experts, Aboriginal researchers and patients, a culturally safe HF resource has been developed for Aboriginal and Torres Strait Islander patients. Engaging Aboriginal researchers, capacity-building, and being responsive to local systems and structures enabled this pilot study to be successfully completed with the Aboriginal community and positive participant feedback demonstrated that the methodology used in this study was appropriate and acceptable; participants were able to engage with willingness and confidence.

Statistical significance of sequential firing patterns in multi-neuronal spike trains

Sequential firings with fixed time delays are frequently observed in simultaneous recordings from multiple neurons. Such temporal patterns are potentially indicative of underlying microcircuits and it is important to know when a repeatedly occurring pattern is statistically significant. These sequences are typically identified through correlation counts. In this paper we present a method for assessing the significance of such correlations. We specify the null hypothesis in terms of a bound on the conditional probabilities that characterize the influence of one neuron on another. This method of testing significance is more general than the currently available methods since under our null hypothesis we do not assume that the spiking processes of different neurons are independent. The structure of our null hypothesis also allows us to rank order the detected patterns. We demonstrate our method on simulated spike trains.

Developing and testing readability measurements for second language learners

This research constructed a readability measurement for French speakers who view English as a second language. It identified the true cognates, which are the similar words from these two languages, as an indicator of the difficulty of an English text for French people. A multilingual lexical resource is used to detect true cognates in text, and Statistical Language Modelling to predict the predict the readability level. The proposed enhanced statistical language model is making a step in the right direction by improving the accuracy of readability predictions for French speakers by up to 10% compared to state of the art approaches. The outcome of this study could accelerate the learning process for French speakers who are studying English. More importantly, this study also benefits the readability estimation research community, presenting an approach and evaluation at sentence level as well as innovating with the use of cognates as a new text feature.

Boarding control system for improved accessibility to offshore wind turbines: Full-scale testing

This paper considers the dynamic modelling and motion control of a Surface Effect Ship (SES) for safer transfer of personnel and equipment from vessel to-and-from an offshore wind-turbine. The control system designed is referred to as Boarding Control System (BCS). The performance of this system is investigated for a specific wind-farm service vessel—The Wave Craft. On a SES, the pressurized air cushion supports the majority of the weight of the vessel. The control problem considered relates to the actuation of the pressure such that wave-induced vessel motions are minimized. Results are given through simulation, model- and full-scale experimental testing.