Conducting statistical tests of hypotheses : five common misconceptions found in transportation research

Most statistical methods use hypothesis testing. Analysis of variance, regression, discrete choice models, contingency tables, and other analysis methods commonly used in transportation research share hypothesis testing as the means of making inferences about the population of interest. Despite the fact that hypothesis testing has been a cornerstone of empirical research for many years, various aspects of hypothesis tests commonly are incorrectly applied, misinterpreted, and ignored—by novices and expert researchers alike. On initial glance, hypothesis testing appears straightforward: develop the null and alternative hypotheses, compute the test statistic to compare to a standard distribution, estimate the probability of rejecting the null hypothesis, and then make claims about the importance of the finding. This is an oversimplification of the process of hypothesis testing. Hypothesis testing as applied in empirical research is examined here. The reader is assumed to have a basic knowledge of the role of hypothesis testing in various statistical methods. Through the use of an example, the mechanics of hypothesis testing is first reviewed. Then, five precautions surrounding the use and interpretation of hypothesis tests are developed; examples of each are provided to demonstrate how errors are made, and solutions are identified so similar errors can be avoided. Remedies are provided for common errors, and conclusions are drawn on how to use the results of this paper to improve the conduct of empirical research in transportation.

Effect of surgical approach on bone vascularisation, fracture and soft tissue healing : comparison of less invasive to open approach

Over the past ten years, minimally invasive plate osteosynthesis (MIPO) for the fixation of long bone fractures has become a clinically accepted method with good outcomes, when compared to the conventional open surgical approach (open reduction internal fixation, ORIF). However, while MIPO offers some advantages over ORIF, it also has some significant drawbacks, such as a more demanding surgical technique and increased radiation exposure. No clinical or experimental study to date has shown a difference between the healing outcomes in fractures treated with the two surgical approaches. Therefore, a novel, standardised severe trauma model in sheep has been developed and validated in this project to examine the effect of the two surgical approaches on soft tissue and fracture healing. Twenty four sheep were subjected to severe soft tissue damage and a complex distal femur fracture. The fractures were initially stabilised with an external fixator. After five days of soft tissue recovery, internal fixation with a plate was applied, randomised to either MIPO or ORIF. Within the first fourteen days, the soft tissue damage was monitored locally with a compartment pressure sensor and systemically by blood tests. The fracture progress was assessed fortnightly by x-rays. The sheep were sacrificed in two groups after four and eight weeks, and CT scans and mechanical testing performed. Soft tissue monitoring showed significantly higher postoperative Creatine Kinase and Lactate Dehydrogenase values in the ORIF group compared to MIPO. After four weeks, the torsional stiffness was significantly higher in the MIPO group (p=0.018) compared to the ORIF group. The torsional strength also showed increased values for the MIPO technique (p=0.11). The measured total mineralised callus volumes were slightly higher in the ORIF group. However, a newly developed morphological callus bridging score showed significantly higher values for the MIPO technique (p=0.007), with a high correlation to the mechanical properties (R2=0.79). After eight weeks, the same trends continued, but without statistical significance. In summary, this clinically relevant study, using the newly developed severe trauma model in sheep, clearly demonstrates that the minimally invasive technique minimises additional soft tissue damage and improves fracture healing in the early stage compared to the open surgical approach method.

Shear tests of Litesteel beams with web openings

This paper presents the details of experimental studies on the shear strength of a recently developed, cold-formed steel beam known as LiteSteel Beam (LSB) with web openings. The innovative LSB sections have the beneficial characteristics of torsionally rigid closed rectangular flanges combined with economical fabrication processes from a single strip of high strength steel. They combine the stability of hot-rolled steel sections with the high strength to weight ratio of conventional cold-formed steel sections. The LSB sections are commonly used as flexural members in the building industry. Current practice in flooring systems is to include openings in the web element of floor joists or bearers so that building services can be located within them. Shear behaviour of LSBs with web openings is more complicated while their shear strengths are considerably reduced by the presence of web openings. However, limited research has been undertaken on the shear behaviour and strength of LSBs with web openings. Therefore a detailed experimental study involving 26 shear tests was undertaken to investigate the shear behaviour and strength of different LSB sections. Simply supported test specimens of LSBs with an aspect ratio of 1.5 were loaded at midspan until failure. This paper presents the details of this experimental study and the results. Experimental results showed that the current design rules in cold-formed steel structures design codes (AS/NZS 4600) [1] are very conservative for the shear design of LSBs with web openings. Improved design equations have been proposed for the shear strength of LSBs with web openings based on experimental results from this study.

Three little boys and their literacy trajectories

There has been escalating concern about the comparative literacy standards of boys and girls in Australia for some time now. Benchmark testing reveals that girls outperform boys in standardised forms of literacy, with more fine-grained analyses of the results indicating that it is particular groups of boys who are not doing well on these tests. This paper considers this issue, and makes several observations about students, literacy and literacy development and educational futures.

Cracking the language code : NAPLAN numeracy tests in years 7 and 9

Focusing on the use of language is a crucial strategy in good mathematics teaching and a teacher’s guidance can assist students to master the language of mathematics. This article discusses the statements with reference to recent year 7 and 9 NAPLAN numeracy tests. It draws the readers’ attention to the complexities of language in the field of mathematics. Although this article refers to NAPLAN numeracy tests it also offers advice about good teaching practice.

Lateral distortional buckling tests of a new hollow flange channel beam

The LiteSteel beam (LSB) is a new hollow flange channel section developed by OneSteel Australian Tube Mills using their patented dual electric resistance welding and automated continuous roll-forming process. It has a unique geometry consisting of torsionally rigid rectangular hollow flanges and a relatively slender web. The LSBs are commonly used as flexural members in buildings. However, the LSB flexural members are subjected to lateral distortional buckling, which reduces their member moment capacities. Unlike the commonly observed lateral torsional buckling of steel beams, the lateral distortional buckling of LSBs is characterised by simultaneous lateral deflection, twist, and cross sectional change due to web distortion. An experimental study including more than 50 lateral buckling tests was therefore conducted to investigate the behaviour and strength of LSB flexural members. It included the available 13 LSB sections with spans ranging from 1200 to 4000 mm. Lateral buckling tests based on a quarter point loading were conducted using a special test rig designed to simulate the required simply supported and loading conditions accurately. Experimental moment capacities were compared with the predictions from the design rules in the Australian cold-formed steel structures standard. The new design rules in the standard were able to predict the moment capacities more accurately than previous design rules. This paper presents the details of lateral distortional buckling tests, in particular the features of the lateral buckling test rig, the results and the comparisons. It also includes the results of detailed studies into the mechanical properties and residual stresses of LSBs.

Data-driven accountability in Australia : an unfolding story with lessons for leaders

Throughout the world, state and nation standardised testing of children, has become a "huge industry" (English, 2002). Although English is referring to the American system which has been involved in standardised testing for over half a century, the same could be said of many other countries, including Australia. It has been only in recent years that Australia has embraced national testing as part of a wider reform effort to bring about increased accountability in schooling. The results of high-stakes tests in Australia are now published in newspapers and electronically on the Australian federal government's MySchool website (www.myschoold.edu.au). MySchool provides results on the National Assessment Program - Literacy and Numeracy (NAPLAN) for students in Years 3,5, 7 and 9. Data are available that compare schools to statistically similar schools. This more recent publication of national testing results in Australia is a visible example of "contractual accountability", described by Mulford, Edmunds, Kendall, Kendall and Bishop (2008) as " the degree to which [actors] are fulfilling the expectations of particular audiences in terms of standards, outcomes and results" (p.20).

The use of semantic priming as a paradigm for the detection of faking on self-report psychological tests

It is recognised that individuals do not always respond honestly when completing psychological tests. One of the foremost issues for research in this area is the inability to detect individuals attempting to fake. While a number of strategies have been identified in faking, a commonality of these strategies is the latent role of long term memory. Seven studies were conducted in order to examine whether it is possible to detect the activation of faking related cognitions using a lexical decision task. Study 1 found that engagement with experiential processing styles predicted the ability to fake successfully, confirming the role of associative processing styles in faking. After identifying appropriate stimuli for the lexical decision task (Studies 2A and 2B), Studies 3 to 5 examined whether a cognitive state of faking could be primed and subsequently identified, using a lexical decision task. Throughout the course of these studies, the experimental methodology was increasingly refined in an attempt to successfully identify the relevant priming mechanisms. The results were consistent and robust throughout the three priming studies: faking good on a personality test primed positive faking related words in the lexical decision tasks. Faking bad, however, did not result in reliable priming of negative faking related cognitions. To more completely address potential issues with the stimuli and the possible role of affective priming, two additional studies were conducted. Studies 6A and 6B revealed that negative faking related words were more arousing than positive faking related words, and that positive faking related words were more abstract than negative faking related words and neutral words. Study 7 examined whether the priming effects evident in the lexical decision tasks occurred as a result of an unintentional mood induction while faking the psychological tests. Results were equivocal in this regard. This program of research aligned the fields of psychological assessment and cognition to inform the preliminary development and validation of a new tool to detect faking. Consequently, an implicit technique to identify attempts to fake good on a psychological test has been identified, using long established and robust cognitive theories in a novel and innovative way. This approach represents a new paradigm for the detection of individuals responding strategically to psychological testing. With continuing development and validation, this technique may have immense utility in the field of psychological assessment.

Breaching the standardised assessment boundary : assessment for learning as a field of exchange

The introduction of the Australian curriculum, the use of standardised testing (e.g. NAPLAN) and the My School website are couched in a context of accountability. This circumstance has stimulated and in some cases renewed a range of boundaries in Australian Education. The consequences that arise from standardised testing have accentuated the boundaries produced by social reproduction in education which has led to an increase in the numbers of students disengaging from mainstream education and applying for enrolment at the Edmund Rice Education Australia Flexible Learning Centre Network (EREAFLCN). Boundaries are created for many young people who are denied access to credentials and certification as a result of being excluded from or in some way disengaging from standardised education and testing. Young people who participate at the EREAFLCN arrive with a variety of forms of cultural capital that are not valued in current education and employment fields. This is not to say that these young people’s different forms of cultural capital have no value, but rather that such funds of knowledge, repertoires and cultural capital are not valued by the majority of powerful agents in educational and employment fields. How then can the qualitative value of traditionally unorthodox - yet often intricate, ingenious, and astute - versions of cultural capital evident in the habitus of many young people be made to count, be recognised, be valuated? Can a process of educational assessment be a field of capital exchange and a space which breaches boundaries through a valuating process? This paper reports on the development of an innovative approach to assessment in an alternative education institution designed for the re-engagement of ‘at risk’ youth who have left formal schooling. A case study approach has been used to document the engagement of six young people, with an educational approach described as assessment for learning as a field of exchange across two sites in the EREAFLCN. In order to capture the broad range of students’ cultural and social capital, an electronic portfolio system (EPS) is under trial. The model draws on categories from sociological models of capital and reconceptualises the eportfolio as a sociocultural zone of learning and development. Results from the trial show a general tendency towards engagement with the EPS and potential for the attainment of socially valued cultural capital in the form of school credentials. In this way restrictive boundaries can be breached and a more equitable outcome achieved for many young Australians.

Section moment capacity tests of LiteSteel Beams

The LiteSteel Beam (LSB) is a new cold-formed hollow flange channel section developed by OneSteel Australian Tube Mills using their patented dual electric resistance welding and automated continuous roll-forming process. It has a unique geometry consisting of torsionally rigid rectangular hollow flanges and a relatively slender web. In addition to this unique geometry, the LSB sections also have unique characteristics relating to their stress-strain curves, residual stresses, initial geometric imperfections and hollow flanges that are not encountered in conventional hot-rolled and cold-formed steel channel sections. An experimental study including 20 section moment capacity tests was therefore conducted to investigate the behaviour and strength of LSB flexural members. The presence of inelastic reserve bending capacity in these beams was investigated in detail although the current design rules generally limit the section moment capacities of cold-formed steel members to their first yield moments. The ultimate moment capacities from the tests were compared with the section moment capacities predicted by the current cold-formed and hot-rolled steel design standards. It was found that compact and non-compact LSB sections have greater moment capacities than their first yield moments. The current cold-formed steel design standards were found to be conservative in predicting the section moment capacities of compact and non-compact LSB sections while the hot-rolled steel design standards were able to better predict them. This paper has shown that suitable modifications are needed to the current design rules to allow the inclusion of available inelastic bending capacities of LSBs in design.

Time limitations in NAPLAN numeracy tests

The article discusses evidence that time prevented many students from showing what they could do in the 2010 Year 7 and 9 NAPLAN numeracy tests. In addition to analysing the available data, the article discusses some NAPLAN numeracy questions that contribute to this problem. It is suggested that schools should investigate whether time limitation is a problem for their own students. The article discusses the implications of these findings for teachers preparing students for NAPLAN tests and for the developers of the tests.

Non-compositional concepts and quantum tests

Compositionality is a frequently made assumption in linguistics, and yet many human subjects reveal highly non-compositional word associations when confronted with novel concept combinations. This article will show how a non-compositional account of concept combinations can be supplied by modelling them as interacting quantum systems.

Tests and Models of Non-compositional Concepts

The question of under what conditions conceptual representation is compositional remains debatable within cognitive science. This paper proposes a well developed mathematical apparatus for a probabilistic representation of concepts, drawing upon methods developed in quantum theory to propose a formal test that can determine whether a specific conceptual combination is compositional, or not. This test examines a joint probability distribution modeling the combination, asking whether or not it is factorizable. Empirical studies indicate that some combinations should be considered non-compositionally.