The internal validity of web-based studies

Honing and Ladinig (2008) make the assertion that while the internal validity of web-based studies may be reduced, this is offset by an increase in external validity possible when experimenters can sample a wider range of participants and experimental settings. In this paper, the issue of internal validity is more closely examined, and it is agued that there is no necessary reason why internal validity of a web-based study should be worse than that of a lab-based one. Errors of measurement or inconsistencies of manipulation will typically balance across conditions of the experiment, and thus need not necessarily threaten the validity of a study’s findings.

A two week persistent navigation and mapping experiment using RatSLAM : insights and current developments

One of the major challenges in achieving long term robot autonomy is the need for a SLAM algorithm that can perform SLAM over the operational lifetime of the robot, preferably without human intervention or supervision. In this paper we present insights gained from a two week long persistent SLAM experiment, in which a Pioneer robot performed mock deliveries in a busy office environment. We used the biologically inspired visual SLAM system, RatSLAM, combined with a hybrid control architecture that selected between exploring the environment, performing deliveries, and recharging. The robot performed more than a thousand successful deliveries with only one failure (from which it recovered), travelled more than 40 km over 37 hours of active operation, and recharged autonomously 23 times. We discuss several issues arising from the success (and limitations) of this experiment and two subsequent avenues of work.

Field measurement of wheel-rail impact force at insulated rail joint

When wheels pass over insulated rail joints (IRJs) a vertical impact force is generated. The ability to measure the impact force is valuable as the force signature helps understand the behaviour of the IRJs, in particular their potential for failure. The impact forces are thought to be one of the main factors that cause damage to the IRJ and track components. Study of the deterioration mechanism helps finding new methods to improve the service life of IRJs in track. In this research, the strain-gage-based wheel load detector, for the first time, is employed to measure the wheel–rail contact-impact force at an IRJ in a heavy haul rail line. In this technique, the strain gages are installed within the IRJ assembly without disturbing the structural integrity of IRJ and arranged in a full wheatstone bridge to form a wheel load detector. The instrumented IRJ is first tested and calibrated in the lab and then installed in the field. For comparison purposes, a reference rail section is also instrumented with the same strain gage pattern as the IRJ. In this paper the measurement technique, the process of instrumentation, and tests as well as some typical data obtained from the field and the inferences are presented.

Pore formation during dehydration of polycrystalline gypsum observed and quantified in a time-series synchrotron radiation based X-ray micro-tomography experiment

We conducted an in-situ X-ray micro-computed tomography heating experiment at the Advanced Photon Source (USA) to dehydrate an unconfined 2.3 mm diameter cylinder of Volterra Gypsum. We used a purpose-built X-ray transparent furnace to heat the sample to 388 K for a total of 310 min to acquire a three-dimensional time-series tomography dataset comprising nine time steps. The voxel size of 2.2 μm3 proved sufficient to pinpoint reaction initiation and the organization of drainage architecture in space and time. We observed that dehydration commences across a narrow front, which propagates from the margins to the centre of the sample in more than four hours. The advance of this front can be fitted with a square-root function, implying that the initiation of the reaction in the sample can be described as a diffusion process. Novel parallelized computer codes allow quantifying the geometry of the porosity and the drainage architecture from the very large tomographic datasets (20483 voxels) in unprecedented detail. We determined position, volume, shape and orientation of each resolvable pore and tracked these properties over the duration of the experiment. We found that the pore-size distribution follows a power law. Pores tend to be anisotropic but rarely crack-shaped and have a preferred orientation, likely controlled by a pre-existing fabric in the sample. With on-going dehydration, pores coalesce into a single interconnected pore cluster that is connected to the surface of the sample cylinder and provides an effective drainage pathway. Our observations can be summarized in a model in which gypsum is stabilized by thermal expansion stresses and locally increased pore fluid pressures until the dehydration front approaches to within about 100 μm. Then, the internal stresses are released and dehydration happens efficiently, resulting in new pore space. Pressure release, the production of pores and the advance of the front are coupled in a feedback loop.

Variation in risk seeking behavior in a natural experiment following a large negative wealth shock induced by a natural disaster

An ongoing challenge in behavioral economics is to understand the variations observed in risk attitudes as a function of their environmental context. Of particular interest is the effect of wealth on risk attitudes. The research in this area has however faced two constraints: the difficulty to study the causal effects of large changes in wealth, and the causal effects of losses on risk behavior. The present paper address this double limitation by providing evidence of the variation of risk attitude after large losses using a natural disaster (Brisbane floods) as the setting for a natural experiment.

Institutional and individual labor market discrimination based on hukou status : an artefactual field experiment

We study discrimination based on the hukou system that segregates citizens in groups of migrants and locals in urban China. We use an artefactual field experiment with a labor market framing. We recruit workers on their real labor market as experimental participants and investigate if official discrimination motivates individual discrimination based on hukou status. In our experimental results we observe discrimination based on the hukou characteristic: however, statistical discrimination does not seem to be the source of this, as status is exogeneous for our participants and migrants and locals behave similarly. Furthermore, discrimination increases between two experimental frameworks when motives for statistical discrimination are removed.

Are academics messy? Testing the broken windows theory with a field experiment in the work environment

We test the broken windows theory using a field experiment in a shared area of an academic workplace(the department common room). More specifically, we explore academics’ and postgraduate students’ behavior under an order condition (a clean environment) and a disorder condition (a messy environment). We find strong evidence that signs of disorderly behavior trigger littering: In 59% of the cases, subjects litter in the disorder treatment as compared to 18% in the order condition. These results remain robust in a multivariate analysis even when controlling for a large set of factors not directly examined by previous studies. Overall, when academic staff and postgraduate students observe that others have violated the social norm of keeping the common room clean, all else being equal, the probability of littering increases by around 40%.

Utility of an alternative bicycle commute route of lower proximity to motorised traffic in decreasing exposure to ultra-fine particles, respiratory symptoms and airway inflammation - a structured exposure experiment

Background: Bicycle commuting in an urban environment of high air pollution is known as a potential health risk, especially for susceptible individuals. While risk management strategies aimed to reduce motorised traffic emissions exposure have been suggested, limited studies have assessed the utility of such strategies in real-world circumstances. Objectives: The potential of reducing exposure to ultrafine particles (UFP; < 0.1 µm) during bicycle commuting by lowering interaction with motorised traffic was investigated with real-time air pollution and acute inflammatory measurements in healthy individuals using their typical, and an alternative to their typical, bicycle commute route. Methods: Thirty-five healthy adults (mean ± SD: age = 39 ± 11 yr; 29% female) each completed two return trips of their typical route (HIGH) and a pre-determined altered route of lower interaction with motorised traffic (LOW; determined by the proportion of on-road cycle paths). Particle number concentration (PNC) and diameter (PD) were monitored in real-time in-commute. Acute inflammatory indices of respiratory symptom incidence, lung function and spontaneous sputum (for inflammatory cell analyses) were collected immediately pre-commute, and one and three hours post-commute. Results: LOW resulted in a significant reduction in mean PNC (1.91 x e4 ± 0.93 x e4 ppcc vs. 2.95 x e4 ± 1.50 x e4 ppcc; p ≤ 0.001). Besides incidence of in-commute offensive odour detection (42 vs. 56 %; p = 0.019), incidence of dust and soot observation (33 vs. 47 %; p = 0.038) and nasopharyngeal irritation (31 vs. 41 %; p = 0.007), acute inflammatory indices were not significantly associated to in-commute PNC, nor were these indices reduced with LOW compared to HIGH. Conclusions: Exposure to PNC, and the incidence of offensive odour and nasopharyngeal irritation, can be significantly reduced when utilising a strategy of lowering interaction with motorised traffic whilst bicycle commuting, which may bring important benefits for both healthy and susceptible individuals.

Computer experiment – a case study for modelling and simulation of manufacturing systems

Deterministic computer simulation of physical experiments is now a common technique in science and engineering. Often, physical experiments are too time consuming, expensive or impossible to conduct. Complex computer models or codes, rather than physical experiments lead to the study of computer experiments, which are used to investigate many scientific phenomena. A computer experiment consists of a number of runs of the computer code with different input choices. The Design and Analysis of Computer Experiments is a rapidly growing technique in statistical experimental design. This paper aims to discuss some practical issues when designing a computer simulation and/or experiments for manufacturing systems. A case study approach is reviewed and presented.

The rural school experiment : creating a Queensland yeoman

Using historical narrative and extensive archival research, this thesis portrays the story of the twentieth century Queensland Rural Schools. The initiative started at Nambour Primary School in 1917, and extended over the next four decades to encompass thirty primary schools that functioned as centralized institutions training children in agricultural science, domestic science, and manual trade training. The Rural Schools formed the foundation of a systemised approach to agricultural education intended to facilitate the State’s closer settlement ideology. The purpose of the Rural Schools was to mitigate urbanisation, circumvent foreign incursion and increase Queensland’s productivity by turning boys into farmers, or the tradesmen required to support them, and girls into the homemakers that these farmers needed as wives and mothers for the next generation. Effectively Queensland took rural boys and girls and created a new yeomanry to aid the State’s development.

Brothers in arms – An experiment on the alliance puzzle

The generic alliance game considers players in an alliance who fight against an external enemy. After victory, the alliance may break up, and its members may fight against each other over the spoils of the victory. Our experimental analysis of this game shows: In-group solidarity vanishes after the break-up of the alliance. Former ‘brothers in arms’ fight even more vigorously against each other than strangers do. Furthermore, this vigorous internal fighting is anticipated and reduces the ability of the alliance to mobilize the joint fighting effort, compared to a situation in which victorious alliance members share the spoils of victory equally and peacefully

Retrieval of health advice on the web: AEHRC at ShARe/CLEF eHealth Evaluation Lab Task 3

This paper details the participation of the Australian e- Health Research Centre (AEHRC) in the ShARe/CLEF 2013 eHealth Evaluation Lab { Task 3. This task aims to evaluate the use of information retrieval (IR) systems to aid consumers (e.g. patients and their relatives) in seeking health advice on the Web. Our submissions to the ShARe/CLEF challenge are based on language models generated from the web corpus provided by the organisers. Our baseline system is a standard Dirichlet smoothed language model. We enhance the baseline by identifying and correcting spelling mistakes in queries, as well as expanding acronyms using AEHRC's Medtex medical text analysis platform. We then consider the readability and the authoritativeness of web pages to further enhance the quality of the document ranking. Measures of readability are integrated in the language models used for retrieval via prior probabilities. Prior probabilities are also used to encode authoritativeness information derived from a list of top-100 consumer health websites. Empirical results show that correcting spelling mistakes and expanding acronyms found in queries signi cantly improves the e ectiveness of the language model baseline. Readability priors seem to increase retrieval e ectiveness for graded relevance at early ranks (nDCG@5, but not precision), but no improvements are found at later ranks and when considering binary relevance. The authoritativeness prior does not appear to provide retrieval gains over the baseline: this is likely to be because of the small overlap between websites in the corpus and those in the top-100 consumer-health websites we acquired.

Identify disorders in health records using Conditional Random Fields and Metamap: AEHRC at ShARe/CLEF 2013 eHealth Evaluation Lab Task 1

The Australian e-Health Research Centre (AEHRC) recently participated in the ShARe/CLEF eHealth Evaluation Lab Task 1. The goal of this task is to individuate mentions of disorders in free-text electronic health records and map disorders to SNOMED CT concepts in the UMLS metathesaurus. This paper details our participation to this ShARe/CLEF task. Our approaches are based on using the clinical natural language processing tool Metamap and Conditional Random Fields (CRF) to individuate mentions of disorders and then to map those to SNOMED CT concepts. Empirical results obtained on the 2013 ShARe/CLEF task highlight that our instance of Metamap (after ltering irrelevant semantic types), although achieving a high level of precision, is only able to identify a small amount of disorders (about 21% to 28%) from free-text health records. On the other hand, the addition of the CRF models allows for a much higher recall (57% to 79%) of disorders from free-text, without sensible detriment in precision. When evaluating the accuracy of the mapping of disorders to SNOMED CT concepts in the UMLS, we observe that the mapping obtained by our ltered instance of Metamap delivers state-of-the-art e ectiveness if only spans individuated by our system are considered (`relaxed' accuracy).

Exit polls, turnout, and bandwagon voting : evidence from a natural experiment

We exploit a voting reform in France to estimate the causal effect of exit poll information on turnout and bandwagon voting. Before the change in legislation, individuals in some French overseas territories voted after the election result had already been made public via exit poll information from mainland France. We estimate that knowing the exit poll information decreases voter turnout by about 12 percentage points. Our study is the first clean empirical design outside of the laboratory to demonstrate the effect of such knowledge on voter turnout. Furthermore, we find that exit poll information significantly increases bandwagon voting; that is, voters who choose to turn out are more likely to vote for the expected winner.