Probabilistic evaluation of time series models : a comparison of several approaches

Several methods are examined which allow to produce forecasts for time series in the form of probability assignments. The necessary concepts are presented, addressing questions such as how to assess the performance of a probabilistic forecast. A particular class of models, cluster weighted models (CWMs), is given particular attention. CWMs, originally proposed for deterministic forecasts, can be employed for probabilistic forecasting with little modification. Two examples are presented. The first involves estimating the state of (numerically simulated) dynamical systems from noise corrupted measurements, a problem also known as filtering. There is an optimal solution to this problem, called the optimal filter, to which the considered time series models are compared. (The optimal filter requires the dynamical equations to be known.) In the second example, we aim at forecasting the chaotic oscillations of an experimental bronze spring system. Both examples demonstrate that the considered time series models, and especially the CWMs, provide useful probabilistic information about the underlying dynamical relations. In particular, they provide more than just an approximation to the conditional mean.

Detection of mutations in Salmonella enterica gyrA, gyrB, parC and parE genes by denaturing high performance liquid chromatography (DHPLC) using standard HPLC instrumentation

Aims: Quinolone antibiotics are the agents of choice for treating systemic Salmonella infections. Resistance to quinolones is usually mediated by mutations in the DNA gyrase gene gyrA. Here we report the evaluation of standard HPLC equipment for the detection of mutations (single nucleotide polymorphisms; SNPs) in gyrA, gyrB, parC and parE by denaturing high performance liquid chromatography (DHPLC). Methods: A panel of Salmonella strains was assembled which comprised those with known different mutations in gyrA (n = 8) and fluoroquinolone-susceptible and -resistant strains (n = 50) that had not been tested for mutations in gyrA. Additionally, antibiotic-susceptible strains of serotypes other than Salmonella enterica serovar Typhimurium strains were examined for serotype-specific mutations in gyrB (n = 4), parC (n = 6) and parE (n = 1). Wild-type (WT) control DNA was prepared from Salmonella Typhimurium NCTC 74. The DNA of respective strains was amplified by PCR using Optimase (R) proofreading DNA polymerase. Duplex DNA samples were analysed using an Agilent A1100 HPLC system with a Varian Helix (TM) DNA column. Sequencing was used to validate mutations detected by DHPLC in the strains with unknown mutations. Results: Using this HPLC system, mutations in gyrA, gyrB, parC and parE were readily detected by comparison with control chromatograms. Sequencing confirmed the gyrA predicted mutations as detected by DHPLC in the unknown strains and also confirmed serotype-associated sequence changes in non-Typhimurium serotypes. Conclusions: The results demonstrated that a non-specialist standard HPLC machine fitted with a generally available column can be used to detect SNPs in gyrA, gyrB, parC and parE genes by DHPLC. Wider applications should be possible.

Simulation of thermal performance of horizontal slinky-loop heat exchangers for ground source heat pumps

This paper presents results obtained from a numerical simulation for the horizontal slinky-loop heat exchanger of a ground-source heat pump system. A three-dimensional numerical model was developed and the results of the thermal performance of various heat exchanger configurations are presented. The investigation was carried out on five types of loop pitch (loop spacing), three types of loop diameter, three values of soil thermal properties, and allowing continuous and intermittent operation. Comparison was made for the heat transfer rate, the amount of pipe material needed, as well as excavation work required for the horizontal slinky-loop heat exchanger. The results indicate that system parameters have a significant effect on the thermal performance of the system

What happens to precocious readers’ performance by the age of 11 years?

This paper reports on the progress made by a group of fourteen 11-year-old children who had been originally identified as being precocious readers before they started primary school at the age of 5-years. The data enable comparisons to be made with the performance of the children when they were younger so that a six year longitudinal analysis can be made. The children who began school as precocious readers continued to make progress in reading accuracy, rate and comprehension, thereby maintaining their superior performance relative to a comparison group. However, their progress appeared to follow the same developmental trajectory as that of the comparison group. Measures of phonological awareness showed that there are long term, stable individual differences which correlated with all measures of reading. The children who were reading precociously early showed significantly higher levels of phonological awareness than the comparison children. In addition, they showed the same levels of performance on this task as a further group of high achieving young adults. A positive effect of being able to read at precociously early age was identified in the significantly higher levels of receptive vocabulary found amongst the these children. The analyses indicated that rises in receptive vocabulary resulted from reading performance rather than the other way round

A comparison of automated keyphrase extraction techniques and of automatic evaluation vs. human evaluation

Keyphrases are added to documents to help identify the areas of interest they contain. However, in a significant proportion of papers author selected keyphrases are not appropriate for the document they accompany: for instance, they can be classificatory rather than explanatory, or they are not updated when the focus of the paper changes. As such, automated methods for improving the use of keyphrases are needed, and various methods have been published. However, each method was evaluated using a different corpus, typically one relevant to the field of study of the method’s authors. This not only makes it difficult to incorporate the useful elements of algorithms in future work, but also makes comparing the results of each method inefficient and ineffective. This paper describes the work undertaken to compare five methods across a common baseline of corpora. The methods chosen were Term Frequency, Inverse Document Frequency, the C-Value, the NC-Value, and a Synonym based approach. These methods were analysed to evaluate performance and quality of results, and to provide a future benchmark. It is shown that Term Frequency and Inverse Document Frequency were the best algorithms, with the Synonym approach following them. Following these findings, a study was undertaken into the value of using human evaluators to judge the outputs. The Synonym method was compared to the original author keyphrases of the Reuters’ News Corpus. The findings show that authors of Reuters’ news articles provide good keyphrases but that more often than not they do not provide any keyphrases.

Does grammatical aspect affect motion event cognition? A cross-linguistic comparison of English and Swedish speakers

In this article, we explore whether cross-linguistic differences in grammatical aspect encoding may give rise to differences in memory and cognition. We compared native speakers of two languages that encode aspect differently (English and Swedish) in four tasks that examined verbal descriptions of stimuli, online triads matching, and memory-based triads matching with and without verbal interference. Results showed between-group differences in verbal descriptions and in memory-based triads matching. However, no differences were found in online triads matching and in memory-based triads matching with verbal interference. These findings need to be interpreted in the context of the overall pattern of performance, which indicated that both groups based their similarity judgments on common perceptual characteristics of motion events. These results show for the first time a cross-linguistic difference in memory as a function of differences in grammatical aspect encoding, but they also contribute to the emerging view that language fine tunes rather than shapes perceptual processes that are likely to be universal and unchanging.

The challenge of validation: assessing the performance of a test of productive vocabulary

This paper assesses the performance of a vocabulary test designed to measure second language productive vocabulary knowledge.The test, Lex30, uses a word association task to elicit vocabulary, and uses word frequency data to measure the vocabulary produced. Here we report firstly on the reliability of the test as measured by a test-retest study, a parallel test forms experiment and an internal consistency measure. We then investigate the construct validity of the test by looking at changes in test performance over time, analyses of correlations with scores on similar tests, and comparison of spoken and written test performance. Last, we examine the theoretical bases of the two main test components: eliciting vocabulary and measuring vocabulary. Interpretations of our findings are discussed in the context of test validation research literature. We conclude that the findings reported here present a robust argument for the validity of the test as a research tool, and encourage further investigation of its validity in an instructional context

Analysis of the seasonal cycle within the first international urban land-surface model comparison

A number of urban land-surface models have been developed in recent years to satisfy the growing requirements for urban weather and climate interactions and prediction. These models vary considerably in their complexity and the processes that they represent. Although the models have been evaluated, the observational datasets have typically been of short duration and so are not suitable to assess the performance over the seasonal cycle. The First International Urban Land-Surface Model comparison used an observational dataset that spanned a period greater than a year, which enables an analysis over the seasonal cycle, whilst the variety of models that took part in the comparison allows the analysis to include a full range of model complexity. The results show that, in general, urban models do capture the seasonal cycle for each of the surface fluxes, but have larger errors in the summer months than in the winter. The net all-wave radiation has the smallest errors at all times of the year but with a negative bias. The latent heat flux and the net storage heat flux are also underestimated, whereas the sensible heat flux generally has a positive bias throughout the seasonal cycle. A representation of vegetation is a necessary, but not sufficient, condition for modelling the latent heat flux and associated sensible heat flux at all times of the year. Models that include a temporal variation in anthropogenic heat flux show some increased skill in the sensible heat flux at night during the winter, although their daytime values are consistently overestimated at all times of the year. Models that use the net all-wave radiation to determine the net storage heat flux have the best agreement with observed values of this flux during the daytime in summer, but perform worse during the winter months. The latter could result from a bias of summer periods in the observational datasets used to derive the relations with net all-wave radiation. Apart from these models, all of the other model categories considered in the analysis result in a mean net storage heat flux that is close to zero throughout the seasonal cycle, which is not seen in the observations. Models with a simple treatment of the physical processes generally perform at least as well as models with greater complexity.

Good machine performance in Turing’s imitation game

In this paper we consider transcripts which originated from a practical series of Turing’s Imitation Game which was held on 23rd June 2012 at Bletchley Park, England. In some cases the tests involved a 3-participant simultaneous comparison of two hidden entities whereas others were the result of a direct 2-participant interaction. Each of the transcripts considered here resulted in a human interrogator being fooled, by a machine, into concluding that they had been conversing with a human. Particular features of the conversation are highlighted, successful ploys on the part of each machine discussed and likely reasons for the interrogator being fooled are considered. Subsequent feedback from the interrogators involved is also included

Task design and second language performance: the effect of narrative type on learner output

This article presents a study examining how narrative structure and narrative complexity might influence the performance of second language learners. Forty learners of English in London and sixty learners in Teheran were asked to retell cartoon stories from picture prompts. Each performed two of four narrative tasks that had different degrees of narrative structure (loose or tight) and of storyline complexity (with or without background events). Results support the findings of previous research that tight task structure is connected to increased accuracy and that narratives involving background information give rise to more complex syntax. A comparison of the data from the London and Teheran cohorts showed that the learners in London used significantly more complex syntax and diverse vocabulary even though they did not differ from the Teheran learners in other performance dimensions.

Performance of a BP c-Si building Integrated PV system after 15years of installation

In this study, the performance, yield and characteristics of a 15 year old photovoltaic system installation has been investigated. The technology, BP Saturn modules which were steel-blue polycrystalline silicon cells are no longer in production. A bespoke monitoring system was designed and purpose built to monitor the characteristics of 6 strings, of 18 modules connected in series. The total output of the system is configured to 6.5kWp (series to parallel configuration). The PV system is demonstrating system outputs to be inferior by 0.7% per year. However,efficiency values in comparison to standard test conditions have remained practically the same. This output though very relevant to the possible performance and stability of aging cells, requires additional parametric studies to develop a more robust argument. The result presented in this paper is part of an on going investigation into PV system aging effects.

Digital code-switching between Cypriot and Standard Greek: performance and identity play online

Studies of code-switching in writing are very limited in comparison with the numerous investigations of this phenomenon in oral communication. Recent research has revealed that in text-based computer-mediated communication internet users bring into play the various languages available in their linguistic repertoire and, consequently, switch between them. In this case study, I investigate digital code-switching between Cypriot and Standard Greek, the two varieties of Greek spoken on the island of Cyprus. Following Auer’s conversation analytic approach and Gafaranga’s view that conversational structure coexists with social structure, I investigate code-switching in online interactions. The data to be analysed here, unlike those considered in most studies of code-switching, are written data, obtained from channel #Cyprus of Internet Relay Chat. The results suggest that code-switching in writing is influenced not only by macro-sociolinguistic factors, but they are also shaped by the medium- and social-specific characteristics of Internet Relay Chat. This, in turn, allows internet users to gain access to different roles and perform various identities within this online context.

Importance of initial state and atmospheric conditions for urban land surface models' performance

Urban land surface models (LSM) are commonly evaluated for short periods (a few weeks to months) because of limited observational data. This makes it difficult to distinguish the impact of initial conditions on model performance or to consider the response of a model to a range of possible atmospheric conditions. Drawing on results from the first urban LSM comparison, these two issues are considered. Assessment shows that the initial soil moisture has a substantial impact on the performance. Models initialised with soils that are too dry are not able to adjust their surface sensible and latent heat fluxes to realistic values until there is sufficient rainfall. Models initialised with too wet soils are not able to restrict their evaporation appropriately for periods in excess of a year. This has implications for short term evaluation studies and implies the need for soil moisture measurements to improve data assimilation and model initialisation. In contrast, initial conditions influencing the thermal storage have a much shorter adjustment timescale compared to soil moisture. Most models partition too much of the radiative energy at the surface into the sensible heat flux at the probable expense of the net storage heat flux.

Assessing the performance of a building integrated BP c-Si PV system

In this study, the performance, yield and characteristics of a 16 year old photovoltaic (PV) system installation have been investigated. The technology, BP Saturn modules which were steel-blue polycrystalline silicon cells are no longer in production. A bespoke monitoring system has been designed to monitor the characteristics of 6 refurbished strings, of 18 modules connected in series. The total output of the system is configured to 6.5 kWp (series to parallel configuration). In addition to experimental results, the performance ratio (PR) of known values was simulated using PVSyst, a simulation software package. From calculations using experimental values, the PV system showed approximately 10% inferior power outputs to what would have been expected as standard test conditions. However, efficiency values in comparison to standard test conditions and the performance ratio (w75% from PVSyst simulations) over the past decade have remained practically the same. This output though very relevant to the possible performance and stability of aging cells, requires additional parametric studies to develop a more robust argument. The result presented in this paper is part of an on-going investigation into PV system aging effects.

The effects of flavonoid and other polyphenol consumption on cognitive performance: A systematic research review of human experimental and epidemiological studies

Literature reviews suggest flavonoids, a sub-class of polyphenols, are beneficial for cognition. This is the first review examining the effect of consumption of all polyphenol groups on cognitive function. Inclusion criteria were polyphenol vs. control interventions and epidemiological studies with an objective measure of cognitive function. Participants were healthy or mildly cognitively impaired adults. Studies were excluded if clinical assessment or diagnosis of Alzheimer’s disease, dementia, or cognitive impairment was the sole measure of cognitive function, or if the polyphenol was present with potentially confounding compounds such as caffeine (e.g. tea studies) or Ginkgo Biloba. 28 studies were identified; 4 berry juice studies, 4 cocoa studies, 13 isoflavone supplement studies, 3 other supplement studies, and 4 epidemiological surveys. Overall, 16 studies reported cognitive benefits following polyphenol consumption. Evidence suggests that consuming additional polyphenols in the diet can lead to cognitive benefits, however, the observed effects were small. Declarative memory and particularly spatial memory appear most sensitive to polyphenol consumption and effects may differ depending on polyphenol source. Polyphenol berry fruit juice consumption was most beneficial for immediate verbal memory, whereas isoflavone based interventions were associated with significant improvements for delayed spatial memory and executive function. Comparison between studies was hampered by methodological inconsistencies. Hence, there was no clear evidence for an association between cognitive outcomes and polyphenol dose response, duration of intervention, or population studied. In conclusion, however, the findings do imply that polyphenol consumption has potential to benefit cognition both acutely and chronically.