University of Glasgow (qirdcsuog) at TREC Crowdsourcing 2011 : TurkRank-network-based worker ranking in crowdsourcing

For TREC Crowdsourcing 2011 (Stage 2) we propose a networkbased approach for assigning an indicative measure of worker trustworthiness in crowdsourced labelling tasks. Workers, the gold standard and worker/gold standard agreements are modelled as a network. For the purpose of worker trustworthiness assignment, a variant of the PageRank algorithm, named TurkRank, is used to adaptively combine evidence that suggests worker trustworthiness, i.e., agreement with other trustworthy co-workers and agreement with the gold standard. A single parameter controls the importance of co-worker agreement versus gold standard agreement. The TurkRank score calculated for each worker is incorporated with a worker-weighted mean label aggregation.

Is intent-aware expected reciprocal rank sufficient to evaluate diversity?

In this paper we define two models of users that require diversity in search results; these models are theoretically grounded in the notion of intrinsic and extrinsic diversity. We then examine Intent-Aware Expected Reciprocal Rank (ERR-IA), one of the official measures used to assess diversity in TREC 2011-12, with respect to the proposed user models. By analyzing ranking preferences as expressed by the user models and those estimated by ERR-IA, we investigate whether ERR-IA assesses document rankings according to the requirements of the diversity retrieval task expressed by the two models. Empirical results demonstrate that ERR-IA neglects query-intents coverage by attributing excessive importance to redundant relevant documents. ERR-IA behavior is contrary to the user models that require measures to first assess diversity through the coverage of intents, and then assess the redundancy of relevant intents. Furthermore, diversity should be considered separately from document relevance and the documents positions in the ranking.

Crowdsourcing interactions : using crowdsourcing for evaluating interactive information retrieval systems

In the field of information retrieval (IR), researchers and practitioners are often faced with a demand for valid approaches to evaluate the performance of retrieval systems. The Cranfield experiment paradigm has been dominant for the in-vitro evaluation of IR systems. Alternative to this paradigm, laboratory-based user studies have been widely used to evaluate interactive information retrieval (IIR) systems, and at the same time investigate users’ information searching behaviours. Major drawbacks of laboratory-based user studies for evaluating IIR systems include the high monetary and temporal costs involved in setting up and running those experiments, the lack of heterogeneity amongst the user population and the limited scale of the experiments, which usually involve a relatively restricted set of users. In this paper, we propose an alternative experimental methodology to laboratory-based user studies. Our novel experimental methodology uses a crowdsourcing platform as a means of engaging study participants. Through crowdsourcing, our experimental methodology can capture user interactions and searching behaviours at a lower cost, with more data, and within a shorter period than traditional laboratory-based user studies, and therefore can be used to assess the performances of IIR systems. In this article, we show the characteristic differences of our approach with respect to traditional IIR experimental and evaluation procedures. We also perform a use case study comparing crowdsourcing-based evaluation with laboratory-based evaluation of IIR systems, which can serve as a tutorial for setting up crowdsourcing-based IIR evaluations.

Synthesis of MgB2 at low temperature and autogenous pressure

High quality, micron-sized interpenetrating grains of MgB2 with high density are produced at low temperatures (~420oC < T < ~500oC) under autogenous pressure by pre-mixing Mg powder and NaBH4 and heating in an Inconel 601 alloy reactor for 5−15 hours. Optimum production of MgB2 with yields greater than 75% occurs for autogenous pressure in the range 1.0 MPa to 2.0 MPa with the reactor at ~500oC. Autogenous pressure is induced by the decomposition of NaBH4 in the presence of Mg and/or other Mg-based compounds. The morphology, transition temperature and magnetic properties of MgB2 are dependent on the heating regime. Significant improvement in physical properties accrues when the reactor temperature is held at 250oC for >20minutes prior to a hold at 500oC.

Characterising the spatial dynamics of sympatric Aedes aegypti and Aedes albopictus populations in the Philippines

Entomological surveillance and control are essential to the management of dengue fever (DF). Hence, understanding the spatial and temporal patterns of DF vectors, Aedes (Stegomyia) aegypti (L.) and Ae. (Stegomyia) albopictus (Skuse), is paramount. In the Philippines, resources are limited and entomological surveillance and control are generally commenced during epidemics, when transmission is difficult to control. Recent improvements in spatial epidemiological tools and methods offer opportunities to explore more efficient DF surveillance and control solutions: however, there are few examples in the literature from resource-poor settings. The objectives of this study were to: (i) explore spatial patterns of Aedes populations and (ii) predict areas of high and low vector density to inform DF control in San Jose village, Muntinlupa city, Philippines. Fortnightly, adult female Aedes mosquitoes were collected from 50 double-sticky ovitraps (SOs) located in San Jose village for the period June-November 2011. Spatial clustering analysis was performed to identify high and low density clusters of Ae. aegypti and Ae. albopictus mosquitoes. Spatial autocorrelation was assessed by examination of semivariograms, and ordinary kriging was undertaken to create a smoothed surface of predicted vector density in the study area. Our results show that both Ae. aegypti and Ae. albopictus were present in San Jose village during the study period. However, one Aedes species was dominant in a given geographic area at a time, suggesting differing habitat preferences and interspecies competition between vectors. Density maps provide information to direct entomological control activities and advocate the development of geographically enhanced surveillance and control systems to improve DF management in the Philippines.

A comprehensive analysis of parameter settings for novelty-biased cumulative gain

In the TREC Web Diversity track, novelty-biased cumulative gain (α-NDCG) is one of the official measures to assess retrieval performance of IR systems. The measure is characterised by a parameter, α, the effect of which has not been thoroughly investigated. We find that common settings of α, i.e. α=0.5, may prevent the measure from behaving as desired when evaluating result diversification. This is because it excessively penalises systems that cover many intents while it rewards those that redundantly cover only few intents. This issue is crucial since it highly influences systems at top ranks. We revisit our previously proposed threshold, suggesting α be set on a query-basis. The intuitiveness of the measure is then studied by examining actual rankings from TREC 09-10 Web track submissions. By varying α according to our query-based threshold, the discriminative power of α-NDCG is not harmed and in fact, our approach improves α-NDCG's robustness. Experimental results show that the threshold for α can turn the measure to be more intuitive than using its common settings.

A query-basis approach to parametrizing novelty-biased cumulative gain

Novelty-biased cumulative gain (α-NDCG) has become the de facto measure within the information retrieval (IR) community for evaluating retrieval systems in the context of sub-topic retrieval. Setting the incorrect value of parameter α in α-NDCG prevents the measure from behaving as desired in particular circumstances. In fact, when α is set according to common practice (i.e. α = 0.5), the measure favours systems that promote redundant relevant sub-topics rather than provide novel relevant ones. Recognising this characteristic of the measure is important because it affects the comparison and the ranking of retrieval systems. We propose an approach to overcome this problem by defining a safe threshold for the value of α on a query basis. Moreover, we study its impact on system rankings through a comprehensive simulation.

When two is better than one : a study of ranking paradigms and their integrations for subtopic retrieval

In this paper, we consider the problem of document ranking in a non-traditional retrieval task, called subtopic retrieval. This task involves promoting relevant documents that cover many subtopics of a query at early ranks, providing thus diversity within the ranking. In the past years, several approaches have been proposed to diversify retrieval results. These approaches can be classified into two main paradigms, depending upon how the ranks of documents are revised for promoting diversity. In the first approach subtopic diversification is achieved implicitly, by choosing documents that are different from each other, while in the second approach this is done explicitly, by estimating the subtopics covered by documents. Within this context, we compare methods belonging to the two paradigms. Furthermore, we investigate possible strategies for integrating the two paradigms with the aim of formulating a new ranking method for subtopic retrieval. We conduct a number of experiments to empirically validate and contrast the state-of-the-art approaches as well as instantiations of our integration approach. The results show that the integration approach outperforms state-of-the-art strategies with respect to a number of measures.

University of Glasgow at ImageCLEFPhoto 2009 : optimising similarity and diversity in image retrieval

In this paper we describe the approaches adopted to generate the runs submitted to ImageCLEFPhoto 2009 with an aim to promote document diversity in the rankings. Four of our runs are text based approaches that employ textual statistics extracted from the captions of images, i.e. MMR [1] as a state of the art method for result diversification, two approaches that combine relevance information and clustering techniques, and an instantiation of Quantum Probability Ranking Principle. The fifth run exploits visual features of the provided images to re-rank the initial results by means of Factor Analysis. The results reveal that our methods based on only text captions consistently improve the performance of the respective baselines, while the approach that combines visual features with textual statistics shows lower levels of improvements.

Two-photon fluorescence spectroscopy for identification of healthy and malignant biological tissues

Two-photon fluorescence spectroscopy has been performed on rat skeletal muscles to investigate the effect of fixation processes on the micro-environments of the endogenous fluorophors in rat skeletal muscles. The two-photon fluorescence spectra measured for different fixation periods show a differential among those samples that were fixed in water, formalin and methanol, respectively. The results imply that two-photon fluorescence spectroscopy can be a potential technique for identification of healthy and malignant biological tissues.

Electrical insulation of high voltage inductor with co-axial electrode at floating voltage

Inductive fault current limiters (FCLs) have several advantages, such as significant current limitation, immediate triggering and relatively low losses. Despite these advantages, saturated core FCLs have not been commercialized due to its large size and associated high costs. A major remaining challenge is to reduce the footprint of the device. In this paper, a solution to reduce the overall footprint is proposed and discussed. In arrangements of windings on a core in reactors such as FCLs, the core is conventionally grounded. The electrical insulation distance between high voltage winding and core can be reduced if the core is left at floating potential. This paper shows the results of the investigation carried out on the insulation of such a coil-core assembly. Two experiments were conducted. In the first, the behavior of the apparatus under high voltage conditions was assessed by performing power frequency and lightning impulse tests. In the second experiment, a low voltage test was conducted during which voltages of different frequencies and pulses with varying rise times were applied. A finite element simulation was also carried out for comparison and further investigation

Beyond Bilbao : rethinking flagship cultural development and planning in three California cities

Since the widely publicized revitalization success story of the Guggenheim Museum Bilbao, local governments have been scrambling to create their own flagship cultural projects. Because of the broad public sponsorship of such projects, urban planners need a full understanding of the associated potentials and problems. However, little research specifically examines the localized complexities of the flagship cultural strategy. Examining projects in Los Angeles, San Francisco, and San Jose, California, the article illustrates that much more than impressive architecture influences their catalytic ability. Flagship cultural projects are highly dependent on a variety of contextual factors and, therefore, should be positioned to build on existing arts and related commercial activity rather than gamble that they will generate new development from scratch.

Museums as urban catalysts : the role of urban design in flagship cultural development

A long-held urban redevelopment strategy has been the investment in flagship cultural projects—large-scale, iconic museums and arts centres that are intended to enhance the city image while catalyzing private sector investment and attracting tourists to the surrounding area. This paper concentrates on an aspect of the flagship cultural strategy that has received surprisingly little focused attention—the role that urban design and context play in realizing project outcomes. The analysis concentrates on two established flagship museums in Los Angeles and San Jose, California. The research demonstrates that certain urban design characteristics can negatively affect the ability of a project to attract visitors and generate commercial activity. However, at the same time, factors beyond the local context may be an overriding factor in project outcomes thus calling into question the concept of cultural catalyst.