Query routing in cooperative semi-structured peer-to-peer information retrieval networks

Conventional web search engines are centralised in that a single entity crawls and indexes the documents selected for future retrieval, and the relevance models used to determine which documents are relevant to a given user query. As a result, these search engines suffer from several technical drawbacks such as handling scale, timeliness and reliability, in addition to ethical concerns such as commercial manipulation and information censorship. Alleviating the need to rely entirely on a single entity, Peer-to-Peer (P2P) Information Retrieval (IR) has been proposed as a solution, as it distributes the functional components of a web search engine – from crawling and indexing documents, to query processing – across the network of users (or, peers) who use the search engine. This strategy for constructing an IR system poses several efficiency and effectiveness challenges which have been identified in past work. Accordingly, this thesis makes several contributions towards advancing the state of the art in P2P-IR effectiveness by improving the query processing and relevance scoring aspects of a P2P web search. Federated search systems are a form of distributed information retrieval model that route the user’s information need, formulated as a query, to distributed resources and merge the retrieved result lists into a final list. P2P-IR networks are one form of federated search in routing queries and merging result among participating peers. The query is propagated through disseminated nodes to hit the peers that are most likely to contain relevant documents, then the retrieved result lists are merged at different points along the path from the relevant peers to the query initializer (or namely, customer). However, query routing in P2P-IR networks is considered as one of the major challenges and critical part in P2P-IR networks; as the relevant peers might be lost in low-quality peer selection while executing the query routing, and inevitably lead to less effective retrieval results. This motivates this thesis to study and propose query routing techniques to improve retrieval quality in such networks. Cluster-based semi-structured P2P-IR networks exploit the cluster hypothesis to organise the peers into similar semantic clusters where each such semantic cluster is managed by super-peers. In this thesis, I construct three semi-structured P2P-IR models and examine their retrieval effectiveness. I also leverage the cluster centroids at the super-peer level as content representations gathered from cooperative peers to propose a query routing approach called Inverted PeerCluster Index (IPI) that simulates the conventional inverted index of the centralised corpus to organise the statistics of peers’ terms. The results show a competitive retrieval quality in comparison to baseline approaches. Furthermore, I study the applicability of using the conventional Information Retrieval models as peer selection approaches where each peer can be considered as a big document of documents. The experimental evaluation shows comparative and significant results and explains that document retrieval methods are very effective for peer selection that brings back the analogy between documents and peers. Additionally, Learning to Rank (LtR) algorithms are exploited to build a learned classifier for peer ranking at the super-peer level. The experiments show significant results with state-of-the-art resource selection methods and competitive results to corresponding classification-based approaches. Finally, I propose reputation-based query routing approaches that exploit the idea of providing feedback on a specific item in the social community networks and manage it for future decision-making. The system monitors users’ behaviours when they click or download documents from the final ranked list as implicit feedback and mines the given information to build a reputation-based data structure. The data structure is used to score peers and then rank them for query routing. I conduct a set of experiments to cover various scenarios including noisy feedback information (i.e, providing positive feedback on non-relevant documents) to examine the robustness of reputation-based approaches. The empirical evaluation shows significant results in almost all measurement metrics with approximate improvement more than 56% compared to baseline approaches. Thus, based on the results, if one were to choose one technique, reputation-based approaches are clearly the natural choices which also can be deployed on any P2P network.

Conservation value, biodiversity value and methods of assessment in regenerating and human disturbed tropical forest

Although the value of primary forests for biodiversity conservation is well known, the potential biodiversity and conservation value of regenerating forests remains controversial. Many factors likely contribute to this, including: 1. the variable ages of regenerating forests being studied (often dominated by relatively young regenerating forests); 2. the potential for confounding on-going human disturbance (such as logging and hunting); 3. the relatively low number of multi-taxa studies; 4. the lack of studies that directly compare different historic disturbances within the same location; 5. contrasting patterns from different survey methodologies and the paucity of knowledge on the impacts across different vertical levels of rainforest biodiversity (often due to a lack of suitable methodologies available to assess them). We also know relatively little as to how biodiversity is affected by major current impacts, such as unmarked rainforest roads, which contribute to this degradation of habitat and fragmentation. This thesis explores the potential biodiversity value of regenerating rainforests under the best of scenarios and seeks to understand more about the impact of current human disturbance to biodiversity; data comes from case studies from the Manu and Sumaco Biosphere Reserves in the Western Amazon. Specifically, I compare overall biodiversity and conservation value of a best case regenerating rainforest site with a selection of well-studied primary forest sites and with predicted species lists for the region; including a focus on species of key conservation concern. I then investigate the biodiversity of the same study site in reference to different types of historic anthropogenic disturbance. Following this I investigate the impacts to biodiversity from an unmarked rainforest road. In order to understand more about the differential effects of habitat disturbance on arboreal diversity I directly assess how patterns of butterfly biodiversity vary between three vertical strata. Although assessments within the canopy have been made for birds, invertebrates and bats, very few studies have successfully targeted arboreal mammals. I therefore investigate the potential of camera traps for inventorying arboreal mammal species in comparison with traditional methodologies. Finally, in order to investigate the possibility that different survey methodologies might identify different biodiversity patterns in habitat disturbance assessments, I investigate whether two different but commonly used survey methodologies used to assess amphibians, indicate the same or different responses of amphibian biodiversity to historic habitat change by people. The regenerating rainforest study site contained high levels of species richness; both in terms of alpha diversity found in nearby primary forest areas (87% ±3.5) and in terms of predicted primary forest diversity from the region (83% ±6.7). This included 89% (39 out of 44) of the species of high conservation concern predicted for the Manu region. Faunal species richness in once completely cleared regenerating forest was on average 13% (±9.8) lower than historically selectively logged forest. The presence of the small unmarked road significantly altered levels of faunal biodiversity for three taxa, up to and potentially beyond 350m into the forest interior. Most notably, the impact on biodiversity extended to at least 32% of the whole reserve area. The assessment of butterflies across strata showed that different vertical zones within the same rainforest responded differently in areas with different historic human disturbance. A comparison between forest regenerating after selective logging and forest regenerating after complete clearance, showed that there was a 17% greater reduction in canopy species richness in the historically cleared forest compared with the terrestrial community. Comparing arboreal camera traps with traditional ground-based techniques suggests that camera traps are an effective tool for inventorying secretive arboreal rainforest mammal communities and detect a higher number of cryptic species. Finally, the two survey methodologies used to assess amphibian communities identified contrasting biodiversity patterns in a human modified rainforest; one indicated biodiversity differences between forests with different human disturbance histories, whereas the other suggested no differences between forest disturbance types. Overall, in this thesis I find that the conservation and biodiversity value of regenerating and human disturbed tropical forest can potentially contribute to rainforest biodiversity conservation, particularly in the best of circumstances. I also highlight the importance of utilising appropriate study methodologies that to investigate these three-dimensional habitats, and contribute to the development of methodologies to do so. However, care should be taken when using different survey methodologies, which can provide contrasting biodiversity patterns in response to human disturbance.

Applied evolution: An integrated approach to studying life history traits in response to drug selection

The use of chemical control measures to reduce the impact of parasite and pest species has frequently resulted in the development of resistance. Thus, resistance management has become a key concern in human and veterinary medicine, and in agricultural production. Although it is known that factors such as gene flow between susceptible and resistant populations, drug type, application methods, and costs of resistance can affect the rate of resistance evolution, less is known about the impacts of density-dependent eco-evolutionary processes that could be altered by drug-induced mortality. The overall aim of this thesis was to take an experimental evolution approach to assess how life history traits respond to drug selection, using a free-living dioecious worm (Caenorhabditis remanei) as a model. In Chapter 2, I defined the relationship between C. remanei survival and Ivermectin dose over a range of concentrations, in order to control the intensity of selection used in the selection experiment described in Chapter 4. The dose-response data were also used to appraise curve-fitting methods, using Akaike Information Criterion (AIC) model selection to compare a series of nonlinear models. The type of model fitted to the dose response data had a significant effect on the estimates of LD50 and LD99, suggesting that failure to fit an appropriate model could give misleading estimates of resistance status. In addition, simulated data were used to establish that a potential cost of resistance could be predicted by comparing survival at the upper asymptote of dose-response curves for resistant and susceptible populations, even when differences were as low as 4%. This approach to dose-response modeling ensures that the maximum amount of useful information relating to resistance is gathered in one study. In Chapter 3, I asked how simulations could be used to inform important design choices used in selection experiments. Specifically, I focused on the effects of both within- and between-line variation on estimated power, when detecting small, medium and large effect sizes. Using mixed-effect models on simulated data, I demonstrated that commonly used designs with realistic levels of variation could be underpowered for substantial effect sizes. Thus, use of simulation-based power analysis provides an effective way to avoid under or overpowering a study designs incorporating variation due to random effects. In Chapter 4, I 3 investigated how Ivermectin dosage and changes in population density affect the rate of resistance evolution. I exposed replicate lines of C. remanei to two doses of Ivermectin (high and low) to assess relative survival of lines selected in drug-treated environments compared to untreated controls over 10 generations. Additionally, I maintained lines where mortality was imposed randomly to control for differences in density between drug treatments and to distinguish between the evolutionary consequences of drug treatment versus ecological processes affected by changes in density-dependent feedback. Intriguingly, both drug-selected and random-mortality lines showed an increase in survivorship when challenged with Ivermectin; the magnitude of this increase varied with the intensity of selection and life-history stage. The results suggest that interactions between density-dependent processes and life history may mediate evolved changes in susceptibility to control measures, which could result in misleading conclusions about the evolution of heritable resistance following drug treatment. In Chapter 5, I investigated whether the apparent changes in drug susceptibility found in Chapter 4 were related to evolved changes in life-history of C. remanei populations after selection in drug-treated and random-mortality environments. Rapid passage of lines in the drug-free environment had no effect on the measured life-history traits. In the drug-free environment, adult size and fecundity of drug-selected lines increased compared to the controls but drug selection did not affect lifespan. In the treated environment, drug-selected lines showed increased lifespan and fecundity relative to controls. Adult size of randomly culled lines responded in a similar way to drug-selected lines in the drug-free environment, but no change in fecundity or lifespan was observed in either environment. The results suggest that life histories of nematodes can respond to selection as a result of the application of control measures. Failure to take these responses into account when applying control measures could result in adverse outcomes, such as larger and more fecund parasites, as well as over-estimation of the development of genetically controlled resistance. In conclusion, my thesis shows that there may be a complex relationship between drug selection, density-dependent regulatory processes and life history of populations challenged with control measures. This relationship could have implications for how resistance is monitored and managed if life histories of parasitic species show such eco-evolutionary responses to drug application.