Using interaction data for improving the offline and online evaluation of search engines

This thesis investigates how web search evaluation can be improved using historical interaction data. Modern search engines combine offline and online evaluation approaches in a sequence of steps that a tested change needs to pass through to be accepted as an improvement and subsequently deployed. We refer to such a sequence of steps as an evaluation pipeline. In this thesis, we consider the evaluation pipeline to contain three sequential steps: an offline evaluation step, an online evaluation scheduling step, and an online evaluation step. In this thesis we show that historical user interaction data can aid in improving the accuracy or efficiency of each of the steps of the web search evaluation pipeline. As a result of these improvements, the overall efficiency of the entire evaluation pipeline is increased. Firstly, we investigate how user interaction data can be used to build accurate offline evaluation methods for query auto-completion mechanisms. We propose a family of offline evaluation metrics for query auto-completion that represents the effort the user has to spend in order to submit their query. The parameters of our proposed metrics are trained against a set of user interactions recorded in the search engine’s query logs. From our experimental study, we observe that our proposed metrics are significantly more correlated with an online user satisfaction indicator than the metrics proposed in the existing literature. Hence, fewer changes will pass the offline evaluation step to be rejected after the online evaluation step. As a result, this would allow us to achieve a higher efficiency of the entire evaluation pipeline. Secondly, we state the problem of the optimised scheduling of online experiments. We tackle this problem by considering a greedy scheduler that prioritises the evaluation queue according to the predicted likelihood of success of a particular experiment. This predictor is trained on a set of online experiments, and uses a diverse set of features to represent an online experiment. Our study demonstrates that a higher number of successful experiments per unit of time can be achieved by deploying such a scheduler on the second step of the evaluation pipeline. Consequently, we argue that the efficiency of the evaluation pipeline can be increased. Next, to improve the efficiency of the online evaluation step, we propose the Generalised Team Draft interleaving framework. Generalised Team Draft considers both the interleaving policy (how often a particular combination of results is shown) and click scoring (how important each click is) as parameters in a data-driven optimisation of the interleaving sensitivity. Further, Generalised Team Draft is applicable beyond domains with a list-based representation of results, i.e. in domains with a grid-based representation, such as image search. Our study using datasets of interleaving experiments performed both in document and image search domains demonstrates that Generalised Team Draft achieves the highest sensitivity. A higher sensitivity indicates that the interleaving experiments can be deployed for a shorter period of time or use a smaller sample of users. Importantly, Generalised Team Draft optimises the interleaving parameters w.r.t. historical interaction data recorded in the interleaving experiments. Finally, we propose to apply the sequential testing methods to reduce the mean deployment time for the interleaving experiments. We adapt two sequential tests for the interleaving experimentation. We demonstrate that one can achieve a significant decrease in experiment duration by using such sequential testing methods. The highest efficiency is achieved by the sequential tests that adjust their stopping thresholds using historical interaction data recorded in diagnostic experiments. Our further experimental study demonstrates that cumulative gains in the online experimentation efficiency can be achieved by combining the interleaving sensitivity optimisation approaches, including Generalised Team Draft, and the sequential testing approaches. Overall, the central contributions of this thesis are the proposed approaches to improve the accuracy or efficiency of the steps of the evaluation pipeline: the offline evaluation frameworks for the query auto-completion, an approach for the optimised scheduling of online experiments, a general framework for the efficient online interleaving evaluation, and a sequential testing approach for the online search evaluation. The experiments in this thesis are based on massive real-life datasets obtained from Yandex, a leading commercial search engine. These experiments demonstrate the potential of the proposed approaches to improve the efficiency of the evaluation pipeline.

A petrographic investigation into the durability of common replacement sandstones to the crystallisation of de-icing salts

Scottish sandstone buildings are now suffering the long-term effects of salt-crystallisation damage, owing in part to the repeated deposition of de-icing salts during winter months. The use of de-icing salts is necessary in order to maintain safe road and pavement conditions during cold weather, but their use comes at a price. Sodium chloride (NaCl), which is used as the primary de-icing salt throughout the country, is a salt known to be damaging to sandstone masonry. However, there remains a range of alternative, commercially available de-icing salts. It is unknown however, what effect these salts have on porous building materials, such as sandstone. In order to protect our built heritage against salt-induced decay, it is vital to understand the effects of these different salts on the range of sandstone types that we see within the historic buildings of Scotland. Eleven common types of sandstone were characterised using a suite of methods in order to understand their mineralogy, pore structure and their response to moisture movement, which are vital properties that govern a stone’s response to weathering and decay. Sandstones were then placed through a range of durability tests designed to measure their resistance to various weathering processes. Three salt crystallisation tests were undertaken on the sandstones over a range of 16 to 50 cycles, which tested their durability to NaCl, CaCl2, MgCl2 and a chloride blend salt. Samples were primarily analysed by measuring their dry weight loss after each cycle, visually after each cycle and by other complimentary methods in order to understand their changing response to moisture uptake after salt treatment. Salt crystallisation was identified as the primary mechanism of decay across each salt, with the extent of damage in each sandstone influenced by environmental conditions and pore-grain properties of the stone. Damage recorded in salt crystallisation tests was ultimately caused by the generation of high crystallisation pressures within the confined pore networks of each stone. Stone and test-specific parameters controlled the location and magnitude of damage, with the amount of micro-pores, their spatial distribution, the water absorption coefficient and the drying efficiency of each stone being identified as the most important stone-specific properties influencing salt-induced decay. Strong correlations were found between the dry weight loss of NaCl treated samples and the proportion of pores <1µm in diameter. Crystallisation pressures are known to scale inversely with pore size, while the spatial distribution of these micro-pores is thought to influence the rate, overall extent and type of decay within the stone by concentrating crystallisation pressures in specific regions of the stone. The water absorption determines the total amount of moisture entering into the stone, which represents the total amount of void space for salt crystallisation. The drying parameters on the other hand, ultimately control the distribution of salt crystallisation. Those stones that were characterised by a combination of a high proportion of micro-pores, high water absorption values and slow drying kinetics were shown to be most vulnerable to NaCl-induced decay. CaCl2 and MgCl2 are shown to have similar crystallisation behaviour, forming thin crystalline sheets under low relative humidity and/or high temperature conditions. Distinct differences in their behaviour that are influenced by test specific criteria were identified. The location of MgCl2 crystallisation close to the stone surface, as influenced by prolonged drying under moderate temperature drying conditions, was identified as the main factor that caused substantial dry weight loss in specific stone types. CaCl2 solutions remained unaffected under these conditions and only crystallised under high temperatures. Homogeneous crystallisation of CaCl2 throughout the stone produced greater internal change, with little dry weight loss recorded. NaCl formed distinctive isometric hopper crystals that caused damage through the non-equilibrium growth of salts in trapped regions of the stone. Damage was sustained as granular decay and contour scaling across most stone types. The pore network and hydric properties of the stones continually evolve in response to salt crystallisation, creating a dynamic system whereby the initial, known properties of clean quarried stone will not continually govern the processes of salt crystallisation, nor indeed can they continually predict the behaviour of stone to salt-induced decay.

An investigation of the clinical utility of preoperative cardiopulmonary exercise testing in patients undergoing major pancreatic surgery

Pancreaticoduodenectomy with or without adjuvant chemotherapy remains the only modality of possible cure in patients with cancer involving the head of the pancreas and the periampullary region. While mortality rates after pancreaticoduodenectomy have improved considerably over the course of the last century, morbidity remains high. Patient selection is of paramount importance in ensuring that major surgery is offered to individuals who will most benefit from a pancreaticoduodenectomy. Moreover, identifying preoperative risk factors provides potential targets for prehabilitation and optimisation of the patient's physiology before undertaking surgery. In addition to this, early identification of patients who are likely to develop postoperative complications allows for better allocation of critical care resources and more aggressive management high risk patients. Cardiopulmonary exercise testing is becoming an increasingly popular tool in the preoperative risk assessment of the surgical patient. However, very little work has been done to investigate the role of cardiopulmonary exercise testing in predicting complications after pancreaticoduodenectomy. The impact of jaundice, systemic inflammation and other preoperative clinicopathological characteristics on cardiopulmonary exercise physiology has not been studied in detail before in this cohort of patients. The overall aim of the thesis was to examine the relationships between preoperative clinico-pathological characteristics including cardiopulmonary exercise physiology, obstructive jaundice, body composition and systemic inflammation and complications and the post-surgical systemic inflammatory response in patients undergoing pancreaticoduodenectomy. Chapter 1 reviews the existing literature on preoperative cardiopulmonary exercise testing, the impact of obstructive jaundice, perioperative systemic inflammation and the importance of body composition in determining outcomes in patients undergoing major surgery with particular reference to pancreatic surgery. Chapter 2 reports on the role of cardiopulmonary exercise testing in predicting postoperative complications after pancreaticoduodenectomy. The results demonstrate that patients with V˙O2AT less than 10 ml/kg/min are more likely to develop a postoperative pancreatic fistula, stay longer in hospital and less likely to receive adjuvant therapy. These results emphasise the importance of aerobic fitness to recover from the operative stress of major surgery without significant morbidity. Cardiopulmonary exercise testing may prove useful in selecting patients for intensive prehabilitation programmes as well as for other optimisation measures to prepare them for major surgery. Chapter 3 evaluates the relationship between cardiopulmonary exercise physiology and other clinicopathological characteristics of the patient. A detailed analysis of cardiopulmonary exercise test parameters in jaundiced versus non-jaundiced patients demonstrates that obstructive jaundice does not impair cardiopulmonary exercise physiology. This further supports emerging evidence in contemporary literature that jaundiced patients can proceed directly to surgery without preoperative biliary drainage. The results of this study also show an interesting inverse relationship between body mass index and anaerobic threshold which is analysed in more detail in Chapter 4. Chapter 4 examines the relationship between preoperative cardiopulmonary exercise physiology and body composition in depth. All parameters measured at cardiopulmonary exercise test are compared against body composition and body mass index. The results of this chapter report that the current method of reporting V˙O2, both at peak exercise and anaerobic threshold, is biased against obese subjects and advises caution in the interpretation of cardiopulmonary exercise test results in patients with a high BMI. This is particularly important as current evidence in literature suggests that postoperative outcomes in obese subjects are comparable to non-obese subjects while cardiopulmonary exercise test results are also abnormally low in this very same cohort of patients. Chapter 5 analyses the relationship between preoperative clinico-pathological characteristics including systemic inflammation and the magnitude of the postoperative systemic inflammatory response. Obstructive jaundice appears to have an immunosuppressive effect while elevated preoperative CRP and hypoalbuminemia appear to have opposite effects with hypoalbuminemia resulting in a lower response while elevated CRP in the absence of hypoalbuminemia resulted in a greater postoperative systemic inflammatory response. Chapter 6 evaluates the role of the early postoperative systemic inflammatory response in predicting complications after pancreaticoduodenectomy and aims to establish clinically relevant thresholds for C-Reactive Protein for the prediction of complications. The results of this chapter demonstrate that CRP levels as early as the second postoperative day are associated with complications. While post-operative CRP was useful in the prediction of infective complications, this was the case only in patients who did not develop a post-operative pancreatic fistula. The predictive ability of inflammatory markers for infectious complications was blunted in patients with a pancreatic fistula. Chapter 7 summarises the findings of this thesis, their place in current literature and future directions. The results of this thesis add to the current knowledge regarding the complex pathophysiological abnormalities in patients undergoing pancreaticoduodenectomy, with specific emphasis on the interaction between cardiopulmonary exercise physiology, obstructive jaundice, systemic inflammation and postoperative outcomes. The work presented in this thesis lays the foundations for further studies aimed at improving outcomes after pancreaticoduodenectomy through the development of individualised, goal-directed therapies that are initiated well before this morbid yet necessary operation is performed.

A house, not a home? Examining the use of the private rented sector to resolve homelessness in Scotland

Changes to homelessness legislation in post-devolution Scotland have resulted in an expansion of rights for homeless households seeking formal assistance from local authorities. These changes have led to Scotland’s homelessness arrangements being considered among the most progressive in Europe. In recent years, however, the Scottish Government has increasingly promoted homelessness prevention and Housing Options approaches as a means by which homelessness might be avoided or resolved without recourse to statutory rights. As part of that, they have promoted greater use of the private rented sector (PRS) as a key housing option, with the potential to meet the needs of homeless households. The arguments made to support use of the PRS have much in common with arguments for privatisation in other areas of social policy, notably greater choice for the individual promoting better welfare outcomes, and competition among providers encouraging improvements in quality of service provision. Critics have argued that such benefits may not be realised and that, on the contrary, privatisation may lead to exclusion or act to worsen households’ outcomes. This thesis considers the extent to which the PRS has been utilised in Scotland to accommodate homeless households, and the consequences of this for their welfare. The thesis uses a combination of quantitative and qualitative methods. To examine trends in the use of the PRS, it presents quantitative analysis of the data on the operation of the statutory system and Housing Options arrangements, and of data from a survey of local authority homelessness strategy officers. To examine the consequences of this for homeless households, the thesis uses qualitative research involving face-to-face interviews with 35 homeless households across three local authority areas. This research considers the extent to which households’ experiences of homelessness, housing need and the PRS reflect the arguments presented in the literature, and how settled accommodation has impacted on households’ ability to participate fully in society. The research found an increasing but still limited role for the PRS in resolving statutory homelessness in Scotland, with indications that the PRS is being increasingly used as part of the Housing Options approach and as a means of resolving homelessness outside the statutory system. The PRS is being utilised to varying degrees across different local authority areas, and a variety of methods are being used to do so. While local authorities saw clear advantages to making greater use of the sector, a number of significant barriers including affordability, available stock and landlord preferences - made this difficult in practice. Research with previously homeless households in the PRS similarly found broadly positive experiences and views of the sector, particularly with regard to enabling households to access good quality accommodation in desirable areas of their choosing, with many households highlighting improvements relating to social inclusion and participation. Nevertheless, concerns around the security of tenure offered by the sector, repairs, service standards and unequal power relations between landlord and tenant persisted. As such, homeless households frequently expressed their decision to enter the sector in terms of a trade-off between choice and security.

The commodification of culture in the Thai tourism context: a study of culinary experiences in touristic traditional markets

The purpose of the thesis is to examine the relationship between tourism and the local culture expressed in culinary experiences offered in the traditional, nostalgic-themed markets that have arisen as popular attractions in the 21 st century. Central to the thesis is an examination of how the traditional cultural values are articulated in the production, promotion and consumption of culinary experiences in order to understand the value of culture when embedded in the process of commodification, as well as to understand influential socio-cultural factors. The thesis investigates the potential of traditional markets to promote food as the main attraction in the market. Field studies were conducted from December 2012–March 2014 in eight traditional markets in the central region of Thailand. Based on the ethnographic approach in studying the narratives in the markets, a variety of methods were implemented in the process of data collection. Besides observational analysis of the venue, semi-structured interviews and the self-administered questionnaires were used to collect data from actors who engage in food experiences, including management team members, food traders and visitors. Data was also collected from interviews with officers working for Tourism Authority of Thailand (TAT).  Keys findings of the thesis reveal that the cultural expressions of food experience in each market is an outcome of both the interactions of worldviews expressed by actors involved in the traditional market and the socio-cultural condition of Thailand. The relationships between stakeholders’ attitudes towards food experiences and the commercial potentials and limitations of food were analysed. The analysis of the cultural value of culinary experiences demonstrates that the existing academic discussions of the authenticity of tourism are insightful in explaining the character of food experiences offered in this tourism scenario. Most importantly, authenticity in tourism experiences, being a desirable element in culinary experiences, is a reflection of the how the pre-modern aspect of Thai society is embraced in a contemporary context. In addition, the commodification of culinary culture generates multidimensional consequences on the value of traditional culture and local lives. Moreover, the performance of culinary experiences can be viewed from the perspective of how Thai society interacts with globalization. The thesis also points out that it is possible to compare the situation of the traditional markets with the marketing positioning of food in Thai tourism marketing policy.

Surface acoustic wave streaming in a PDMS microfluidic system: effect of frequency and fluid geometry & A remote ultrasonic glucose sensor

This thesis describes two separate projects. The first is a theoretical and experimental investigation of surface acoustic wave streaming in microfluidics. The second is the development of a novel acoustic glucose sensor. A separate abstract is given for each here. Optimization of acoustic streaming in microfluidic channels by SAWs Surface Acoustic Waves, (SAWs) actuated on flat piezoelectric substrates constitute a convenient and versatile tool for microfluidic manipulation due to the easy and versatile interfacing with microfluidic droplets and channels. The acoustic streaming effect can be exploited to drive fast streaming and pumping of fluids in microchannels and droplets (Shilton et al. 2014; Schmid et al. 2011), as well as size dependant sorting of particles in centrifugal flows and vortices (Franke et al. 2009; Rogers et al. 2010). Although the theory describing acoustic streaming by SAWs is well understood, very little attention has been paid to the optimisation of SAW streaming by the correct selection of frequency. In this thesis a finite element simulation of the fluid streaming in a microfluidic chamber due to a SAW beam was constructed and verified against micro-PIV measurements of the fluid flow in a fabricated device. It was found that there is an optimum frequency that generates the fastest streaming dependent on the height and width of the chamber. It is hoped this will serve as a design tool for those who want to optimally match SAW frequency with a particular microfluidic design. An acoustic glucose sensor Diabetes mellitus is a disease characterised by an inability to properly regulate blood glucose levels. In order to keep glucose levels under control some diabetics require regular injections of insulin. Continuous monitoring of glucose has been demonstrated to improve the management of diabetes (Zick et al. 2007; Heinemann & DeVries 2014), however there is a low patient uptake of continuous glucose monitoring systems due to the invasive nature of the current technology (Ramchandani et al. 2011). In this thesis a novel way of monitoring glucose levels is proposed which would use ultrasonic waves to ‘read’ a subcutaneous glucose sensitive-implant, which is only minimally invasive. The implant is an acoustic analogy of a Bragg stack with a ‘defect’ layer that acts as the sensing layer. A numerical study was performed on how the physical changes in the sensing layer can be deduced by monitoring the reflection amplitude spectrum of ultrasonic waves reflected from the implant. Coupled modes between the skin and the sensing layer were found to be a potential source of error and drift in the measurement. It was found that by increasing the number of layers in the stack that this could be minimized. A laboratory proof of concept system was developed using a glucose sensitive hydrogel as the sensing layer. It was possible to monitor the changing thickness and speed of sound of the hydrogel due to physiological relevant changes in glucose concentration.