Scaling up data mining techniques to large datasets using parallel and distributed processing

Advances in hardware and software technology enable us to collect, store and distribute large quantities of data on a very large scale. Automatically discovering and extracting hidden knowledge in the form of patterns from these large data volumes is known as data mining. Data mining technology is not only a part of business intelligence, but is also used in many other application areas such as research, marketing and financial analytics. For example medical scientists can use patterns extracted from historic patient data in order to determine if a new patient is likely to respond positively to a particular treatment or not; marketing analysts can use extracted patterns from customer data for future advertisement campaigns; finance experts have an interest in patterns that forecast the development of certain stock market shares for investment recommendations. However, extracting knowledge in the form of patterns from massive data volumes imposes a number of computational challenges in terms of processing time, memory, bandwidth and power consumption. These challenges have led to the development of parallel and distributed data analysis approaches and the utilisation of Grid and Cloud computing. This chapter gives an overview of parallel and distributed computing approaches and how they can be used to scale up data mining to large datasets.

Kinematical analysis of redundant drive wire mechanisms with velocity constraint

In this paper, we propose a new velocity constraint type for Redundant Drive Wire Mechanisms. The purpose of this paper is to demonstrate that the proposed velocity constraint module can fix the orientation of the movable part and to use the kinematical analysis method to obtain the moving direction of the movable part. First, we discuss the necessity of using this velocity constraint type and the possible applications of the proposed mechanism. Second, we derive the basic equations of a wire mechanism with this constraint type. Next, we present a method of motion analysis on active and passive constraint spaces, which is used to find the moving direction of a movable part. Finally, we apply the above analysis method on a wire mechanism with a velocity constraint module and on a wire mechanism with four double actuator modules. By evaluating the results, we prove the validity of the proposed constraint type.

Power allocation strategies for distributed space-time codes in two-way relay networks

We study a two-way relay network (TWRN), where distributed space-time codes are constructed across multiple relay terminals in an amplify-and-forward mode. Each relay transmits a scaled linear combination of its received symbols and their conjugates,with the scaling factor chosen based on automatic gain control. We consider equal power allocation (EPA) across the relays, as well as the optimal power allocation (OPA) strategy given access to instantaneous channel state information (CSI). For EPA, we derive an upper bound on the pairwise-error-probability (PEP), from which we prove that full diversity is achieved in TWRNs. This result is in contrast to one-way relay networks, in which case a maximum diversity order of only unity can be obtained. When instantaneous CSI is available at the relays, we show that the OPA which minimizes the conditional PEP of the worse link can be cast as a generalized linear fractional program, which can be solved efficiently using the Dinkelback-type procedure.We also prove that, if the sum-power of the relay terminals is constrained, then the OPA will activate at most two relays.

The angular momentum constraint on climate sensitivity and downward influence in the middle atmosphere

It is shown that under reasonable assumptions, conservation of angular momentum provides a strong constraint on gravity wave drag feedbacks to radiative perturbations in the middle atmosphere. In the time mean, radiatively induced temperature perturbations above a given altitude z cannot induce changes in zonal mean wind and temperature below z through feedbacks in gravity wave drag alone (assuming an unchanged gravity wave source spectrum). Thus, despite the many uncertainties in the parameterization of gravity wave drag, the role of gravity wave drag in middle-atmosphere climate perturbations may be much more limited than its role in climate itself. This constraint limits the possibilities for downward influence from the mesosphere. In order for a gravity wave drag parameterization to respect the momentum constraint and avoid spurious downward influence, any nonzero parameterized momentum flux at a model lid must be deposited within the model domain, and there must be no zonal mean sponge layer. Examples are provided of how violation of these conditions leads to spurious downward influence. For planetary waves, the momentum constraint does not prohibit downward influence, but it limits the mechanisms by which it can occur: in the time mean, downward influence from a radiative perturbation can only arise through changes in reflection and meridional propagation properties of planetary waves.

Post-occupancy evaluation studies in recently refurbished office building: energy performance and employees' satisfaction

Existing buildings contribute greatly to global energy use and greenhouse gas emissions. In the UK, about 18% of carbon emissions are generated by non-domestic buildings; sustainable building refurbishment can play an important role in reducing carbon emissions. This paper looks at the performance of a recently refurbished 5-storey office building in London, in terms of energy consumption as well as occupants’ satisfaction. Pre- and post-occupancy evaluation studies were conducted using online questionnaire surveys and energy consumption evaluation. Results from pre-occupancy and post-occupancy evaluation studies showed that employees, in general, were more satisfied with their work environment at the refurbished building than with that of their previous office. Employees’ self-reported productivity improved after the move to Elms House. These surveys showed a positive relationship between employees’ satisfaction with their work environment and their self-reported productivity, well-being and enjoyment at work. The factor that contributed to increasing employee satisfaction the most was: better use of interior space. Although the refurbishment was a success in terms of reducing energy consumption per m2, the performance gap was almost 3 times greater than that estimated. Unregulated loads, problems with building control, ineffective use of space and occupants’ behaviour are argued to be reasons for this gap.

Higher Education: Understanding the impact of distance learning mode on user information assimilation and satisfaction

There is increasing pressure to capture of video within Higher Education. Although much research has looked at how communication technologies enhance information transfer during playback of video, consideration of technical issues seems incongruous if we do not consider how presentation mode affects information assimilated by, and satisfaction of, learners with a range of individual differences, and from a range of different backgrounds. This paper considers whether a relationship exists between the media and presentation mode used in recorded content, and the level of information assimilation and satisfaction perceived by learners with a range of individual differences. Results aim to inform learning practitioners whether generic delivery is justified, or whether tailoring content delivery enhances the experience of specific learner groups.

Post-occupancy studies of an office environment: Energy performance and occupants’ satisfaction

It is generally accepted that the physical workplace environment affects employees’ satisfaction and, consequently, their perceived productivity and well-being. This study investigated whether employee “satisfaction” variables can predict perceived productivity, well-being and enjoyment at work, and if so, to what extent. The study also explored whether limiting employees’ control over their environment could save energy without compromising employees’ satisfaction and perceived productivity. Preoccupancy and post-occupancy evaluation studies were conducted, in terms of both energy consumption and employee perceptions, to make comparisons between a company’s old and current headquarters buildings, both located in the same area of London. The results showed that employees were more satisfied with their work environment at their new HQ, in general, than with that of their previous office. Also, employees’ self-reported productivity, well-being and enjoyment at work improved after the move. It was revealed that the combination of employees’ level of satisfaction with “interior use of space” and “physical conditions” was the best predictor of their perceived productivity, while satisfaction with “indoor facilities” was not a good predictor. In terms of energy performance, although the new HQ’s energy consumption per m2 was significantly less than that of the previous building, there was still a gap between the refurbishment design target and the actual performance of the building. The findings suggest that this gap could be due to a number of factors, including an ineffective use of interior space, and occupants’ behaviour.

A generalised Bayesian instrumental variable approach under student t-distributed errors with application

Bayesian analysis is given of an instrumental variable model that allows for heteroscedasticity in both the structural equation and the instrument equation. Specifically, the approach for dealing with heteroscedastic errors in Geweke (1993) is extended to the Bayesian instrumental variable estimator outlined in Rossi et al. (2005). Heteroscedasticity is treated by modelling the variance for each error using a hierarchical prior that is Gamma distributed. The computation is carried out by using a Markov chain Monte Carlo sampling algorithm with an augmented draw for the heteroscedastic case. An example using real data illustrates the approach and shows that ignoring heteroscedasticity in the instrument equation when it exists may lead to biased estimates.

A semi-distributed ntegrated itrogen model for multiple source assessment in tchments (INCA): Part I — model structure and process equations

A new model has been developed for assessing multiple sources of nitrogen in catchments. The model (INCA) is process based and uses reaction kinetic equations to simulate the principal mechanisms operating. The model allows for plant uptake, surface and sub-surface pathways and can simulate up to six land uses simultaneously. The model can be applied to catchment as a semi-distributed simulation and has an inbuilt multi-reach structure for river systems. Sources of nitrogen can be from atmospheric deposition, from the terrestrial environment (e.g. agriculture, leakage from forest systems etc.), from urban areas or from direct discharges via sewage or intensive farm units. The model is a daily simulation model and can provide information in the form of time series at key sites, or as profiles down river systems or as statistical distributions. The process model is described and in a companion paper the model is applied to the River Tywi catchment in South Wales and the Great Ouse in Bedfordshire.

A conceptual framework of patient satisfaction with a pharmacy adherence service

Background Patients do not adhere to their medicines for a host of reasons which can include their underlying beliefs as well as the quality of their interactions with healthcare professionals. One way of measuring the outcome of pharmacy adherence services is to assess patient satisfaction but no questionnaire exists that truly captures patients' experiences with these relatively new services. Objective Our objective was to develop a conceptual framework specific to patient satisfaction with a community pharmacy adherence service based on criteria used by patients themselves. Setting The study was based in community pharmacies in one large geographical area of the UK (Surrey). All the work was conducted between October 2008 and September 2010. Methods This study involved qualitative non-participant observation and semi-structured interviewing. We observed the recruitment of patients to the Medicines Use Review (MUR) service and also actual MUR consultations (7). We also interviewed patients (15). Data collection continued until no new themes were identified during analysis. We analysed interviews to firstly create a comprehensive account of themes which had significance within the transcripts, then created sub-themes within super-ordinate categories. We used a structure-process-outcome approach to develop a conceptual framework relating to patient satisfaction with the MUR. Favourable ethical opinion for this study was received from the NHS Surrey Research Ethics Committee on 2nd June 2008. Results Five super-ordinate themes linked to patient satisfaction with the MUR service were identified, including relationships with healthcare providers; attitudes towards healthcare providers; patients' experience of health, healthcare and medicines; patients' views of the MUR service; the logistics of the MUR service. In the conceptual framework, structure was conceptualised as existing relationships, environment, and time; process was conceptualised as related to recruitment and consultation stages; and outcome as two concepts of immediate patient outcomes and satisfaction on reflection. Conclusion We identified and highlighted factors that can influence patient satisfaction with the MUR service and this led to the development of a conceptual framework of patient satisfaction with the MUR service. This can form the basis for developing a questionnaire for measuring patient satisfaction with this and similar pharmacy adherence services. Impact of findings on practice * Pharmacists and researchers can access the relevant ideas presented here in relation to patient satisfaction with pharmacy adherence services. * Researcher can use the conceptual framework as a basis for measuring the quality of pharmacy adherence services. * Community pharmacists can improve the quality of healthcare they provide by realizing concepts relevant to patient satisfaction with adherence services.

Dynamic distributed lanes: motion planning for multiple autonomous vehicles

Unorganized traffic is a generalized form of travel wherein vehicles do not adhere to any predefined lanes and can travel in-between lanes. Such travel is visible in a number of countries e.g. India, wherein it enables a higher traffic bandwidth, more overtaking and more efficient travel. These advantages are visible when the vehicles vary considerably in size and speed, in the absence of which the predefined lanes are near-optimal. Motion planning for multiple autonomous vehicles in unorganized traffic deals with deciding on the manner in which every vehicle travels, ensuring no collision either with each other or with static obstacles. In this paper the notion of predefined lanes is generalized to model unorganized travel for the purpose of planning vehicles travel. A uniform cost search is used for finding the optimal motion strategy of a vehicle, amidst the known travel plans of the other vehicles. The aim is to maximize the separation between the vehicles and static obstacles. The search is responsible for defining an optimal lane distribution among vehicles in the planning scenario. Clothoid curves are used for maintaining a lane or changing lanes. Experiments are performed by simulation over a set of challenging scenarios with a complex grid of obstacles. Additionally behaviours of overtaking, waiting for a vehicle to cross and following another vehicle are exhibited.

Calibration of structure in a distributed forecasting model for a semiarid flash flood: dynamic surface storage and channel roughness

Flash floods pose a significant danger for life and property. Unfortunately, in arid and semiarid environment the runoff generation shows a complex non-linear behavior with a strong spatial and temporal non-uniformity. As a result, the predictions made by physically-based simulations in semiarid areas are subject to great uncertainty, and a failure in the predictive behavior of existing models is common. Thus better descriptions of physical processes at the watershed scale need to be incorporated into the hydrological model structures. For example, terrain relief has been systematically considered static in flood modelling at the watershed scale. Here, we show that the integrated effect of small distributed relief variations originated through concurrent hydrological processes within a storm event was significant on the watershed scale hydrograph. We model these observations by introducing dynamic formulations of two relief-related parameters at diverse scales: maximum depression storage, and roughness coefficient in channels. In the final (a posteriori) model structure these parameters are allowed to be both time-constant or time-varying. The case under study is a convective storm in a semiarid Mediterranean watershed with ephemeral channels and high agricultural pressures (the Rambla del Albujón watershed; 556 km 2 ), which showed a complex multi-peak response. First, to obtain quasi-sensible simulations in the (a priori) model with time-constant relief-related parameters, a spatially distributed parameterization was strictly required. Second, a generalized likelihood uncertainty estimation (GLUE) inference applied to the improved model structure, and conditioned to observed nested hydrographs, showed that accounting for dynamic relief-related parameters led to improved simulations. The discussion is finally broadened by considering the use of the calibrated model both to analyze the sensitivity of the watershed to storm motion and to attempt the flood forecasting of a stratiform event with highly different behavior.

Are happy youth also satisfied adults? An analysis of the impact of childhood factors on adult life satisfaction

This paper aims to consider whether there is a link between youth happiness levels and adult life satisfaction. Our results are unequivocal that such a link exists both because demographic and socio-economic conditions are persistent over a lifetime and also because there is a persistence in personality effects. To test this link, we estimate a model of happiness for a sample of young people. This model provides us with a range of variables measuring socio-economic effects and personality effects amongst young people. These variables are then included in the adult life satisfaction model. The model is estimated using data from the British Household Panel Survey for 1994–2008. In addition to childhood happiness levels influencing adult life satisfaction significantly, we also find that the youthful personality trait for happiness has a larger effect on adult life satisfaction than demographic and socio-economic conditions.

Assessing the sensitivities of a distributed snow model to forcing data resolution

Highly heterogeneous mountain snow distributions strongly affect soil moisture patterns; local ecology; and, ultimately, the timing, magnitude, and chemistry of stream runoff. Capturing these vital heterogeneities in a physically based distributed snow model requires appropriately scaled model structures. This work looks at how model scale—particularly the resolutions at which the forcing processes are represented—affects simulated snow distributions and melt. The research area is in the Reynolds Creek Experimental Watershed in southwestern Idaho. In this region, where there is a negative correlation between snow accumulation and melt rates, overall scale degradation pushed simulated melt to earlier in the season. The processes mainly responsible for snow distribution heterogeneity in this region—wind speed, wind-affected snow accumulations, thermal radiation, and solar radiation—were also independently rescaled to test process-specific spatiotemporal sensitivities. It was found that in order to accurately simulate snowmelt in this catchment, the snow cover needed to be resolved to 100 m. Wind and wind-affected precipitation—the primary influence on snow distribution—required similar resolution. Thermal radiation scaled with the vegetation structure (~100 m), while solar radiation was adequately modeled with 100–250-m resolution. Spatiotemporal sensitivities to model scale were found that allowed for further reductions in computational costs through the winter months with limited losses in accuracy. It was also shown that these modeling-based scale breaks could be associated with physiographic and vegetation structures to aid a priori modeling decisions.