905 resultados para Reinforcement Learning,resource-constrained devices,iOS devices,on-device machine learning
Resumo:
This paper presents a novel method for enabling a robot to determine the direction to a sound source through interacting with its environment. The method uses a new neural network, the Parameter-Less Self-Organizing Map algorithm, and reinforcement learning to achieve rapid and accurate response.
Resumo:
The problem of evaluating different learning rules and other statistical estimators is analysed. A new general theory of statistical inference is developed by combining Bayesian decision theory with information geometry. It is coherent and invariant. For each sample a unique ideal estimate exists and is given by an average over the posterior. An optimal estimate within a model is given by a projection of the ideal estimate. The ideal estimate is a sufficient statistic of the posterior, so practical learning rules are functions of the ideal estimator. If the sole purpose of learning is to extract information from the data, the learning rule must also approximate the ideal estimator. This framework is applicable to both Bayesian and non-Bayesian methods, with arbitrary statistical models, and to supervised, unsupervised and reinforcement learning schemes.
Resumo:
This thesis presents an investigation, of synchronisation and causality, motivated by problems in computational neuroscience. The thesis addresses both theoretical and practical signal processing issues regarding the estimation of interdependence from a set of multivariate data generated by a complex underlying dynamical system. This topic is driven by a series of problems in neuroscience, which represents the principal background motive behind the material in this work. The underlying system is the human brain and the generative process of the data is based on modern electromagnetic neuroimaging methods . In this thesis, the underlying functional of the brain mechanisms are derived from the recent mathematical formalism of dynamical systems in complex networks. This is justified principally on the grounds of the complex hierarchical and multiscale nature of the brain and it offers new methods of analysis to model its emergent phenomena. A fundamental approach to study the neural activity is to investigate the connectivity pattern developed by the brain’s complex network. Three types of connectivity are important to study: 1) anatomical connectivity refering to the physical links forming the topology of the brain network; 2) effective connectivity concerning with the way the neural elements communicate with each other using the brain’s anatomical structure, through phenomena of synchronisation and information transfer; 3) functional connectivity, presenting an epistemic concept which alludes to the interdependence between data measured from the brain network. The main contribution of this thesis is to present, apply and discuss novel algorithms of functional connectivities, which are designed to extract different specific aspects of interaction between the underlying generators of the data. Firstly, a univariate statistic is developed to allow for indirect assessment of synchronisation in the local network from a single time series. This approach is useful in inferring the coupling as in a local cortical area as observed by a single measurement electrode. Secondly, different existing methods of phase synchronisation are considered from the perspective of experimental data analysis and inference of coupling from observed data. These methods are designed to address the estimation of medium to long range connectivity and their differences are particularly relevant in the context of volume conduction, that is known to produce spurious detections of connectivity. Finally, an asymmetric temporal metric is introduced in order to detect the direction of the coupling between different regions of the brain. The method developed in this thesis is based on a machine learning extensions of the well known concept of Granger causality. The thesis discussion is developed alongside examples of synthetic and experimental real data. The synthetic data are simulations of complex dynamical systems with the intention to mimic the behaviour of simple cortical neural assemblies. They are helpful to test the techniques developed in this thesis. The real datasets are provided to illustrate the problem of brain connectivity in the case of important neurological disorders such as Epilepsy and Parkinson’s disease. The methods of functional connectivity in this thesis are applied to intracranial EEG recordings in order to extract features, which characterize underlying spatiotemporal dynamics before during and after an epileptic seizure and predict seizure location and onset prior to conventional electrographic signs. The methodology is also applied to a MEG dataset containing healthy, Parkinson’s and dementia subjects with the scope of distinguishing patterns of pathological from physiological connectivity.
Resumo:
The bearings in the air motors of modern jet aircraft engines must operate dry in hostile conditions at temperatures up to 500° C, where the thrust races in the actuators operate at temperatures up to 300° C. One of the few metallurgical combinations which can function efficiently under these conditions is martensitic stainless steel on tungsten carbide. The work described was initiated to isolate the wear mechanisms of two such steels in contact with tungsten carbide at temperatures up to 500° C. Experiments were carried out on angular contact bearings similar to these used in service, where both rolling and sliding is present and also for pure sliding conditions using a pin-on-disc apparatus. Wear measurements of the bearings were obtained with wear rates, friction and surface temperatures from the pin-on-disc machine for a series of loads and speeds. Extensive X-ray diffraction analysis was carried out on the wear debris, with also S.E.M. analysis and hardness tests on the worn surfaces along with profilometry measurements of the disc. The oxidational parameters of the steel were obtained from measurements of oxide growth rates by ellipsometry. Three distinct mechanisms of wear were established and the latter two were found to be present in both configurations. These involve an oxidational-abrasive mechanism at loads below 40 N with pin surface temperatures up to about 300 °C, with the mechanism changing to severe wear for higher loads. As the temperature increases a third wear mechanism appears due to transfer of relatively soft oxide films to the steel surface reducing the wear rate. Theoretical K factors were derived and compared with experimental values which were found to be in good agreement for the severe wear mechanism. The pin-on-disc experiments may be useful as a screening test for material selection, without the considerable cost of producing the angular contact bearings.
Resumo:
In recent years the optical domain has been traditionally reserved for node-to-node transmission with the processing and switching achieved entirely in the electrical domain. However, with the constantly increasing demand for bandwidth and the resultant increase in transmission speeds, there is a very real fear that current electronic technology as used for processing will not be able to cope with future demands. Fuelled by this requirement for faster processing speeds, considerable research is currently being carried out into the potential of All-optical processing. One of the fundamental obstacles in realising All-optical processing is the requirement for All-optical buffering. Without all-optical buffers it is extremely difficult to resolve situations such as contention and congestion. Many devices have been proposed to solve this problem however none of them provide the perfect solution. The subject of this research is to experimentally demonstrate a novel all-optical memory device. Unlike many previously demonstrated optical storage devices the device under consideration utilises only a single loop mirror and a single SOA as its switch, whilst providing full regenerative capabilities required for long-term storage. I will explain some of the principles and characteristics of the device, which will then be experimentally demonstrated. The device configuration will then be studied and investigated as to its suitability for Hybrid Integrated Technology.
Resumo:
Despite the importance of new firms to the economy, determinants of start-ups have mainly been examined at a country level and discussion of regional entrepreneurial activity has received less attention. Since there are significant variations in entrepreneurship rates across and within countries, such an investigation at a regional level would help in gaining an in depth understanding of the impact of the individual level resource endowments and neighbourhood characteristics on an individual’s decision to engage in entrepreneurial activity. The main aim of the thesis is to explore various theories of entrepreneurship and develop integrated frameworks for examining the determinants of entrepreneurial activity at a neighbourhood level in the East Midlands region in England. The specific objectives of the thesis are to examine how the individual level resources and the neighbourhood characteristics: (i) combine to influence an individual to engage in the different stages of the entrepreneurial process, (ii) influence natives and migrants to engage in start up activity and (iii) influence women and men to become self-employed and ambitious entrepreneurs. In terms of the methodology, the empirical analysis is based on two databases combined: 2006 to 2009 GEM East Midlands region and the English Index of Multiple Deprivation dataset. Based on the critical review of the literature on entrepreneurship the thesis develop theoretical frameworks which led to formulate hypotheses related to the differentiated impact of both individual and neighbourhood level factors on the propensity of an individual to be involved in entrepreneurial activity. The findings indicate that the determinants of entrepreneurial activity vary with human, financial and the local environment factors affecting the entrepreneurial process. Finally, the thesis calls for caution when developing and applying generic and specific policy measures aimed at promoting entry into entrepreneurship.
Resumo:
There are a great deal of approaches in artificial intelligence, some of them also coming from biology and neirophysiology. In this paper we are making a review, discussing many of them, and arranging our discussion around the autonomous agent research. We highlight three aspect in our classification: type of abstraction applied for representing agent knowledge, the implementation of hypothesis processing mechanism, allowed degree of freedom in behaviour and self-organizing. Using this classification many approaches in artificial intelligence are evaluated. Then we summarize all discussed ideas and propose a series of general principles for building an autonomous adaptive agent.
Resumo:
Brazilian pepper (Schinus terebinthifolius) is an exotic shrub or small tree that has become well established as an invasive and highly competitive species through much of southern Florida. Love vine (Cassytha filiformis), a native parasitic plant, was noted parasitizing Brazilian pepper, apparently affecting its health. The objective of this study was to investigate the nature of this parasitic interaction in southern Florida. Brazilian pepper populations were studied to determine whether parasitism by love vine may affect growth and reproduction. Anatomical studies of love vine parasitizing Brazilian pepper determined physical aspects of the parasitic interaction at the cell and tissue level. Physiological aspects of this interaction were investigated to help describe love vine resource acquisition as a parasite on host Brazilian pepper plants, and as an autotrophic plant. An investigation of ecological aspects of this parasitic interaction was done to determine whether physical or biological aspects of habitats may contribute to love vine parasitism on Brazilian pepper. These studies indicated that: (1) parasitism by love vine significantly decreased growth and reproduction of Brazilian pepper plants; (2) anatomical and physiological investigations indicated that love vine was primarily a xylem parasite on Brazilian pepper, but that some assimilated carbon nutrients may also be acquired from the host; (3) love vine is autotrophic (i.e., hemiparasitic), but is totally dependent on its host for necessary resources; (4) the occurrence of love vine parasitism on Brazilian pepper is mediated by physical characters of the biological community. ^
Resumo:
In recent years, hotels in Cyprus have encountered difficult economic times due to increasing customer demands and strong internal industry development competition. The hospitality industry’s main concern globally is to serve its customer S needs and desires, most of which are addressed through personal services. Hence, the hotel businesses that are able to provide quality services to its ever-demanding customers in a warm and efficient manner are those businesses which will be more likely to obtain a long term competitive advantage over their rivals. Ironically, the quality of services frequently cannot fully appreciated until something goes wrong, and then, the poor quality of services can have long lasting lingering effects on the customer base and, hence, often is translated into a loss of business. Nevertheless, since the issue of delivery of hospitality services always involves people, this issue must center around the management of the human resource factor, and in particular, on the way which interacts with itself and with guests, as service encounters. In the eyes of guests, hospitality businesses will be viewed successful or failure, depending on [he cumulative impact of the service encounters they have experienced on a personal level. Finally, since hotels are offering intangible and perishable personal service encounters, managing these services must be a paramount concern of any hotel business. As a preliminary exercise, visualize when you have last visited a hotel, or a restaurant, and then, ask yourself these questions: What did you feel about the quality of the experience? Was it a memorable one, which you would recommend it to others, or there were certain things, which could have made the difference? Thus, the way personalized services are provided can make the deference in attracting arid retaining long-term customers
Resumo:
Brazilian pepper (Schinus terebinthifolius) is an exotic shrub or small tree that has become well established as an invasive and highly competitive species through much of southern Florida. Love vine (Cassytha filiformis), a native parasitic plant, was noted parasitizing Brazilian pepper, apparently affecting its health. The objective of this study was to investigate the nature of this parasitic interaction in southern Florida. Brazilian pepper populations were studied to determine whether parasitism by love vine may affect growth and reproduction. Anatomical studies of love vine parasitizing Brazilian pepper determined physical aspects of the parasitic interaction at the cell and tissue level. Physiological aspects of this interaction were investigated to help describe love vine resource acquisition as a parasite on host Brazilian pepper plants, and as an autotrophic plant. An investigation of ecological aspects of this parasitic interaction was done to determine whether physical or biological aspects of habitats may contribute to love vine parasitism on Brazilian pepper. These studies indicated that: 1) parasitism by love vine significantly decreased growth and reproduction of Brazilian pepper plants; 2) anatomical and physiological investigations indicated that love vine was primarily a xylem parasite on Brazilian pepper, but that some assimilated carbon nutrients may also be acquired from the host; 3) love vine is autotrophic (i. e., hemiparasitic), but is totally dependent on its host for necessary resources; 4) the occurrence of love vine parasitism on Brazilian pepper is mediated by physical characters of the biological community.
Resumo:
Beamforming is a technique widely used in various fields. With the aid of an antenna array, the beamforming aims to minimize the contribution of unknown interferents directions, while capturing the desired signal in a given direction. In this thesis are proposed beamforming techniques using Reinforcement Learning (RL) through the Q-Learning algorithm in antennas array. One proposal is to use RL to find the optimal policy selection between the beamforming (BF) and power control (PC) in order to better leverage the individual characteristics of each of them for a certain amount of Signal to Interference plus noise Ration (SINR). Another proposal is to use RL to determine the optimal policy between blind beamforming algorithm of CMA (Constant Modulus Algorithm) and DD (Decision Direct) in multipath environments. Results from simulations showed that the RL technique could be effective in achieving na optimal of switching between different techniques.
Resumo:
The frugivorous “true” fruit fly, Bactrocera tryoni (Queensland fruit fly), is presumed to have a nonresourced-based lek mating system. This is largely untested, and contrary data exists to suggest Bactrocera tryoni may have a resource-based mating system focused on fruiting host plants. We tested the mating system of Bactrocera tryoni, and its close sibling Bactrocera neohumeralis, in large field cages using laboratory reared flies. We used observational experiments that allowed us to determine if: (i) mating pairs were aggregated or nonaggregated; (ii) mating system was resource or nonresource based; (iii) flies utilized possible landmarks (tall trees over short) as mate-rendezvous sites; and (iv) males called females from male-dominated leks. We recorded nearly 250 Bactrocera tryoni mating pairs across all experiments, revealing that: (i) mating pairs were aggregated; (ii) mating nearly always occurred in tall trees over short; (iii) mating was nonresource based; and (iv) that males and females arrived at the mate-rendezvous site together with no evidence that males preceded females. Bactrocera neohumeralis copulations were much more infrequent (only 30 mating pairs in total), but for those pairs there was a similar preference for tall trees and no evidence of a resource-based mating system. Some aspects of Bactrocera tryoni mating behavior align with theoretical expectations of a lekking system, but others do not. Until evidence for unequivocal female choice can be provided (as predicted under a true lek), the mating system of Bactrocera tryoni is best described as a nonresource based, aggregation system for which we also have evidence that land-marking may be involved.
Resumo:
Efficient crop monitoring and pest damage assessments are key to protecting the Australian agricultural industry and ensuring its leading position internationally. An important element in pest detection is gathering reliable crop data frequently and integrating analysis tools for decision making. Unmanned aerial systems are emerging as a cost-effective solution to a number of precision agriculture challenges. An important advantage of this technology is it provides a non-invasive aerial sensor platform to accurately monitor broad acre crops. In this presentation, we will give an overview on how unmanned aerial systems and machine learning can be combined to address crop protection challenges. A recent 2015 study on insect damage in sorghum will illustrate the effectiveness of this methodology. A UAV platform equipped with a high-resolution camera was deployed to autonomously perform a flight pattern over the target area. We describe the image processing pipeline implemented to create a georeferenced orthoimage and visualize the spatial distribution of the damage. An image analysis tool has been developed to minimize human input requirements. The computer program is based on a machine learning algorithm that automatically creates a meaningful partition of the image into clusters. Results show the algorithm delivers decision boundaries that accurately classify the field into crop health levels. The methodology presented in this paper represents a venue for further research towards automated crop protection assessments in the cotton industry, with applications in detecting, quantifying and monitoring the presence of mealybugs, mites and aphid pests.
Resumo:
The objective of reservoir engineering is to manage fields of oil production in order to maximize the production of hydrocarbons according to economic and physical restrictions. The deciding of a production strategy is a complex activity involving several variables in the process. Thus, a smart system, which assists in the optimization of the options for developing of the field, is very useful in day-to-day of reservoir engineers. This paper proposes the development of an intelligent system to aid decision making, regarding the optimization of strategies of production in oil fields. The intelligence of this system will be implemented through the use of the technique of reinforcement learning, which is presented as a powerful tool in problems of multi-stage decision. The proposed system will allow the specialist to obtain, in time, a great alternative (or near-optimal) for the development of an oil field known