Learning to play Pac-Man: An evolutionary, rule-based approach

Pac-Man is a well-known, real-time computer game that provides an interesting platform for research. We describe an initial approach to developing an artificial agent that replaces the human to play a simplified version of Pac-Man. The agent is specified as a simple finite state machine and ruleset. with parameters that control the probability of movement by the agent given the constraints of the maze at some instant of time. In contrast to previous approaches, the agent represents a dynamic strategy for playing Pac-Man, rather than a pre-programmed maze-solving method. The agent adaptively "learns" through the application of population-based incremental learning (PBIL) to adjust the agents' parameters. Experimental results are presented that give insight into some of the complexities of the game, as well as highlighting the limitations and difficulties of the representation of the agent.

Ocular blood flow measurements in healthy human myopic eyes

Background. To evaluate the haemodynamic features of young healthy myopes and emmetropes, in order to ascertain the perfusion profile of human myopia and its relationship with axial length prior to reaching a degenerative state. Methods The retrobulbar, microretinal and pulsatile ocular blood flow (POBF) of one eye of each of twenty-two high myopes (N=22, mean spherical equivalent (MSE) =-5.00D), low myopes (N=22, MSE-1.00 to-4.50D) and emmetropes (N=22, MSE±0.50D) was analyzed using color Doppler Imaging, Heidelberg retinal flowmetry and ocular blood flow analyser (OBF) respectively. Intraocular pressure, axial length (AL), systemic blood pressure, and body mass index were measured. Results. When compared to the emmetropes and low myopes, the AL was greater in high myopia (p<0.0001). High myopes showed higher central retinal artery resistance index (CRA RI) (p=0.004), higher peak systolic to end diastolic velocities ratio (CRA ratio) and lower end diastolic velocity (CRA EDv) compared to low myopes (p=0.014, p=0.037). Compared to emmetropes, high myopes showed lower OBFamplitude (OBFa) (p=0.016). The POBF correlated significantly with the systolic and diastolic blood velocities of the CRA (p=0.016, p=0.036). MSE and AL correlated negatively with OBFa (p=0.03, p=0.003), OBF volume (p=0.02, p<0.001), POBF (p=0.01, p<0.001) and positively with CRA RI (p=0.007, p=0.05). Conclusion. High myopes exhibited significantly reduced pulse amplitude and CRA blood velocity, the first of which may be due to an OBF measurement artefact or real decreased ocular blood flow pulsatility. Axial length and refractive error correlated moderately with the ocular pulse and with the resistance index of the CRA, which in turn correlated amongst themselves. It is hypothesized that the compromised pulsatile and CRA haemodynamics observed in young healthy myopes is an early feature of the decrease in ocular blood flow reported in pathological myopia. Such vascular features would increase the susceptibility for vascular and age-related eye diseases.

Models of gas-liquid solubilities

A recent method for phase equilibria, the AGAPE method, has been used to predict activity coefficients and excess Gibbs energy for binary mixtures with good accuracy. The theory, based on a generalised London potential (GLP), accounts for intermolecular attractive forces. Unlike existing prediction methods, for example UNIFAC, the AGAPE method uses only information derived from accessible experimental data and molecular information for pure components. Presently, the AGAPE method has some limitations, namely that the mixtures must consist of small, non-polar compounds with no hydrogen bonding, at low moderate pressures and at conditions below the critical conditions of the components. Distinction between vapour-liquid equilibria and gas-liquid solubility is rather arbitrary and it seems reasonable to extend these ideas to solubility. The AGAPE model uses a molecular lattice-based mixing rule. By judicious use of computer programs a methodology was created to examine a body of experimental gas-liquid solubility data for gases such as carbon dioxide, propane, n-butane or sulphur hexafluoride which all have critical temperatures a little above 298 K dissolved in benzene, cyclo-hexane and methanol. Within this methodology the value of the GLP as an ab initio combining rule for such solutes in very dilute solutions in a variety of liquids has been tested. Using the GLP as a mixing rule involves the computation of rotationally averaged interactions between the constituent atoms, and new calculations have had to be made to discover the magnitude of the unlike pair interactions. These numbers have been seen as significant in their own right in the context of the behaviour of infinitely-dilute solutions. A method for extending this treatment to "permanent" gases has also been developed. The findings from the GLP method and from the more general AGAPE approach have been examined in the context of other models for gas-liquid solubility, both "classical" and contemporary, in particular those derived from equations-of-state methods and from reference solvent methods.

Formability of high strength aluminium sheet

An initial review of the subject emphasises the need for improved fuel efficiency in vehicles and the possible role of aluminium in reducing weight. The problems of formability generally in manufacture and of aluminium in particular are discussed in the light of published data. A range of thirteen commercially available sheet aluminium alloys have been compared with respect to mechanical properties as these affect forming processes and behaviour in service. Four alloys were selected for detailed comparison. The formability and strength of these were investigated in terms of underlying mechanisms of deformation as well as the microstructural characteristics of the alloys including texture, particle dispersion, grain size and composition. In overall terms, good combinations of strength and ductility are achievable with alloys of the 2xxx and 6xxx series. Some specific alloys are notably better than others. The strength of formed components is affected by paint baking in the final stages of manufacture. Generally, alloys of the 6xxx family are strengthened while 2xxx and 5xxx become weaker. Some anomalous behaviour exists, however. Work hardening of these alloys appears to show rather abrupt decreases over certain strain ranges which is probably responsible for the relatively low strains at which both diffuse and local necking occur. Using data obtained from extended range tensile tests, the strain distribution in more complex shapes can be successfully modelled using finite element methods.Sheet failure during forming occurs by abrupt shear fracture in many instances. This condition is favoured by states of biaxial tension, surface defects in the form of fine scratches and certain types of crystallographic texture. The measured limit strains of the materials can be understood on the basis of attainment of a critical shear stress for fracture.

Automata–based Method for Solving Systems of Linear Constraints in {0,1}

We consider a finite state automata based method of solving a system of linear Diophantine equations with coefficients from the set {-1,0,1} and solutions in {0,1}.

Timed Transition Automata as Numerical Planning Domain

A general technique for transforming a timed finite state automaton into an equivalent automated planning domain based on a numerical parameter model is introduced. Timed transition automata have many applications in control systems and agents models; they are used to describe sequential processes, where actions are labelling by automaton transitions subject to temporal constraints. The language of timed words accepted by a timed automaton, the possible sequences of system or agent behaviour, can be described in term of an appropriate planning domain encapsulating the timed actions patterns and constraints. The time words recognition problem is then posed as a planning problem where the goal is to reach a final state by a sequence of actions, which corresponds to the timed symbols labeling the automaton transitions. The transformation is proved to be correct and complete and it is space/time linear on the automaton size. Experimental results shows that the performance of the planning domain obtained by transformation is scalable for real world applications. A major advantage of the planning based approach, beside of the solving the parsing problem, is to represent in a single automated reasoning framework problems of plan recognitions, plan synthesis and plan optimisation.

Weak Ergodicity of Mt /Mt /N /N + R Queue

2000 Mathematics Subject Classification: 60J27, 60K25.

Modelagem do consumo de energia de redes de sensores sem fio usando SystemC-AMS e stateflow

This work aims at modeling power consumption at the nodes of a Wireless Sensor Network (WSN). For doing so, a finite state machine was implemented by means of SystemC-AMS and Stateflow modeling and simulation tools. In order to achieve this goal, communication data in a WSN were collected. Based on the collected data, a simulation environment for power consumption characterization, which aimed at describing the network operation, was developed. Other than performing power consumption simulation, this environment also takes into account a discharging model as to analyze the battery charge level at any given moment. Such analysis result in a graph illustrating the battery voltage variations as well as its state of charge (SOC). Finally, a case study of the WSN power consumption aims to analyze the acquisition mode and network data communication. With this analysis, it is possible make adjustments in node-sensors to reduce the total power consumption of the network.

Precast Prestressed Concrete Panel Subdecks in Skewed Bridges, Interim Report, 1990

Precast prestressed concrete panels have been used in bridge deck construction in Iowa and many other states. To investigate the performance of these panels at abutment or pier diaphragm locations for bridges with various skew angles, a research program involving both analytical and experimental aspects, is being conducted. This interim report presents the status of the research with respect to four tasks. Task 1 which involves a literature review and two surveys is essentially complete. Task 2 which involved field investigations of three Iowa bridges containing precast panel subdecks has been completed. Based on the findings of these investigations, future inspections are recommended to evaluate potential panel deterioration due to possible corrosion of the prestressed strands. Task 3 is the experimental program which has been established to monitor the behavior of five configurations of full scale composite deck slabs. Three dimensional test and instrumentation frameworks have been constructed to load and monitor the slab specimens. The first slab configuration representing an interior panel condition is being tested and preliminary results are presented for one of these tests in this interim report. Task 4 involves the analytical investigation of the experimental specimens. Finite element methods are being applied to analytically predict the behavior of the test specimens. The first test configuration of the interior panel condition has been analyzed for the same loads used in the laboratory, and the results are presented herein. Very good correlation between the analytical and experimental results has occurred.

Dimensionality hyper-reduction and machine learning for dynamical systems with varying parameters

Thesis (Ph.D.)--University of Washington, 2016-08

Predicting the metabolic energy costs of bipedalism using evolutionary robotics

To understand the evolution of bipedalism among the homnoids in an ecological context we need to be able to estimate theenerrgetic cost of locomotion in fossil forms. Ideally such an estimate would be based entirely on morphology since, except for the rare instances where footprints are preserved, this is hte only primary source of evidence available. In this paper we use evolutionary robotics techniques (genetic algoritms, pattern generators and mechanical modeling) to produce a biomimentic simulation of bipedalism based on human body dimensions. The mechnaical simulation is a seven-segment, two-dimensional model with motive force provided by tension generators representing the major muscle groups acting around the lower-limb joints. Metabolic energy costs are calculated from the muscel model, and bipedal gait is generated using a finite-state pattern generator whose parameters are produced using a genetic algorithm with locomotor economy (maximum distance for a fixed energy cost) as the fitness criterion. The model is validated by comparing the values it generates with those for modern humans. The result (maximum efficiency of 200 J m-1) is within 15% of the experimentally derived value, which is very encouraging and suggests that this is a useful analytic technique for investigating the locomotor behaviour of fossil forms. Initial work suggests that in the future this technique could be used to estimate other locomotor parameters such as top speed. In addition, the animations produced by this technique are qualitatively very convincing, which suggests that this may also be a useful technique for visualizing bipedal locomotion.

Cone penetration testing to assess slope stability in the 1979 Nice landslide area (Ligurian Margin, SE France)

In the landslide-prone area near the Nice international airport, southeastern France, an interdisciplinary approach is applied to develop realistic lithological/geometrical profiles and geotechnical/strength sub-seafloor models. Such models are indispensable for slope stability assessments using limit equilibrium or finite element methods. Regression analyses, based on the undrained shear strength (su) of intact gassy sediments are used to generate a sub-seafloor strength model based on 37 short dynamic and eight long static piezocone penetration tests, and laboratory experiments on one Calypso piston and 10 gravity cores. Significant strength variations were detected when comparing measurements from the shelf and the shelf break, with a significant drop in su to 5.5 kPa being interpreted as a weak zone at a depth between 6.5 and 8.5 m below seafloor (mbsf). Here, a 10% reduction of the in situ total unit weight compared to the surrounding sediments is found to coincide with coarse-grained layers that turn into a weak zone and detachment plane for former and present-day gravitational, retrogressive slide events, as seen in 2D chirp profiles. The combination of high-resolution chirp profiles and comprehensive geotechnical information allows us to compute enhanced 2D finite element slope stability analysis with undrained sediment response compared to previous 2D numerical and 3D limit equilibrium assessments. Those models suggest that significant portions (detachment planes at 20 m or even 55 mbsf) of the Quaternary delta and slope apron deposits may be mobilized. Given that factors of safety are equal or less than 1 when further considering the effect of free gas, a high risk for a landslide event of considerable size off Nice international airport is identified

Avaliação do desempenho de fundações em edificação no DF com a utilização de técnicas de interação solo-estrutura

Dissertação (mestrado)—Universidade de Brasília, Faculdade de Tecnologia, Departamento de Engenharia Civil e Ambiental, 2015.

MRI indices of functional recovery following intracerebral implantation of a human neural stem cell line in a pre-clinical model of ischaemic stroke

Stem cell therapy for ischaemic stroke is an emerging field in light of an increasing number of patients surviving with permanent disability. Several allogenic and autologous cells types are now in clinical trials with preliminary evidence of safety. Some clinical studies have reported functional improvements in some patients. After initial safety evaluation in a Phase 1 study, the conditionally immortalised human neural stem cell line CTX0E03 is currently in a Phase 2 clinical trial (PISCES-II). Previous pre-clinical studies conducted by ReNeuron Ltd, showed evidence of functional recovery in the Bilateral Asymmetry test up to 6 weeks following transplantation into rodent brain, 4 weeks after middle cerebral artery occlusion. Resting-state fMRI is increasingly used to investigate brain function in health and disease, and may also act as a predictor of recovery due to known network changes in the post-stroke recovery period. Resting-state methods have also been applied to non-human primates and rodents which have been found to have analogous resting-state networks to humans. The sensorimotor resting-state network of rodents is impaired following experimental focal ischaemia of the middle cerebral artery territory. However, the effects of stem cell implantation on brain functional networks has not previously been investigated. Prior studies assessed sensorimotor function following sub-cortical implantation of CTX0E03 cells in the rodent post-stroke brain but with no MRI assessments of functional improvements. This thesis presents research on the effect of sub-cortical implantation of CTX0E03 cells on the resting- state sensorimotor network and sensorimotor deficits in the rat following experimental stroke, using protocols based on previous work with this cell line. The work in this thesis identified functional tests of appropriate sensitivity for long-term dysfunction suitable for this laboratory, and investigated non-invasive monitoring of physiological variables required to optimize BOLD signal stability within a high-field MRI scanner. Following experimental stroke, rats demonstrated expected sensorimotor dysfunction and changes in the resting-state sensorimotor network. CTX0E03 cells did not improve post-stroke functional outcome (compared to previous studies) and with no changes in resting-state sensorimotor network activity. However, in control animals, we observed changes in functional networks due to the stereotaxic procedure. This illustrates the sensitivity of resting-state fMRI to stereotaxic procedures. We hypothesise that the damage caused by cell or vehicle implantation may have prevented functional and network recovery which has not been previously identified due to the application of different functional tests. The findings in this thesis represent one of few pre-clinical studies in resting-state fMRI network changes post-stroke and the only to date applying this technique to evaluate functional outcomes following a clinically applicable human neural stem cell treatment for ischaemic stroke. It was found that injury caused by stereotaxic injection should be taken into account when assessing the effectiveness of treatment.

Error estimation and adaptive mesh refinement for aerodynamic flows

This lecture course covers the theory of so-called duality-based a posteriori error estimation of DG finite element methods. In particular, we formulate consistent and adjoint consistent DG methods for the numerical approximation of both the compressible Euler and Navier-Stokes equations; in the latter case, the viscous terms are discretized based on employing an interior penalty method. By exploiting a duality argument, adjoint-based a posteriori error indicators will be established. Moreover, application of these computable bounds within automatic adaptive finite element algorithms will be developed. Here, a variety of isotropic and anisotropic adaptive strategies, as well as $hp$-mesh refinement will be investigated.