Reinforcement learning utilizes proxemics: an avatar learns to manipulate the position of people in immersive virtual reality

A reinforcement learning (RL) method was used to train a virtual character to move participants to a specified location. The virtual environment depicted an alleyway displayed through a wide field-of-view head-tracked stereo head-mounted display. Based on proxemics theory, we predicted that when the character approached within a personal or intimate distance to the participants, they would be inclined to move backwards out of the way. We carried out a between-groups experiment with 30 female participants, with 10 assigned arbitrarily to each of the following three groups: In the Intimate condition the character could approach within 0.38m and in the Social condition no nearer than 1.2m. In the Random condition the actions of the virtual character were chosen randomly from among the same set as in the RL method, and the virtual character could approach within 0.38m. The experiment continued in each case until the participant either reached the target or 7 minutes had elapsed. The distributions of the times taken to reach the target showed significant differences between the three groups, with 9 out of 10 in the Intimate condition reaching the target significantly faster than the 6 out of 10 who reached the target in the Social condition. Only 1 out of 10 in the Random condition reached the target. The experiment is an example of applied presence theory: we rely on the many findings that people tend to respond realistically in immersive virtual environments, and use this to get people to achieve a task of which they had been unaware. This method opens up the door for many such applications where the virtual environment adapts to the responses of the human participants with the aim of achieving particular goals.

The use of external mesh reinforcement to reduce intimal hyperplasia and preserve the structure of human saphenous veins.

The saphenous vein is the conduit of choice in bypass graft procedures. Haemodynamic factors play a major role in the development of intimal hyperplasia (IH), and subsequent bypass failure. To evaluate the potential protective effect of external reinforcement on such a failure, we developed an ex vivo model for the perfusion of segments of human saphenous veins under arterial shear stress. In veins submitted to pulsatile high pressure (mean pressure at 100 mmHg) for 3 or 7 days, the use of an external macroporous polyester mesh 1) prevented the dilatation of the vessel, 2) decreased the development of IH, 3) reduced the apoptosis of smooth muscle cells, and the subsequent fibrosis of the media layer, 4) prevented the remodelling of extracellular matrix through the up-regulation of matrix metalloproteinases (MMP-2, MMP-9) and plasminogen activator type I. The data show that, in an experimental ex vivo setting, an external scaffold decreases IH and maintains the integrity of veins exposed to arterial pressure, via increase in shear stress and decrease wall tension, that likely contribute to trigger selective molecular and cellular changes.

A model for the evolution of reinforcement learning in fluctuating games

Many species are able to learn to associate behaviours with rewards as this gives fitness advantages in changing environments. Social interactions between population members may, however, require more cognitive abilities than simple trial-and-error learning, in particular the capacity to make accurate hypotheses about the material payoff consequences of alternative action combinations. It is unclear in this context whether natural selection necessarily favours individuals to use information about payoffs associated with nontried actions (hypothetical payoffs), as opposed to simple reinforcement of realized payoff. Here, we develop an evolutionary model in which individuals are genetically determined to use either trial-and-error learning or learning based on hypothetical reinforcements, and ask what is the evolutionarily stable learning rule under pairwise symmetric two-action stochastic repeated games played over the individual's lifetime. We analyse through stochastic approximation theory and simulations the learning dynamics on the behavioural timescale, and derive conditions where trial-and-error learning outcompetes hypothetical reinforcement learning on the evolutionary timescale. This occurs in particular under repeated cooperative interactions with the same partner. By contrast, we find that hypothetical reinforcement learners tend to be favoured under random interactions, but stable polymorphisms can also obtain where trial-and-error learners are maintained at a low frequency. We conclude that specific game structures can select for trial-and-error learning even in the absence of costs of cognition, which illustrates that cost-free increased cognition can be counterselected under social interactions.

Large Magnetoresistance in Fe/MgO/FeCo(001) Epitaxial Tunnel-Junctions on GaAs(001).

We present tunneling experiments on Fe~001!/MgO~20 Å!/FeCo~001! single-crystal epitaxial junctions of high quality grown by sputtering and laser ablation. Tunnel magnetoresistance measurements give 60% at 30 K, to be compared with 13% obtained recently on ~001!-oriented Fe/amorphous-Al2O3 /FeCo tunnel junctions. This difference demonstrates that the spin polarization of tunneling electrons is not directly related to the density of states of the free metal surface Fe~001! in this case but depends on the actual electronic structure of the entire electrode/barrier system.

Reinforcement versus Fluidization in Cytoskeletal Mechanoresponsiveness

Every adherent eukaryotic cell exerts appreciable traction forces upon its substrate. Moreover, every resident cell within the heart, great vessels, bladder, gut or lung routinely experiences large periodic stretches. As an acute response to such stretches the cytoskeleton can stiffen, increase traction forces and reinforce, as reported by some, or can soften and fluidize, as reported more recently by our laboratory, but in any given circumstance it remains unknown which response might prevail or why. Using a novel nanotechnology, we show here that in loading conditions expected in most physiological circumstances the localized reinforcement response fails to scale up to the level of homogeneous cell stretch; fluidization trumps reinforcement. Whereas the reinforcement response is known to be mediated by upstream mechanosensing and downstream signaling, results presented here show the fluidization response to be altogether novel: it is a direct physical effect of mechanical force acting upon a structural lattice that is soft and fragile. Cytoskeletal softness and fragility, we argue, is consistent with early evolutionary adaptations of the eukaryotic cell to material properties of a soft inert microenvironment.

Sonographic diagnosis of carpal tunnel syndrome: a study in 200 hospital workers

AbstractObjective:To describe the prevalence of carpal tunnel syndrome in a sample of 200 healthy hospital workers, establishing the respective epidemiological associations.Materials and Methods:Two hundred individuals were submitted to wrist ultrasonography to measure the median nerve area. They were questioned and examined for epidemiological data, body mass index, carpal tunnel syndrome signs and symptoms, and submitted to the Boston carpal tunnel questionnaire (BCTQ) to evaluate the carpal tunnel syndrome severity. A median nerve area ≥ 9 mm2 was considered to be diagnostic of carpal tunnel syndrome.Results:Carpal tunnel syndrome was diagnosed by ultrasonography in 34% of the sample. It was observed the association of carpal tunnel syndrome with age (p < 0.0001), paresthesia (p < 0.0001), Tinel's test (p < 0.0001), Phalen's test (p< 0.0001), BCTQ score (p < 0.0001), and years of formal education (p < 0.0001). Years of formal education was the only variable identified as an independent risk factor for carpal tunnel syndrome (95% CI = 1.03 to 1.24).Conclusion:The prevalence of carpal tunnel syndrome in a population of hospital workers was of 34%. The number of years of formal education was the only independent risk factor for carpal tunnel syndrome.

Research on the suitability of organosolv semi-chemical triticale fibers as reinforcement for recycled hdpe composites

The main objective of this research was to study the feasibility of incorporating organosolv semi-chemical triticale fibers as the reinforcing element in recycled high density polyethylene (HDPE). In the first step, triticale fibers were characterized in terms of chemical composition and compared with other biomass species (wheat, rye, softwood, and hardwood). Then, organosolv semi-chemical triticale fibers were prepared by the ethanolamine process. These fibers were characterized in terms of its yield, kappa number, fiber length/diameter ratio, fines, and viscosity; the obtained results were compared with those of eucalypt kraft pulp. In the second step, the prepared fibers were examined as a reinforcing element for recycled HDPE composites. Coupled and non-coupled HDPE composites were prepared and tested for tensile properties. Results showed that with the addition of the coupling agent maleated polyethylene (MAPE), the tensile properties of composites were significantly improved, as compared to non-coupled samples and the plain matrix. Furthermore, the influence of MAPE on the interfacial shear strength (IFSS) was studied. The contributions of both fibers and matrix to the composite strength were also studied. This was possible by the use of a numerical iterative method based on the Bowyer-Bader and Kelly-Tyson equations

Study of mesoscopic tunnel junctions between two normal metals

The main purpose of this work was to study different kinds of metal-based tunnel junctions at low temperatures. The problem which had to be solved was creating a junction with appropriate properties at these temperatures. The materials for junctions were found experimentally. The goal was to find an alloy material that can provide a high quality tunnel junction, which remains in the normal conductive state at low temperatures without applying magnetic field. The fabrication technology of such a device, based on an alloy of aluminium and manganese, is described in detail. In this thesis theoretical properties of tunnel junctions are considered and results of experiments with tunnel junctions are described and quantitative properties of the junctions are analyzed based on the experimental data.

Effect of working pressure at different spray nozzles on drift quantification in wind tunnel

Each year, there is an increase in pesticide consumption and in its importance of use in the large-scale agricultural production, being fundamental the knowledge of application technology to the activity success. The objective of the present study was to evaluate the influence of working pressure on the drift generated by different spray nozzles, assessed in wind tunnel. The treatments were composed of two spray nozzles AXI 110015 and AXI 11002 with pressure levels of 276 and 414 kPa. The spray solution was composed by water and NaCl at 10%. The applications were conducted at wind speed of 2.0 m s-1, being the drift collected at 5.0; 10.0 and 15.0 m away from the spray boom and at heights of 0.2; 0.4; 0.6; 0.8 e 1.0 m from the tunnel floor. To both spray nozzles, the greatest drift was collected at the smallest distance to the spray-boom and at the lowest height. The AXI 11002 nozzle gave a smaller drift relative to the AXI 110015 nozzle for the two tested pressures and for all the collection points. Regardless of the nozzle, a rise in the working pressure increases the spray drift percentage at all distances in the wind tunnel.

Ultrasound evaluation on carpal tunnel syndrome before and after bariatric surgery

Objective:To evaluate the prevalence of carpal tunnel syndrome in candidates for bariatric surgery comparing with the non-obese population and verify the effects on it of bariatric treatment. Methods:We studiedthree groups of individuals: 1) patients waiting for bariatric surgery (preoperative); 2) individuals who had already undergone the procedure (postoperative); and 3) control group. We collected demographic and clinical data of carpal tunnel syndrome. The Ultrasound examination was carried out to diagnose the syndrome by measuring the median nerve area. Results:We included 329 individuals (114 in the preoperative group, 90 in the postoperative group and 125 controls). There was a higher prevalence of paresthesias (p=0.0003), clinical tests (p=0.0083) on the preoperative group when compared with controls (p<0.00001). There were lowe levels of paresthesias (p=0.0002) and median nerve area (p=0.04) in postoperative patients but with no significant difference in general. A significant difference was found between the preoperative and postoperative groups (p=0.05) in those who performed non-manual work.Conclusion: There was a higher prevalence of carpal tunnel syndrome in the preoperative group compared with the control one, but no significant difference was observed between the pre and postoperative groups in general. There was difference between pre and postoperative groups for non-manual workers.

Prediction of transients and control reactions in a transonic wind tunnel

This work describes a lumped parameter mathematical model for the prediction of transients in an aerodynamic circuit of a transonic wind tunnel. Control actions to properly handle those perturbations are also assessed. The tunnel circuit technology is up to date and incorporates a novel feature: high-enthalpy air injection to extend the tunnel’s Reynolds number capability. The model solves the equations of continuity, energy and momentum and defines density, internal energy and mass flow as the basic parameters in the aerodynamic study as well as Mach number, stagnation pressure and stagnation temperature, all referred to test section conditions, as the main control variables. The tunnel circuit response to control actions and the stability of the flow are numerically investigated. Initially, for validation purposes, the code was applied to the AWT ("Altitude Wind Tunnel" of NASA-Lewis). In the sequel, the Brazilian transonic wind tunnel was investigated, with all the main control systems modeled, including injection.