Reinforcement learning utilizes proxemics: an avatar learns to manipulate the position of people in immersive virtual reality

A reinforcement learning (RL) method was used to train a virtual character to move participants to a specified location. The virtual environment depicted an alleyway displayed through a wide field-of-view head-tracked stereo head-mounted display. Based on proxemics theory, we predicted that when the character approached within a personal or intimate distance to the participants, they would be inclined to move backwards out of the way. We carried out a between-groups experiment with 30 female participants, with 10 assigned arbitrarily to each of the following three groups: In the Intimate condition the character could approach within 0.38m and in the Social condition no nearer than 1.2m. In the Random condition the actions of the virtual character were chosen randomly from among the same set as in the RL method, and the virtual character could approach within 0.38m. The experiment continued in each case until the participant either reached the target or 7 minutes had elapsed. The distributions of the times taken to reach the target showed significant differences between the three groups, with 9 out of 10 in the Intimate condition reaching the target significantly faster than the 6 out of 10 who reached the target in the Social condition. Only 1 out of 10 in the Random condition reached the target. The experiment is an example of applied presence theory: we rely on the many findings that people tend to respond realistically in immersive virtual environments, and use this to get people to achieve a task of which they had been unaware. This method opens up the door for many such applications where the virtual environment adapts to the responses of the human participants with the aim of achieving particular goals.

The use of external mesh reinforcement to reduce intimal hyperplasia and preserve the structure of human saphenous veins.

The saphenous vein is the conduit of choice in bypass graft procedures. Haemodynamic factors play a major role in the development of intimal hyperplasia (IH), and subsequent bypass failure. To evaluate the potential protective effect of external reinforcement on such a failure, we developed an ex vivo model for the perfusion of segments of human saphenous veins under arterial shear stress. In veins submitted to pulsatile high pressure (mean pressure at 100 mmHg) for 3 or 7 days, the use of an external macroporous polyester mesh 1) prevented the dilatation of the vessel, 2) decreased the development of IH, 3) reduced the apoptosis of smooth muscle cells, and the subsequent fibrosis of the media layer, 4) prevented the remodelling of extracellular matrix through the up-regulation of matrix metalloproteinases (MMP-2, MMP-9) and plasminogen activator type I. The data show that, in an experimental ex vivo setting, an external scaffold decreases IH and maintains the integrity of veins exposed to arterial pressure, via increase in shear stress and decrease wall tension, that likely contribute to trigger selective molecular and cellular changes.

Improvement of the antibacterial activity of daptomycin-loaded polymeric microparticles by Eudragit RL 100: An assessment by isothermal microcalorimetry.

The aim of the present study was to develop novel daptomycin-loaded acrylic microparticles with improved release profiles and antibacterial activity against two clinically relevant methicillin-susceptible and methicillin-resistant Staphylococcus aureus strains (MSSA and MRSA, respectively). Daptomycin was encapsulated into poly(methyl methacrylate) (PMMA) and PMMA-Eudragit RL 100 (EUD) microparticles by a double emulsion-solvent evaporation method. For comparison purposes similar formulations were prepared with vancomycin. Particle morphology, size distribution, encapsulation efficiency, surface charge, physicochemical properties, in vitro release and biocompatibility were assessed. Particles exhibited a micrometer size and a spherical morphology. The addition of EUD to the formulation caused a shift in the surface charge of the particles from negative zeta potential values (100% PMMA formulations) to strongly positive. It also improved daptomycin encapsulation efficiency and release, whereas vancomycin encapsulation and release were strongly hindered. Plain and antibiotic-loaded particles presented comparable biocompatibility profiles. The antibacterial activity of the particles was assessed by isothermal microcalorimetry against both MSSA and MRSA. Daptomycin-loaded PMMA-EUD particles presented the highest antibacterial activity against both strains. The addition of 30% EUD to the daptomycin-loaded PMMA particles caused a 40- and 20-fold decrease in the minimum inhibitory (MIC) and bactericidal concentration (MBC) values, respectively, when compared to the 100% PMMA formulations. On the other hand, vancomycin-loaded microparticles presented the highest antibacterial activity in PMMA particles. Unlike conventional methods, isothermal microcalorimetry proved to be a real-time, sensitive and accurate method for assessment of antibacterial activity of antibiotic-loaded polymeric microparticles. Finally, the addition of EUD to formulations proved to be a powerful strategy to improve daptomycin encapsulation efficiency and release, and consequently improving the microparticles activity against two relevant S. aureus strains.

A model for the evolution of reinforcement learning in fluctuating games

Many species are able to learn to associate behaviours with rewards as this gives fitness advantages in changing environments. Social interactions between population members may, however, require more cognitive abilities than simple trial-and-error learning, in particular the capacity to make accurate hypotheses about the material payoff consequences of alternative action combinations. It is unclear in this context whether natural selection necessarily favours individuals to use information about payoffs associated with nontried actions (hypothetical payoffs), as opposed to simple reinforcement of realized payoff. Here, we develop an evolutionary model in which individuals are genetically determined to use either trial-and-error learning or learning based on hypothetical reinforcements, and ask what is the evolutionarily stable learning rule under pairwise symmetric two-action stochastic repeated games played over the individual's lifetime. We analyse through stochastic approximation theory and simulations the learning dynamics on the behavioural timescale, and derive conditions where trial-and-error learning outcompetes hypothetical reinforcement learning on the evolutionary timescale. This occurs in particular under repeated cooperative interactions with the same partner. By contrast, we find that hypothetical reinforcement learners tend to be favoured under random interactions, but stable polymorphisms can also obtain where trial-and-error learners are maintained at a low frequency. We conclude that specific game structures can select for trial-and-error learning even in the absence of costs of cognition, which illustrates that cost-free increased cognition can be counterselected under social interactions.

Reinforcement versus Fluidization in Cytoskeletal Mechanoresponsiveness

Every adherent eukaryotic cell exerts appreciable traction forces upon its substrate. Moreover, every resident cell within the heart, great vessels, bladder, gut or lung routinely experiences large periodic stretches. As an acute response to such stretches the cytoskeleton can stiffen, increase traction forces and reinforce, as reported by some, or can soften and fluidize, as reported more recently by our laboratory, but in any given circumstance it remains unknown which response might prevail or why. Using a novel nanotechnology, we show here that in loading conditions expected in most physiological circumstances the localized reinforcement response fails to scale up to the level of homogeneous cell stretch; fluidization trumps reinforcement. Whereas the reinforcement response is known to be mediated by upstream mechanosensing and downstream signaling, results presented here show the fluidization response to be altogether novel: it is a direct physical effect of mechanical force acting upon a structural lattice that is soft and fragile. Cytoskeletal softness and fragility, we argue, is consistent with early evolutionary adaptations of the eukaryotic cell to material properties of a soft inert microenvironment.

Suitability of human and mammalian cells of different origin for the assessment of genotoxicity of metal and polymeric engineered nanoparticles.

Nanogenotoxicity is a crucial endpoint in safety testing of nanomaterials as it addresses potential mutagenicity, which has implications for risks of both genetic disease and carcinogenesis. Within the NanoTEST project, we investigated the genotoxic potential of well-characterised nanoparticles (NPs): titanium dioxide (TiO2) NPs of nominal size 20 nm, iron oxide (8 nm) both uncoated (U-Fe3O4) and oleic acid coated (OC-Fe3O4), rhodamine-labelled amorphous silica 25 (Fl-25 SiO2) and 50 nm (Fl-50 SiO) and polylactic glycolic acid polyethylene oxide polymeric NPs - as well as Endorem® as a negative control for detection of strand breaks and oxidised DNA lesions with the alkaline comet assay. Using primary cells and cell lines derived from blood (human lymphocytes and lymphoblastoid TK6 cells), vascular/central nervous system (human endothelial human cerebral endothelial cells), liver (rat hepatocytes and Kupffer cells), kidney (monkey Cos-1 and human HEK293 cells), lung (human bronchial 16HBE14o cells) and placenta (human BeWo b30), we were interested in which in vitro cell model is sufficient to detect positive (genotoxic) and negative (non-genotoxic) responses. All in vitro studies were harmonized, i.e. NPs from the same batch, and identical dispersion protocols (for TiO2 NPs, two dispersions were used), exposure time, concentration range, culture conditions and time-courses were used. The results from the statistical evaluation show that OC-Fe3O4 and TiO2 NPs are genotoxic in the experimental conditions used. When all NPs were included in the analysis, no differences were seen among cell lines - demonstrating the usefulness of the assay in all cells to identify genotoxic and non-genotoxic NPs. The TK6 cells, human lymphocytes, BeWo b30 and kidney cells seem to be the most reliable for detecting a dose-response.

Research on the suitability of organosolv semi-chemical triticale fibers as reinforcement for recycled hdpe composites

The main objective of this research was to study the feasibility of incorporating organosolv semi-chemical triticale fibers as the reinforcing element in recycled high density polyethylene (HDPE). In the first step, triticale fibers were characterized in terms of chemical composition and compared with other biomass species (wheat, rye, softwood, and hardwood). Then, organosolv semi-chemical triticale fibers were prepared by the ethanolamine process. These fibers were characterized in terms of its yield, kappa number, fiber length/diameter ratio, fines, and viscosity; the obtained results were compared with those of eucalypt kraft pulp. In the second step, the prepared fibers were examined as a reinforcing element for recycled HDPE composites. Coupled and non-coupled HDPE composites were prepared and tested for tensile properties. Results showed that with the addition of the coupling agent maleated polyethylene (MAPE), the tensile properties of composites were significantly improved, as compared to non-coupled samples and the plain matrix. Furthermore, the influence of MAPE on the interfacial shear strength (IFSS) was studied. The contributions of both fibers and matrix to the composite strength were also studied. This was possible by the use of a numerical iterative method based on the Bowyer-Bader and Kelly-Tyson equations

A low-cost ultrasonic spray dryer to produce spherical microparticles from polymeric matrices

The spray-drying technique has been widely used for drying heat-sensitive foods, pharmaceuticals, and other substances, because it leads to rapid solvent evaporation from droplets. This method involves the transformation of a feed from a fluid state into a dried particulate, by spraying the feed into a hot medium. Despite being most often considered a dehydration process, spray drying can also be used as an encapsulation method. Therefore, this work proposes the use of a simple and low-cost ultrasonic spray dryer system to produce spherical microparticles. This equipment was successfully applied to the preparation of dextrin microspheres on a laboratory scale and for academic purposes.

Development and physicochemical characterization of dexamethasone-loaded polymeric nanocapsule suspensions

The influence of drug concentration, oil phase, and surfactants on the characteristics of dexamethasone-loaded nanocapsules was investigated. The best formulations were obtained at dexamethasone concentrations of 0.25 and 0.50 mg.mL-1 (encapsulation efficiency: 80-90%; mean size: 189-253 nm). The type of oil phase influenced only the stability of dexamethasone-loaded nanocapsules. The association of polysorbate 80 and sorbitan monooleate provided a more stable formulation. Sunflower oil and sorbitan sesquioleate used for the first time as oil phase and surfactant for nanocapsules, respectively, have allowed obtaining suspensions with low mean size and narrow size distribution.

Measuring air pressure with a polymeric gas sensor

In this communication we describe the application of a conductive polymer gas sensor as an air pressure sensor. The device consists of a thin doped poly(4'-hexyloxy-2,5-biphenylene ethylene) (PHBPE) film deposited on an interdigitated metallic electrode. The sensor is cheap, easy to fabricate, lasts for several months, and is suitable for measuring air pressures in the range between 100 and 700 mmHg.

Derivative spectrophotometric method for determination of acyclovir in polymeric nanoparticles

A derivative spectrophotometric method was validated for quantification of acyclovir in poly (n-butylcyanoacrylate) (PBCA) nanoparticles. Specificity, linearity, precision, accuracy, recovery, detection (LOD) and quantification (LOQ) limits were established for method validation. First-derivative at 295.2 nm eliminated interferences from nanoparticle ingredients and presented linearity for acyclovir concentrations ranging from 1.25 to 40.0 µg/mL (r = 0.9999). Precision and accuracy data demonstrated good reproducibility. Recovery ranged from 99.3 to 101.2. LOD was 0.08 µg/mL and LOQ, 0.25 µg/mL. Thus, the proposed method proved to be easy, low cost, and accurate, and therefore, an useful alternative to quantify acyclovir in nanoparticles.

Romp as a versatile method for the obtention of differentiated polymeric materials

Ring Opening Metathesis Polymerization (ROMP) of cyclic olefins is a powerful transition metal-catalyzed reaction for syntheses of polymers and copolymers. The key feature of this reaction is the [2+2]-cycloaddition mechanism, with retention of the olefinic unsaturation in the polymer chain and occurrence of living polymerization. With the development of metal-carbene type catalysts for this process, many addressed polymeric materials have been successfully prepared to be employed in several fields of the science and technology. This review summarizes recent examples of syntheses of polymers with amphiphilic features such as block, graft, brush or star copolymers; as well syntheses of biomaterials, dendronized architectures, photoactive polymers, cross-linked or self-healing materials, and polymers from renewed supplies.

Development and validation of a High Performance Liquid Chromatographic method for determination of etoposide in biodegradable polymeric implants

A method using HPLC-UV was developed and validated for the determination of etoposide incorporated into polycaprolactone implants. The method was carried out in isocratic mode using a C18 column (250 x 4.6 mm; 5 µm), at 25 ºC, with acetonitrile and acetic acid 4% (70:30) as mobile phase, a flow rate of 2 mL/min, and UV detection at 285 nm. The method was linear (r² > 0.99) over the range of 5 to 65 µg/mL, precise (RSD < 5%), accurate (recovery of 98.7%), robust, selective regarding excipient of the sample, and had a quantitation limit equal to 1.76 µg/mL. The validated method can be successfully employed for routine quality control analyses.

Revisão dos tratamentos químicos da fibra natural para mistura com poliolefinas

The use of natural fibers as reinforcement in polymer composites has been a focus of interest. However, these composites exhibit lower mechanical properties than those of pure polymers because of the low interfacial interactions between the hydrophobic polymer matrix and the hydrophilic fiber. To overcome this problem, different chemical treatments applied to the fibers have been reported. One of the most used treatments is mercerization, which can improve adhesion between the fiber and polymeric matrix. Another chemical treatment involves the use of acids (stearic and oleic acids). The chemically treated fibers used in composite materials showed improved mechanical properties.

Formulation and characterization of poloxamer 407®: thermoreversible gel containing polymeric microparticles and hyaluronic acid

The influence of the composition and preparation method on the sol-gel transition temperature (Tsol-gel) and rheological response of poloxamer-based formulations was determined. Manual and more complex mechanical stirring were found to provide similar results. In addition, a linear dependence of Tsol-gel on the poloxamer content was observed in the range of concentrations analyzed, and a Poloxamer 407® concentration of 18% was selected. The addition of hyaluronic acid did not lead to significant changes in the Tsol-gel values. In contrast, the addition of microparticles caused a reduction in Tsol-gel without a significant reduction in gel strength, and pseudoplastic characteristics were observed, indicating that a thermoreversible gel was obtained with a rheology suitable for application in the treatment of burn wounds.