37 resultados para Reinforcement Learning,resource-constrained devices,iOS devices,on-device machine learning
em Biblioteca Digital da Produção Intelectual da Universidade de São Paulo (BDPI/USP)
Resumo:
One of the most important recent improvements in cardiology is the use of ventricular assist devices (VADs) to help patients with severe heart diseases, especially when they are indicated to heart transplantation. The Institute Dante Pazzanese of Cardiology has been developing an implantable centrifugal blood pump that will be able to help a sick human heart to keep blood flow and pressure at physiological levels. This device will be used as a totally or partially implantable VAD. Therefore, an improvement on device performance is important for the betterment of the level of interaction with patient`s behavior or conditions. But some failures may occur if the device`s pumping control does not follow the changes in patient`s behavior or conditions. The VAD control system must consider tolerance to faults and have a dynamic adaptation according to patient`s cardiovascular system changes, and also must attend to changes in patient conditions, behavior, or comportments. This work proposes an application of the mechatronic approach to this class of devices based on advanced techniques for control, instrumentation, and automation to define a method for developing a hierarchical supervisory control system that is able to perform VAD control dynamically, automatically, and securely. For this methodology, we used concepts based on Bayesian network for patients` diagnoses, Petri nets to generate a VAD control algorithm, and Safety Instrumented Systems to ensure VAD system security. Applying these concepts, a VAD control system is being built for method effectiveness confirmation.
Resumo:
Classical and operant conditioning principles, such as the behavioral discrepancy-derived assumption that reinforcement always selects antecedent stimulus and response relations, have been studied at the neural level, mainly by observing the strengthening of neuronal responses or synaptic connections. A review of the literature on the neural basis of behavior provided extensive scientific data that indicate a synthesis between the two conditioning processes based mainly on stimulus control in learning tasks. The resulting analysis revealed the following aspects. Dopamine acts as a behavioral discrepancy signal in the midbrain pathway of positive reinforcement, leading toward the nucleus accumbens. Dopamine modulates both types of conditioning in the Aplysia mollusk and in mammals. In vivo and in vitro mollusk preparations show convergence of both types of conditioning in the same motor neuron. Frontal cortical neurons are involved in behavioral discrimination in reversal and extinction procedures, and these neurons preferentially deliver glutamate through conditioned stimulus or discriminative stimulus pathways. Discriminative neural responses can reliably precede operant movements and can also be common to stimuli that share complex symbolic relations. The present article discusses convergent and divergent points between conditioning paradigms at the neural level of analysis to advance our knowledge on reinforcement.
Resumo:
This paper investigates how to make improved action selection for online policy learning in robotic scenarios using reinforcement learning (RL) algorithms. Since finding control policies using any RL algorithm can be very time consuming, we propose to combine RL algorithms with heuristic functions for selecting promising actions during the learning process. With this aim, we investigate the use of heuristics for increasing the rate of convergence of RL algorithms and contribute with a new learning algorithm, Heuristically Accelerated Q-learning (HAQL), which incorporates heuristics for action selection to the Q-Learning algorithm. Experimental results on robot navigation show that the use of even very simple heuristic functions results in significant performance enhancement of the learning rate.
Resumo:
The intra-buccal polymeric bioadhesive systems that can stay adhered to the oral soft tissues for drug programmed release, with the preventive and/or therapeutic purpose has been employed for large clinical situations. A system based on hydroxypropyl methyl cellulose/Carbopol 934`/magnesium stearate (HPMC/Cp/StMg) was developed having the sodium fluoride as active principle. This kind of system was evaluated according to its resistance to the removal by means of physical test of tensile strength. Swine buccal mucosa extracted immediately after animals` sacrifice was employed as substrate for the physical trials, to obtain 16 test bodies. Artificial saliva with or without mucin was used to involve the substrate/bioadhesive system sets during the trials. Artificial salivas viscosity was determined by means of Brookfield viscometer, showing the artificial saliva with mucin 10.0 cP, and the artificial saliva without mucin 7.5 cP. The tensile strength assays showed the following averages: for the group ""artificial saliva with mucin"" - 12.89 Pa, and for the group ""without mucin"" - 12.35 Pa. Statistical analysis showed no significant difference between the assays for both artificial salivas, and it was possible to conclude that the variable mucin did not interfered with the bioadhesion process for the polymeric devices. The device was able to release fluoride in a safe, efficient and constant way up to 8 hours.
Resumo:
Sociable robots are embodied agents that are part of a heterogeneous society of robots and humans. They Should be able to recognize human beings and each other, and to engage in social, interactions. The use of a robotic architecture may strongly reduce the time and effort required to construct a sociable robot. Such architecture must have structures and mechanisms to allow social interaction. behavior control and learning from environment. Learning processes described oil Science of Behavior Analysis may lead to the development of promising methods and Structures for constructing robots able to behave socially and learn through interactions from the environment by a process of contingency learning. In this paper, we present a robotic architecture inspired from Behavior Analysis. Methods and structures of the proposed architecture, including a hybrid knowledge representation. are presented and discussed. The architecture has been evaluated in the context of a nontrivial real problem: the learning of the shared attention, employing an interactive robotic head. The learning capabilities of this architecture have been analyzed by observing the robot interacting with the human and the environment. The obtained results show that the robotic architecture is able to produce appropriate behavior and to learn from social interaction. (C) 2009 Elsevier Inc. All rights reserved.
Resumo:
The constrained compartmentalized knapsack problem can be seen as an extension of the constrained knapsack problem. However, the items are grouped into different classes so that the overall knapsack has to be divided into compartments, and each compartment is loaded with items from the same class. Moreover, building a compartment incurs a fixed cost and a fixed loss of the capacity in the original knapsack, and the compartments are lower and upper bounded. The objective is to maximize the total value of the items loaded in the overall knapsack minus the cost of the compartments. This problem has been formulated as an integer non-linear program, and in this paper, we reformulate the non-linear model as an integer linear master problem with a large number of variables. Some heuristics based on the solution of the restricted master problem are investigated. A new and more compact integer linear model is also presented, which can be solved by a branch-and-bound commercial solver that found most of the optimal solutions for the constrained compartmentalized knapsack problem. On the other hand, heuristics provide good solutions with low computational effort. (C) 2011 Elsevier BM. All rights reserved.
Resumo:
This paper analyzes the behavior of the base of a precast column in the socket foundation with smooth interfaces. This research is motivated by the lack of information and guidelines on the behavior of column bases in the embedded region. An experimental program with two full-scale specimens was carried-out. These two specimens had smooth interfaces at the internal faces of the socket, different embedded lengths and were subjected to loads with large eccentricities. The experimental results showed that the failure of the specimens occurred by the yielding of the longitudinal reinforcement out of the embedded region, while the transverse reinforcement was not very stressed. Some recommendations on the anchorage of the longitudinal reinforcement and a strut-and-tie model for the behavior of column bases in the embedded region are proposed.
Resumo:
Aims: There remains significant concern about the long-term safety of drug-eluting stents (DES). However, bare metal stents (BMS) have been used safely for over two decades. There is therefore a pressing need to explore alternative strategies for reducing restenosis with BMS. This study was designed to examine whether IVUS-guided cutting balloon angioplasty (CBA) with BMS could convey similar restenosis rates to DES. Methods and results: In the randomised REstenosis reDUction by Cutting balloon angioplasty Evaluation (REDUCE III) study, 521 patients were divided into four groups based on device and IVUS use before BMS (IVUS-CBA-BMS: 137 patients; Angio-CBA-BMS: 123; IVUS-BA-BMS: 142; and Angio-BA-BMS: 119). At follow-up, the IVUS-CBA-BMS group had a significantly lower restenosis rate (6.6%) than the other groups (p=0.016). We performed a quantitative coronary angiography (QCA) based matched comparison between an IVUS-guided CBA-BMS strategy (REDUCE III) and a DES strategy (Rapamycin-Eluting-Stent Evaluation At Rotterdam Cardiology. Hospital, the RESEARCH study). We matched the presence of diabetes, vessel size, and lesion severity by QCA. Restenosis (>50% diameter stenosis at follow-up) and target vessel revascularisation (TVR) were examined. QCA-matched comparison resulted in 120-paired lesions. While acute gain was significantly greater in IVUS-CBA-BMS than DES (1.65 +/- 0.41 mm vs. 1.28 +/- 0.57 mm, p=0.001), late loss was significantly less with DES than with IVUS-CBA-BMS (0.03 +/- 0.42 mm vs. 0.80 +/- 0.47 mm, p=0.001). However, no difference was found in restenosis rates (IVUS-CBA-BMS: 6.6% vs. DES: 5.0%, p=0.582) and TVR (6.6% and 6.6%, respectively). Conclusions: An IVUS-guided CBA-BMS strategy yielded restenosis rates similar to those achieved by DES and provided an effective alternative to the use of DES.
Resumo:
A new approach to electrochromics, based on the reversible coating-dissolution of an oxide from an inorganic electrochromic electrolyte consisting of a silver-amine complex in a polymer electrolyte (PEO), has proven successful. The reversible electrodeposition of silver onto indium-tin oxide coated glass (ITO) was investigated and the influence of HClO(4) and KI was evaluated. Several characteristics of the electrolyte Ag-PEO make it suitable for use in electrochromic reversible silver electrodeposition devices, such as visible absorption spectrum with an absorbance variation of 60%, an electrochromic efficiency of 5.2 cm(2) C(-1) and an ionic conductivity 4.4 x 10(-4) S cm(-1). The addition of perchloric acid improved the transparency of Ag-PEO, and potassium iodide (KI) was fundamental in setting up the process of reversible silver electrodeposition in the PEO polymeric matrix. A description of the electrochemical processes implied is presented. A number of approaches focusing on the improvement of system performance are tested. (C) 2009 Elsevier Ltd. All rights reserved.
Resumo:
Magnetic field effects on the conductivity of different types of organic devices: undoped and dye doped aluminium (III) 8-hydroxyquinoline (Alq(3))-based organic light emitting diodes (OLEDs), electron-only Alq(3)-based diodes, and a hole-only N,N`-diphenyl-N,N`-bis(1-naphthyl)1,1`-biphenyl-4,4`-diamine (alpha-NPD)-based diode were studied at room temperature. Only negative magnetoresistance (MR) was observed for the Alq(3)-based devices. The addition of a rubrene dye in Alq(3)-based OLEDs quenches the MR by a factor of 5. The alpha-NPD hole-only device showed only positive MR. Our results are discussed with respect to the actual models for MR in organic semiconductors. Our results are in good agreement with the bipolaron model. (C) 2009 Elsevier B.V. All rights reserved.
Resumo:
Background. Several medical devices used during hemodynamic procedures, particularly angiographic diagnostic and therapeutic cardiac catheters, are manufactured for single use only. However, reprocessing and reuse of these devices has been reported, to determine the frequency of reuse and reprocessing of single-use medical devices used during hemodynamic procedures in Brazil and to evaluate how reprocessing is performed. Design. National survey, conducted from December 1999 to July 2001. Methods. Most of the institutions affiliated with the Brazilian Society of Hemodynamic and Interventional Cardiology were surveyed by use of a questionnaire sent in the mail. Results. The questionnaire response rate was 50% (119 of 240 institutions). Of the 119 institutions that responded, 116 (97%) reported reuse of single-use devices used during hemodynamic procedures, and only 26 (22%) reported use of a standardized reprocessing protocol. Cleaning, flushing, rinsing, drying, sterilizing and packaging methods varied greatly and were mostly inadequate. Criteria for discarding reused devices varied widely. Of the 119 institutions that responded, 80 (67%) reported having a surveillance system for adverse events associated with the reuse of medical devices, although most of these institutions did not routinely review the data, and only 38 (32%) described a training program for the personnel who reprocessed single-use devices. Conclusions. The reuse of single-use devices used during hemodynamic procedures was very frequent in hospitals in Brazil. Basic guidance on how to reuse and reprocess single-use medical devices is urgently needed, because, despite the lack of studies to support reusing and reprocessing single-use medical devices, such devices are necessary in limited-resource areas in which these practices are current.
Resumo:
A biofilm is a complex community of surface-associated cells enclosed in a polymer matrix. They attach to solid surfaces and their formation can be affected by growth conditions and co-infection with other pathogens. The presence of biofilm may protect the microorganisms from host defenses, as well as significantly reduce their susceptibility to antifungal agents. Pathogenic microbes can form biofilms on the inert surfaces of implanted devices such as catheters, prosthetic cardiac valves and intrauterine devices (IUDs). The present study was carried out to analyze the presence of biofilm on the surface of intrauterine devices in patients with recurrent vulvovaginal candidiasis, and to determine the susceptibility profile of the isolated yeasts to amphotericin B and fluconazole. Candida albicans was recovered from the IUDs and it was found to be susceptible to the antifungal agents when tested under planktonic growing conditions. These findings indicate the presence of the biofilm on the surface of the IUD as an important risk factor for recurrent vulvovaginal candidiasis.
Resumo:
Background: Previous studies have pointed out that the mere elevation of the maxillary sinus membrane promotes bone formation without the use of augmentation materials. Purpose: This experimental study aimed at evaluating if the two-stage procedure for sinus floor augmentation could benefit from the use of a space-making device in order to increase the bone volume to enable later implant installation with good primary stability. Materials and Methods: Six male tufted capuchin primates (Cebus apella) were subjected to extraction of the three premolars and the first molar on both sides of the maxilla to create an edentulous area. The sinuses were opened using the lateral bone-wall window technique, and the membrane was elevated. One resorbable space-making device was inserted in each maxillary sinus, and the bone window was returned in place. The animals were euthanatized after 6 months, and biopsy blocks containing the whole maxillary sinus and surrounding soft tissues were prepared for ground sections. Results: The histological examination of the specimens showed bone formation in contact with both the schneiderian membrane and the device in most cases even when the device was displaced. The process of bone formation indicates that this technique is potentially useful for two-stage sinus floor augmentation. The lack of stabilization of the device within the sinus demands further improvement of space-makers for predictable bone augmentation. Conclusions: It is concluded that (1) the device used in this study did not trigger any important inflammatory reaction; (2) when the sinus membrane was elevated, bone formation was a constant finding; and (3) an ideal space-making device should be stable and elevate the membrane to ensure a maintained connection between the membrane and the secluded space.
Resumo:
High-resolution X-ray diffractometry is used to probe the nature of a diffraction-peak broadening previously noticed in quantum dots (QDs) systems with freestanding InAs islands on top of GaAs (001) substrates [Freitas et al., Phys. Status Solidi (A) 204, 2548 (2007)]. The procedure is hence extended to further investigate the capping process of InAs/GaAs QDs. A direct correlation is established between QDs growth rates and misorientation of lattice-planes at the samples surfaces. This effect provides an alternative too] for studying average strain fields on QDs systems in standard triple axis diffractometers running on X-ray tube sources, which are much more common than synchrotron facilities. (C) 2009 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim
Resumo:
The control of molecular architecture provided by the layer-by-layer (LbL) technique has led to enhanced biosensors, in which advantageous features of distinct materials can be combined. Full optimization of biosensing performance, however, is only reached if the film morphology is suitable for the principle of detection of a specific biosensor. In this paper, we report a detailed morphology analysis of LbL films made with alternating layers of single-walled carbon nanotubes (SWNTs) and polyamidoamine (PAMAM) dendrimers, which were then covered with a layer of penicillinase (PEN). An optimized performance to detect penicillin G was obtained with 6-bilayer SWNT/PAMAM LbL films deposited on p-Si-SiO(2)-Ta(2)O(5) chips, used in biosensors based on a capacitive electrolyte-insulator-semiconductor (EIS) and a light-addressable potentiometric sensor (LAPS) structure, respectively. Field-emission scanning electron microscopy (FESEM) and atomic force microscopy (AFM) images indicated that the LbL films were porous, with a large surface area due to interconnection of SWNT into PAMAM layers. This morphology was instrumental for the adsorption of a larger quantity of PEN, with the resulting LbL film being highly stable. The experiments to detect penicillin were performed with constant-capacitance (Con Cap) and constant-current (CC) measurements for EIS and LAPS sensors, respectively, which revealed an enhanced detection signal and sensitivity of ca. 100 mV/decade for the field-effect sensors modified with the PAMAM/SWNT LbL film. It is concluded that controlling film morphology is essential for an enhanced performance of biosensors, not only in terms of sensitivity but also stability and response time. (C) 2010 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim