Policy Improvement for POMDPs Using Normalized Importance Sampling

We present a new method for estimating the expected return of a POMDP from experience. The estimator does not assume any knowle ge of the POMDP and allows the experience to be gathered with an arbitrary set of policies. The return is estimated for any new policy of the POMDP. We motivate the estimator from function-approximation and importance sampling points-of-view and derive its theoretical properties. Although the estimator is biased, it has low variance and the bias is often irrelevant when the estimator is used for pair-wise comparisons.We conclude by extending the estimator to policies with memory and compare its performance in a greedy search algorithm to the REINFORCE algorithm showing an order of magnitude reduction in the number of trials required.

Passive vibration isolation using axially loaded curved beams

A nonlinear spring element of a vibration isolator should ideally possess high static and low dynamic stiffness. A buckled beam may be a good candidate to fulfil this requirement provided its internal resonance frequencies are high enough to achieve a wide frequency range of isolation. If a straight beam is used, there is a singularity in the force-displacement characteristic. To smooth this characteristic and eliminate the singularity at the buckling point, beams with initial constant curvature along their length are investigated here as an alternative to the buckled straight beam. Their force displacement characteristics are compared with different initial curvature and with a straight buckled beam. The minimum achievable dynamic stiffness with its corresponding static stiffness is compared for different initial curvatures. A case study is considered where the beams are optimized to isolate a one kilogram mass and to achieve a natural frequency of 1 Hz, considering small amplitudes of vibration. Resonance frequencies of the optimized beams for different curvature are presented. It is shown that an order of magnitude reduction in stiffness compared with a linear spring is achievable, while the internal resonance frequencies of the curved beam are high enough to achieve an acceptable frequency range of isolation.

Accumulation rates of sediments and main sedimentary components in ODP Leg 121 holes on Broken Ridge

Broken Ridge, in the eastern Indian Ocean,is overlain by about 1600 m of middle Cretaceous to Pleistocene tuffaceous and carbonate sediments that record the oceanographic history of southern hemisphere mid-to high-latitude regions. Prior to about 42 Ma, Broken Ridge formed the northern part of the broad Kerguelen-Broken Ridge Plateau. During the middle Eocene, this feature was split by the newly forming Southeast Indian Ocean Ridge; since then, Broken Ridge has drifted north from about 55° to 31°S. The lower part of the sedimentary section is characterized by Turonian to Santonian tuffs that contain abundant glauconite and some carbonate. The tuffs record a large but apparently local volcanic input that characterized the central part of Broken Ridge into the early Tertiary. Maestrichtian shallow-water(several hundred to 1000 m depth) limestones and cherts accumulated at some of the highest rates ever documented from the open ocean, 4 to 5 g/cm**2/kyr. A complete (with all biostratigraphic zones) Cretaceous-Tertiary boundary section was recovered from site 752. The first 1.5 m.y. of the Tertiary is characterized by an order-of-magnitude reduction in the flux of biogenic sediments, indicating a period of sharply reduced biological productivity at 55°S, following which the carbonate and silica sedimentation rates almost reach the previous high values of the latest Cretaceous. We recovered a complete section through the Paleocene that contains all major fossil groups and is more than 300 m thick, perhaps the best pelagic Paleocene section encountered in ocean drilling. About 42 Ma, Broken Ridge was uplifted 2500 m in response to the intra-plateau rifting event; subsequent erosion and deposition has resulted in a prominent Eocene angular unconformity atop the ridge. An Oligocene disconformity characterized by a widespread pebble layer probably represents the 30 Ma sea-level fall. The Neogene pelagic ooze on Broken Ridge has been winnowed, and thus its grain size provides a direct physical record of the energy of the southern hemisphere drift current in the Indian Ocean for the past 30 m.y.

Heat dissipation from carbon nano-electronics

The incorporation of graphitic compounds such as carbon nanotubes (CNTs) and graphene into nano-electronic device packaging holds much promise for waste heat management given their high thermal conductivities. However, as these graphitic materials must be used in together with other semiconductor/insulator materials, it is not known how thermal transport is affected by the interaction. Using different simulation techniques, in this thesis, we evaluate the thermal transport properties - thermal boundary conductance (TBC) and thermal conductivity - of CNTs and single-layer graphene in contact with an amorphous SiO2 (a-SiO2) substrate. First, the theoretical methodologies and concepts used in our simulations are presented. In particular, two concepts are described in detail as they are necessary for the understanding of the subsequent chapters. The first is the linear response Green-Kubo (GK) theory of thermal boundary conductance (TBC), which we develop in this thesis, and the second is the spectral energy density method, which we use to directly compute the phonon lifetimes and thermal transport coefficients. After we set the conceptual foundations, the TBC of the CNT-SiO2 interface is computed using non- equilibrium molecular dynamics (MD) simulations and the new Green-Kubo method that we have developed. Its dependence on temperature, the strength of the interaction with the substrate, and tube diameter are evaluated. To gain further insight into the phonon dynamics in supported CNTs, the scattering rates are computed using the spectral energy density (SED) method. With this method, we are able to distinguish the different scattering mechanisms (boundary and CNT-substrate phonon-phonon) and rates. The phonon lifetimes in supported CNTs are found to be reduced by contact with the substrate and we use that lifetime reduction to determine the change in CNT thermal conductivity. Next, we examine thermal transport in graphene supported on SiO2. The phonon contribution to the TBC of the graphene-SiO2 interface is computed from MD simulations and found to agree well with experimentally measured values. We derive the theory of remote phonon scattering of graphene electrons and compute the heat transfer coefficient dependence on doping level and temperature. The thermal boundary conductance from remote phonon scattering is found to be an order of magnitude smaller than that of the phonon contribution. The in-plane thermal conductivity of supported graphene is calculated from MD simulations. The experimentally measured order of magnitude reduction in thermal conductivity is reproduced in our simulations. We show that this reduction is due to the damping of the flexural (ZA) modes. By varying the interaction between graphene and the substrate, the ZA modes hybridize with the substrate Rayleigh modes and the dispersion of the hybridized modes is found to linearize in the strong coupling limit, leading to an increased thermal conductance in the composite structure.

Determinação em tempo real da magnitude de danos físicos por impacto em linhas de beneficiamento e em condições de laboratório e seus efeitos na qualidade de tomate

Tomatoes are one of the most important vegetable crops grown in Brazil and are among the crops that have one of the highest post-harvest losses indexes in the country. The present work aimed at evaluating impact damage observed in packing lines of fresh tomatoes as well as to determine, under laboratory conditions, quality alterations of tomato fruits submitted to impact damage in different surface types. Critical points evaluation was accomplished using an instrumented sphere. Critical transference points found showed variations in acceleration levels from 30 to 129 G (m s-2). Tests carried out under laboratory conditions showed that padded surfaces reduced up to 31% impact damage. Incidence of severe internal physical damage was evaluated by a subjective scale and increased by 79% on hard surfaces for the highest fall drop. On the other hand, it was observed an effective reduction in physical damage on fruits when padded surfaces were used. When a 10-cm drop was performed, the maximum reduction measured was 10% for hard surfaces and 5% for previously padded surfaces. For quality parameters, it was observed for high drops on hard surfaces, highest values for weight loss, total acidity, lower values for vitamin C and Soluble Solids.

Hypotensive Response Magnitude and Duration in Hypertensives: Continuous and Interval Exercise

Background: Although exercise training is known to promote post-exercise hypotension, there is currently no consistent argument about the effects of manipulating its various components (intensity, duration, rest periods, types of exercise, training methods) on the magnitude and duration of hypotensive response. Objective: To compare the effect of continuous and interval exercises on hypotensive response magnitude and duration in hypertensive patients by using ambulatory blood pressure monitoring (ABPM). Methods: The sample consisted of 20 elderly hypertensives. Each participant underwent three ABPM sessions: one control ABPM, without exercise; one ABPM after continuous exercise; and one ABPM after interval exercise. Systolic blood pressure (SBP), diastolic blood pressure (DBP), mean arterial pressure (MAP), heart rate (HR) and double product (DP) were monitored to check post-exercise hypotension and for comparison between each ABPM. Results: ABPM after continuous exercise and after interval exercise showed post-exercise hypotension and a significant reduction (p < 0.05) in SBP, DBP, MAP and DP for 20 hours as compared with control ABPM. Comparing ABPM after continuous and ABPM after interval exercise, a significant reduction (p < 0.05) in SBP, DBP, MAP and DP was observed in the latter. Conclusion: Continuous and interval exercise trainings promote post-exercise hypotension with reduction in SBP, DBP, MAP and DP in the 20 hours following exercise. Interval exercise training causes greater post-exercise hypotension and lower cardiovascular overload as compared with continuous exercise.

Quantifying the gap between policy and practice in cardiovascular risk reduction: a review of evidence from recent cardiovascular and diabetes audits in the UK

As part of CHD NSF implementation, a pilot project is being undertaken under the auspices of the National Screening Committee to test the practical implications and outcomes of implementing a systematic programme of cardiovascular risk reduction in primary care, initially identifying those at high risk due to pre-existing cardiovascular disease or diabetes. To assist in assessing the magnitude of the challenge faced by the pilot programmes, the UK National Screening Committee (NSC) commissioned a review of current practice based on recent cardiovascular and diabetes audits in the UK. This report details the findings of the review, providing 6 key recommendations for future cardiovascular audits.

Temporal distribution and magnitude of the vulnerability period around stroke depend on stroke subtype.

Background: We aimed to analyze the rate and time distribution of pre- and post-morbid cerebrovascular events in a single ischemic stroke population, and whether these depend on the etiology of the index stroke. Methods: In 2,203 consecutive patients admitted to a single stroke center registry (ASTRAL), the ischemic stroke that led to admission was considered the index event. Frequency distribution and cumulative relative distribution graphs of the most recent and first recurrent event (ischemic stroke, transient ischemic attack, intracranial or subarachnoid hemorrhage) were drawn in weekly and daily intervals for all strokes and for all stroke types. Results: The frequency of events at identical time points before and after the index stroke was mostly reduced in the first week after (vs. before) stroke (1.0 vs. 4.2%, p < 0.001) and the first month (2.7 vs. 7.4%, p < 0.001), and then ebbed over the first year (8.4 vs. 13.1%, p < 0.001). On daily basis, the peak frequency was noticed at day -1 (1.6%) with a reduction to 0.7% on the index day and 0.17% 24 h after. The event rate in patients with atherosclerotic stroke was particularly high around the index event, but 1-year cumulative recurrence rate was similar in all stroke types. Conclusions: We confirm a short window of increased vulnerability in ischemic stroke and show a 4-, 3- and 2-fold reduction in post-stroke events at 1 week, 1 month and 1 year, respectively, compared to identical pre-stroke periods. This break in the 'stroke wave' is particularly striking after atherosclerotic and lacunar strokes.

Wind Turbine Direct-Drive Permanent-Magnet Generator with Direct Liquid Cooling for Mass Reduction

Today’s electrical machine technology allows increasing the wind turbine output power by an order of magnitude from the technology that existed only ten years ago. However, it is sometimes argued that high-power direct-drive wind turbine generators will prove to be of limited practical importance because of their relatively large size and weight. The limited space for the generator in a wind turbine application together with the growing use of wind energy pose a challenge for the design engineers who are trying to increase torque without making the generator larger. When it comes to high torque density, the limiting factor in every electrical machine is heat, and if the electrical machine parts exceed their maximum allowable continuous operating temperature, even for a short time, they can suffer permanent damage. Therefore, highly efficient thermal design or cooling methods is needed. One of the promising solutions to enhance heat transfer performances of high-power, low-speed electrical machines is the direct cooling of the windings. This doctoral dissertation proposes a rotor-surface-magnet synchronous generator with a fractional slot nonoverlapping stator winding made of hollow conductors, through which liquid coolant can be passed directly during the application of current in order to increase the convective heat transfer capabilities and reduce the generator mass. This doctoral dissertation focuses on the electromagnetic design of a liquid-cooled direct-drive permanent-magnet synchronous generator (LC DD-PMSG) for a directdrive wind turbine application. The analytical calculation of the magnetic field distribution is carried out with the ambition of fast and accurate predicting of the main dimensions of the machine and especially the thickness of the permanent magnets; the generator electromagnetic parameters as well as the design optimization. The focus is on the generator design with a fractional slot non-overlapping winding placed into open stator slots. This is an a priori selection to guarantee easy manufacturing of the LC winding. A thermal analysis of the LC DD-PMSG based on a lumped parameter thermal model takes place with the ambition of evaluating the generator thermal performance. The thermal model was adapted to take into account the uneven copper loss distribution resulting from the skin effect as well as the effect of temperature on the copper winding resistance and the thermophysical properties of the coolant. The developed lumpedparameter thermal model and the analytical calculation of the magnetic field distribution can both be integrated with the presented algorithm to optimize an LC DD-PMSG design. Based on an instrumented small prototype with liquid-cooled tooth-coils, the following targets have been achieved: experimental determination of the performance of the direct liquid cooling of the stator winding and validating the temperatures predicted by an analytical thermal model; proving the feasibility of manufacturing the liquid-cooled tooth-coil winding; moreover, demonstration of the objectives of the project to potential customers.

Changes in the magnitude and pattern of translocation of photoassimilated ¹CO in soybean plants following an acute exposure to gamma radiation /

Young soybean plants (Glycine ~. L. cultivar Harosoy '63), grown under controlled conditions, were exposed to gamma radiation on a single occasion. One hour following exposure to 3,750 rads, the mature trifoliate leaf of the soybean plant was isolated in a closed system and permitted to photoassimilate approximately 1-5 pCi of 14C02 for 15 minutes. After an additional 45 minute-period, the plant was sacrificed and the magnitude of translocation and distribution pattern of 14C determined. In the non-irradiated plants 18~ of the total 14C recovered was outside the fed leaf blades and of this translocated 14c, 28~ was above the node of the fed leaf, 38~ in the stem below the node, 28~ in the roots and 7~ in the petiole. As well, in the irradiated plants, a smaller per cent (6~) of the total 14 C recovered was exported out of the source leaf blades. Of this translocated 14c , a smaller per cent (20~) was found in the apical region above the node of the source leaf and a higher per cent (45~) was recovered from the stem below the node and in the petiole (11~). The per cent of exported 14 C recovered from the root was unaffected by the radiation. Replacement of the shoot apex with 20 ppm IAA immediately following irradiation, only J partially increased the magnitude of translocation but did completely restore the pattern of distribution to that observed in the non-irradiated plants. From supplementary studies showing a radiationinduced reduction of photosynthetic rates in the source leaf and a reduction of the cumulative stem and leaf lengths in the apical sink region, the observed effects of radiation on the translocation process have been correlated to damage incurred by the source and sink regions. These data suggest that the reduction in the magnitude of translocation is the result of damage to both the source and sink regions rather than the phloem conducting tissue itself, whereas the change in the pattern of translocation is probably the result of a reduced rate of 14C-assimilate movement caused by a radiation-induced decrease of sink metabolism, especially the decrease in the metabolism of the apical sink.

Urban Detection From Hyperspectral Images Using Dimension-Reduction Model and Fusion of Multiple Segmentations Based on Stuctural and Textural Features

Ce mémoire de maîtrise présente une nouvelle approche non supervisée pour détecter et segmenter les régions urbaines dans les images hyperspectrales. La méthode proposée n ́ecessite trois étapes. Tout d’abord, afin de réduire le coût calculatoire de notre algorithme, une image couleur du contenu spectral est estimée. A cette fin, une étape de réduction de dimensionalité non-linéaire, basée sur deux critères complémentaires mais contradictoires de bonne visualisation; à savoir la précision et le contraste, est réalisée pour l’affichage couleur de chaque image hyperspectrale. Ensuite, pour discriminer les régions urbaines des régions non urbaines, la seconde étape consiste à extraire quelques caractéristiques discriminantes (et complémentaires) sur cette image hyperspectrale couleur. A cette fin, nous avons extrait une série de paramètres discriminants pour décrire les caractéristiques d’une zone urbaine, principalement composée d’objets manufacturés de formes simples g ́eométriques et régulières. Nous avons utilisé des caractéristiques texturales basées sur les niveaux de gris, la magnitude du gradient ou des paramètres issus de la matrice de co-occurrence combinés avec des caractéristiques structurelles basées sur l’orientation locale du gradient de l’image et la détection locale de segments de droites. Afin de réduire encore la complexité de calcul de notre approche et éviter le problème de la ”malédiction de la dimensionnalité” quand on décide de regrouper des données de dimensions élevées, nous avons décidé de classifier individuellement, dans la dernière étape, chaque caractéristique texturale ou structurelle avec une simple procédure de K-moyennes et ensuite de combiner ces segmentations grossières, obtenues à faible coût, avec un modèle efficace de fusion de cartes de segmentations. Les expérimentations données dans ce rapport montrent que cette stratégie est efficace visuellement et se compare favorablement aux autres méthodes de détection et segmentation de zones urbaines à partir d’images hyperspectrales.

Ring-opening polymerization in molten PEEK: transient reduction of melt-viscosity by macrocyclic aromatic thioetherketones

Blends of PEEK with macrocyclic thioether-ketones show initial melt-viscosities reduced by more than an order of magnitude relative to the polymer itself, enabling more facile processing and fabrication. On raising the temperature of the melt, however, the macrocycle undergoes spontaneous, entropically-driven ring-opening polymerization (ED-ROP), so that the properties of the final polymer should not, in principle, be compromised by the presence of low-MW macrocyclic material.

Mechanistic changes observed in heavy water for nitrate reduction reaction on palladium-modified Pt(hkl) electrodes

Reduction of nitrate on palladium-modified platinum single-crystal electrodes has been investigated both voltammetrically and spectroscopically in acidic media (pH = 1). Results obtained in H2O and D2O solvents are compared for the three crystallographic orientations. FTIR and differential electrochemical mass spectrometry (DEMS) results clearly indicate that the isotopic substitution of the solvent has a large effect in the mechanism of the reaction, changing the nature of the detected products. For Pt(111)/Pd and Pt(100)/Pd, N2O is detected as the main product of nitrate reduction when D2O is used as solvent, while no N2O is detected when the reaction is performed in H2O. For Pt(110)/Pd, N2O is detected in both solvents, although the use of D2O clearly favours the preferential formation of this product. The magnitude of voltammetric currents is also affected by the nature of the solvent. This has been analysed considering, in addition to the different product distribution, the existence of different transport numbers and optical constants of the solvent.

Effects of Food Availability on Yolk Androgen Deposition in the Black-Legged Kittiwake (Rissa tridactyla), a Seabird with Facultative Brood Reduction

In birds with facultative brood reduction, survival of the junior chick is thought to be regulated primarily by food availability. In black-legged kittiwakes (Rissa tridactyla) where parents and chicks are provided with unlimited access to supplemental food during the breeding season, brood reduction still occurs and varies interannually. Survival of the junior chick is therefore affected by factors in addition to the amount of food directly available to them. Maternally deposited yolk androgens affect competitive dynamics within a brood, and may be one of the mechanisms by which mothers mediate brood reduction in response to a suite of environmental and physiological cues. The goal of this study was to determine whether food supplementation during the pre-lay period affected patterns of yolk androgen deposition in free-living kittiwakes in two years (2003 and 2004) that varied in natural food availability. Chick survival was measured concurrently in other nests where eggs were not collected. In both years, supplemental feeding increased female investment in eggs by increasing egg mass. First-laid ("A") eggs were heavier but contained less testosterone and androstenedione than second-laid ("B") eggs across years and treatments. Yolk testosterone was higher in 2003 (the year with higher B chick survival) across treatments. The difference in yolk testosterone levels between eggs within a clutch varied among years and treatments such that it was relatively small when B chick experienced the lowest and the highest survival probabilities, and increased with intermediate B chick survival probabilities. The magnitude of testosterone asymmetry in a clutch may allow females to optimize fitness by either predisposing a brood for reduction or facilitating survival of younger chicks.

Radical Chain Reduction of Alkylboron Compounds with Catechols

The conversion of alkylboranes to the corresponding alkanes is classically performed via protonolysis of alkylboranes. This simple reaction requires the use of severe reaction conditions, that is, treatment with a carboxylic acid at high temperature (>150 degrees C). We report here a mild radical procedure for the transformation of organoboranes to alkalies. 4-tert-Butylcatechol, a well-established radical inhibitor and antioxidant, is acting as a source of hydrogen atoms. An efficient chain reaction is observed due to the exceptional reactivity of phenoxyl radicals toward alkylboranes. The reaction has been applied to a wide range of organoboron derivatives such as B-alkylcatecholboranes, trialkylboranes, pinacolboronates, and alkylboronic acids. Furthermore, the so far elusive rate constants for the hydrogen transfer between secondary alkyl radical and catechol derivatives have been experimentally determined. Interestingly, they are less than 1 order of magnitude slower than that of tin hydride at 80 degrees C, making catechols particularly attractive for a wide range of transformations involving C-C bond formation.