Gradient estimation in dendritic reinforcement learning

We study synaptic plasticity in a complex neuronal cell model where NMDA-spikes can arise in certain dendritic zones. In the context of reinforcement learning, two kinds of plasticity rules are derived, zone reinforcement (ZR) and cell reinforcement (CR), which both optimize the expected reward by stochastic gradient ascent. For ZR, the synaptic plasticity response to the external reward signal is modulated exclusively by quantities which are local to the NMDA-spike initiation zone in which the synapse is situated. CR, in addition, uses nonlocal feedback from the soma of the cell, provided by mechanisms such as the backpropagating action potential. Simulation results show that, compared to ZR, the use of nonlocal feedback in CR can drastically enhance learning performance. We suggest that the availability of nonlocal feedback for learning is a key advantage of complex neurons over networks of simple point neurons, which have previously been found to be largely equivalent with regard to computational capability.

Hydrodynamic Characterization of Bile Salt Host-Guest Complexes by Pulsed Field Gradient NMR Spectroscopy

The work described herein is aimed at understanding primary and secondary aggregation of bile salt micelles and how micelles can perform chiral recognition of binapthyl analytes. Previous work with cholate and deoxycholate using micellar electrokinetic chromatography (MEKC) and nuclear magnetic resonance (NMR) has provided insightinto cholate and deoxycholate micelle formation, especially with respect to the critical micelle concentration (CMC). Chiral separations of the model analyte, 1,1â??-binaphthyl-2,2â??-diyl hydrogen phosphate (BNDHP), via cholate (C) and deoxycholate (DC) mediated MEKC separataions previously have shown the DC CMC to be 7-10 mM andthe cholate CMC at 14 mM at ph 12. A second model analyte,1,1â??-binaphthol (BN), was also previously investigated to probe micellar structure, but the MEKC data for this analyte implied a higher CMC, which may be interpreted as secondary aggregation. Thiswork extends the investigation of bile salts to include pulsed field gradient spin echo (PFGSE) NMR experiments being used to gain information about the size and degree of polydispersity of cholate and deoxycholate micelles. Concentrations of cholate below 10mM show a large variation in effective radius likely due to the existence of transient preliminary aggregates. The onset of the primary micelle shows a dramatic increase in effective radius of the micelle in cholate and deoxycholate. In the region of expectedsecondary aggregation a gradual increase of effective radius was observed with cholate; deoxycholate showed a persistent aggregate size in the secondary micelle region that is modulated by the presence of an analyte molecule. Effective radii of cholate anddeoxycholate (individually) were compared with and without R- and S-BNDHP in order to observe the effective radius difference of micelles with and without analyte present. The presence of S-BNDHP consistently resulted in a larger effective aggregate radius incholate and deoxycholate, confirming previous data of the S-BNDHP interacting more with the micelle than R-BNDHP. In total, various NMR techniques, like diffusion NMR can be used to gain a greater understanding of the bile salt micellization process and chiral resolution.

Effects of experimental freezing on soil nitrogen dynamics in soils from a net nitrification gradient in a nitrogen-saturated hardwood forest ecosystem

This study examined effects of soil freezing on N dynamics in soil along an N processing gradient within a mixed hardwood dominated watershed at Fernow Experimental Forest, West Virginia. Sites were designated as LN (low rates of N processing), ML (moderately low), MH (moderately high), and HN (high). Soils underwent three 7-day freezing treatments (0, –20, or –80 °C) in the laboratory. Responses varied between temperature treatments and along the gradient. Initial effects differed among freezing treatments for net N mineralization, but not nitrification, in soils across the gradient, generally maintained at LN < ML ≤ MH < HN for all treatments. Net N mineralization potential was higher following freezing at –20 and –80 °C than control; all were higher than at 0 °C. Net nitrification potential exhibited similar patterns. LN was an exception, with net nitrification low regardless of treatment. Freezing response of N mineralization differed greatly from that of nitrification, suggesting that soil freezing may decouple two processes of the soil N cycle that are otherwise tightly linked at our site. Results also suggest that soil freezing at temperatures commonly experienced at this site can further increase net nitrification in soils already exhibiting high nitrification from N saturation.

Lowered microvascular vessel wall oxygen consumption augments tissue pO2 during PgE1-induced vasodilation

Continuous infusion of intravenous prostaglandin E1 (PgE1, 2.5 mug/kg/min) was used to determine how vasodilation affects oxygen consumption of the microvascular wall and tissue pO(2) in the hamster window chamber model. While systemic measurements (mean arterial pressure and heart rate) and central blood gas measurements were not affected, PgE1 treatment caused arteriolar (64.6 +/- 25.1 microm) and venular diameter (71.9 +/- 29.5 microm) to rise to 1.15 +/- 0.21 and 1.06 +/- 0.19, respectively, relative to baseline. Arteriolar (3.2 x 10(-2) +/- 4.3 x 10(-2) nl/s) and venular flow (7.8 x 10(-3) +/- 1.1 x 10(-2)/s) increased to 1.65 +/- 0.93 and 1.32 +/- 0.72 relative to baseline. Interstitial tissue pO(2) was increased significantly from baseline (21 +/- 8 to 28 +/- 7 mmHg; P < 0.001). The arteriolar vessel wall gradient, a measure of oxygen consumption by the microvascular wall decreased from 20 +/- 6 to 16 +/- 3 mmHg (P < 0.001). The arteriolar vessel wall gradient, a measure of oxygen consumption by the vascular wall, decreased from 20 +/- 6 to 16 +/- 3 mmHg (P < 0.001). This reduction reflects a 20% decrease in oxygen consumption by the vessel wall and up to 50% when cylindrical geometry is considered. The venular vessel wall gradient decreased from 12 +/- 4 to 9 +/- 4 mmHg (P < 0.001). Thus PgE1-mediated vasodilation has a positive microvascular effect: enhancement of tissue perfusion by increasing flow and then augmentation of tissue oxygenation by reducing oxygen consumption by the microvascular wall.

Hardware accelerated ray cast of volume data and volume gradient for an optimized splines-based multi-resolution 2D-3D registration

This paper describes a method for DRR generation as well as for volume gradients projection using hardware accelerated 2D texture mapping and accumulation buffering and demonstrates its application in 2D-3D registration of X-ray fluoroscopy to CT images. The robustness of the present registration scheme are guaranteed by taking advantage of a coarse-to-fine processing of the volume/image pyramids based on cubic B-splines. A human cadaveric spine specimen together with its ground truth was used to compare the present scheme with a purely software-based scheme in three aspects: accuracy, speed, and capture ranges. Our experiments revealed an equivalent accuracy and capture ranges but with much shorter registration time with the present scheme. More specifically, the results showed 0.8 mm average target registration error, 55 second average execution time per registration, and 10 mm and 10° capture ranges for the present scheme when tested on a 3.0 GHz Pentium 4 computer.

Differentiating normal hyaline cartilage from post-surgical repair tissue using fast gradient echo imaging in delayed gadolinium-enhanced MRI (dGEMRIC) at 3 Tesla

The purpose was to evaluate the relative glycosaminoglycan (GAG) content of repair tissue in patients after microfracturing (MFX) and matrix-associated autologous chondrocyte transplantation (MACT) of the knee joint with a dGEMRIC technique based on a newly developed short 3D-GRE sequence with two flip angle excitation pulses. Twenty patients treated with MFX or MACT (ten in each group) were enrolled. For comparability, patients from each group were matched by age (MFX: 37.1 +/- 16.3 years; MACT: 37.4 +/- 8.2 years) and postoperative interval (MFX: 33.0 +/- 17.3 months; MACT: 32.0 +/- 17.2 months). The Delta relaxation rate (DeltaR1) for repair tissue and normal hyaline cartilage and the relative DeltaR1 were calculated, and mean values were compared between both groups using an analysis of variance. The mean DeltaR1 for MFX was 1.07 +/- 0.34 versus 0.32 +/- 0.20 at the intact control site, and for MACT, 1.90 +/- 0.49 compared to 0.87 +/- 0.44, which resulted in a relative DeltaR1 of 3.39 for MFX and 2.18 for MACT. The difference between the cartilage repair groups was statistically significant. The new dGEMRIC technique based on dual flip angle excitation pulses showed higher GAG content in patients after MACT compared to MFX at the same postoperative interval and allowed reducing the data acquisition time to 4 min.

Planar magneto-photonic and gradient-photonic structures : crystals and metamaterials.

In the field of photonics, two new types of material structures, photonic crystals and metamaterials, are presently of great interest. Both are studied in the present work, which focus on planar magnetic materials in the former and planar gradient metamaterials in the latter. These planar periodic structures are easy to handle and integrate into optical systems. The applications are promising field for future optical telecommunication systems and give rise to new optical, microwave and radio technologies. The photonic crystal part emphasizes the utilization of magnetic material based photonic crystals due to its remarkable magneto-optical characteristics. Bandgaps tuning by magnetic field in bismuth-gadolinium-substituted lutetium iron garnet (Bi0.8 Gd0.2 Lu2.0 Fe5 O12) based one- dimensional photonic crystals are investigated and demonstrated in this work. Magnetic optical switches are fabricated and tested. Waveguide formulation for band structure in magneto photonic crystals is developed. We also for the first time demonstrate and test two- dimensional magneto photonic crystals optical. We observe multi-stopbands in two- dimensional photonic waveguide system and study the origin of multi-stopbands. The second part focus on studying photonic metamaterials and planar gradient photonic metamaterial design. We systematically study the effects of varying the geometry of the fishnet unit cell on the refractive index in optical frequency. It is the first time to design and demonstrate the planar gradient structure in the high optical frequency. Optical beam bending using planar gradient photonic metamaterials is observed. The technologies needed for the fabrication of the planar gradient photonic metamaterials are investigated. Beam steering devices, shifter, gradient optical lenses and etc. can be derived from this design.

THERMAL CHARACTERIZATION OF COMBUSTION CHAMBER COMPONENTS IN A GASOLINE TURBOCHARGED DIRECT INJECTION (GTDI) ENGINE

This report is a PhD dissertation proposal to study the in-cylinder temperature and heat flux distributions within a gasoline turbocharged direct injection (GTDI) engine. Recent regulations requiring automotive manufacturers to increase the fuel efficiency of their vehicles has led to great technological achievements in internal combustion engines. These achievements have increased the power density of gasoline engines dramatically in the last two decades. Engine technologies such as variable valve timing (VVT), direct injection (DI), and turbocharging have significantly improved engine power-to-weight and power-to-displacement ratios. A popular trend for increasing vehicle fuel economy in recent years has been to downsize the engine and add VVT, DI, and turbocharging technologies so that a lighter more efficient engine can replace a larger, heavier one. With the added power density, thermal management of the engine becomes a more important issue. Engine components are being pushed to their temperature limits. Therefore it has become increasingly important to have a greater understanding of the parameters that affect in-cylinder temperatures and heat transfer. The proposed research will analyze the effects of engine speed, load, relative air-fuel ratio (AFR), and exhaust gas recirculation (EGR) on both in-cylinder and global temperature and heat transfer distributions. Additionally, the effect of knocking combustion and fuel spray impingement will be investigated. The proposed research will be conducted on a 3.5 L six cylinder GTDI engine. The research engine will be instrumented with a large number of sensors to measure in-cylinder temperatures and pressures, as well as, the temperature, pressure, and flow rates of energy streams into and out of the engine. One of the goals of this research is to create a model that will predict the energy distribution to the crankshaft, exhaust, and cooling system based on normalized values for engine speed, load, AFR, and EGR. The results could be used to aid in the engine design phase for turbocharger and cooling system sizing. Additionally, the data collected can be used for validation of engine simulation models, since in-cylinder temperature and heat flux data is not readily available in the literature..