Aktionenlernen mit Selbstorganisierenden Karten und Reinforcement Learning

Die vorliegende Arbeit beschäftigt sich mit der Entwicklung eines Funktionsapproximators und dessen Verwendung in Verfahren zum Lernen von diskreten und kontinuierlichen Aktionen: 1. Ein allgemeiner Funktionsapproximator – Locally Weighted Interpolating Growing Neural Gas (LWIGNG) – wird auf Basis eines Wachsenden Neuralen Gases (GNG) entwickelt. Die topologische Nachbarschaft in der Neuronenstruktur wird verwendet, um zwischen benachbarten Neuronen zu interpolieren und durch lokale Gewichtung die Approximation zu berechnen. Die Leistungsfähigkeit des Ansatzes, insbesondere in Hinsicht auf sich verändernde Zielfunktionen und sich verändernde Eingabeverteilungen, wird in verschiedenen Experimenten unter Beweis gestellt. 2. Zum Lernen diskreter Aktionen wird das LWIGNG-Verfahren mit Q-Learning zur Q-LWIGNG-Methode verbunden. Dafür muss der zugrunde liegende GNG-Algorithmus abgeändert werden, da die Eingabedaten beim Aktionenlernen eine bestimmte Reihenfolge haben. Q-LWIGNG erzielt sehr gute Ergebnisse beim Stabbalance- und beim Mountain-Car-Problem und gute Ergebnisse beim Acrobot-Problem. 3. Zum Lernen kontinuierlicher Aktionen wird ein REINFORCE-Algorithmus mit LWIGNG zur ReinforceGNG-Methode verbunden. Dabei wird eine Actor-Critic-Architektur eingesetzt, um aus zeitverzögerten Belohnungen zu lernen. LWIGNG approximiert sowohl die Zustands-Wertefunktion als auch die Politik, die in Form von situationsabhängigen Parametern einer Normalverteilung repräsentiert wird. ReinforceGNG wird erfolgreich zum Lernen von Bewegungen für einen simulierten 2-rädrigen Roboter eingesetzt, der einen rollenden Ball unter bestimmten Bedingungen abfangen soll.

Mixed finite-element methods for elliptic convection-dominated problems arising in semiconductor physics

In this work we develop and analyze an adaptive numerical scheme for simulating a class of macroscopic semiconductor models. At first the numerical modelling of semiconductors is reviewed in order to classify the Energy-Transport models for semiconductors that are later simulated in 2D. In this class of models the flow of charged particles, that are negatively charged electrons and so-called holes, which are quasi-particles of positive charge, as well as their energy distributions are described by a coupled system of nonlinear partial differential equations. A considerable difficulty in simulating these convection-dominated equations is posed by the nonlinear coupling as well as due to the fact that the local phenomena such as "hot electron effects" are only partially assessable through the given data. The primary variables that are used in the simulations are the particle density and the particle energy density. The user of these simulations is mostly interested in the current flow through parts of the domain boundary - the contacts. The numerical method considered here utilizes mixed finite-elements as trial functions for the discrete solution. The continuous discretization of the normal fluxes is the most important property of this discretization from the users perspective. It will be proven that under certain assumptions on the triangulation the particle density remains positive in the iterative solution algorithm. Connected to this result an a priori error estimate for the discrete solution of linear convection-diffusion equations is derived. The local charge transport phenomena will be resolved by an adaptive algorithm, which is based on a posteriori error estimators. At that stage a comparison of different estimations is performed. Additionally a method to effectively estimate the error in local quantities derived from the solution, so-called "functional outputs", is developed by transferring the dual weighted residual method to mixed finite elements. For a model problem we present how this method can deliver promising results even when standard error estimator fail completely to reduce the error in an iterative mesh refinement process.

Phylogeny and historical biogeography of the Australian Camphorosmeae (Chenopodiaceae)

Diese Studie befasst sich mit der Phylogenie und Biogeographie der australischen Camphorosmeae, die ein wichtiges Element der Flora arider Gebiete Australiens sind. Die molekularen Phylogenien wurden mit Hilfe Bayes’scher Statistik und „maximum likelihood”berechnet. Um das Alter der Gruppe und interner Linien abzuschätzen, wurden die Methoden „Nonparametric rate smoothing” und “penalized likelihood” benutzt. Morphologische Merkmale wurden nach Kriterien der Parsimonie auf den molekularen Baum aufgetragen. „Brooks parsimony analysis”, „cladistic analysis of distributions and endemism”, „dispersal-vicariance analysis”,„ancestral area analysis” und „weighted ancestral area analysis” wurden angewandt, um Abfolge und Richtungen der Ausbreitung der Gruppe in Australien zu analysieren.Von sieben getesteten Markern hatten nur die nukleären ETS und ITS genügend Variation für die phylogenetische Analyse der Camphorosmeae. Die plastidären Marker trnL-trnF spacer,trnP-psaJ spacer, rpS16 intron, rpL16 intron und trnS-trnG spacer zeigten kein ausreichendes phylogenetisches Signal. Die gefundenen phylogenetischen Hypothesen widersprechen der jetzigen Taxonomie der Gruppe. Neobassia, Threlkeldia, Osteocarpum und Enchylaena sollten den Gattungen Sclerolaena bzw. Maireana zugeordnet werden. Die kladistische Analyse der Fruchtanhängsel unterstützt die taxonomischen Ergebnisse der auf DNA basierenden Phylogenie. Allerdings hat die Behaarung, die bei anderen Gruppen der Chenopodiaceae als wichtiges taxonomisches Merkmal herangezogen wird, die Phylogenie nicht unterstützt. Vorfahren der heutigen Camphorosmeen sind im Miozän, vor ca. 8-14 Millionen Jahren, durch Fernausbreitung vermutlich aus Asien in Australien eingewandert. Anfängliche Diversifizierung fand während des späten Miozäns bis in das frühe Pliozän vor ca. 4-7 Millionen Jahren statt. Am Ende des Pliozäns existierten schon 45% - 72% der Abstammungslinien der jetzigen Camphorosmeen. Dies weist auf eine schnelle Ausbreitung hin. Das Alter stimmt mit dem Einsetzen der Aridisierung Australiens überein, und deutet darauf hin, dass die Ausbreitung der ariden Gebiete eine große Rolle bei der Diversifizierung der Gruppe spielte. Die Vorfahren der australischen Camphorosmeae scheinen die Südküste Australiens zuerst besiedeln zu haben. Dies geschah vor dem Einsetzen der Aridisierung des Kontinents. Die anschließende Ausbreitung erfolgte in verschiedene Richtungen und folgte der fortschreitenden Austrocknung im späten Tertiär und im ganzen Quartär. Durch ihre Anpassung an Trockenheit ist der Erfolg der Camphorosmeae in den ariden Gebieten zu erklären.Die Abwesenheit von klaren phylogenetischen und artspezifischen Signalen zwischen Arten der australischen Camphorosmeae ist auf das junge Alter und die schnelle Diversifizierung der Gruppe zurückzuführen, welche die Häufung von Mutationen und eine starke morphologische Differenzierung nicht zugelassen haben.

Weighted Inequalities and Lipschitz Spaces

In this thesis I have characterized the trace measures for particular potential spaces of functions defined on R^n, but "mollified" so that the potentials are de facto defined on the upper half-space of R^n. The potential functions are kind Riesz-Bessel. The characterization of trace measures for these spaces is a test condition on elementary sets of the upper half-space. To prove the test condition as sufficient condition for trace measures, I had give an extension to the case of upper half-space of the Muckenhoupt-Wheeden and Wolff inequalities. Finally I characterized the Carleson-trace measures for Besov spaces of discrete martingales. This is a simplified discrete model for harmonic extensions of Lipschitz-Besov spaces.

Investigation of the nuclear matter density distributions of the exotic 12 Be, 14 Be and 8 B nuclei by elastic proton scattering in inverse kinematics

The proton-nucleus elastic scattering at intermediate energies is a well-established method for the investigation of the nuclear matter distribution in stable nuclei and was recently applied also for the investigation of radioactive nuclei using the method of inverse kinematics. In the current experiment, the differential cross sections for proton elastic scattering on the isotopes $^{7,9,10,11,12,14}$Be and $^8$B were measured. The experiment was performed using the fragment separator at GSI, Darmstadt to produce the radioactive beams. The main part of the experimental setup was the time projection ionization chamber IKAR which was simultaneously used as hydrogen target and a detector for the recoil protons. Auxiliary detectors for projectile tracking and isotope identification were also installed. As results from the experiment, the absolute differential cross sections d$sigma$/d$t$ as a function of the four momentum transfer $t$ were obtained. In this work the differential cross sections for elastic p-$^{12}$Be, p-$^{14}$Be and p-$^{8}$B scattering at low $t$ ($t leq$~0.05~(GeV/c)$^2$) are presented. The measured cross sections were analyzed within the Glauber multiple-scattering theory using different density parameterizations, and the nuclear matter density distributions and radii of the investigated isotopes were determined. The analysis of the differential cross section for the isotope $^{14}$Be shows that a good description of the experimental data is obtained when density distributions consisting of separate core and halo components are used. The determined {it rms} matter radius is $3.11 pm 0.04 pm 0.13$~fm. In the case of the $^{12}$Be nucleus the results showed an extended matter distribution as well. For this nucleus a matter radius of $2.82 pm 0.03 pm 0.12$~fm was determined. An interesting result is that the free $^{12}$Be nucleus behaves differently from the core of $^{14}$Be and is much more extended than it. The data were also compared with theoretical densities calculated within the FMD and the few-body models. In the case of $^{14}$Be, the calculated cross sections describe the experimental data well while, in the case of $^{12}$Be there are discrepancies in the region of high momentum transfer. Preliminary experimental results for the isotope $^8$B are also presented. An extended matter distribution was obtained (though much more compact as compared to the neutron halos). A proton halo structure was observed for the first time with the proton elastic scattering method. The deduced matter radius is $2.60pm 0.02pm 0.26$~fm. The data were compared with microscopic calculations in the frame of the FMD model and reasonable agreement was observed. The results obtained in the present analysis are in most cases consistent with the previous experimental studies of the same isotopes with different experimental methods (total interaction and reaction cross section measurements, momentum distribution measurements). For future investigation of the structure of exotic nuclei a universal detector system EXL is being developed. It will be installed at the NESR at the future FAIR facility where higher intensity beams of radioactive ions are expected. The usage of storage ring techniques provides high luminosity and low background experimental conditions. Results from the feasibility studies of the EXL detector setup, performed at the present ESR storage ring, are presented.

Investigation of the dipole response of nickel isotopes in the presence of a high-frequency electromagnetic field

The electric dipole response of neutron-rich nickel isotopes has been investigated using the LAND setup at GSI in Darmstadt (Germany). Relativistic secondary beams of 56−57Ni and 67−72Ni at approximately 500 AMeV have been generated using projectile fragmentation of stable ions on a 4 g/cm2 Be target and subsequent separation in the magnetic dipole fields of the FRagment Separator (FRS). After reaching the LAND setup in Cave C, the radioactive ions were excited electromagnetically in the electric field of a Pb target. The decay products have been measured in inverse kinematics using various detectors. Neutron-rich 67−69Ni isotopes decay by the emission of neutrons, which are detected in the LAND detector. The present analysis concentrates on the (gamma,n) and (gamma,2n) channels in these nuclei, since the proton and three-neutron thresholds are unlikely to be reached considering the virtual photon spectrum for nickel ions at 500 AMeV. A measurement of the stable 58Ni isotope is used as a benchmark to check the accuracy of the present results with previously published data. The measured (gamma,n) and (gamma,np) channels are compared with an inclusive photoneutron measurement by Fultz and coworkers, which are consistent within the respective errors. The measured excitation energy distributions of 67−69Ni contain a large portion of the Giant Dipole Resonance (GDR) strength predicted by the Thomas-Reiche-Kuhn energy-weighted sum rule, as well as a significant amount of low-lying E1 strength, that cannot be attributed to the GDR alone. The GDR distribution parameters are calculated using well-established semi-empirical systematic models, providing the peak energies and widths. The GDR strength is extracted from the chi-square minimization of the model GDR to the measured data of the (gamma,2n) channel, thereby excluding any influence of eventual low-lying strength. The subtraction of the obtained GDR distribution from the total measured E1 strength provides the low-lying E1 strength distribution, which is attributed to the Pygmy Dipole Resonance (PDR). The extraction of the peak energy, width and strength is performed using a Gaussian function. The minimization of trial Gaussian distributions to the data does not converge towards a sharp minimum. Therefore, the results are presented by a chi-square distribution as a function of all three Gaussian parameters. Various predictions of PDR distributions exist, as well as a recent measurement of the 68Ni pygmy dipole-resonance obtained by virtual photon scattering, to which the present pygmy dipole-resonance distribution is also compared.

Mimicking the one-dimensional marginal distributions of stochastic diffusions

In the large maturity limit, we compute explicitly the Local Volatility surface for Heston, through Dupire’s formula, with Fourier pricing of the respective derivatives of the call price. Than we verify that the prices of European call options produced by the Heston model, concide with those given by the local volatility model where the Local Volatility is computed as said above.

Weighted geometric mean of large-scale matrices: numerical analysis and algorithms

Computing the weighted geometric mean of large sparse matrices is an operation that tends to become rapidly intractable, when the size of the matrices involved grows. However, if we are not interested in the computation of the matrix function itself, but just in that of its product times a vector, the problem turns simpler and there is a chance to solve it even when the matrix mean would actually be impossible to compute. Our interest is motivated by the fact that this calculation has some practical applications, related to the preconditioning of some operators arising in domain decomposition of elliptic problems. In this thesis, we explore how such a computation can be efficiently performed. First, we exploit the properties of the weighted geometric mean and find several equivalent ways to express it through real powers of a matrix. Hence, we focus our attention on matrix powers and examine how well-known techniques can be adapted to the solution of the problem at hand. In particular, we consider two broad families of approaches for the computation of f(A) v, namely quadrature formulae and Krylov subspace methods, and generalize them to the pencil case f(A\B) v. Finally, we provide an extensive experimental evaluation of the proposed algorithms and also try to assess how convergence speed and execution time are influenced by some characteristics of the input matrices. Our results suggest that a few elements have some bearing on the performance and that, although there is no best choice in general, knowing the conditioning and the sparsity of the arguments beforehand can considerably help in choosing the best strategy to tackle the problem.

Comparison of physiological triggering schemes for diffusion-weighted magnetic resonance imaging in kidneys

To determine the potential benefit of combined respiratory-cardiac triggering for diffusion-weighted imaging (DWI) of kidneys compared to respiratory triggering alone (RT).

Evaluation of renal allograft function early after transplantation with diffusion-weighted MR imaging

To determine the inter-patient variability of apparent diffusion coefficients (ADC) and concurrent micro-circulation contributions from diffusion-weighted MR imaging (DW-MRI) in renal allografts early after transplantation, and to obtain initial information on whether these measures are altered in histologically proven acute allograft rejection (AR).

Predicting and monitoring cancer treatment response with diffusion-weighted MRI

An imaging biomarker that would provide for an early quantitative metric of clinical treatment response in cancer patients would provide for a paradigm shift in cancer care. Currently, nonimage based clinical outcome metrics include morphology, clinical, and laboratory parameters, however, these are obtained relatively late following treatment. Diffusion-weighted MRI (DW-MRI) holds promise for use as a cancer treatment response biomarker as it is sensitive to macromolecular and microstructural changes which can occur at the cellular level earlier than anatomical changes during therapy. Studies have shown that successful treatment of many tumor types can be detected using DW-MRI as an early increase in the apparent diffusion coefficient (ADC) values. Additionally, low pretreatment ADC values of various tumors are often predictive of better outcome. These capabilities, once validated, could provide for an important opportunity to individualize therapy thereby minimizing unnecessary systemic toxicity associated with ineffective therapies with the additional advantage of improving overall patient health care and associated costs. In this report, we provide a brief technical overview of DW-MRI acquisition protocols, quantitative image analysis approaches and review studies which have implemented DW-MRI for the purpose of early prediction of cancer treatment response.

Synthetic-echo time postprocessing technique for generating images with variable T2-weighted contrast: diagnosis of meniscal and cartilage abnormalities of the knee

To assess the feasibility and accuracy of a synthetic-echo time (TE) magnetic resonance (MR) postprocessing technique for the diagnostic evaluation of abnormalities of menisci and articular cartilage in the knee.

Diffusion-weighted imaging for the follow-up of patients after matrix-associated autologous chondrocyte transplantation

To evaluate the use of diffusion-weighted imaging (DWI) for the assessment of cartilage maturation in patients after matrix-associated autologous chondrocyte transplantation (MACT).

EPITHET: Positive Result After Reanalysis Using Baseline Diffusion-Weighted Imaging/Perfusion-Weighted Imaging Co-Registration

the Echoplanar Imaging Thrombolytic Evaluation Trial (EPITHET) was a prospective, randomized, double-blinded, placebo-controlled, phase II trial of alteplase between 3 and 6 hours after stroke onset. The primary outcome of infarct growth attenuation on MRI with alteplase in mismatch patients was negative when mismatch volumes were assessed volumetrically, without coregistration, which underestimates mismatch volumes. We hypothesized that assessing the extent of mismatch by coregistration of perfusion and diffusion MRI maps may more accurately allow the effects of alteplase vs placebo to be evaluated.

Susceptibility-weighted imaging of the brain: Does gadolinium administration matter?

Susceptibility-weighted MR imaging (SWI) is usually obtained without administration of intravenous gadolinium (Gd). However, it is occasionally necessary to perform SWI after Gd is injected. The effects of Gd on SWI have not been systematically examined. The aim of this prospective study was to investigate whether performing SWI after Gd would influence the diagnostic image quality, parenchymal signal and vascular enhancement. An additional aim is to suggest potential future applications for Gd-enhanced SWI.