Interacting Bose-Fermi mixtures in optical lattices

In this thesis, we investigate mixtures of quantum degenerate Bose and Fermi gases of neutral atoms in threedimensional optical lattices. Feshbach resonances allow to control interspecies interactions in these systems precisely, by preparing suitable combinations of internal atomic states and applying external magnetic fields. This way, the system behaviour can be tuned continuously from mutual transparency to strongly interacting correlated phases, up to the stability boundary.rnThe starting point for these investigations is the spin-polarized fermionic band insulator. The properties of this non-interacting system are fully determined by the Pauli exclusion principle for the occupation of states in the lattice. A striking demonstration of the latter can be found in the antibunching of the density-density correlation of atoms released from the lattice. If bosonic atoms are added to this system, isolated heteronuclear molecules can be formed on the lattice sites via radio-frequency stimulation. The efficiency of this process hints at a modification of the atom number distribution over the lattice caused by interspecies interaction.rnIn the following, we investigate systems with tunable interspecies interaction. To this end, a method is developed which allows to assess the various contributions to the system Hamiltonian both qualitatively and quantitatively by following the quantum phase diffusion of the bosonic matter wave.rnBesides a modification of occupation number statistics, these measurements show a significant renormalization of the bosonic Hubbard parameters. The final part of the thesis considers the implications of this renormalization effect on the many particle physics in the mixture. Here, we demonstrate how the quantum phase transition from a bosonic superfluid to a Mott insulator state is shifted towards considerably shallower lattices due to renormalization.