3D considerations for motion perception and visuomotor transformations

Moving through a stable, three-dimensional world is a hallmark of our motor and perceptual experience. This stability is constantly being challenged by movements of the eyes and head, inducing retinal blur and retino-spatial misalignments for which the brain must compensate. To do so, the brain must account for eye and head kinematics to transform two-dimensional retinal input into the reference frame necessary for movement or perception. The four studies in this thesis used both computational and psychophysical approaches to investigate several aspects of this reference frame transformation. In the first study, we examined the neural mechanism underlying the visuomotor transformation for smooth pursuit using a feedforward neural network model. After training, the model performed the general, three-dimensional transformation using gain modulation. This gave mechanistic significance to gain modulation observed in cortical pursuit areas while also providing several testable hypotheses for future electrophysiological work. In the second study, we asked how anticipatory pursuit, which is driven by memorized signals, accounts for eye and head geometry using a novel head-roll updating paradigm. We showed that the velocity memory driving anticipatory smooth pursuit relies on retinal signals, but is updated for the current head orientation. In the third study, we asked how forcing retinal motion to undergo a reference frame transformation influences perceptual decision making. We found that simply rolling one's head impairs perceptual decision making in a way captured by stochastic reference frame transformations. In the final study, we asked how torsional shifts of the retinal projection occurring with almost every eye movement influence orientation perception across saccades. We found a pre-saccadic, predictive remapping consistent with maintaining a purely retinal (but spatially inaccurate) orientation perception throughout the movement. Together these studies suggest that, despite their spatial inaccuracy, retinal signals play a surprisingly large role in our seamless visual experience. This work therefore represents a significant advance in our understanding of how the brain performs one of its most fundamental functions.

Differential contributions of the mIPS and PMd in the movement planning of reaches investigated through HD-tDCS

To reach for a target, we must formulate a movement plan - a difference vector of the target position with respect to the starting hand position. While it is known that the medial part of the intraparietal sulcus (mIPS) and the dorsal premotor (PMd) activity reflects aspects of a kinematic plan for a reaching movement, it is unclear whether or how the two regions may differ. We investigated the functional roles of the mIPS and PMd in the planning of reaching movements using high definition transcranial direct current stimulation (HD-tDCS) and examined changes in horizontal endpoint error when participants were subjected to anodal and cathodal stimulation. The left mIPS and PMd were functionally localized with fMRI in each participant using an interleaved center-out pointing and saccade task and mapped onto the scalp using Brainsight. We adopted a randomized, single-blind design and applied anodal and cathodal stimulation (2mA for 20 min; 3cm radius 4x1 electrode placement) during 4 separate visits scheduled at least a week apart. Each participant performed 250 baseline, stimulation, and post-stimulation memory-guided reaches starting from one of two initial hand positions (IHPs) to one of 4 briefly flashed targets (20 cm distant, 5 cm apart horizontally) while fixating on a straight-ahead cross located at the target line. Separate 2-way repeated measures ANOVAs of horizontal endpoint error difference after cathodal tDCS at each stimulation site revealed a significant IHP by target position interaction effect at the left mIPS, and significant IHP and target main effects at the left PMd. Behaviorally, these effects corresponded to IHP-dependent contractions after cathodal mIPS tDCS and IHP-independent contractions after cathodal PMd tDCS. These results suggest that the movement vector is not yet formed at the input level of mIPS, but is encoded at the input of PMd. These results also indicate that tDCS is a viable, useful method in investigating movement planning properties through temporary perturbations of the system.