Social saliency : visual psychophysics and single-neuron recordings in humans

My thesis studies how people pay attention to other people and the environment. How does the brain figure out what is important and what are the neural mechanisms underlying attention? What is special about salient social cues compared to salient non-social cues? In Chapter I, I review social cues that attract attention, with an emphasis on the neurobiology of these social cues. I also review neurological and psychiatric links: the relationship between saliency, the amygdala and autism. The first empirical chapter then begins by noting that people constantly move in the environment. In Chapter II, I study the spatial cues that attract attention during locomotion using a cued speeded discrimination task. I found that when the motion was expansive, attention was attracted towards the singular point of the optic flow (the focus of expansion, FOE) in a sustained fashion. The more ecologically valid the motion features became (e.g., temporal expansion of each object, spatial depth structure implied by distribution of the size of the objects), the stronger the attentional effects. However, compared to inanimate objects and cues, people preferentially attend to animals and faces, a process in which the amygdala is thought to play an important role. To directly compare social cues and non-social cues in the same experiment and investigate the neural structures processing social cues, in Chapter III, I employ a change detection task and test four rare patients with bilateral amygdala lesions. All four amygdala patients showed a normal pattern of reliably faster and more accurate detection of animate stimuli, suggesting that advantageous processing of social cues can be preserved even without the amygdala, a key structure of the “social brain”. People not only attend to faces, but also pay attention to others’ facial emotions and analyze faces in great detail. Humans have a dedicated system for processing faces and the amygdala has long been associated with a key role in recognizing facial emotions. In Chapter IV, I study the neural mechanisms of emotion perception and find that single neurons in the human amygdala are selective for subjective judgment of others’ emotions. Lastly, people typically pay special attention to faces and people, but people with autism spectrum disorders (ASD) might not. To further study social attention and explore possible deficits of social attention in autism, in Chapter V, I employ a visual search task and show that people with ASD have reduced attention, especially social attention, to target-congruent objects in the search array. This deficit cannot be explained by low-level visual properties of the stimuli and is independent of the amygdala, but it is dependent on task demands. Overall, through visual psychophysics with concurrent eye-tracking, my thesis found and analyzed socially salient cues and compared social vs. non-social cues and healthy vs. clinical populations. Neural mechanisms underlying social saliency were elucidated through electrophysiology and lesion studies. I finally propose further research questions based on the findings in my thesis and introduce my follow-up studies and preliminary results beyond the scope of this thesis in the very last section, Future Directions.

Dissecting neural circuits for vision in nonhuman primates using fMRI-guided electrophysiology and optogenetics

The visual system is a remarkable platform that evolved to solve difficult computational problems such as detection, recognition, and classification of objects. Of great interest is the face-processing network, a sub-system buried deep in the temporal lobe, dedicated for analyzing specific type of objects (faces). In this thesis, I focus on the problem of face detection by the face-processing network. Insights obtained from years of developing computer-vision algorithms to solve this task have suggested that it may be efficiently and effectively solved by detection and integration of local contrast features. Does the brain use a similar strategy? To answer this question, I embark on a journey that takes me through the development and optimization of dedicated tools for targeting and perturbing deep brain structures. Data collected using MR-guided electrophysiology in early face-processing regions was found to have strong selectivity for contrast features, similar to ones used by artificial systems. While individual cells were tuned for only a small subset of features, the population as a whole encoded the full spectrum of features that are predictive to the presence of a face in an image. Together with additional evidence, my results suggest a possible computational mechanism for face detection in early face processing regions. To move from correlation to causation, I focus on adopting an emergent technology for perturbing brain activity using light: optogenetics. While this technique has the potential to overcome problems associated with the de-facto way of brain stimulation (electrical microstimulation), many open questions remain about its applicability and effectiveness for perturbing the non-human primate (NHP) brain. In a set of experiments, I use viral vectors to deliver genetically encoded optogenetic constructs to the frontal eye field and faceselective regions in NHP and examine their effects side-by-side with electrical microstimulation to assess their effectiveness in perturbing neural activity as well as behavior. Results suggest that cells are robustly and strongly modulated upon light delivery and that such perturbation can modulate and even initiate motor behavior, thus, paving the way for future explorations that may apply these tools to study connectivity and information flow in the face processing network.

Microelectrode Implants for Spinal Cord Stimulation in Rats

Paralysis is a debilitating condition afflicting millions of people across the globe, and is particularly deleterious to quality of life when motor function of the legs is severely impaired or completely absent. Fortunately, spinal cord stimulation has shown great potential for improving motor function after spinal cord injury and other pathological conditions. Many animal studies have shown stimulation of the neural networks in the spinal cord can improve motor ability so dramatically that the animals can even stand and step after a complete spinal cord transaction.

This thesis presents work to successfully provide a chronically implantable device for rats that greatly enhances the ability to control the site of spinal cord stimulation. This is achieved through the use of a parylene-C based microelectrode array, which enables a density of stimulation sites unattainable with conventional wire electrodes. While many microelectrode devices have been proposed in the past, the spinal cord is a particularly challenging environment due to the bending and movement it undergoes in a live animal. The developed microelectrode array is the first to have been implanted in vivo while retaining functionality for over a month. In doing so, different neural pathways can be selectively activated to facilitate standing and stepping in spinalized rats using various electrode combinations, and important differences in responses are observed.

An engineering challenge for the usability of any high density electrode array is connecting the numerous electrodes to a stimulation source. This thesis develops several technologies to address this challenge, beginning with a fully passive implant that uses one wire per electrode to connect to an external stimulation source. The number of wires passing through the body and the skin proved to be a hazard for the health of the animal, so a multiplexed implant was devised in which active electronics reduce the number of wires. Finally, a fully wireless implant was developed. As these implants are tested in vivo, encapsulation is of critical importance to retain functionality in a chronic experiment, especially for the active implants, and it was achieved without the use of costly ceramic or metallic hermetic packaging. Active implants were built that retained functionality 8 weeks after implantation, and achieved stepping in spinalized rats after just 8-10 days, which is far sooner than wire-based electrical stimulation has achieved in prior work.

Enlarging the depth of focus by filtering in the phase-space domain

The ambiguity function was employed as a merit function to design an optical system with a high depth of focus. The ambiguity function with the desired enlarged-depth-of-focus characteristics was obtained by using a properly designed joint filter to modify the ambiguity function of the original pupil in the phase-space domain. From the viewpoint of the filter theory, we roughly propose that the constraints of the spatial filters that are used to enlarge the focal depth must be satisfied. These constraints coincide with those that appeared in the previous literature on this topic. Following our design procedure, several sets of apodizers were synthesized, and their performances in the defocused imagery were compared with each other and with other previous designs. (c) 2005 Optical Society of America.

Analysis of optical systems with extended depth of field using the Wigner distribution function

We describe the use of a Wigner distribution function approach for exploring the problem of extending the depth of field in a hybrid imaging system. The Wigner distribution function, in connection with the phase-space curve that formulates a joint phase-space description of an optical field, is employed as a tool to display and characterize the evolving behavior of the amplitude point spread function as a wave propagating along the optical axis. It provides a comprehensive exhibition of the characteristics for the hybrid imaging system in extending the depth of field from both wave optics and geometrical optics. We use it to analyze several well-known optical designs in extending the depth of field from a new viewpoint. The relationships between this approach and the earlier ambiguity function approach are also briefly investigated. (c) 2006 Optical Society of America.

Superresolution, extended focal depth or focal shift with electrically controllable radial birefringent filter

In this paper an electrically controllable radial birefringent pupil filter is proposed. It consists of two polarizers and an improved electrically controllable optical azimuth rotator which has two lambda/4 retarders, one electro-optical crystal and one radial birefringent crystal. The evolution and distribution of polarization states of this pupil filter are discussed. The most interesting and useful advantage of such a structure is that the characteristic of transverse superresolution and axial extended focal depth or focal shift can be obtained merely by controlling the applied voltage on the electro-optical crystal. The radial birefringent crystal azimuth angle cooperating with different electrical inductive phase differences will determine the transverse and axial intensity distribution. It is shown that for particular ranges of electrical inductive phase difference it is possible to obtain transverse superresolution along with extended focal depth or with a focal shift.

Depth-sensitive analysis of fluorine on lunar sample surfaces and in carbonaceous chondrites by a nuclear resonant reaction technique

The nuclear resonant reaction ¹⁹F(ρ,αγ)¹⁶O has been used to perform depth-sensitive analyses of fluorine in lunar samples and carbonaceous chondrites. The resonance at 0.83 MeV (center-of-mass) in this reaction is utilized to study fluorine surface films, with particular interest paid to the outer micron of Apollo 15 green glass, Apollo 17 orange glass, and lunar vesicular basalts. These results are distinguished from terrestrial contamination, and are discussed in terms of a volcanic origin for the samples of interest. Measurements of fluorine in carbonaceous chondrites are used to better define the solar system fluorine abundance. A technique for measurement of carbon on solid surfaces with applications to direct quantitative analysis of implanted solar wind carbon in lunar samples is described.

The design and development of the Windermere Profiler. An instrument for measuring how various environmental parameters vary with depth in lakes, reservoirs and rivers

A review article detailing the background, development and functionality of the Windermere Profiler, a multi parameter environmental monitoring instrument for use in lakes, reservoirs and rivers. The article explains the requirement for regular data collection by the Freshwater Biological Association at Windermere. The article covers the requirements of a profiling instrument, the design considerations, the electronic circuitry, the computer program, the operation of the computer software, the profiler in use and further developments to the design. A number of figures and images accompany the article.

Applications of a nuclear technique for depth-sensitive hydrogen analysis : trapped H in lunar samples and the hydration of terrestrial obsidian

The resonant nuclear reaction ¹⁹F(p,αy)¹⁶O has been used to perform depth-sensitive analyses for both fluorine and hydrogen in solid samples. The resonance at 0.83 MeV (center-of-mass) in this reaction has been applied to the measurement of the distribution of trapped solar protons in lunar samples to depths of ~1/2µm. These results are interpreted in terms of a redistribution of the implanted H which has been influenced by heavy radiation damage in the surface region. Fluorine determinations have been performed in a 1-µm surface layer on lunar and meteoritic samples using the same ¹⁹F(p,αy)¹⁶O resonance. The measurement of H depth distributions has also been used to study the hydration of terrestrial obsidian, a phenomenon of considerable archaeological interest as a means of dating obsidian artifacts. Additional applications of this type of technique are also discussed.

Aspects of the washout of salmonid eggs. 6. Information on gravel composition , redd sites, the dimensions of redds and the depth of egg burial

Sampling was concentrated on the North Moor region and the series of ditches which drained this area to the Bristol Channel. Although most ditches were not deep the mud substratum precluded sampling from within the habitat. All samples were taken with a pond net from the banks. Efforts were made to sample each part of the habitat although in some ditches the macrophyte growth was so intense as to make sampling difficult particularly of the sediments. Organisms were identified on the 10 sampling sites.

Advanced Monte Carlo Simulation and Machine Learning for Frequency Domain Optical Coherence Tomography

Optical Coherence Tomography(OCT) is a popular, rapidly growing imaging technique with an increasing number of bio-medical applications due to its noninvasive nature. However, there are three major challenges in understanding and improving an OCT system: (1) Obtaining an OCT image is not easy. It either takes a real medical experiment or requires days of computer simulation. Without much data, it is difficult to study the physical processes underlying OCT imaging of different objects simply because there aren't many imaged objects. (2) Interpretation of an OCT image is also hard. This challenge is more profound than it appears. For instance, it would require a trained expert to tell from an OCT image of human skin whether there is a lesion or not. This is expensive in its own right, but even the expert cannot be sure about the exact size of the lesion or the width of the various skin layers. The take-away message is that analyzing an OCT image even from a high level would usually require a trained expert, and pixel-level interpretation is simply unrealistic. The reason is simple: we have OCT images but not their underlying ground-truth structure, so there is nothing to learn from. (3) The imaging depth of OCT is very limited (millimeter or sub-millimeter on human tissues). While OCT utilizes infrared light for illumination to stay noninvasive, the downside of this is that photons at such long wavelengths can only penetrate a limited depth into the tissue before getting back-scattered. To image a particular region of a tissue, photons first need to reach that region. As a result, OCT signals from deeper regions of the tissue are both weak (since few photons reached there) and distorted (due to multiple scatterings of the contributing photons). This fact alone makes OCT images very hard to interpret.

This thesis addresses the above challenges by successfully developing an advanced Monte Carlo simulation platform which is 10000 times faster than the state-of-the-art simulator in the literature, bringing down the simulation time from 360 hours to a single minute. This powerful simulation tool not only enables us to efficiently generate as many OCT images of objects with arbitrary structure and shape as we want on a common desktop computer, but it also provides us the underlying ground-truth of the simulated images at the same time because we dictate them at the beginning of the simulation. This is one of the key contributions of this thesis. What allows us to build such a powerful simulation tool includes a thorough understanding of the signal formation process, clever implementation of the importance sampling/photon splitting procedure, efficient use of a voxel-based mesh system in determining photon-mesh interception, and a parallel computation of different A-scans that consist a full OCT image, among other programming and mathematical tricks, which will be explained in detail later in the thesis.

Next we aim at the inverse problem: given an OCT image, predict/reconstruct its ground-truth structure on a pixel level. By solving this problem we would be able to interpret an OCT image completely and precisely without the help from a trained expert. It turns out that we can do much better. For simple structures we are able to reconstruct the ground-truth of an OCT image more than 98% correctly, and for more complicated structures (e.g., a multi-layered brain structure) we are looking at 93%. We achieved this through extensive uses of Machine Learning. The success of the Monte Carlo simulation already puts us in a great position by providing us with a great deal of data (effectively unlimited), in the form of (image, truth) pairs. Through a transformation of the high-dimensional response variable, we convert the learning task into a multi-output multi-class classification problem and a multi-output regression problem. We then build a hierarchy architecture of machine learning models (committee of experts) and train different parts of the architecture with specifically designed data sets. In prediction, an unseen OCT image first goes through a classification model to determine its structure (e.g., the number and the types of layers present in the image); then the image is handed to a regression model that is trained specifically for that particular structure to predict the length of the different layers and by doing so reconstruct the ground-truth of the image. We also demonstrate that ideas from Deep Learning can be useful to further improve the performance.

It is worth pointing out that solving the inverse problem automatically improves the imaging depth, since previously the lower half of an OCT image (i.e., greater depth) can be hardly seen but now becomes fully resolved. Interestingly, although OCT signals consisting the lower half of the image are weak, messy, and uninterpretable to human eyes, they still carry enough information which when fed into a well-trained machine learning model spits out precisely the true structure of the object being imaged. This is just another case where Artificial Intelligence (AI) outperforms human. To the best knowledge of the author, this thesis is not only a success but also the first attempt to reconstruct an OCT image at a pixel level. To even give a try on this kind of task, it would require fully annotated OCT images and a lot of them (hundreds or even thousands). This is clearly impossible without a powerful simulation tool like the one developed in this thesis.

Delivery of Targeted Nanoparticles Across the Blood-Brain Barrier Using a Detachable Targeting Ligand

Chronic diseases of the central nervous system are poorly treated due to the inability of most therapeutics to cross the blood-brain barrier. The blood-brain barrier is an anatomical and physiological barrier that severely restricts solute influx, including most drugs, from the blood to the brain. One promising method to overcome this obstacle is to use endogenous solute influx systems at the blood-brain barrier to transport drugs. Therapeutics designed to enter the brain through transcytosis by binding the transferrin receptor, however, are restricted within endothelial cells. The focus of this work was to develop a method to increase uptake of transferrin-containing nanoparticles into the brain by overcoming these restrictive processes.

To accomplish this goal, nanoparticles were prepared with surface transferrin molecules bound through various liable chemical bonds. These nanoparticles were designed to shed the targeting molecule during transcytosis to allow increased accumulation of nanoparticles within the brain.

Transferrin was added to the surface of nanoparticles through either redox or pH sensitive chemistry. First, nanoparticles with transferrin bound through disulfide bonds were prepared. These nanoparticles showed decreased avidity for the transferrin receptor after exposure to reducing agents and increased ability to enter the brain in vivo compared to those lacking the disulfide link.

Next, transferrin was attached through a chemical bond that cleaves at mildly acidic pH. Nanoparticles containing a cleavable link between transferrin and gold nanoparticle cores were found to both cross an in vitro model of the blood-brain barrier and accumulate within the brain in significantly higher numbers than similar nanoparticles lacking the cleavable bond. Also, this increased accumulation was not seen when using this same strategy with an antibody to transferrin receptor, indicating that behavior of nanoparticles at the blood-brain barrier varies depending on what type of targeting ligand is used.

Finally, polymeric nanoparticles loaded with dopamine and utilizing a superior acid-cleavable targeting chemistry were investigated as a potential treatment for Parkinson’s disease. These nanoparticles were capable of increasing dopamine quantities in the brains of healthy mice, highlighting the therapeutic potential of this design. Overall, this work describes a novel method to increase targeted nanoparticle accumulation in the brain.