Place recognition with ConvNet landmarks: Viewpoint-robust, condition-robust, training-free

Place recognition has long been an incompletely solved problem in that all approaches involve significant compromises. Current methods address many but never all of the critical challenges of place recognition – viewpoint-invariance, condition-invariance and minimizing training requirements. Here we present an approach that adapts state-of-the-art object proposal techniques to identify potential landmarks within an image for place recognition. We use the astonishing power of convolutional neural network features to identify matching landmark proposals between images to perform place recognition over extreme appearance and viewpoint variations. Our system does not require any form of training, all components are generic enough to be used off-the-shelf. We present a range of challenging experiments in varied viewpoint and environmental conditions. We demonstrate superior performance to current state-of-the- art techniques. Furthermore, by building on existing and widely used recognition frameworks, this approach provides a highly compatible place recognition system with the potential for easy integration of other techniques such as object detection and semantic scene interpretation.

A lagrangian formulation for statistical fluid registration

We defined a new statistical fluid registration method with Lagrangian mechanics. Although several authors have suggested that empirical statistics on brain variation should be incorporated into the registration problem, few algorithms have included this information and instead use regularizers that guarantee diffeomorphic mappings. Here we combine the advantages of a large-deformation fluid matching approach with empirical statistics on population variability in anatomy. We reformulated the Riemannian fluid algorithmdeveloped in [4], and used a Lagrangian framework to incorporate 0 th and 1st order statistics in the regularization process. 92 2D midline corpus callosum traces from a twin MRI database were fluidly registered using the non-statistical version of the algorithm (algorithm 0), giving initial vector fields and deformation tensors. Covariance matrices were computed for both distributions and incorporated either separately (algorithm 1 and algorithm 2) or together (algorithm 3) in the registration. We computed heritability maps and two vector and tensorbased distances to compare the power and the robustness of the algorithms.

Heritability of white matter fiber tract shapes: A HARDI study of 198 twins

Genetic analysis of diffusion tensor images (DTI) shows great promise in revealing specific genetic variants that affect brain integrity and connectivity. Most genetic studies of DTI analyze voxel-based diffusivity indices in the image space (such as 3D maps of fractional anisotropy) and overlook tract geometry. Here we propose an automated workflow to cluster fibers using a white matter probabilistic atlas and perform genetic analysis on the shape characteristics of fiber tracts. We apply our approach to large study of 4-Tesla high angular resolution diffusion imaging (HARDI) data from 198 healthy, young adult twins (age: 20-30). Illustrative results show heritability for the shapes of several major tracts, as color-coded maps.

A new combined surface and volume registration

3D registration of brain MRI data is vital for many medical imaging applications. However, purely intensitybased approaches for inter-subject matching of brain structure are generally inaccurate in cortical regions, due to the highly complex network of sulci and gyri, which vary widely across subjects. Here we combine a surfacebased cortical registration with a 3D fluid one for the first time, enabling precise matching of cortical folds, but allowing large deformations in the enclosed brain volume, which guarantee diffeomorphisms. This greatly improves the matching of anatomy in cortical areas. The cortices are segmented and registered with the software Freesurfer. The deformation field is initially extended to the full 3D brain volume using a 3D harmonic mapping that preserves the matching between cortical surfaces. Finally, these deformation fields are used to initialize a 3D Riemannian fluid registration algorithm, that improves the alignment of subcortical brain regions. We validate this method on an MRI dataset from 92 healthy adult twins. Results are compared to those based on volumetric registration without surface constraints; the resulting mean templates resolve consistent anatomical features both subcortically and at the cortex, suggesting that the approach is well-suited for cross-subject integration of functional and anatomic data.

Automatic clustering and population analysis of white matter tracts using maximum density paths

We introduce a framework for population analysis of white matter tracts based on diffusion-weighted images of the brain. The framework enables extraction of fibers from high angular resolution diffusion images (HARDI); clustering of the fibers based partly on prior knowledge from an atlas; representation of the fiber bundles compactly using a path following points of highest density (maximum density path; MDP); and registration of these paths together using geodesic curve matching to find local correspondences across a population. We demonstrate our method on 4-Tesla HARDI scans from 565 young adults to compute localized statistics across 50 white matter tracts based on fractional anisotropy (FA). Experimental results show increased sensitivity in the determination of genetic influences on principal fiber tracts compared to the tract-based spatial statistics (TBSS) method. Our results show that the MDP representation reveals important parts of the white matter structure and considerably reduces the dimensionality over comparable fiber matching approaches.

Dynamics of gray matter loss in Alzheimer's disease

We detected and mapped a dynamically spreading wave of gray matter loss in the brains of patients with Alzheimer's disease (AD). The loss pattern was visualized in four dimensions as it spread over time from temporal and limbic cortices into frontal and occipital brain regions, sparing sensorimotor cortices. The shifting deficits were asymmetric (left hemisphere > right hemisphere) and correlated with progressively declining cognitive status (p < 0.0006). Novel brain mapping methods allowed us to visualize dynamic patterns of atrophy in 52 high-resolution magnetic resonance image scans of 12 patients with AD (age 68.4 ± 1.9 years) and 14 elderly matched controls (age 71.4 ± 0.9 years) scanned longitudinally (two scans; interscan interval 2.1 ± 0.4 years). A cortical pattern matching technique encoded changes in brain shape and tissue distribution across subjects and time. Cortical atrophy occurred in a well defined sequence as the disease progressed, mirroring the sequence of neurofibrillary tangle accumulation observed in cross sections at autopsy. Advancing deficits were visualized as dynamic maps that change over time. Frontal regions, spared early in the disease, showed pervasive deficits later (< 15% loss). The maps distinguished different phases of AD and differentiated AD from normal aging. Local gray matter loss rates (5.3 ± 2.3% per year in AD v 0.9 ± 0.9% per year in controls) were faster in the left hemisphere (p < 0.029) than the right. Transient barriers to disease progression appeared at limbic/frontal boundaries. This degenerative sequence, observed in vivo as it developed, provides the first quantitative, dynamic visualization of cortical atrophic rates in normal elderly populations and in those with dementia.

Mapping cortical change in Alzheimer's disease, brain development, and schizophrenia

This paper describes algorithms that can identify patterns of brain structure and function associated with Alzheimer's disease, schizophrenia, normal aging, and abnormal brain development based on imaging data collected in large human populations. Extraordinary information can be discovered with these techniques: dynamic brain maps reveal how the brain grows in childhood, how it changes in disease, and how it responds to medication. Genetic brain maps can reveal genetic influences on brain structure, shedding light on the nature-nurture debate, and the mechanisms underlying inherited neurobehavioral disorders. Recently, we created time-lapse movies of brain structure for a variety of diseases. These identify complex, shifting patterns of brain structural deficits, revealing where, and at what rate, the path of brain deterioration in illness deviates from normal. Statistical criteria can then identify situations in which these changes are abnormally accelerated, or when medication or other interventions slow them. In this paper, we focus on describing our approaches to map structural changes in the cortex. These methods have already been used to reveal the profile of brain anomalies in studies of dementia, epilepsy, depression, childhood- and adult-onset schizophrenia, bipolar disorder, attention-deficit/hyperactivity disorder, fetal alcohol syndrome, Tourette syndrome, Williams syndrome, and in methamphetamine abusers. Specifically, we describe an image analysis pipeline known as cortical pattern matching that helps compare and pool cortical data over time and across subjects. Statistics are then defined to identify brain structural differences between groups, including localized alterations in cortical thickness, gray matter density (GMD), and asymmetries in cortical organization. Subtle features, not seen in individual brain scans, often emerge when population-based brain data are averaged in this way. Illustrative examples are presented to show the profound effects of development and various diseases on the human cortex. Dynamically spreading waves of gray matter loss are tracked in dementia and schizophrenia, and these sequences are related to normally occurring changes in healthy subjects of various ages.

In search of good probability assessors: An experimental comparison of elicitation rules for confidence judgments

In this paper, we use an experimental design to compare the performance of elicitation rules for subjective beliefs. Contrary to previous works in which elicited beliefs are compared to an objective benchmark, we consider a purely subjective belief framework (confidence in one’s own performance in a cognitive task and a perceptual task). The performance of different elicitation rules is assessed according to the accuracy of stated beliefs in predicting success. We measure this accuracy using two main factors: calibration and discrimination. For each of them, we propose two statistical indexes and we compare the rules’ performances for each measurement. The matching probability method provides more accurate beliefs in terms of discrimination, while the quadratic scoring rule reduces overconfidence and the free rule, a simple rule with no incentives, which succeeds in eliciting accurate beliefs. Nevertheless, the matching probability appears to be the best mechanism for eliciting beliefs due to its performances in terms of calibration and discrimination, but also its ability to elicit consistent beliefs across measures and across tasks, as well as its empirical and theoretical properties.

Incorporating visual information for spoken term detection

Spoken term detection (STD) is the task of looking up a spoken term in a large volume of speech segments. In order to provide fast search, speech segments are first indexed into an intermediate representation using speech recognition engines which provide multiple hypotheses for each speech segment. Approximate matching techniques are usually applied at the search stage to compensate the poor performance of automatic speech recognition engines during indexing. Recently, using visual information in addition to audio information has been shown to improve phone recognition performance, particularly in noisy environments. In this paper, we will make use of visual information in the form of lip movements of the speaker in indexing stage and will investigate its effect on STD performance. Particularly, we will investigate if gains in phone recognition accuracy will carry through the approximate matching stage to provide similar gains in the final audio-visual STD system over a traditional audio only approach. We will also investigate the effect of using visual information on STD performance in different noise environments.

Conjoint use of Dibenzosilole and Indan-1,3-dione Functionalities to Prepare an Efficient Non-Fullerene Acceptor for Solution-Processable Bulk-Heterojunction Solar Cells

A solution-processable, non-fullerene electron acceptor, 2,2′-(((5,5-dioctyl-5 H-dibenzo[b,d]silole-3,7-diyl)bis(thiophene-5,2-diyl))bis(methanylylidene))bis(1 H-indene-1,3(2 H)-dione) (called N5) comprised of dibenzosilole and 1,3-indanedione building blocks was designed, synthesized, and fully characterized. N5 is highly soluble in various organic solvents, has high thermal stability, and has energy levels matching those of archetypal donor poly(3-hexylthiophene). Solution-processable, bulk-heterojunction solar cells afforded promising power conversion efficiency of 2.76 % when N5 was used as a non-fullerene electron acceptor along with the conventional donor polymer poly(3-hexylthiophene). As per our knowledge, the material reported herein is the first example in the literature where synchronous use of such building blocks is demonstrated in the design an efficient, non-fullerene acceptor.

Crowning of dibenzosilole with a naphthalenediimide functional group to prepare an electron acceptor for organic solar cells

A novel, solution-processable non-fullerene electron acceptor 9,9′-(5,5-dioctyl-5H-dibenzo [b,d]silole-3,7-diyl)bis(2,7-dioctyl-4-(octylamino)benzo[lmn][3,8]phenanthroline-1,3,6,8(2H,7H)-tetraone) (B3) based on dibenzosilole and naphthalenediimide building blocks was designed, synthesized, characterized and successfully used in a bulk-heterojunction organic solar cell. B3 displayed excellent solubility, thermal stability and acquired electron energy levels matching with those of archetypal donor polymer poly(3-hexylthiophene). Solution-processable bulk-heterojunction devices afforded 1.16% power conversion efficiency with a high fill factor of 53%. B3 is the first example in the literature using this design principle, where mild donor units at the peripheries of end-capped naphthalenediimide units tune solubility and optical energy levels simultaneously.

A genome-wide screen for susceptibility loci in ankylosing spondylitis

Objective. To localize the regions containing genes that determine susceptibility to ankylosing spondylitis (AS). Methods. One hundred five white British families with 121 affected sibling pairs with AS were recruited, largely from the Royal National Hospital for Rheumatic Diseases AS database. A genome-wide linkage screen was undertaken using 254 highly polymorphic microsatellite markers from the Medical Research Council (UK) (MRC) set. The major histocompatibility complex (MHC) region was studied more intensively using 5 microsatellites lying within the HLA class III region and HLA-DRB1 typing. The Analyze package was used for 2-point analysis, and GeneHunter for multipoint analysis. Results. When only the MRC set was considered, 11 markers in 7 regions achieved a P value of ≤0.01. The maximum logarithm of odds score obtained was 3.8 (P = 1.4 x 10-5) using marker D6S273, which lies in the HLA class III region. A further marker used in mapping of the MHC class III region achieved a LOD score of 8.1 (P = 1 x 10-9). Nine of 118 affected sibling pairs (7.6%) did not share parental haplotypes identical by descent across the MHC, suggesting that only 31% of the susceptibility to AS is coded by genes linked to the MHC. The maximum non-MHC LOD score obtained was 2.6 (P = 0.0003) for marker D16S422. Conclusion. The results of this study confirm the strong linkage of the MHC with AS, and provide suggestive evidence regarding the presence and location of non-MHC genes influencing susceptibility to the disease.

A comprehensive ovine model of blood transfusion

Background The growing awareness of transfusion-associated morbidity and mortality necessitates investigations into the underlying mechanisms. Small animals have been the dominant transfusion model but have associated limitations. This study aimed to develop a comprehensive large animal (ovine) model of transfusion encompassing: blood collection, processing and storage, compatibility testing right through to post-transfusion outcomes. Materials and methods Two units of blood were collected from each of 12 adult male Merino sheep and processed into 24 ovine-packed red blood cell (PRBC) units. Baseline haematological parameters of ovine blood and PRBC cells were analysed. Biochemical changes in ovine PRBCs were characterized during the 42-day storage period. Immunological compatibility of the blood was confirmed with sera from potential recipient sheep, using a saline and albumin agglutination cross-match. Following confirmation of compatibility, each recipient sheep (n = 12) was transfused with two units of ovine PRBC. Results Procedures for collecting, processing, cross-matching and transfusing ovine blood were established. Although ovine red blood cells are smaller and higher in number, their mean cell haemoglobin concentration is similar to human red blood cells. Ovine PRBC showed improved storage properties in saline–adenine–glucose–mannitol (SAG-M) compared with previous human PRBC studies. Seventy-six compatibility tests were performed and 17·1% were incompatible. Only cross-match compatible ovine PRBC were transfused and no adverse reactions were observed. Conclusion These findings demonstrate the utility of the ovine model for future blood transfusion studies and highlight the importance of compatibility testing in animal models involving homologous transfusions.

Frequency response function based damage identification using principal component analysis and pattern recognition technique

Pattern recognition is a promising approach for the identification of structural damage using measured dynamic data. Much of the research on pattern recognition has employed artificial neural networks (ANNs) and genetic algorithms as systematic ways of matching pattern features. The selection of a damage-sensitive and noise-insensitive pattern feature is important for all structural damage identification methods. Accordingly, a neural networks-based damage detection method using frequency response function (FRF) data is presented in this paper. This method can effectively consider uncertainties of measured data from which training patterns are generated. The proposed method reduces the dimension of the initial FRF data and transforms it into new damage indices and employs an ANN method for the actual damage localization and quantification using recognized damage patterns from the algorithm. In civil engineering applications, the measurement of dynamic response under field conditions always contains noise components from environmental factors. In order to evaluate the performance of the proposed strategy with noise polluted data, noise contaminated measurements are also introduced to the proposed algorithm. ANNs with optimal architecture give minimum training and testing errors and provide precise damage detection results. In order to maximize damage detection results, the optimal architecture of ANN is identified by defining the number of hidden layers and the number of neurons per hidden layer by a trial and error method. In real testing, the number of measurement points and the measurement locations to obtain the structure response are critical for damage detection. Therefore, optimal sensor placement to improve damage identification is also investigated herein. A finite element model of a two storey framed structure is used to train the neural network. It shows accurate performance and gives low error with simulated and noise-contaminated data for single and multiple damage cases. As a result, the proposed method can be used for structural health monitoring and damage detection, particularly for cases where the measurement data is very large. Furthermore, it is suggested that an optimal ANN architecture can detect damage occurrence with good accuracy and can provide damage quantification with reasonable accuracy under varying levels of damage.

Utility of temporal artery biopsy samples for genome-wide analysis of giant cell arteritis

Giant Cell Arteritis (GCA) is the most common vasculitis affecting the elderly. Archived formalin-fixed paraffin-embedded (FFPE) temporal artery biopsy (TAB) specimens potentially represent a valuable resource for large-scale genetic analysis of this disease. FFPE TAB samples were obtained from 12 patients with GCA. Extracted TAB DNA was assessed by real time PCR before restoration using the Illumina HD FFPE Restore Kit. Paired FFPE-blood samples were genotyped on the Illumina OmniExpress FFPE microarray. The FFPE samples that passed stringent quality control measures had a mean genotyping success of >97%. When compared with their matching peripheral blood DNA, the mean discordant heterozygote and homozygote single nucleotide polymorphisms calls were 0.0028 and 0.0003, respectively, which is within the accepted tolerance of reproducibility. This work demonstrates that it is possible to successfully obtain high-quality microarray-based genotypes FFPE TAB samples and that this data is similar to that obtained from peripheral blood.