Nested dictionary learning for hierarchical organization of imagery and text

A tree-based dictionary learning model is developed for joint analysis of imagery and associated text. The dictionary learning may be applied directly to the imagery from patches, or to general feature vectors extracted from patches or superpixels (using any existing method for image feature extraction). Each image is associated with a path through the tree (from root to a leaf), and each of the multiple patches in a given image is associated with one node in that path. Nodes near the tree root are shared between multiple paths, representing image characteristics that are common among different types of images. Moving toward the leaves, nodes become specialized, representing details in image classes. If available, words (text) are also jointly modeled, with a path-dependent probability over words. The tree structure is inferred via a nested Dirichlet process, and a retrospective stick-breaking sampler is used to infer the tree depth and width.

Imagery and retrieval of auditory and visual information: neural correlates of successful and unsuccessful performance.

Remembering past events - or episodic retrieval - consists of several components. There is evidence that mental imagery plays an important role in retrieval and that the brain regions supporting imagery overlap with those supporting retrieval. An open issue is to what extent these regions support successful vs. unsuccessful imagery and retrieval processes. Previous studies that examined regional overlap between imagery and retrieval used uncontrolled memory conditions, such as autobiographical memory tasks, that cannot distinguish between successful and unsuccessful retrieval. A second issue is that fMRI studies that compared imagery and retrieval have used modality-aspecific cues that are likely to activate auditory and visual processing regions simultaneously. Thus, it is not clear to what extent identified brain regions support modality-specific or modality-independent imagery and retrieval processes. In the current fMRI study, we addressed this issue by comparing imagery to retrieval under controlled memory conditions in both auditory and visual modalities. We also obtained subjective measures of imagery quality allowing us to dissociate regions contributing to successful vs. unsuccessful imagery. Results indicated that auditory and visual regions contribute both to imagery and retrieval in a modality-specific fashion. In addition, we identified four sets of brain regions with distinct patterns of activity that contributed to imagery and retrieval in a modality-independent fashion. The first set of regions, including hippocampus, posterior cingulate cortex, medial prefrontal cortex and angular gyrus, showed a pattern common to imagery/retrieval and consistent with successful performance regardless of task. The second set of regions, including dorsal precuneus, anterior cingulate and dorsolateral prefrontal cortex, also showed a pattern common to imagery and retrieval, but consistent with unsuccessful performance during both tasks. Third, left ventrolateral prefrontal cortex showed an interaction between task and performance and was associated with successful imagery but unsuccessful retrieval. Finally, the fourth set of regions, including ventral precuneus, midcingulate cortex and supramarginal gyrus, showed the opposite interaction, supporting unsuccessful imagery, but successful retrieval performance. Results are discussed in relation to reconstructive, attentional, semantic memory, and working memory processes. This is the first study to separate the neural correlates of successful and unsuccessful performance for both imagery and retrieval and for both auditory and visual modalities.

Spatial imagery preserves temporal order.

Line drawings were presented in either a spatial or a nonspatial format. Subjects recalled each of four sets of 24 items in serial order. Amount recalled in the correct serial order and sequencing errors were scored. In Experiment 1 items appeared either in consecutive locations of a matrix or in one central location. Subjects who saw the items in different locations made fewer sequencing errors than those who saw each item in a central location, but serial recall levels for these two conditions did not differ. When items appeared in nonconsecutive locations in Experiment 2, the advantage of the spatial presentation on sequencing errors disappeared. Experiment 3 included conditions in which both the consecutive and nonconsecutive spatial formats were paired with retrieval cues that either did or did not indicate the sequence of locations in which the items had appeared. Spatial imagery aided sequencing when, and only when, the order of locations in which the stimuli appeared could be reconstructed at retrieval.

The Toronto Word Pool: Norms for imagery, concreteness, orthographic variables, and grammatical usage for 1,080 words

Imagery and concreteness norms and percentage noun usage were obtained on the 1,080 verbal items from the Toronto Word Pool. Imagery was defined as the rated ease with which a word aroused a mental image, and concreteness was defined in relation to level of abstraction. The degree to which a word was functionally a noun was estimated in a sentence generation task. The mean and standard deviation of the imagery and concreteness ratings for each item are reported together with letter and printed frequency counts for the words and indications of sex differences in the ratings. Additional data in the norms include a grammatical function code derived from dictionary definitions, a percent noun judgment, indexes of statistical approximation to English, and an orthographic neighbor ratio. Validity estimates for the imagery and concreteness ratings are derived from comparisons with scale values drawn from the Paivio, Yuille, and Madigan (1968) noun pool and the Toglia and Battig (1978) norms. © 1982 Psychonomic Society, Inc.

Visual imagery in autobiographical memory: The role of repeated retrieval in shifting perspective.

Recent memories are generally recalled from a first-person perspective whereas older memories are often recalled from a third-person perspective. We investigated how repeated retrieval affects the availability of visual information, and whether it could explain the observed shift in perspective with time. In Experiment 1, participants performed mini-events and nominated memories of recent autobiographical events in response to cue words. Next, they described their memory for each event and rated its phenomenological characteristics. Over the following three weeks, they repeatedly retrieved half of the mini-event and cue-word memories. No instructions were given about how to retrieve the memories. In Experiment 2, participants were asked to adopt either a first- or third-person perspective during retrieval. One month later, participants retrieved all of the memories and again provided phenomenology ratings. When first-person visual details from the event were repeatedly retrieved, this information was retained better and the shift in perspective was slowed.

Trace gas measurements from infrared satellite for chemistry and climate applications

Space-borne thermal infrared instruments working in the nadir geometry are providing spectroscopic measurements of species that impact on the chemical composition of the atmosphere and on the climate forcing: H2O, CO2, N2O, CH4, CFCs, O3, and CO. The atmospheric abundances obtained from the analysis of IMG/ADEOS measurements are discussed in order to demonstrate the potential scientific return to be expected from future missions using advanced infrared nadir sounders. Some strengths and limitations of passive infrared remote sensing from space are illustrated. © 2003 European Geosciences Union.

Determining the irrigated area under center - pivots systems in the southewestern of Buenos Aires Province (Argentina) employing satellite images

p.109-119

Eating secret [at Whitstable Biennale Satellite]

Research around ingesting /public perceptions of ‘secret’ and exploring other narratives around our perceptions of food and eating.

Epipelagic mesozooplankton distribution and abundance over the Mascarene Plateau and Basin, south-western Indian Ocean

The crescent shaped Mascarene Plateau (southwestern Indian Ocean), some 2200 km in length, forms a partial barrier to the (predominantly westward) flow of the South Equatorial Current. Shallow areas of the Mascarene Plateau effectively form a large shelf sea without an associated coastline. Zooplankton sampling transects were made across the plateau and also the basin to the west, to investigate the role the partial interruption of flow has on zooplankton biomass and community structure over the region. Biomass data from Optical Plankton Counter (OPC) analysis, and variability in community structure from taxonomic analysis, appear to indicate that the obstruction by the plateau causes upwelling, nutrient enrichment and enhanced chlorophyll and secondary production levels downstream. The Mascarene Basin is clearly distinguishable from the ridge itself, and from the waters to the south and north, both in terms of size-distributed zooplankton biomass and community structure. Satellite remote sensing data, particularly remotely-sensed ocean colour imagery and the sea surface height anomaly (SSHA), indicate support for this hypothesis. A correlation was found between OPC biovolume and SSHA and sea surface temperature (SST), which may indicate the physical processes driving mesozooplankton variability in this area. Biomass values away from the influence of the ridge averaged 24 mg m-3, but downstream if the ridge biomass averaged 263 mg m-3. Copepods comprised 60% of the mean total organisms. Calanoid copepods varied considerably between regions, being lowest away from the influence of the plateau, where higher numbers of the cyclopoid copepods Oithona spp., Corycaeus spp. and Oncaea spp., and the harpacticoid Microsetella spp. were found.

Relating sardine recruitment in the Northern Benguela to satellite-derived sea surface height using a neural network pattern recognition approach

Processes of enrichment, concentration and retention are thought to be important for the successful recruitment of small pelagic fish in upwelling areas, but are difficult to measure. In this study, a novel approach is used to examine the role of spatio-temporal oceanographic variability on recruitment success of the Northern Benguela sardine Sardinops sagax. This approach applies a neural network pattern recognition technique, called a self-organising map (SOM), to a seven-year time series of satellite-derived sea level data. The Northern Benguela is characterised by quasi-perennial upwelling of cold, nutrient-rich water and is influenced by intrusions of warm, nutrient-poor Angola Current water from the north. In this paper, these processes are categorised in terms of their influence on recruitment success through the key ocean triad mechanisms of enrichment, concentration and retention. Moderate upwelling is seen as favourable for recruitment, whereas strong upwelling, weak upwelling and Angola Current intrusion appear detrimental to recruitment success. The SOM was used to identify characteristic patterns from sea level difference data and these were interpreted with the aid of sea surface temperature data. We found that the major oceanographic processes of upwelling and Angola Current intrusion dominated these patterns, allowing them to be partitioned into those representing recruitment favourable conditions and those representing adverse conditions for recruitment. A marginally significant relationship was found between the index of sardine recruitment and the frequency of recruitment favourable conditions (r super(2) = 0.61, p = 0.068, n = 6). Because larvae are vulnerable to environmental influences for a period of at least 50 days after spawning, the SOM was then used to identify windows of persistent favourable conditions lasting longer than 50 days, termed recruitment favourable periods (RFPs). The occurrence of RFPs was compared with back-calculated spawning dates for each cohort. Finally, a comparison of RFPs with the time of spawning and the index of recruitment showed that in years where there were 50 or more days of favourable conditions following spawning, good recruitment followed (Mann-Whitney U-test: p = 0.064, n = 6). These results show the value of the SOM technique for describing spatio-temporal variability in oceanographic processes. Variability in these processes appears to be an important factor influencing recruitment in the Northern Benguela sardine, although the available data time series is currently too short to be conclusive. Nonetheless, the analysis of satellite data, using a neural network pattern-recognition approach, provides a useful framework for investigating fisheries recruitment problems.

Use of satellite data for modelling food availability and survival of marine fish larvae

A modelling scheme is described which uses satellite retrieved sea-surface temperature and chlorophyll-a to derive monthly zooplankton biomass estimates in the eastern North Atlantic; this forms part of a bio-physical model of inter-annual variations in the growth and survival of larvae and post-larvae of mackerel (Scomber scombrus). The temperature and chlorophyll data are incorporated first to model copepod (Calanus) egg production rates. Egg production is then converted to available food using distribution data from the Continuous Plankton Recorder (CPR) Survey, observed population biomass per unit daily egg production and the proportion of the larval mackerel diet comprising Calanus. Results are validated in comparison with field observations of zooplankton biomass. The principal benefit of the modelling scheme is the ability to use the combination of broad scale coverage and fine scale temporal and spatial variability of satellite data as driving forces in the model; weaknesses are the simplicity of the egg production model and the broad-scale generalizations assumed in the raising factors to convert egg production to biomass.

Position and structure of the subtropical/Azores front region from combined Lagrangian and remote sensing (IR/altimeter/SeaWIFS) measurements

The position and structure of the North Atlantic Subtropical Front is studied using Lagrangian flow tracks and remote sensing (AVHRR imagery: TOPEX/POSEIDON altimetry: SeaWiFS) in a broad region ( similar to 31 degree to similar to 36 degree N) of marked gradient of dynamic height (Azores Current) that extends from the Mid-Atlantic Ridge (MAR), near similar to 40 degree W, to the Eastern Boundary ( similar to 10 degree W). Drogued Argos buoy and ALACE tracks are superposed on infrared satellite images in the Subtropical Front region. Cold (cyclonic) structures, called storms, and warm (anticyclonic) structures of 100-300 km in size can be found on the south side of the Subtropical Front outcrop, which has a temperature contrast of about 1 degree C that can be followed for similar to 2500 km near 35 degree N. Warmer water adjacent to the outcrop is flowing eastward (Azores Current) but some warm water is returned westward about 300 km to the south (southern Counterflow). Estimates of horizontal diffusion in a Storm (D=2.2t10 super(2) m super(2) s super(-1)) and in the Subtropical Front region near 200 m depth (D sub(x)=1.3t10 super(4) m super(2) s super(-1), D sub(y)=2.6t10 super(3) m super(2) s super(-1)) are made from the Lagrangian tracks. Altimeter and in situ measurements show that Storms track westwards. Storms are separated by about 510 km and move westward at 2.7 km d super(-1). Remote sensing reveals that some initial structures start evolving as far east as 23 degree W but are more organized near 29 degree W and therefore Storms are about 1 year old when they reach the MAR (having travelled a distance of 1000 km). Structure and seasonality in SeaWiFS data in the region is examined.