Deep learning for computer vision: a comparison between convolutional neural networks and hierarchical temporal memories on object recognition tasks

In recent years, Deep Learning techniques have shown to perform well on a large variety of problems both in Computer Vision and Natural Language Processing, reaching and often surpassing the state of the art on many tasks. The rise of deep learning is also revolutionizing the entire field of Machine Learning and Pattern Recognition pushing forward the concepts of automatic feature extraction and unsupervised learning in general. However, despite the strong success both in science and business, deep learning has its own limitations. It is often questioned if such techniques are only some kind of brute-force statistical approaches and if they can only work in the context of High Performance Computing with tons of data. Another important question is whether they are really biologically inspired, as claimed in certain cases, and if they can scale well in terms of "intelligence". The dissertation is focused on trying to answer these key questions in the context of Computer Vision and, in particular, Object Recognition, a task that has been heavily revolutionized by recent advances in the field. Practically speaking, these answers are based on an exhaustive comparison between two, very different, deep learning techniques on the aforementioned task: Convolutional Neural Network (CNN) and Hierarchical Temporal memory (HTM). They stand for two different approaches and points of view within the big hat of deep learning and are the best choices to understand and point out strengths and weaknesses of each of them. CNN is considered one of the most classic and powerful supervised methods used today in machine learning and pattern recognition, especially in object recognition. CNNs are well received and accepted by the scientific community and are already deployed in large corporation like Google and Facebook for solving face recognition and image auto-tagging problems. HTM, on the other hand, is known as a new emerging paradigm and a new meanly-unsupervised method, that is more biologically inspired. It tries to gain more insights from the computational neuroscience community in order to incorporate concepts like time, context and attention during the learning process which are typical of the human brain. In the end, the thesis is supposed to prove that in certain cases, with a lower quantity of data, HTM can outperform CNN.

Neuronal Correlates of Perception, Imagery, and Memory for Familiar Tunes

We used fMRI to investigate the neuronal correlates of encoding and recognizing heard and imagined melodies. Ten participants were shown lyrics of familiar verbal tunes; they either heard the tune along with the lyrics, or they had to imagine it. In a subsequent surprise recognition test, they had to identify the titles of tunes that they had heard or imagined earlier. The functional data showed substantial overlap during melody perception and imagery, including secondary auditory areas. During imagery compared with perception, an extended network including pFC, SMA, intraparietal sulcus, and cerebellum showed increased activity, in line with the increased processing demands of imagery. Functional connectivity of anterior right temporal cortex with frontal areas was increased during imagery compared with perception, indicating that these areas form an imagery-related network. Activity in right superior temporal gyrus and pFC was correlated with the subjective rating of imagery vividness. Similar to the encoding phase, the recognition task recruited overlapping areas, including inferior frontal cortex associated with memory retrieval, as well as left middle temporal gyrus. The results present new evidence for the cortical network underlying goal-directed auditory imagery, with a prominent role of the right pFC both for the subjective impression of imagery vividness and for on-line mental monitoring of imagery-related activity in auditory areas.

Contextual Information and Memory for Unfamiliar Tunes in Older and Younger Adults

We examined age differences in the effectiveness of multiple repetitions and providing associative facts on tune memory. For both tune and fact recognition, three presentations were beneficial. Age was irrelevant in fact recognition, but older adults were less successful than younger in tune recognition. The associative fact did not affect young adults' performance. Among older people, the neutral association harmed performance; the emotional fact mitigated performance back to baseline. Young adults seemed to rely solely on procedural memory, or repetition, to learn tunes. Older adults benefitted by using emotional associative information to counteract memory burdens imposed by neutral associative information.

Melody recognition at fast and slow tempos: Effects of age, experience, and familiarity

Eighty-one listeners defined by three age ranges (18–30, 31–59, and over 60 years) and three levels of musical experience performed an immediate recognition task requiring the detection of alterations in melodies. On each trial, a brief melody was presented, followed 5 sec later by a test stimulus that either was identical to the target or had two pitches changed, for a same–different judgment. Each melody pair was presented at 0.6 note/sec, 3.0 notes/sec, or 6.0 notes/sec. Performance was better with familiar melodies than with unfamiliar melodies. Overall performance declined slightly with age and improved substantially with increasing experience, in agreement with earlier results in an identification task. Tempo affected performance on familiar tunes (moderate was best), but not on unfamiliar tunes. We discuss these results in terms of theories of dynamic attending, cognitive slowing, and working memory in aging.

Effects of timbre and tempo change on memory for music

We investigated the effects of different encoding tasks and of manipulations of two supposedly surface parameters of music on implicit and explicit memory for tunes. In two experiments, participants were first asked to either categorize instrument or judge familiarity of 40 unfamiliar short tunes. Subsequently, participants were asked to give explicit and implicit memory ratings for a list of 80 tunes, which included 40 previously heard. Half of the 40 previously heard tunes differed in timbre (Experiment 1) or tempo (Experiment 2) in comparison with the first exposure. A third experiment compared similarity ratings of the tunes that varied in timbre or tempo. Analysis of variance (ANOVA) results suggest first that the encoding task made no difference for either memory mode. Secondly, timbre and tempo change both impaired explicit memory, whereas tempo change additionally made implicit tune recognition worse. Results are discussed in the context of implicit memory for nonsemantic materials and the possible differences in timbre and tempo in musical representations.

Implicit Memory for Music in Alzheimer's Disease

Short, unfamiliar melodies were presented to young and older adults and to Alzheimer's disease (AD) patients in an implicit and an explicit memory task. The explicit task was yes–no recognition, and the implicit task was pleasantness ratings, in which memory was shown by higher ratings for old versus new melodies (the mere exposure effect). Young adults showed retention of the melodies in both tasks. Older adults showed little explicit memory but did show the mere exposure effect. The AD patients showed neither. The authors considered and rejected several artifactual reasons for this null effect in the context of the many studies that have shown implicit memory among AD patients. As the previous studies have almost always used the visual modality for presentation, they speculate that auditory presentation, especially of nonverbal material, may be compromised in AD because of neural degeneration in auditory areas in the temporal lobes.

Memory for the absolute pitch of familiar songs

Four experiments were conducted to examine the ability of people without "perfect pitch" to retain the absolute pitch offamiliar tunes. In Experiment 1, participants imagined given tunes, and then hummed their first notes four times either between or within sessions. The variability of these productions was very low. Experiment 2 used a recognition paradigm, with results similar to those in Experiment 1 for musicians, but with some additional variability shown for unselected subjects. In Experiment 3, subjects rated the suitability ofvarious pitches to start familiar tunes. Previously given preferred notes were rated high, as were notes three or four semitones distant from the preferred notes, but not notes one or two semitones distant. In Experiment 4, subjects mentally transformed the pitches of familiar tunes to the highest and lowest levels possible. These experiments suggest some retention of the absolute pitch of tunes despite a paucity of verbal or visual cues for the pitch.

Nimodipine prior to alcohol withdrawal prevents memory deficits during the abstinence phase

Effects of the dihydropyridine, nimodipine, an antagonist at L-type calcium channels, on the memory loss in rats caused by long term alcohol consumption were examined. Either a single dose of nimodipine or 2 weeks of repeated administration was given prior to withdrawal from 8 months of alcohol consumption. Memory was measured by the object recognition test and the T maze. Both nimodipine treatments prevented the memory deficits when these were measured between 1 and 2 months after alcohol withdrawal. At the end of the memory testing, 2 months after cessation of chronic alcohol consumption, glucocorticoid concentrations were increased in specific regions of rat brain without changes in plasma concentrations. Both nimodipine treatment schedules substantially reduced these rises in brain glucocorticoid. The data indicate that blockade of L-type calcium channels prior to alcohol withdrawal protects against the memory deficits caused by prolonged alcohol intake. This shows that specific drug treatments, such as nimodipine, given over the acute withdrawal phase, can prevented the neuronal changes responsible for subsequent adverse effects of long term consumption of alcohol. The results also suggest the possibility that regional brain glucocorticoid increases may be involved in the adverse effects of long term alcohol intake on memory. Such local changes in brain glucocorticoid levels would have major effects on neuronal function. The studies indicate that L-type calcium channels and brain glucocorticoid levels could form new targets for the treatment of cognitive deficits in alcoholics.

The Role of Consciousness in Memory

Conscious events interact with memory systems in learning, rehearsal and retrieval (Ebbinghaus 1885/1964; Tulving 1985). Here we present hypotheses that arise from the IDA computional model (Franklin, Kelemen and McCauley 1998; Franklin 2001b) of global workspace theory (Baars 1988, 2002). Our primary tool for this exploration is a flexible cognitive cycle employed by the IDA computational model and hypothesized to be a basic element of human cognitive processing. Since cognitive cycles are hypothesized to occur five to ten times a second and include interaction between conscious contents and several of the memory systems, they provide the means for an exceptionally fine-grained analysis of various cognitive tasks. We apply this tool to the small effect size of subliminal learning compared to supraliminal learning, to process dissociation, to implicit learning, to recognition vs. recall, and to the availability heuristic in recall. The IDA model elucidates the role of consciousness in the updating of perceptual memory, transient episodic memory, and procedural memory. In most cases, memory is hypothesized to interact with conscious events for its normal functioning. The methodology of the paper is unusual in that the hypotheses and explanations presented are derived from an empirically based, but broad and qualitative computational model of human cognition.

Sensory and conceptual representations in memory: Motor images which cannot be imaged

The paper argues for a distinction between sensory-and conceptual-information storage in the human information-processing system. Conceptual information is characterized as meaningful and symbolic, while sensory information may exist in modality-bound form. Furthermore, it is assumed that sensory information does not contribute to conscious remembering and can be used only in data-driven process reptitions, which can be accompanied by a kind of vague or intuitive feeling. Accordingly, pure top-down and willingly controlled processing, such as free recall, should not have any access to sensory data. Empirical results from different research areas and from two experiments conducted by the authors are presented in this article to support these theoretical distinctions. The experiments were designed to separate a sensory-motor and a conceptual component in memory for two-digit numbers and two-letter items, when parts of the numbers or items were imaged or drawn on a tablet. The results of free recall and recognition are discussed in a theoretical framework which distinguishes sensory and conceptual information in memory.

The effects of resistance training on well-being and memory in eldery volunteers

Objective: to determine the short- and long-term effects of resistance training on muscle strength, psychological well-being, control-beliefs, cognitive speed and memory in normally active elderly people. Methods: 46 elderly people (mean age 73.2 years; 18 women and 28 men), were randomly assigned to training and control groups (n = 23 each). Pre- and post-tests were administered 1 week before and 1 week after the 8-week training intervention. The training sessions, performed once a week, consisted of a 10 min warm-up phase and eight resistance exercises on machines. Results: there was a significant increase in maximum dynamic strength in the training group. This training effect was associated with a significant decrease in self-attentiveness, which is known to enhance psychological well-being. No significant changes could be observed in control-beliefs. Modest effects on cognitive functioning occurred with the training procedure: although there were no changes in cognitive speed, significant pre/post-changes could be shown in free recall and recognition in the experimental group. A post-test comparison between the experimental group and control group showed a weak effect for recognition but no significant differences in free recall. Significant long-term effects were found in the training group for muscular strength and memory performance (free recall) 1 year later. Conclusion: an 8-week programme of resistance training lessens anxiety and self-attentiveness and improves muscle strength.

Improving memory in elderly adults by instructing them in professional actors' learning strategies

This study examined a new type of cognitive intervention. For four weeks, participants (ages 65 to 82) were instructed in professional acting techniques, followed by rehearsal and performance of theatrical scenes. Although the training was not targeted in any way to the tasks used in pre- and post-testing, participants produced significantly higher recall and recognition scores after the intervention. It is suggested that the cognitive effort involved in analyzing and adopting theatrical characters' motivations (and then experiencing those characters' mental/emotional states during performance) is responsible for the observed improvement. A secondary strand of this study showed that participants who were given annotated scripts in which the implied goals of the characters were made explicit demonstrated significantly faster access to the stored material, as measured by a computer latency task.

Low reliability of perceptual priming: consequences for the interpretation of functional dissociations between explicit and implicit memory

In this study, three experiments are presented that investigate the reliability of memory measures. In Experiment 1, the well-known dissociation between explicit (recall, recognition) and implicit memory (picture clarification) as a function of age in a sample of 335 persons aged between 65 and 95 was replicated. Test-retest reliability was significantly lower in implicit than in explicit measures. In Experiment 2, parallel-test reliabilities in a student sample confirmed the finding of Experiment 1. In Experiment 3, the reliability of cued recall and word stem completion was investigated. There were significant priming effects and a dissociation between explicit and implicit memory as a function of levels of processing. However, the reliability of implicit memory measures was again substantially lower than in explicit tests in all test conditions. As a consequence, differential reliabilities of direct and indirect memory tests should be considered as a possible determinant of dissociations between explicit and implicit memory as a function of experimental or quasi-experimental manipulations.

Disturbed cortico–amygdalar functional connectivity as pathophysiological correlate of working memory deficits in bipolar affective disorder

Patients suffering from bipolar affective disorder show deficits in working memory functions. In a previous functional magnetic resonance imaging study, we observed an abnormal hyperactivity of the amygdala in bipolar patients during articulatory rehearsal in verbal working memory. In the present study, we investigated the dynamic neurofunctional interactions between the right amygdala and the brain systems that underlie verbal working memory in both bipolar patients and healthy controls. In total, 18 euthymic bipolar patients and 18 healthy controls performed a modified version of the Sternberg item-recognition (working memory) task. We used the psychophysiological interaction approach in order to assess functional connectivity between the right amygdala and the brain regions involved in verbal working memory. In healthy subjects, we found significant negative functional interactions between the right amygdala and multiple cortical brain areas involved in verbal working memory. In comparison with the healthy control subjects, bipolar patients exhibited significantly reduced functional interactions of the right amygdala particularly with the right-hemispheric, i.e., ipsilateral, cortical regions supporting verbal working memory. Together with our previous finding of amygdala hyperactivity in bipolar patients during verbal rehearsal, the present results suggest that a disturbed right-hemispheric “cognitive–emotional” interaction between the amygdala and cortical brain regions underlying working memory may be responsible for amygdala hyperactivation and affects verbal working memory (deficits) in bipolar patients.