Bag-of-Features Approach to Unsupervised Visual Object Categorisation

The large and growing number of digital images is making manual image search laborious. Only a fraction of the images contain metadata that can be used to search for a particular type of image. Thus, the main research question of this thesis is whether it is possible to learn visual object categories directly from images. Computers process images as long lists of pixels that do not have a clear connection to high-level semantics which could be used in the image search. There are various methods introduced in the literature to extract low-level image features and also approaches to connect these low-level features with high-level semantics. One of these approaches is called Bag-of-Features which is studied in the thesis. In the Bag-of-Features approach, the images are described using a visual codebook. The codebook is built from the descriptions of the image patches using clustering. The images are described by matching descriptions of image patches with the visual codebook and computing the number of matches for each code. In this thesis, unsupervised visual object categorisation using the Bag-of-Features approach is studied. The goal is to find groups of similar images, e.g., images that contain an object from the same category. The standard Bag-of-Features approach is improved by using spatial information and visual saliency. It was found that the performance of the visual object categorisation can be improved by using spatial information of local features to verify the matches. However, this process is computationally heavy, and thus, the number of images must be limited in the spatial matching, for example, by using the Bag-of-Features method as in this study. Different approaches for saliency detection are studied and a new method based on the Hessian-Affine local feature detector is proposed. The new method achieves comparable results with current state-of-the-art. The visual object categorisation performance was improved by using foreground segmentation based on saliency information, especially when the background could be considered as clutter.

Visual Arts Data Skills for Researchers (VADS4R)

Workshop at Open Repositories 2014, Helsinki, Finland, June 9-13, 2014

From KAPTUR to VADS4R: Exploring Research Data Management in the Visual Arts

Presentation at Open Repositories 2014, Helsinki, Finland, June 9-13, 2014

From KAPTUR to VADSR: Exploring Research Data Management in the Visual Arts

Poster at Open Repositories 2014, Helsinki, Finland, June 9-13, 2014

Trilling race : the political economy of racialised visual-aural encounters

This thesis investigates the matter of race in the context of Finnish language acquisition among adult migrants in Finland. Here matter denotes both the materiality of race and how race comes to matter. Drawing primarily on an auto/ethno/graphic account of learning the Finnish language as a participant in the Finnish for foreigners classes, this thesis problematises the ontology and epistemology of race, i.e., what race is, how it is known, and what an engagement with race entails. Taking cues from the bodily practices of learning the Finnish trill or the rolling r, this study proposes a notion of “trilling race” and argues for an onto-epistemological dis/continuity that marks race’s arrival. The notion of dis/continuity reworks the distinction between continuity and discontinuity, and asks about the how of the arrival of any identity, the where, and the when. In so doing, an analysis of “trilling race” engages with one of the major problematics that has exercised much critical attention, namely: how to read race differently. That is, to rethink the conundrum of the need to counter “representational weight” (Puar 2007, 191) of race on the one hand, and to account for the racialised lived realities on the other. The link between a study of the phenomenon of host country language acquisition and an examination of the question of race is not as obvious as it might seem. For example, what does the argument that the process of language learning is racialised actually imply? Does it mean that race, as a process of racialisation or an ongoing configuration of sets of power relations, exerts force from an outside on the otherwise neutral process of learning the host country language? Or does it mean that race, as an identity category, presents as among the analytical perspectives, along with gender and class for instance, of the phenomenon of host country language acquisition? With these questions in mind, and to foreground the examination of the question of race in the context of Finnish language acquisition among adult migrants, this thesis opens with a discussion of the art installation Finnexia by Lisa Erdman. Finnexia is a fictitious drug said to facilitate Finnish language learning through accelerating the cognitive learning process and reducing the anxiety of speaking the Finnish language. Not only does the Finnexia installation make visible the ways in which the lack of skill in Finnish is fgured as the threshold – a border that separates the inside from the outside – to integration, but also, and importantly, it raises questions about the nature of difference, and the process of differentiation that separates the individual from the social, fact from fiction, nature from culture. These puzzles animate much of the analysis in this dissertation. These concerns continue to be addressed in the rest of part one. Whereas chapter two offers a reconsideration of the ambiguities of ethnisme/ethnicity and race, chapter three dilates on the methodological implications of a conception of the dis/continuity of race. Part two focuses on the matter of race and examines the political economy of visual-aural encounters, whereas part three shifts the focus and rethinks the possibilities and limitations of transforming racialised and normative constraints. Taking up these particular problematics, this thesis as a whole argues that race trills itself: its identity/difference is simultaneously made possible and impossible.

Pretraining Convolutional Neural Networks for Visual Recognition

Convolutional Neural Networks (CNN) have become the state-of-the-art methods on many large scale visual recognition tasks. For a lot of practical applications, CNN architectures have a restrictive requirement: A huge amount of labeled data are needed for training. The idea of generative pretraining is to obtain initial weights of the network by training the network in a completely unsupervised way and then fine-tune the weights for the task at hand using supervised learning. In this thesis, a general introduction to Deep Neural Networks and algorithms are given and these methods are applied to classification tasks of handwritten digits and natural images for developing unsupervised feature learning. The goal of this thesis is to find out if the effect of pretraining is damped by recent practical advances in optimization and regularization of CNN. The experimental results show that pretraining is still a substantial regularizer, however, not a necessary step in training Convolutional Neural Networks with rectified activations. On handwritten digits, the proposed pretraining model achieved a classification accuracy comparable to the state-of-the-art methods.

Developmental patterns of individiuals within a sensory-based learning environment in art education : insights emerging from a case study /

My research permitted me to reexamine my recent evaluations of the Leaf Project given to the Foundation Year students during the fall semester of 1997. My personal description of the drawing curriculum formed part of the matrix of the Foundation Core Studies at the Ontario College of Art and Design. Research was based on the random selection of 1 8 students distributed over six of my teaching groups. The entire process included a representation of all grade levels. The intent of the research was to provide a pattern of alternative insights that could provide a more meaningful method of evaluation for visual learners in an art education setting. Visual methods of learning are indeed complex and involve the interplay of many sensory modalities of input. Using a qualitative method of research analysis, a series of queries were proposed into a structured matrix grid for seeking out possible and emerging patterns of learning. The grid provided for interrelated visual and linguistic analysis with emphasis in reflection and interconnectedness. Sensory-based modes of learning are currently being studied and discussed amongst educators as alternative approaches to learning. As patterns emerged from the research, it became apparent that a paradigm for evaluation would have to be a progressive profile of the learning that would take into account many of the different and evolving learning processes of the individual. A broader review of the student's entire development within the Foundation Year Program would have to have a shared evaluation through a cross section of representative faculty in the program. The results from the research were never intended to be conclusive. We realized from the start that sensory-based learning is a difficult process to evaluate from traditional standards used in education. The potential of such a process of inquiry permits the researcher to ask for a set of queries that might provide for a deeper form of evaluation unique to the students and their related learning environment. Only in this context can qualitative methods be used to profile their learning experiences in an expressive and meaningful manner.

The nature of the highly artistic student in visual arts at secondary school /

This qualitative investigation examined the nature of 7 highly artistic visual arts students at 2 secondary schools in southcentral Ontario. Through interviews, questionnaires, observations, and artwork documents, this study attempted to understand these highly artistic students in terms of creativity, motivation, social and emotional perspectives, and cognitive processes. Data collection occuned over a 3-monlh period. and the data analysis program NVivo 7 was used for coding to develop themes and categories for organizing data. The findings of this study illustrate the significant place that \ isual arts can lake in the growth and development for the youth of today. Participants idcniificd dcxclopnig critical thinking and problem-solving skills, taking risks, and meeting challenges ilirouuh their engagement in the creative process. The transferability of these skills \\ as referenced to numerous aspects of their lives. By enhancing individual perspectives through the study of visual arts, their local and world connections were extended, and environmental and societal concerns evolved. In addition, the communicative opportunities that visual arts provided for these students in terms of personal expression provided emotional health and paths of personal discovery. Through the participants' production of artwork with the many stages this involves, combined with insight into their needs, the participants relayed miportant suggestions for programming enhancements and educational settmgs lor \ isiial arts classrooms. These suggestions are meaningful for educators and curriculum developers of the future.

Sinister creativity: a phenomenological exploration of some of the experiences and perceptions of six lefthanded visual artists

Six lefthanded artist-educators were interviewed to attempt to discover any patterns t6 their perceptions and experiences. Artists have their own culture and priorities. According to the literature, lefthanded people appear more likely to suffer from dyslexia, allergies, asthma and other auto-immune diseases as well as machinery and equipment injuries. Patterns emerging suggested that lefthanded people indeed suffer more from dyslexia. More startling was the distinct possibility that many artists have traumatic childhood histories. This would commonly include negative school experiences, and for a significant number sexual assault, perceived or actual abandonment by parents, and/or consistently low selfesteem. The researcher discovered possible reasons why creative people frequently have problems at school, why they tend to be rebellious and anti-establishment oriented, how many of them perceive societal rules, and why they are more likely to be lefthanded. These characteristics all have significant implications for art school administrators.

Why do some adults change their minds about what is important in the visual arts? : a case study

This-~-case study used ethnographic-methodo-logy. --The research project was an introductory study of one adult's present and past experiences with the visual arts, exploring, in particular, the causes and processes that were related to the individual's changes of mind in order to develop an understanding of why that individual had changed her mind about what was significant in the visual arts. The individual who provided the data was a solid supporter of art galleries: female, middle-aged, graduate of university and college, married with two children, and living in an urban community. The data were collected from two informal conversational interviews and from a written description of one change experience selected by the participant. The individual had positive experiences with art during early childhood, in elementary and secondary school, during university, in avocational drawing and painting studio courses, and in aesthetic experiences. All of these experiences have had individual effects and, together, they have had a cumulative effect on the development of the participant's opinions and ideas about the visual arts. The experiences which had the most effect on the development of the individual's perspectives on the visual arts were handson studio, educational, and aesthetic experiences. Further research is suggested to investigate why some adults change their minds about the visual arts.

All of My Blood is Red: Contemporary Metis Visual Culture and Identity

This thesis explores notions of contemporary Metis identity through the lens of visual culture, as articulated in the works of three visual artists of Metis ancestry. I discuss the complexities of being Metis with reference to specific art works by Christi Belcourt, David Garneau and Rosalie Favell. In addition to a visual culture analysis of these three Metis artists, I supplement my discussion of Metis identity with a selection of autoethnographic explorations of my identity as a Metis woman through out this thesis. The self-reflexive aspect of this work documents the ways in which my understanding of myself as a Metis woman have been deepened and reworked in the process of conducting this research, while also offering an expanded conception of contemporary Metis culture. I present this work as an important point of departure for giving a greater presence to contemporary Metis visual culture across Canada:

Temporalité et surveillance dans l'art de David Rokeby

Pour respecter les droits d'auteur, la version électronique de ce mémoire à été dépouillée de ses documents visuels et audio-visuels. La version intégrale du mémoire a été déposée au Service de la gestion des documents et des archives de l'Université de Montréal.

Analyse des pratiques de cinq enseignantes spécialisées en arts plastiques au primaire favorisant l'action de l'élève dans le travail de l'exposition d'art en milieu scolaire

Thèse numérisée par la Division de la gestion de documents et des archives de l'Université de Montréal

Le cinéma omnistéréo ou l'art d'avoir des yeux tout le tour de la tête

Cette thèse s'intéresse à des aspects du tournage, de la projection et de la perception du cinéma stéréo panoramique, appelé aussi cinéma omnistéréo. Elle s'inscrit en grande partie dans le domaine de la vision par ordinateur, mais elle touche aussi aux domaines de l'infographie et de la perception visuelle humaine. Le cinéma omnistéréo projette sur des écrans immersifs des vidéos qui fournissent de l'information sur la profondeur de la scène tout autour des spectateurs. Ce type de cinéma comporte des défis liés notamment au tournage de vidéos omnistéréo de scènes dynamiques, à la projection polarisée sur écrans très réfléchissants rendant difficile l'estimation de leur forme par reconstruction active, aux distorsions introduites par l'omnistéréo pouvant fausser la perception des profondeurs de la scène. Notre thèse a tenté de relever ces défis en apportant trois contributions majeures. Premièrement, nous avons développé la toute première méthode de création de vidéos omnistéréo par assemblage d'images pour des mouvements stochastiques et localisés. Nous avons mis au point une expérience psychophysique qui montre l'efficacité de la méthode pour des scènes sans structure isolée, comme des courants d'eau. Nous proposons aussi une méthode de tournage qui ajoute à ces vidéos des mouvements moins contraints, comme ceux d'acteurs. Deuxièmement, nous avons introduit de nouveaux motifs lumineux qui permettent à une caméra et un projecteur de retrouver la forme d'objets susceptibles de produire des interréflexions. Ces motifs sont assez généraux pour reconstruire non seulement les écrans omnistéréo, mais aussi des objets très complexes qui comportent des discontinuités de profondeur du point de vue de la caméra. Troisièmement, nous avons montré que les distorsions omnistéréo sont négligeables pour un spectateur placé au centre d'un écran cylindrique, puisqu'elles se situent à la périphérie du champ visuel où l'acuité devient moins précise.

Visual information processing during conscious and non-conscious face perception

Les stimuli naturels projetés sur nos rétines nous fournissent de l’information visuelle riche. Cette information varie le long de propriétés de « bas niveau » telles que la luminance, le contraste, et les fréquences spatiales. Alors qu’une partie de cette information atteint notre conscience, une autre partie est traitée dans le cerveau sans que nous en soyons conscients. Les propriétés de l’information influençant l’activité cérébrale et le comportement de manière consciente versus non-consciente demeurent toutefois peu connues. Cette question a été examinée dans les deux derniers articles de la présente thèse, en exploitant les techniques psychophysiques développées dans les deux premiers articles. Le premier article présente la boîte à outils SHINE (spectrum, histogram, and intensity normalization and equalization), développée afin de permettre le contrôle des propriétés de bas niveau de l'image dans MATLAB. Le deuxième article décrit et valide la technique dite des bulles fréquentielles, qui a été utilisée tout au long des études de cette thèse pour révéler les fréquences spatiales utilisées dans diverses tâches de perception des visages. Cette technique offre les avantages d’une haute résolution au niveau des fréquences spatiales ainsi que d’un faible biais expérimental. Le troisième et le quatrième article portent sur le traitement des fréquences spatiales en fonction de la conscience. Dans le premier cas, la méthode des bulles fréquentielles a été utilisée avec l'amorçage par répétition masquée dans le but d’identifier les fréquences spatiales corrélées avec les réponses comportementales des observateurs lors de la perception du genre de visages présentés de façon consciente versus non-consciente. Les résultats montrent que les mêmes fréquences spatiales influencent de façon significative les temps de réponse dans les deux conditions de conscience, mais dans des sens opposés. Dans le dernier article, la méthode des bulles fréquentielles a été combinée à des enregistrements intracrâniens et au Continuous Flash Suppression (Tsuchiya & Koch, 2005), dans le but de cartographier les fréquences spatiales qui modulent l'activation de structures spécifiques du cerveau (l'insula et l'amygdale) lors de la perception consciente versus non-consciente des expressions faciales émotionnelles. Dans les deux régions, les résultats montrent que la perception non-consciente s'effectue plus rapidement et s’appuie davantage sur les basses fréquences spatiales que la perception consciente. La contribution de cette thèse est donc double. D’une part, des contributions méthodologiques à la recherche en perception visuelle sont apportées par l'introduction de la boîte à outils SHINE ainsi que de la technique des bulles fréquentielles. D’autre part, des indications sur les « corrélats de la conscience » sont fournies à l’aide de deux approches différentes.