Categorizations of physical gesture in piano teaching: A preliminary enquiry

The significance of the “physicality” involved in learning to play a musical instrument and the essential role of teachers are areas in need of research. This article explores the role of gesture within teacher–student communicative interaction in one-to-one piano lessons. Three teachers were required to teach a pre-selected repertoire of two contrasting pieces to three students studying piano grade 1. The data was collected by video recordings of piano lessons and analysis based on the type and frequency of gestures employed by teachers in association to teaching behaviours specifying where gestures fit under (or evade) predefined classifications. Spontaneous co-musical gestures were observed in the process of piano tuition emerging with similar general communicative purposes as spontaneous co-verbal gestures and were essential for the process of musical communication between teachers and students. Observed frequencies of categorized gestures varied significantly between different teaching behaviours and between the three teachers. Parallels established between co-verbal and co-musical spontaneous gestures lead to an argument for extension of McNeill’s (2005) ideas of imagery–language–dialectic to imagery–music–dialectic with relevant implications for piano pedagogy and fields of study invested in musical communication.

Communicating musical knowledge through gesture: Piano teachers’ gestural behaviours across different levels of student proficiency

Teachers’ communication of musical knowledge through physical gesture represents a valuable pedagogical field in need of investigation. This exploratory case study compares the gestural behaviour of three piano teachers while giving individual lessons to students who differed according to piano proficiency levels. The data was collected by video recordings of one-to-one piano lessons and gestures were categorized using two gesture classifications: the spontaneous co-verbal gesture classification (McNeill, 1992; 2005) and spontaneous co-musical gesture classification (Simones, Schroeder & Rodger, 2013). Poisson regression analysis and qualitative observation suggest a relationship between teachers’ didactic intentions and the types of gesture they produced while teaching, as shown by differences in gestural category frequency between teaching students of higher and lower levels of proficiency. Such reported agreement between teachers’ gestural approach in relation to student proficiency levels indicates a teachers’ gestural scaffolding approach whereby teachers adapted gestural communicative channels to suit students’ specific conceptual skill levels.

Gesture interaction in music for instruments and electroacoustic sounds

Esta tese apresenta alguns aspectos em como o fenómeno do gesto musical pode ser compreendido na percepção da interação musical na música para instrumentos e sons electroacústicos. Através de exemplos de análise, classificação e categorização de diferentes relacões gestuais entre instrumentos e sons electroacústicos, pretende-se estabelecer modelos específicos de interacção que podem ser aplicados como método analítico assim como na composição musical. A pesquisa parte de uma variedade de definições sobre gesto musical na música em geral, na música contemporânea e na música electroacústica em particular, para subsequentemente incluir as relações entre dois eventos sonoros com características diferentes - o electroacústico e o instrumental. São essencialmente abordadas as relações entre gestos musicais através da análise de diversas características: altura, ritmo, timbre, dinâmica, características contrapontísticas, espectromorfológicas, semânticas e espaciais. O resultado da pesquisa teórica serviu de suporte à composição de diversas obras, onde estes aspectos são explorados sob o ponto de vista da criação musical.

Multi-scale cortical keypoints for realtime hand tracking and gesture recognition

Human-robot interaction is an interdisciplinary research area which aims at integrating human factors, cognitive psychology and robot technology. The ultimate goal is the development of social robots. These robots are expected to work in human environments, and to understand behavior of persons through gestures and body movements. In this paper we present a biological and realtime framework for detecting and tracking hands. This framework is based on keypoints extracted from cortical V1 end-stopped cells. Detected keypoints and the cells’ responses are used to classify the junction type. By combining annotated keypoints in a hierarchical, multi-scale tree structure, moving and deformable hands can be segregated, their movements can be obtained, and they can be tracked over time. By using hand templates with keypoints at only two scales, a hand’s gestures can be recognized.

Diagoge ferventissimi redemptoris divi Petri Nolasco parentis nostri regalis, ac militaris ordinis beatæ Mariæ de Mercede redemptionis captivorum cælitur electi fundatoris, & patriachæ in tres libros partita et elegiaco carmine concinnata cui divini redem

UANL

Natural hand-gesture interaction (Interacción natural con gestos manuales).

Tesis (Doctor en Ingeniería con Acentuación en Computación y Mecatrónica) UANL, 2013.

Beat deafness: développement d'un outil de dépistage et nouveaux cas.

Le terme beat deafness désigne une forme d’amusie congénitale spécifique à l’aspect temporel en musique qui a été découverte récemment par l’étude d’un cas unique (Phillips-Silver et al., 2011). L’objectif principal de ce mémoire était d’identifier de nouveaux cas. Nous avons évalué, chez 100 étudiants universitaires, les capacités à percevoir le beat à se synchroniser sur celui-ci. Les capacités de perception ont été évaluées au moyen de deux tests: un test de détection de perturbations rythmiques et un test de classification de courts extraits musicaux en marches et valses. Les capacités de synchronisation ont été évaluées au moyen d’une tâche consistant à taper du doigt sur les temps forts des mêmes marches et valses. Quatre personnes se sont démarquées du groupe par des difficultés de perception et de synchronisation, et sont dès lors considérées comme des nouveaux cas de beat deafness.

Le cri poétique : "Howl" d’Allen Ginsberg dans le contexte de la révolution Beat

Ce mémoire s’intéresse aux transformations littéraires et poétiques mises en œuvre par le mouvement de la Beat Generation au milieu du vingtième siècle en Amérique du Nord. En me penchant sur le recueil de poésie « Howl and Other Poems » du poète Allen Ginsberg, le texte emblématique de cette révolution littéraire, je montre comment le mouvement des Beats représente une transformation dans la tradition littéraire et poétique américaine, occidentale, en ce qui concerne à la fois la forme, les sujets abordés et la pratique d’écriture. Dans un premier temps, j’étudie l’histoire de ces changements en examinant la réception de « Howl », qui a bouleversé les attentes du milieu littéraire de l’époque à cause de son approche inclusive qui accueille tout dans la représentation. Mon deuxième chapitre se penche sur la vision du poète, la vision poétique. Je montre comment la perspective du poète face au monde change chez Ginsberg et les Beats. Au lieu de concevoir la transcendance, l’universel, comme quelque chose d’éloigné du particulier, comme le véhicule la tradition poétique occidentale, les Beats voient l’universel partout, dans tout. Enfin, je m’intéresse à la place du langage dans l’expression de cette nouvelle vision. J’observe comment Ginsberg et les Beats, en s’inspirant de la poésie de Walt Whitman, développent un langage spontané ne relevant plus de la maîtrise de soi.

Beat 0.9.

Software del campo de la Documentación especializado en la consulta y modificación de tesauros documentales de forma interactiva. Está acompañado de un completo manual de uso con las posibilidades de manejo, las características técnicas del programa y la codicología de consulta y creación de los tesauros. Incorpora una versión reducida, denominada Veat, que permite únicamente ,las consultas.

Maternal label and gesture use affects acquisition of specific object names

Ten mothers were observed prospectively, interacting with their infants aged 0 ; 10 in two contexts (picture description and noun description). Maternal communicative behaviours were coded for volubility, gestural production and labelling style. Verbal labelling events were categorized into three exclusive categories: label only; label plus deictic gesture; label plus iconic gesture. We evaluated the predictive relations between maternal communicative style and children's subsequent acquisition of ten target nouns. Strong relations were observed between maternal communicative style and children's acquisition of the target nouns. Further, even controlling for maternal volubility and maternal labelling, maternal use of iconic gestures predicted the timing of acquisition of nouns in comprehension. These results support the proposition that maternal gestural input facilitates linguistic development, and suggest that such facilitation may be a function of gesture type.

Hand Gesture Detection & Recognition System

The project introduces an application using computer vision for Hand gesture recognition. A camera records a live video stream, from which a snapshot is taken with the help of interface. The system is trained for each type of count hand gestures (one, two, three, four, and five) at least once. After that a test gesture is given to it and the system tries to recognize it.A research was carried out on a number of algorithms that could best differentiate a hand gesture. It was found that the diagonal sum algorithm gave the highest accuracy rate. In the preprocessing phase, a self-developed algorithm removes the background of each training gesture. After that the image is converted into a binary image and the sums of all diagonal elements of the picture are taken. This sum helps us in differentiating and classifying different hand gestures.Previous systems have used data gloves or markers for input in the system. I have no such constraints for using the system. The user can give hand gestures in view of the camera naturally. A completely robust hand gesture recognition system is still under heavy research and development; the implemented system serves as an extendible foundation for future work.

Combating shoulder-surfing: a hidden button gesture based scheme

This project describes an authentication technique that is shoulder-surfing resistant. Shoulder surfing is an attack in which an attacker can get access to private information by observing the user’s interaction with a terminal, or by using recording tools to record the user interaction and study the obtained data, with the objective of obtaining unauthorized access to a target user’s personal information. The technique described here relies on gestural analysis coupled with a secondary channel of authentication that uses button pressing. The thesis presents and evaluates multiple alternative algorithms for gesture analysis, and furthermore assesses the effectiveness of the technique.

On energy pumping, synchronization and beat phenomenon in a nonideal structure coupled to an essentially nonlinear oscillator

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)