Designing relational pedagogies with jam2jamXO

This paper examines the affordances of the philosophy and practice of open source and the application of it in developing music education software. In particular I will examine the parallels inherent in the ‘openness’ of pragmatist philosophy in education (Dewey 1916, 1989) such as group or collaborative learning, discovery learning (Bruner 1966) and learning through creative activity with computers (Papert 1980, 1994). Primarily I am interested in ‘relational pedagogies’ (Ruthmann and Dillon In Press) which is in a real sense about the ethics of the transaction between student and teacher in an ecology where technology plays a more significant role. In these contexts relational pedagogies refers to how the music teacher manages their relationships with students and evaluates the affordances of open source technology in that process. It is concerned directly with how the relationship between student and teacher is affected by the technological tools, as is the capacity for music making and learning. In particular technologies that have agency present the opportunity for a partnership between user and technology that enhances the capacity for expressive music making, productive social interaction and learning. In this instance technologies with agency are defined as ones that enhance the capacity to be expressive and perform tasks with virtuosity and complexity where the technology translates simple commands and gestures into complex outcomes. The technology enacts a partnership with the user that becomes both a cognitive and performative amplifier. Specifically we have used this term to describe interactions with generative technologies that use procedural invention as a creative technique to produce music and visual media.

Exploring Rhythmic Automata

The use of Cellular Automata (CA) for musical purposes has a rich history. In general the mapping of CA states to note-level music representations has focused on pitch mapping and downplayed rhythm. This paper reports experiments in the application of one-dimensional cellular automata to the generation and evolution of rhythmic patterns. A selection of CA tendencies are identified that can be used as compositional tools to control the rhythmic coherence of monophonic passages and the polyphonic texture of musical works in broad-brush, rather than precisely deterministic, ways. This will provide the composer and researcher with a clearer understanding of the useful application of CAs for generative music.

Like two ships

In this video, the words animated on screen are sometimes the same and sometimes different from those spoken by a male voice. Both narratives, written and spoken, are constructed entirely from clichés and mixed metaphors. This work examines processes of signification. It emphasizes disruption and disconnection as fundamental and generative operations in making meaning. Extending on post-structural and deconstructionist ideas, this work questions the relationship between written and spoken words. It upsets the assumed efficacy of metaphors and clichés to question the sites and mechanisms of signification.

If things were different

In this video, a couple sits on a couch slowly breaking up. A typical shot/reverse-shot filmic structure is offset as the sound and image goes out of synch. At different times, it becomes so out of synch that they mouth each other’s words. This work engages with the signifying processes of romantic narratives. It emphasizes disruption and discontinuity as fundamental and generative operations in making meaning. Extending on post-structural and deconstructionist ideas, this work emphasizes the constructed nature of representations of heterosexual relationships. It draws attention to the gaps, slippages and fragments that pervade signifying acts.

'Homes for Life' : a critical ecological study of an independent living project

In this paper, an ‘ecological’ lens is applied to an independent living project aiming to provide ‘homes for life’ for adult children with disabilities. The qualities of the project as ecological praxis are highlighted along with the implications for an open-ended enquiry into ecologies for and of the interior. In terms of the ecological concern for intimate modes of being, interior design is shown to be well placed through its association with environments in which people spend most of their life and through powerful concepts such as ‘interiority’ and ‘home’ which link to fundamental existential notions of ‘self ’ and ‘identity’. However, despite the interior being a significant generative force, this has not happened to the exclusion of other disciplines. Ignoring territorial urges to claim areas and concepts as one’s own, the paper describes how the project has actively encouraged design disciplines to trespass in each other’s territories. Ecologies for and of the interior, while recognising the need for discipline emphasis, also demand an integrated and collective approach through what is in effect transdisciplinary practice.

eBILITY : from tool use to partnerships

In this article we identify how computational automation achieved through programming has enabled a new class of music technologies with generative music capabilities. These generative systems can have a degree of music making autonomy that impacts on our relationships with them; we suggest that this coincides with a shift in the music-equipment relationship from tool use to a partnership. This partnership relationship can occur when we use technologies that display qualities of agency. It raises questions about the kinds of skills and knowledge that are necessary to interact musically in such a partnership. These are qualities of musicianship we call eBility. In this paper we seek to define what eBility might consist of and how consideration of it might effect music education practice. The 'e' in eBility refers not only to the electronic nature of computing systems but also to the ethical, enabling, experiential and educational dimensions of the creative relationship with technologies with agency. We hope to initiate a discussion around differentiating what we term representational technologies from those with agency and begin to uncover the implications of these ideas for music educators in schools and communities. We hope also to elucidate the emergent theory and practice that has enabled the development of strategies for optimising this kind of eBility where the tool becomes partner. The identification of musical technologies with agency adds to the authors’ list of metaphors for technology use in music education that previously included tool, medium and instrument. We illustrate these ideas with examples and with data from our work with the jam2jam interactive music system. In this discussion we will outline our experiences with jam2jam as an example of a technology with agency and describe the aspects of eBility that interaction with it promotes.

Cyberinfrastructure inside out : definition and influences shaping its emergence, development, and implementation in the early 21st century

The authors provide a theoretically generative definition of cyberinfrastructure (CI) by drawing from existing definitions and literature in social sciences, law, and policy studies. They propose two models of domestic and international influencers on CI emergence, development, and implementation in the early 21st century. Based on its historical emergence and computational power, they argue that cyberinfrastructure is built on, and yet distinct from the current notion of the internet. The authors seek to answer two research questions: firstly, what is cyberinfrastructure? And secondly, what national and international influencers shape its emergence, development and implementation (in e-science) in the early 21st century? Additionally, consideration will be given to the implications of the proposed definition and models, and future directions on CI research in Internet studies will be suggested.

Improvisation in interactive music systems

This project investigates machine listening and improvisation in interactive music systems with the goal of improvising musically appropriate accompaniment to an audio stream in real-time. The input audio may be from a live musical ensemble, or playback of a recording for use by a DJ. I present a collection of robust techniques for machine listening in the context of Western popular dance music genres, and strategies of improvisation to allow for intuitive and musically salient interaction in live performance. The findings are embodied in a computational agent – the Jambot – capable of real-time musical improvisation in an ensemble setting. Conceptually the agent’s functionality is split into three domains: reception, analysis and generation. The project has resulted in novel techniques for addressing a range of issues in each of these domains. In the reception domain I present a novel suite of onset detection algorithms for real-time detection and classification of percussive onsets. This suite achieves reasonable discrimination between the kick, snare and hi-hat attacks of a standard drum-kit, with sufficiently low-latency to allow perceptually simultaneous triggering of accompaniment notes. The onset detection algorithms are designed to operate in the context of complex polyphonic audio. In the analysis domain I present novel beat-tracking and metre-induction algorithms that operate in real-time and are responsive to change in a live setting. I also present a novel analytic model of rhythm, based on musically salient features. This model informs the generation process, affording intuitive parametric control and allowing for the creation of a broad range of interesting rhythms. In the generation domain I present a novel improvisatory architecture drawing on theories of music perception, which provides a mechanism for the real-time generation of complementary accompaniment in an ensemble setting. All of these innovations have been combined into a computational agent – the Jambot, which is capable of producing improvised percussive musical accompaniment to an audio stream in real-time. I situate the architectural philosophy of the Jambot within contemporary debate regarding the nature of cognition and artificial intelligence, and argue for an approach to algorithmic improvisation that privileges the minimisation of cognitive dissonance in human-computer interaction. This thesis contains extensive written discussions of the Jambot and its component algorithms, along with some comparative analyses of aspects of its operation and aesthetic evaluations of its output. The accompanying CD contains the Jambot software, along with video documentation of experiments and performances conducted during the project.

Why the long face?

In this video, a male voice recites a script comprised entirely of jokes. Words flash on screen in time with the spoken words. Sometimes the two sets of words match, and sometimes they differ. This work examines processes of signification. It emphasizes disruption and disconnection as fundamental and generative operations in making meaning. Extending on post-structural and deconstructionist ideas, this work questions the relationship between written and spoken words. By deliberately confusing the signifying structures of jokes and narratives, it questions the sites and mechanisms of comprehension, humour and signification.

Then I let you

In this video, a male voice recites a teenage love poem. Words flash on screen in time with the spoken words. Sometimes the two sets of words match, and sometimes they differ. This work examines processes of signification. It emphasizes disruption and disconnection as fundamental and generative operations in making meaning. Extending on post-structural and deconstructionist ideas, this work questions the relationship between written and spoken words. By actively disrupting the sincerity of a teenage love poem, it questions the sites and mechanisms of comprehension, poetry and signification.

Threshold

In this video, the words of a translated poem fade in and out above an abstract, moving horizon line. The animated words are set to an emotive stock music track. This work examines processes of signification. It emphasizes abstraction and disconnection as fundamental and generative operations in making meaning. Extending on post-structural and deconstructionist ideas, this work questions the signifying processes of translation and metaphor. By emphasizing the abstract qualities of a translated love poem, it questions the sites and mechanisms of signification.

Volume

In this video, words describing socially awkward conversations float around an animated cloud of gas. A cosmic stock music track accompanies the words. This work examines processes of signification. It emphasizes multiplicity and disconnection as fundamental and generative operations in making meaning. By playing with the simultaneity of internal monologues and external conversations, it draws attention to the seams, gaps and slippages that occur in signifying acts.

A hierarchical evolutionary algorithmic design (HEAD) system for generating and evolving building design models

This thesis develops a detailed conceptual design method and a system software architecture defined with a parametric and generative evolutionary design system to support an integrated interdisciplinary building design approach. The research recognises the need to shift design efforts toward the earliest phases of the design process to support crucial design decisions that have a substantial cost implication on the overall project budget. The overall motivation of the research is to improve the quality of designs produced at the author's employer, the General Directorate of Major Works (GDMW) of the Saudi Arabian Armed Forces. GDMW produces many buildings that have standard requirements, across a wide range of environmental and social circumstances. A rapid means of customising designs for local circumstances would have significant benefits. The research considers the use of evolutionary genetic algorithms in the design process and the ability to generate and assess a wider range of potential design solutions than a human could manage. This wider ranging assessment, during the early stages of the design process, means that the generated solutions will be more appropriate for the defined design problem. The research work proposes a design method and system that promotes a collaborative relationship between human creativity and the computer capability. The tectonic design approach is adopted as a process oriented design that values the process of design as much as the product. The aim is to connect the evolutionary systems to performance assessment applications, which are used as prioritised fitness functions. This will produce design solutions that respond to their environmental and function requirements. This integrated, interdisciplinary approach to design will produce solutions through a design process that considers and balances the requirements of all aspects of the design. Since this thesis covers a wide area of research material, 'methodological pluralism' approach was used, incorporating both prescriptive and descriptive research methods. Multiple models of research were combined and the overall research was undertaken following three main stages, conceptualisation, developmental and evaluation. The first two stages lay the foundations for the specification of the proposed system where key aspects of the system that have not previously been proven in the literature, were implemented to test the feasibility of the system. As a result of combining the existing knowledge in the area with the newlyverified key aspects of the proposed system, this research can form the base for a future software development project. The evaluation stage, which includes building the prototype system to test and evaluate the system performance based on the criteria defined in the earlier stage, is not within the scope this thesis. The research results in a conceptual design method and a proposed system software architecture. The proposed system is called the 'Hierarchical Evolutionary Algorithmic Design (HEAD) System'. The HEAD system has shown to be feasible through the initial illustrative paper-based simulation. The HEAD system consists of the two main components - 'Design Schema' and the 'Synthesis Algorithms'. The HEAD system reflects the major research contribution in the way it is conceptualised, while secondary contributions are achieved within the system components. The design schema provides constraints on the generation of designs, thus enabling the designer to create a wide range of potential designs that can then be analysed for desirable characteristics. The design schema supports the digital representation of the human creativity of designers into a dynamic design framework that can be encoded and then executed through the use of evolutionary genetic algorithms. The design schema incorporates 2D and 3D geometry and graph theory for space layout planning and building formation using the Lowest Common Design Denominator (LCDD) of a parameterised 2D module and a 3D structural module. This provides a bridge between the standard adjacency requirements and the evolutionary system. The use of graphs as an input to the evolutionary algorithm supports the introduction of constraints in a way that is not supported by standard evolutionary techniques. The process of design synthesis is guided as a higher level description of the building that supports geometrical constraints. The Synthesis Algorithms component analyses designs at four levels, 'Room', 'Layout', 'Building' and 'Optimisation'. At each level multiple fitness functions are embedded into the genetic algorithm to target the specific requirements of the relevant decomposed part of the design problem. Decomposing the design problem to allow for the design requirements of each level to be dealt with separately and then reassembling them in a bottom up approach reduces the generation of non-viable solutions through constraining the options available at the next higher level. The iterative approach, in exploring the range of design solutions through modification of the design schema as the understanding of the design problem improves, assists in identifying conflicts in the design requirements. Additionally, the hierarchical set-up allows the embedding of multiple fitness functions into the genetic algorithm, each relevant to a specific level. This supports an integrated multi-level, multi-disciplinary approach. The HEAD system promotes a collaborative relationship between human creativity and the computer capability. The design schema component, as the input to the procedural algorithms, enables the encoding of certain aspects of the designer's subjective creativity. By focusing on finding solutions for the relevant sub-problems at the appropriate levels of detail, the hierarchical nature of the system assist in the design decision-making process.

Beyond here-and-now : extending shared physical experiences to shared conceptual experiences

For robots to use language effectively, they need to refer to combinations of existing concepts, as well as concepts that have been directly experienced. In this paper, we introduce the term generative grounding to refer to the establishment of shared meaning for concepts referred to using relational terms. We investigated a spatial domain, which is both experienced and constructed using mobile robots with cognitive maps. The robots, called Lingodroids, established lexicons for locations, distances, and directions through structured conversations called where-are-we, how-far, what-direction, and where-is-there conversations. Distributed concept construction methods were used to create flexible concepts, based on a data structure called a distributed lexicon table. The lexicon was extended from words for locations, termed toponyms, to words for the relational terms of distances and directions. New toponyms were then learned using these relational operators. Effective grounding was tested by using the new toponyms as targets for go-to games, in which the robots independently navigated to named locations. The studies demonstrate how meanings can be extended from grounding in shared physical experiences to grounding in constructed cognitive experiences, giving the robots a language that refers to their direct experiences, and to constructed worlds that are beyond the here-and-now.

The Socratic classroom : reflective thinking through collaborative inquiry

This book was written to serve two functions. First it is an exploration of what I have called Socratic pedagogy, a collaborative inquiry-based approach to teaching and learning suitable not only to formal educational settings such as the school classroom but to all educational settings. The term is intended to capture a variety of philosophical approaches to classroom practice that could broadly be described Socratic in form. The term ‘philosophy in schools’ is ambiguous and could refer to teaching university style philosophy to high school students or to the teaching of philosophy and logic or critical reasoning in senior years of high school. It is also used to describe the teaching of philosophy in schools generally. In the early and middle phases of schooling the term philosophy for children is often used. But this too is ambiguous as the name was adopted from Matthew Lipman’s Philosophy for Children curriculum that he and his colleagues at the Institute for the Advancement of Philosophy for Children developed. In Britain the term ‘philosophy with children’ is sometimes employed to mark two methods of teaching that have Socratic roots but have distinct differences, namely Philosophy for Children and Socratic Dialogue developed by Leonard Nelson. The use of the term Socratic pedagogy and its companion term Socratic classroom (to refer to the kind of classroom that employs Socratic teaching) avoids the problem of distinguishing between various approaches to philosophical inquiry in the Socratic tradition but also separates it from the ‘study of philosophy’, such as university style philosophy or other approaches which place little or no emphasis on collaborative inquiry based teaching and learning. The second function builds from the first. It is to develop an effective framework for understanding the relationship between what I call the generative, evaluative and connective aspects of communal dialogue, which I think are necessary to the Socratic notion of inquiry. In doing so it is hoped that this book offers some way to show how philosophy as inquiry can contribute to educational theory and practice, while also demonstrating how it can be an effective way to approach teaching and learning. This has meant striking a balance between speaking to philosophers and to teachers and educators together, with the view that both see the virtues of such a project. In the strictest sense this book is not philosophy of education, insofar as its chief focus is not on the analysis of concepts or formulation of definitions specific to education with the aim of formulating directives that guide educational practice. It relinquishes the role of philosopher as ‘spectator’, to one of philosopher ‘immersed in matter’ – in this case philosophical issues in education, specifically those related to philosophical inquiry, pedagogy and classroom practice. Put another way, it is a book about philosophical education.