Sequential Memory with ART: A Self-Organizing Network Capable of Learning Sequences of Patterns

A model which extends the adaptive resonance theory model to sequential memory is presented. This new model learns sequences of events and recalls a sequence when presented with parts of the sequence. A sequence can have repeated events and different sequences can share events. The ART model is modified by creating interconnected sublayers within ART's F2 layer. Nodes within F2 learn temporal patterns by forming recency gradients within LTM. Versions of the ART model like ART I, ART 2, and fuzzy ART can be used.

ART-EMAP: A Neural Network Architecture for Object Recognition by Evidence Accumulation

A new neural network architecture is introduced for the recognition of pattern classes after supervised and unsupervised learning. Applications include spatio-temporal image understanding and prediction and 3-D object recognition from a series of ambiguous 2-D views. The architecture, called ART-EMAP, achieves a synthesis of adaptive resonance theory (ART) and spatial and temporal evidence integration for dynamic predictive mapping (EMAP). ART-EMAP extends the capabilities of fuzzy ARTMAP in four incremental stages. Stage 1 introduces distributed pattern representation at a view category field. Stage 2 adds a decision criterion to the mapping between view and object categories, delaying identification of ambiguous objects when faced with a low confidence prediction. Stage 3 augments the system with a field where evidence accumulates in medium-term memory (MTM). Stage 4 adds an unsupervised learning process to fine-tune performance after the limited initial period of supervised network training. Each ART-EMAP stage is illustrated with a benchmark simulation example, using both noisy and noise-free data. A concluding set of simulations demonstrate ART-EMAP performance on a difficult 3-D object recognition problem.

Fuzzy ART

Adaptive Resonance Theory (ART) models are real-time neural networks for category learning, pattern recognition, and prediction. Unsupervised fuzzy ART and supervised fuzzy ARTMAP synthesize fuzzy logic and ART networks by exploiting the formal similarity between the computations of fuzzy subsethood and the dynamics of ART category choice, search, and learning. Fuzzy ART self-organizes stable recognition categories in response to arbitrary sequences of analog or binary input patterns. It generalizes the binary ART 1 model, replacing the set-theoretic: intersection (∩) with the fuzzy intersection (∧), or component-wise minimum. A normalization procedure called complement coding leads to a symmetric: theory in which the fuzzy inter:>ec:tion and the fuzzy union (∨), or component-wise maximum, play complementary roles. Complement coding preserves individual feature amplitudes while normalizing the input vector, and prevents a potential category proliferation problem. Adaptive weights :otart equal to one and can only decrease in time. A geometric interpretation of fuzzy AHT represents each category as a box that increases in size as weights decrease. A matching criterion controls search, determining how close an input and a learned representation must be for a category to accept the input as a new exemplar. A vigilance parameter (p) sets the matching criterion and determines how finely or coarsely an ART system will partition inputs. High vigilance creates fine categories, represented by small boxes. Learning stops when boxes cover the input space. With fast learning, fixed vigilance, and an arbitrary input set, learning stabilizes after just one presentation of each input. A fast-commit slow-recode option allows rapid learning of rare events yet buffers memories against recoding by noisy inputs. Fuzzy ARTMAP unites two fuzzy ART networks to solve supervised learning and prediction problems. A Minimax Learning Rule controls ARTMAP category structure, conjointly minimizing predictive error and maximizing code compression. Low vigilance maximizes compression but may therefore cause very different inputs to make the same prediction. When this coarse grouping strategy causes a predictive error, an internal match tracking control process increases vigilance just enough to correct the error. ARTMAP automatically constructs a minimal number of recognition categories, or "hidden units," to meet accuracy criteria. An ARTMAP voting strategy improves prediction by training the system several times using different orderings of the input set. Voting assigns confidence estimates to competing predictions given small, noisy, or incomplete training sets. ARPA benchmark simulations illustrate fuzzy ARTMAP dynamics. The chapter also compares fuzzy ARTMAP to Salzberg's Nested Generalized Exemplar (NGE) and to Simpson's Fuzzy Min-Max Classifier (FMMC); and concludes with a summary of ART and ARTMAP applications.

Fuzzy ART Choice Functions

Adaptive Resonance Theory (ART) models are real-time neural networks for category learning, pattern recognition, and prediction. Unsupervised fuzzy ART and supervised fuzzy ARTMAP networks synthesize fuzzy logic and ART by exploiting the formal similarity between tile computations of fuzzy subsethood and the dynamics of ART category choice, search, and learning. Fuzzy ART self-organizes stable recognition categories in response to arbitrary sequences of analog or binary input patterns. It generalizes the binary ART 1 model, replacing the set-theoretic intersection (∩) with the fuzzy intersection(∧), or component-wise minimum. A normalization procedure called complement coding leads to a symmetric theory in which the fuzzy intersection and the fuzzy union (∨), or component-wise maximum, play complementary roles. A geometric interpretation of fuzzy ART represents each category as a box that increases in size as weights decrease. This paper analyzes fuzzy ART models that employ various choice functions for category selection. One such function minimizes total weight change during learning. Benchmark simulations compare peformance of fuzzy ARTMAP systems that use different choice functions.

3-D Object Recognition by the ART-EMAP Evidence Accumulation Network

ART-EMAP synthesizes adaptive resonance theory (AHT) and spatial and temporal evidence integration for dynamic predictive mapping (EMAP). The network extends the capabilities of fuzzy ARTMAP in four incremental stages. Stage I introduces distributed pattern representation at a view category field. Stage 2 adds a decision criterion to the mapping between view and object categories, delaying identification of ambiguous objects when faced with a low confidence prediction. Stage 3 augments the system with a field where evidence accumulates in medium-term memory (MTM). Stage 4 adds an unsupervised learning process to fine-tune performance after the limited initial period of supervised network training. Simulations of the four ART-EMAP stages demonstrate performance on a difficult 3-D object recognition problem.

The Art of Seeing and Painting

The human urge to represent the three-dimensional world using two-dimensional pictorial representations dates back at least to Paleolithic times. Artists from ancient to modern times have struggled to understand how a few contours or color patches on a flat surface can induce mental representations of a three-dimensional scene. This article summarizes some of the recent breakthroughs in scientifically understanding how the brain sees that shed light on these struggles. These breakthroughs illustrate how various artists have intuitively understand paradoxical properties about how the brain sees, and have used that understanding to create great art. These paradoxical properties arise from how the brain forms the units of conscious visual perception; namely, representations of three-dimensional boundaries and surfaces. Boundaries and surfaces are computed in parallel cortical processing streams that obey computationally complementary properties. These streams interact at multiple levels to overcome their complementary weaknesses and to transform their complementary properties into consistent percepts. The article describes how properties of complementary consistency have guided the creation of many great works of art.

Fuzzy ART: An Adaptive Resonance Algorithm for Rapid, Stable Classification of Analog Patterns

The Fuzzy ART system introduced herein incorporates computations from fuzzy set theory into ART 1. For example, the intersection (n) operator used in ART 1 learning is replaced by the MIN operator (A) of fuzzy set theory. Fuzzy ART reduces to ART 1 in response to binary input vectors, but can also learn stable categories in response to analog input vectors. In particular, the MIN operator reduces to the intersection operator in the binary case. Learning is stable because all adaptive weights can only decrease in time. A preprocessing step, called complement coding, uses on-cell and off-cell responses to prevent category proliferation. Complement coding normalizes input vectors while preserving the amplitudes of individual feature activations.

ART 2-A: An Adaptive Resonance Algorithm for Rapid Category Learning and Recognition

This article introduces ART 2-A, an efficient algorithm that emulates the self-organizing pattern recognition and hypothesis testing properties of the ART 2 neural network architecture, but at a speed two to three orders of magnitude faster. Analysis and simulations show how the ART 2-A systems correspond to ART 2 dynamics at both the fast-learn limit and at intermediate learning rates. Intermediate learning rates permit fast commitment of category nodes but slow recoding, analogous to properties of word frequency effects, encoding specificity effects, and episodic memory. Better noise tolerance is hereby achieved without a loss of learning stability. The ART 2 and ART 2-A systems are contrasted with the leader algorithm. The speed of ART 2-A makes practical the use of ART 2 modules in large-scale neural computation.

Fuzzy ART: Fast Stable Learning and Categorization of Analog Patterns by an Adaptive Resonance System

A Fuzzy ART model capable of rapid stable learning of recognition categories in response to arbitrary sequences of analog or binary input patterns is described. Fuzzy ART incorporates computations from fuzzy set theory into the ART 1 neural network, which learns to categorize only binary input patterns. The generalization to learning both analog and binary input patterns is achieved by replacing appearances of the intersection operator (n) in AHT 1 by the MIN operator (Λ) of fuzzy set theory. The MIN operator reduces to the intersection operator in the binary case. Category proliferation is prevented by normalizing input vectors at a preprocessing stage. A normalization procedure called complement coding leads to a symmetric theory in which the MIN operator (Λ) and the MAX operator (v) of fuzzy set theory play complementary roles. Complement coding uses on-cells and off-cells to represent the input pattern, and preserves individual feature amplitudes while normalizing the total on-cell/off-cell vector. Learning is stable because all adaptive weights can only decrease in time. Decreasing weights correspond to increasing sizes of category "boxes". Smaller vigilance values lead to larger category boxes. Learning stops when the input space is covered by boxes. With fast learning and a finite input set of arbitrary size and composition, learning stabilizes after just one presentation of each input pattern. A fast-commit slow-recode option combines fast learning with a forgetting rule that buffers system memory against noise. Using this option, rare events can be rapidly learned, yet previously learned memories are not rapidly erased in response to statistically unreliable input fluctuations.

A Neural Network Realization of Fuzzy ART

A neural network realization of the fuzzy Adaptive Resonance Theory (ART) algorithm is described. Fuzzy ART is capable of rapid stable learning of recognition categories in response to arbitrary sequences of analog or binary input patterns. Fuzzy ART incorporates computations from fuzzy set theory into the ART 1 neural network, which learns to categorize only binary input patterns, thus enabling the network to learn both analog and binary input patterns. In the neural network realization of fuzzy ART, signal transduction obeys a path capacity rule. Category choice is determined by a combination of bottom-up signals and learned category biases. Top-down signals impose upper bounds on feature node activations.

Adaptive Resonance Associative Map: A Hierarchical ART System for Fast Stable Associative Learning

This paper introduces a new class of predictive ART architectures, called Adaptive Resonance Associative Map (ARAM) which performs rapid, yet stable heteroassociative learning in real time environment. ARAM can be visualized as two ART modules sharing a single recognition code layer. The unit for recruiting a recognition code is a pattern pair. Code stabilization is ensured by restricting coding to states where resonances are reached in both modules. Simulation results have shown that ARAM is capable of self-stabilizing association of arbitrary pattern pairs of arbitrary complexity appearing in arbitrary sequence by fast learning in real time environment. Due to the symmetrical network structure, associative recall can be performed in both directions.

Team-teaching for inclusive learning: Purposes, practices and perceptions of a team-teaching initiative in Irish post-primary schools

Background. Schools unequivocally privilege solo-teaching. This research seeks to enhance our understanding of team-teaching by examining how two teachers, working in the same classroom at the same time, might or might not contribute to the promotion of inclusive learning. There are well-established policy statements that encourage change and moves towards the use of team-teaching to promote greater inclusion of students with special educational needs in mainstream schools and mainstream classrooms. What is not so well established is the practice of team-teaching in post-primary settings, with little research conducted to date on how it can be initiated and sustained, and a dearth of knowledge on how it impacts upon the students and teachers involved. Research questions and aims. In light of the paucity and inconclusive nature of the research on team-teaching to date (Hattie, 2009), the orientating question in this study asks ‘To what extent, can the introduction of a formal team-teaching initiative enhance the quality of inclusive student learning and teachers’ learning at post-primary level?’ The framing of this question emerges from ongoing political, legal and educational efforts to promote inclusive education. The study has three main aims. The first aim of this study is to gather and represent the voices and experiences of those most closely involved in the introduction of team-teaching; students, teachers, principals and administrators. The second aim is to generate a theory-informed understanding of such collaborative practices and how they may best be implemented in the future. The third aim is to advance our understandings regarding the day-to-day, and moment-to-moment interactions, between teachers and students which enable or inhibit inclusive learning. Sample. In total, 20 team-teaching dyads were formed across seven project schools. The study participants were from two of the seven project schools, Ash and Oak. It involved eight teachers and 53 students, whose age ranged from 12-16 years old, with 4 teachers forming two dyads per school. In Oak there was a class of first years (n=11) with one dyad and a class of transition year students (n=24) with the other dyad. In Ash one class group (n=18) had two dyads. The subjects in which the dyads engaged were English and Mathematics. Method. This research adopted an interpretive paradigm. The duration of the fieldwork was from April 2007 to June 2008. Research methodologies included semi-structured interviews (n=44), classroom observation (n=20), attendance at monthly teacher meetings (n=6), questionnaires and other data gathering practices which included school documentation, assessment findings and joint examination of student work samples (n=4). Results. Team-teaching involves changing normative practices, and involves placing both demands and opportunities before those who occupy classrooms (teachers and students) and before those who determine who should occupy these classrooms (principals and district administrators). This research shows how team-teaching has the potential to promote inclusive learning, and when implemented appropriately, can impact positively upon the learning experiences of both teachers and students. The results are outlined in two chapters. In chapter four, Social Capital Theory is used in framing the data, the change process of bonding, bridging and linking, and in capturing what the collaborative action of team-teaching means, asks and offers teachers; within classes, between classes, between schools and within the wider educational community. In chapter five, Positioning Theory deductively assists in revealing the moment-to-moment, dynamic and inclusive learning opportunities, that are made available to students through team-teaching. In this chapter a number of vignettes are chosen to illustrate such learning opportunities. These two theories help to reveal the counter-narrative that team-teaching offers, regarding how both teachers and students teach and learn. This counter-narrative can extend beyond the field of special education and include alternatives to the manner in which professional development is understood, implemented, and sustained in schools and classrooms. Team-teaching repositions teachers and students to engage with one another in an atmosphere that capitalises upon and builds relational trust and shared cognition. However, as this research study has found, it is wise that the purposes, processes and perceptions of team-teaching are clear to all so that team-teaching can be undertaken by those who are increasingly consciously competent and not merely accidentally adequate. Conclusions. The findings are discussed in the context of the promotion of effective inclusive practices in mainstream settings. I believe that such promotion requires more nuanced understandings of what is being asked of, and offered to, teachers and students. Team-teaching has, and I argue will increasingly have, its place in the repertoire of responses that support effective inclusive learning. To capture and extend such practice requires theoretical frameworks that facilitate iterative journeys between research, policy and practice. Research to date on team-teaching has been too focused on outcomes over short timeframes and not focused enough on the process that is team-teaching. As a consequence team-teaching has been under-used, under-valued, under-theorised and generally not very well understood. Moving from classroom to staff room and district board room, theoretical frameworks used in this research help to travel with, and understand, the initiation, engagement and early consequences of team-teaching within and across the educational landscape. Therefore, conclusions from this study have implications for the triad of research, practice and policy development where efforts to change normative practices can be matched by understandings associated with what it means to try something new/anew, and what it means to say it made a positive difference.

Understanding teacher collaboration in disadvantaged urban primary schools: uncovering practices that foster professional learning communities

This study is set in the context of disadvantaged urban primary schools in Ireland. It inquires into the collaborative practices of primary teachers exploring how class teachers and support teachers develop ways of working together in an effort to improve the literacy and numeracy levels of their student. Traditionally teachers have worked in isolation and therefore ‘collaboration’ as a practice has been slow to permeate the historically embedded assumption of how a teacher should work. This study aims to answer the following questions. 1). What are the dynamics of teacher collaboration in disadvantaged urban primary schools? 2). In what ways are teacher collaboration and teacher learning related? 3). In what ways does teacher collaboration influence students’ opportunities for learning? In answering these research questions, this study aims to contribute to the body of knowledge pertaining to teacher learning through collaboration. Though current policy and literature advocate and make a case for the development of collaborative teaching practices, key studies have identified gaps in the research literature in relation to the impact of teacher collaboration in schools. This study seeks to address some of those gaps by establishing how schools develop a collaborative environment and how teaching practices are enacted in such a setting. It seeks to determine what skills, relationships, structures and conditions are most important in developing collaborative environments that foster the development of professional learning communities (PLCs). This study uses a mixed method research design involving a postal survey, four snap-shot case studies and one in depth case study in an effort to establish if collaborative practice is a feasible practice resulting in worthwhile benefits for both teachers and students.

Student voice in Irish post-primary schools: a drama of voices

This research is an exploration of the expression of student voice in Irish post-primary schools and how its affordance could impact on students’ and teachers’ experiences in the classroom, and at whole-school level through a student council. Student voice refers to the inclusion of students in decisions that shape their experiences in classrooms and schools, and is fundamental to a rights-based perspective that facilitates students to have a voice and a say in their education. Student voice is essential to the development of democratic principles, active citizenship, and learning and pedagogy. This qualitative research, based in three post-primary case-study schools, concerns teachers in eighteen classrooms engaging in dialogic consultation with their students over one school year. Teachers considered the students’ commentary and then adjusted their practice. The operation of student councils was also examined through the voices of council members, liaison teachers and school principals. Theorised within socio-cultural (social constructivist), social constructionist and poststructural frames, the complexity of student voice emerges from its conceptualisation and enactment. Affording students a voice in their classroom presented positive findings in the context of relationships, pedagogical change and students’ engagement, participation and achievement. The power and authority of the teacher and discordant student voices, particularly relating to examinations, presented challenges affecting teachers’ practice and students’ expectations. The functional redundancy of the student council as a construct for student voice at whole-school level, and its partial redundancy as a construct to reflect prefigurative democracy and active citizenship also emerge from the research. Current policy initiatives in Irish education situate student voice in pedagogy and as dialogic consultation at classroom and whole-school level. This work endorses the necessity for and benefit of such a positioning with the author further arguing that it should not become the instrumental student voice of data source, accountability and performativity.

Inclusive education policy, the general allocation model and dilemmas of practice in primary schools

Background: Inclusive education is central to contemporary discourse internationally reflecting societies’ wider commitment to social inclusion. Education has witnessed transforming approaches that have created differing distributions of power, resource allocation and accountability. Multiple actors are being forced to consider changes to how key services and supports are organised. This research constitutes a case study situated within this broader social service dilemma of how to distribute finite resources equitably to meet individual need, while advancing inclusion. It focuses on the national directive with regard to inclusive educational practice for primary schools, Department of Education and Science Special Education Circular 02/05, which introduced the General Allocation Model (GAM) within the legislative context of the Education of Persons with Special Educational Needs (EPSEN) Act (Government of Ireland, 2004). This research could help to inform policy with ‘facts about what is happening on the ground’ (Quinn, 2013). Research Aims: The research set out to unearth the assumptions and definitions embedded within the policy document, to analyse how those who are at the coalface of policy, and who interface with multiple interests in primary schools, understand the GAM and respond to it, and to investigate its effects on students and their education. It examines student outcomes in the primary schools where the GAM was investigated. Methods and Sample The post-structural study acknowledges the importance of policy analysis which explicitly links the ‘bigger worlds’ of global and national policy contexts to the ‘smaller worlds’ of policies and practices within schools and classrooms. This study insists upon taking the detail seriously (Ozga, 1990). A mixed methods approach to data collection and analysis is applied. In order to secure the perspectives of key stakeholders, semi-structured interviews were conducted with primary school principals, class teachers and learning support/resource teachers (n=14) in three distinct mainstream, non-DEIS schools. Data from the schools and their environs provided a profile of students. The researcher then used the Pobal Maps Facility (available at www.pobal.ie) to identify the Small Area (SA) in which each student resides, and to assign values to each address based on the Pobal HP Deprivation Index (Haase and Pratschke, 2012). Analysis of the datasets, guided by the conceptual framework of the policy cycle (Ball, 1994), revealed a number of significant themes. Results: Data illustrate that the main model to support student need is withdrawal from the classroom under policy that espouses inclusion. Quantitative data, in particular, highlighted an association between segregated practice and lower socioeconomic status (LSES) backgrounds of students. Up to 83% of the students in special education programmes are from lower socio-economic status (LSES) backgrounds. In some schools 94% of students from LSES backgrounds are withdrawn from classrooms daily for special education. While the internal processes of schooling are not solely to blame for class inequalities, this study reveals the power of professionals to order children in school, which has implications for segregated special education practice. Such agency on the part of key actors in the context of practice relates to ‘local constructions of dis/ability’, which is influenced by teacher habitus (Bourdieu, 1984). The researcher contends that inclusive education has not resulted in positive outcomes for students from LSES backgrounds because it is built on faulty assumptions that focus on a psycho-medical perspective of dis/ability, that is, placement decisions do not consider the intersectionality of dis/ability with class or culture. This study argues that the student need for support is better understood as ‘home/school discontinuity’ not ‘disability’. Moreover, the study unearths the power of some parents to use social and cultural capital to ensure eligibility to enhanced resources. Therefore, a hierarchical system has developed in mainstream schools as a result of funding models to support need in inclusive settings. Furthermore, all schools in the study are ‘ordinary’ schools yet participants acknowledged that some schools are more ‘advantaged’, which may suggest that ‘ordinary’ schools serve to ‘bury class’ (Reay, 2010) as a key marker in allocating resources. The research suggests that general allocation models of funding to meet the needs of students demands a systematic approach grounded in reallocating funds from where they have less benefit to where they have more. The calculation of the composite Haase Value in respect of the student cohort in receipt of special education support adopted for this study could be usefully applied at a national level to ensure that the greatest level of support is targeted at greatest need. Conclusion: In summary, the study reveals that existing structures constrain and enable agents, whose interactions produce intended and unintended consequences. The study suggests that policy should be viewed as a continuous and evolving cycle (Ball, 1994) where actors in each of the social contexts have a shared responsibility in the evolution of education that is equitable, excellent and inclusive.