Learning Nonlinear Visual Processing from Natural Images

The paradigm of computational vision hypothesizes that any visual function -- such as the recognition of your grandparent -- can be replicated by computational processing of the visual input. What are these computations that the brain performs? What should or could they be? Working on the latter question, this dissertation takes the statistical approach, where the suitable computations are attempted to be learned from the natural visual data itself. In particular, we empirically study the computational processing that emerges from the statistical properties of the visual world and the constraints and objectives specified for the learning process. This thesis consists of an introduction and 7 peer-reviewed publications, where the purpose of the introduction is to illustrate the area of study to a reader who is not familiar with computational vision research. In the scope of the introduction, we will briefly overview the primary challenges to visual processing, as well as recall some of the current opinions on visual processing in the early visual systems of animals. Next, we describe the methodology we have used in our research, and discuss the presented results. We have included some additional remarks, speculations and conclusions to this discussion that were not featured in the original publications. We present the following results in the publications of this thesis. First, we empirically demonstrate that luminance and contrast are strongly dependent in natural images, contradicting previous theories suggesting that luminance and contrast were processed separately in natural systems due to their independence in the visual data. Second, we show that simple cell -like receptive fields of the primary visual cortex can be learned in the nonlinear contrast domain by maximization of independence. Further, we provide first-time reports of the emergence of conjunctive (corner-detecting) and subtractive (opponent orientation) processing due to nonlinear projection pursuit with simple objective functions related to sparseness and response energy optimization. Then, we show that attempting to extract independent components of nonlinear histogram statistics of a biologically plausible representation leads to projection directions that appear to differentiate between visual contexts. Such processing might be applicable for priming, \ie the selection and tuning of later visual processing. We continue by showing that a different kind of thresholded low-frequency priming can be learned and used to make object detection faster with little loss in accuracy. Finally, we show that in a computational object detection setting, nonlinearly gain-controlled visual features of medium complexity can be acquired sequentially as images are encountered and discarded. We present two online algorithms to perform this feature selection, and propose the idea that for artificial systems, some processing mechanisms could be selectable from the environment without optimizing the mechanisms themselves. In summary, this thesis explores learning visual processing on several levels. The learning can be understood as interplay of input data, model structures, learning objectives, and estimation algorithms. The presented work adds to the growing body of evidence showing that statistical methods can be used to acquire intuitively meaningful visual processing mechanisms. The work also presents some predictions and ideas regarding biological visual processing.

Theories of moral education and implementation in Indonesia: Re-energizing cultural identity and addressing future challenges

School is regarded as a site of moral training for the younger generation to encounter nation’s future challenges as well as to re-energize nation’s cultural identity. The more competitive global society led by free market trade in terms of ASEAN Economic Community (AEC), requires the school to adapt and change its curriculum more frequently. Like many other countries, Indonesian Ministry of Education and Culture has introduced and nurtured universal values and traditional values respectively through school curriculum reforms to develop students’ ability to participating in global society. This paper will describe classical and contemporary theories related to moral education that have been implemented in Indonesia’s school curriculum and school activities. The theories developed by Durkheim, Alastair MacIntyre, and Basil Bernstein will be discussed. This includes explaining how far the theories have been adopted in Indonesia and how the approaches are currently being used in Indonesian schooling. This paper suggests despite the implementation of those theories in Indonesian schools, the government needs to optimise the operation of those theories to gain significant outcomes.

The social tasks of learning to become a physical education teacher: Considering the HPE subject department as a community of practice

Initial teacher education (ITE) students participate in various workplaces within schools and in doing so, form understandings about the numerous, and at times competing, expectations of teachers’ work. Through these experiences they form understandings about themselves as health and physical education (HPE) teachers. This paper examines the ways communities of practice within HPE subject department offices function as sites of workplace learning for student teachers. In particular this research focused on how ITE students negotiate tacit and contradictory expectations as well as social tasks during the practicum and the ways in which their understandings are mediated through participation in the workspace. Qualitative methods of survey and semi-structured interview were used to collect data on a cohort of student teachers during and following their major (10 week) practicum experience. Analysis was informed by theories of communities of practice (Wenger, 1998), workplace learning (Billett, 2001), and social task systems (Doyle, 1977). It was evident that considerable effort, attention, and energy was expended on various interrelated social tasks aimed at building positive relationships with their supervisor and other HPE teachers at the school. The social dynamics were highly nuanced and required a game-like approach. In our view the complexity that student teachers must negotiate in striving for an excellent evaluation warrants specific attention in physical education teacher education (PETE) programs. This study raises questions regarding our responsibilities in sending student teachers into contexts that might even be described as toxic. We offer some suggestions for how PETE might better support students going into practicum contexts that might be regarded as problematic workplaces.

Teaching about deliberative politics: Case studies of classroom–community learning projects in four nations

Theories of deliberative politics position grass-roots community members as more than spectators of politics, and instead recognize their capacity for political engagement by discussing and evaluating options in order to make decisions about issues affecting community life. The processes and products of journalism can assist deliberative politics by providing community members with information resources that are vital for understanding the root causes of problems, weighing up competing claims, forming networks around shared concerns, reaching decisions and undertaking action. This article presents the findings of case studies of four community–classroom projects--one each from Australia, New Zealand, the United States and South Africa--that develop the capacity of journalism students to be effective contributors to deliberative politics. The research points to the importance of learning activities that prepare students to work in diverse communities, map significant community places and structures, identify leaders and stakeholders, engage in respectful dialogue about problems and perspectives, and appreciate community frames and values.

Opponent appetitive-aversive neural processes underlie predictive learning of pain relief.

Termination of a painful or unpleasant event can be rewarding. However, whether the brain treats relief in a similar way as it treats natural reward is unclear, and the neural processes that underlie its representation as a motivational goal remain poorly understood. We used fMRI (functional magnetic resonance imaging) to investigate how humans learn to generate expectations of pain relief. Using a pavlovian conditioning procedure, we show that subjects experiencing prolonged experimentally induced pain can be conditioned to predict pain relief. This proceeds in a manner consistent with contemporary reward-learning theory (average reward/loss reinforcement learning), reflected by neural activity in the amygdala and midbrain. Furthermore, these reward-like learning signals are mirrored by opposite aversion-like signals in lateral orbitofrontal cortex and anterior cingulate cortex. This dual coding has parallels to 'opponent process' theories in psychology and promotes a formal account of prediction and expectation during pain.

Temporal difference models describe higher-order learning in humans.

The ability to use environmental stimuli to predict impending harm is critical for survival. Such predictions should be available as early as they are reliable. In pavlovian conditioning, chains of successively earlier predictors are studied in terms of higher-order relationships, and have inspired computational theories such as temporal difference learning. However, there is at present no adequate neurobiological account of how this learning occurs. Here, in a functional magnetic resonance imaging (fMRI) study of higher-order aversive conditioning, we describe a key computational strategy that humans use to learn predictions about pain. We show that neural activity in the ventral striatum and the anterior insula displays a marked correspondence to the signals for sequential learning predicted by temporal difference models. This result reveals a flexible aversive learning process ideally suited to the changing and uncertain nature of real-world environments. Taken with existing data on reward learning, our results suggest a critical role for the ventral striatum in integrating complex appetitive and aversive predictions to coordinate behaviour.

The user-value of rural electrification: An analysis and adoption of existing models and theories

User-value is a determining factor for product acceptance in product design. Research on rural electrification to date, however, does not draw sufficient attention to the importance of user-value with regard to the overall success of a project. This is evident from the analysis of project reports and applicable indicators from agencies active in the sector. Learning from the design, psychology and sociology literatures, it is important that rural electrification projects incorporate the value perception of the end-user and extend their success beyond the commonly used criteria of financial value, the appropriateness of the technology, capacity building and technology uptake. Creating value for the end-user is particularly important for project acceptance and the sustainability of a scheme once it has been handed over to the local community. In this research paper, existing theories and models of value-theory are transposed and applied to community operated rural electrification schemes and a user-value framework is developed. Furthermore, the importance of value to the end-user is clarified. Current literature on product design reveals that user-value has different properties, many of which are applicable to rural electrification. Five value pillars and their sub-categories important for the users of rural electrification projects are identified, namely: functional; social significance; epistemic; emotional; and cultural values. These pillars provide the main structure for the conceptual framework developed in this research paper. It is proposed that by targeting the values of the end-user, the key factors of user-value applicable to rural electrification projects will be identified and the sustainability of the project will be better ensured. © 2014 The Authors.

The Implications of Philosophical Foundations for Knowledge Representation and Learning in Agents

N.J. Lacey and M.H. Lee, ?The Implications of Philosophical Foundations for Knowledge Representation and Learning in Agents?, Springer-Verlag Lecture Notes on Artificial Intelligence, Vol 2636 on Adaptive Agents and Multi-Agent Systems, 2002.

Team-teaching for inclusive learning: Purposes, practices and perceptions of a team-teaching initiative in Irish post-primary schools

Background. Schools unequivocally privilege solo-teaching. This research seeks to enhance our understanding of team-teaching by examining how two teachers, working in the same classroom at the same time, might or might not contribute to the promotion of inclusive learning. There are well-established policy statements that encourage change and moves towards the use of team-teaching to promote greater inclusion of students with special educational needs in mainstream schools and mainstream classrooms. What is not so well established is the practice of team-teaching in post-primary settings, with little research conducted to date on how it can be initiated and sustained, and a dearth of knowledge on how it impacts upon the students and teachers involved. Research questions and aims. In light of the paucity and inconclusive nature of the research on team-teaching to date (Hattie, 2009), the orientating question in this study asks ‘To what extent, can the introduction of a formal team-teaching initiative enhance the quality of inclusive student learning and teachers’ learning at post-primary level?’ The framing of this question emerges from ongoing political, legal and educational efforts to promote inclusive education. The study has three main aims. The first aim of this study is to gather and represent the voices and experiences of those most closely involved in the introduction of team-teaching; students, teachers, principals and administrators. The second aim is to generate a theory-informed understanding of such collaborative practices and how they may best be implemented in the future. The third aim is to advance our understandings regarding the day-to-day, and moment-to-moment interactions, between teachers and students which enable or inhibit inclusive learning. Sample. In total, 20 team-teaching dyads were formed across seven project schools. The study participants were from two of the seven project schools, Ash and Oak. It involved eight teachers and 53 students, whose age ranged from 12-16 years old, with 4 teachers forming two dyads per school. In Oak there was a class of first years (n=11) with one dyad and a class of transition year students (n=24) with the other dyad. In Ash one class group (n=18) had two dyads. The subjects in which the dyads engaged were English and Mathematics. Method. This research adopted an interpretive paradigm. The duration of the fieldwork was from April 2007 to June 2008. Research methodologies included semi-structured interviews (n=44), classroom observation (n=20), attendance at monthly teacher meetings (n=6), questionnaires and other data gathering practices which included school documentation, assessment findings and joint examination of student work samples (n=4). Results. Team-teaching involves changing normative practices, and involves placing both demands and opportunities before those who occupy classrooms (teachers and students) and before those who determine who should occupy these classrooms (principals and district administrators). This research shows how team-teaching has the potential to promote inclusive learning, and when implemented appropriately, can impact positively upon the learning experiences of both teachers and students. The results are outlined in two chapters. In chapter four, Social Capital Theory is used in framing the data, the change process of bonding, bridging and linking, and in capturing what the collaborative action of team-teaching means, asks and offers teachers; within classes, between classes, between schools and within the wider educational community. In chapter five, Positioning Theory deductively assists in revealing the moment-to-moment, dynamic and inclusive learning opportunities, that are made available to students through team-teaching. In this chapter a number of vignettes are chosen to illustrate such learning opportunities. These two theories help to reveal the counter-narrative that team-teaching offers, regarding how both teachers and students teach and learn. This counter-narrative can extend beyond the field of special education and include alternatives to the manner in which professional development is understood, implemented, and sustained in schools and classrooms. Team-teaching repositions teachers and students to engage with one another in an atmosphere that capitalises upon and builds relational trust and shared cognition. However, as this research study has found, it is wise that the purposes, processes and perceptions of team-teaching are clear to all so that team-teaching can be undertaken by those who are increasingly consciously competent and not merely accidentally adequate. Conclusions. The findings are discussed in the context of the promotion of effective inclusive practices in mainstream settings. I believe that such promotion requires more nuanced understandings of what is being asked of, and offered to, teachers and students. Team-teaching has, and I argue will increasingly have, its place in the repertoire of responses that support effective inclusive learning. To capture and extend such practice requires theoretical frameworks that facilitate iterative journeys between research, policy and practice. Research to date on team-teaching has been too focused on outcomes over short timeframes and not focused enough on the process that is team-teaching. As a consequence team-teaching has been under-used, under-valued, under-theorised and generally not very well understood. Moving from classroom to staff room and district board room, theoretical frameworks used in this research help to travel with, and understand, the initiation, engagement and early consequences of team-teaching within and across the educational landscape. Therefore, conclusions from this study have implications for the triad of research, practice and policy development where efforts to change normative practices can be matched by understandings associated with what it means to try something new/anew, and what it means to say it made a positive difference.

The musical enculturation of Irish traditional musicians: An ethnographic study of learning processes

The enculturation of Irish traditional musicians involves informal, non-formal, and sometimes formal learning processes in a number of different settings, including traditional music sessions, workshops, festivals, and classes. Irish traditional musicians also learn directly from family, peers, and mentors and by using various forms of technology. Each experience contributes to the enculturation process in meaningful and complementary ways. The ethnographic research discussed in this dissertation suggests that within Irish traditional music culture, enculturation occurs most effectively when learners experience a multitude of learning practices. A variety of experiences insures that novices receive multiple opportunities for engagement and learning. If a learner finds one learning practice ineffective, there are other avenues of enculturation. This thesis explores the musical enculturation of Irish traditional musicians. It focuses on the process of becoming a musician by drawing on methodologies and theories from ethnomusicology, education, and Irish traditional music studies. Data was gathered through multiple ethnographic methodologies. Fieldwork based on participant-observation was carried out in a variety of learning contexts, including traditional music sessions, festivals, workshops, and weekly classes. Additionally, interviews with twenty accomplished Irish traditional musicians provide diverse narratives and firsthand insight into musical development and enculturation. These and other methodologies are discussed in Chapter 1. The three main chapters of the thesis explore various common learning experiences. Chapter 2 explores how Irish traditional musicians learn during social and musical interactions between peers, mentors, and family members, and focuses on live music-making which occurs in private homes, sessions, and concerts. These informal and non-formal learning experiences primarily take place outside of organizations and institutions. The interview data suggests these learning experiences are perhaps the most pervasive and influential in terms of musical enculturation. Chapter 3 discusses learning experience in more organized settings, such as traditional music classes, workshops, summer schools, and festivals. The role of organizations such as Comhaltas Ceoltóirí Éireann and pipers’ clubs are discussed from the point of view of the learner. Many of the learning experiences explored in this chapter are informal, non-formal, and sometimes formal in nature, depending on the philosophy of the organization, institution, and individual teacher. The interview data and field observations indicate that learning in these contexts is common and plays a significant role in enculturation, particularly for traditional musicians who were born during and after the 1970s. Chapter 4 explores the ways Irish traditional musicians use technology, including written sources, phonography, videography, websites, and emerging technologies, during the enculturation process. Each type of technology presents different educational implications, and traditional musicians use these technologies in diverse ways and some more than others. For this, and other reasons, technology plays a complex role during the process of musical enculturation. Drawing on themes which emerge during Chapter 2, 3, and 4, the final chapter of this dissertation explores overarching patterns of enculturation within Irish traditional music culture. This ethnographic work suggests that longevity of participation and engagement in multiple learning and performance opportunities foster the enculturation of Irish traditional musicians. Through numerous and prolonged participation in music-making, novices become accustomed to and learn musical, social, and cultural behaviours. The final chapter also explores interconnections between learning experiences and also proposes directions for future research.

Reaching across organisational, sectoral and geographical boundaries: exploring the learning potential of an EU cross-border project

Research This paper outlines some of the key findings from an evaluation of the project and demonstrates that EC funded projects such as this, which seek to promote cross border collaboration and understanding (i.e. across organisational, sectoral and geographical boundaries) offer considerable learning potential – not least about variances in health politics across different communities. However, for this learning to be realised a comprehensive system of knowledge management needs to be an integral part of project planning alongside a system for sustaining embryonic professional networks. The concept of managing relationships was also a key part of the projects success. Executing a project funded by the EU demands the development of complex organisational skills to negotiate all the administrative challenges en route to successful completion and this project in particular relied for its success on the development of social relationships of trust and mutual respect across national, professional and social boundaries. Context A three–year European Commission funded project designed to exchange a wide range of staff (professional semiprofessional and voluntary staff in health and social care) project led by the University of Greenwich (UK) and the Université Catholique de Lille, France was completed this year (February 2008). The project was complex because it involved working in different national contexts, was multi-disciplinary, and demanded the negotiation of multiple boundaries. Theories A mixed method evaluation including written reports gathered immediately after each exchange visit and a post hoc series of individual interviews and focus groups was conducted in order to gain qualitative information (from the participants perspective) on their experiences and to identify any learning gained. Results Analysis of the data provided evidence of learning on a number of levels; personally, inter and intra professionally and organisationally as well as across sectors and also from a project management perspective. The learning crystallised around the extent of the differences noted by the participants between the UK and the French health and social care systems despite geographical proximity, common membership of the EU and many shared challenges in health and social care. The extent of these differences, noted at every level from policy to practice proved a rich source for reflection on organisational philosophies, ways of working, distribution of resources, professional roles and autonomy and professional registration and mobility - in short on health politics at ‘macro’ and ‘micro’ levels.

Enhancing social work students’ learning experience and readiness to undertake practice learning.

This project set out to evaluate the effectiveness of social work education by analysing student perceptions of the strengths and limitations of their education and training on the Bachelor of Social Work, Queen’s University, Belfast (QUB) at different stages of their ‘learning journey’ through the programme.
The author’s primary aim in undertaking this study was to contribute evidence-based understanding of the challenges and opportunities students identified themselves within contemporary practice environments. A secondary aim was to test the effectiveness of key approaches, theories and learning tools in common usage in social work education. The authors believe the outcomes generated by the project demonstrate the value of systematically researching student perceptions of their learning experience and feel the study provides important lessons which should help to inform the future development of social work education not only locally but in other parts of the UK.

A defeasible reasoning model of inductive concept learning from examples and communication

This paper introduces a logical model of inductive generalization, and specifically of the machine learning task of inductive concept learning (ICL). We argue that some inductive processes, like ICL, can be seen as a form of defeasible reasoning. We define a consequence relation characterizing which hypotheses can be induced from given sets of examples, and study its properties, showing they correspond to a rather well-behaved non-monotonic logic. We will also show that with the addition of a preference relation on inductive theories we can characterize the inductive bias of ICL algorithms. The second part of the paper shows how this logical characterization of inductive generalization can be integrated with another form of non-monotonic reasoning (argumentation), to define a model of multiagent ICL. This integration allows two or more agents to learn, in a consistent way, both from induction and from arguments used in the communication between them. We show that the inductive theories achieved by multiagent induction plus argumentation are sound, i.e. they are precisely the same as the inductive theories built by a single agent with all data. © 2012 Elsevier B.V.

Testing preference formation in learning design contingent valuation (LDCV) using advanced information and repetitive treatments

Policymakers have largely replaced Single Bounded Discrete Choice (SBDC) valuation by the more statistically efficient repetitive methods; Double Bounded Discrete Choice (DBDC) and Discrete Choice Experiments (DCE) . Repetitive valuation permits classification into rational preferences: (i) a priori well-formed; (ii) consistent non-arbitrary values “discovered” through repetition and experience; (Plott, 1996; List 2003) and irrational preferences; (iii) consistent but arbitrary values as “shaped” by preceding bid level (Tufano, 2010; Ariely et al., 2003) and (iv) inconsistent and arbitrary values. Policy valuations should demonstrate behaviorally rational preferences. We outline novel methods for testing this in DBDC applied to renewable energy premiums in Chile.

Supporting the learning and networking experiences of doctoral students

This study explores the impact of a Graduate Virtual Research Environment (GVRE) on the learning and networking experiences of research students. The GVRE was established to support and enhance research skills and employability training across a university. It provides an extensive range of resources including video reflections based on the experiences of students and staff; GVRE members are encouraged to comment and engage in discussions on these resources. Our work is framed using social theories of learning and the role of communities in the support and development of research students. In particular, we are interested in exploring the challenges involved in developing communities and networks for students whose main focus is their individual research. The GVRE was made available to over 600 students and in this research we explore its impact on the experiences of research students. In particular, we investigate four questions: (a) what impact does the students use of the GVRE have on the development of their research skills; (b) what impact does membership of the GVRE have on the networks and communities of research students; (c) how do research students view the relationships between their research skills training programme, their individual research and the GVRE; and (d) how do research students currently use social media. We use an interpretivist approach and our data sources include site statistics, responses to a questionnaire and also feedback from a focus group. Our findings indicate that networking remains an issue and students suggested approaches to facilitating this using the GVRE: (1) A clearer pathway from skills need identification to skills acquisition; (2) Rewards for activities around networking - possibly through credit on the training scheme; (3) Activities that would involve research directly. Feedback on the GVRE indicated that it is valued by research students as it facilitates the development of their research skills. In terms of marketing the GVRE to research students important factors identified were: the ease of access to the site, the overview it gives of the PhD process; and the value of the site to students around the defining moments of their studies when the students felt they needed additional advice and guidance.