Learning with noise and regularizers in multilayer neural networks

We study the effect of two types of noise, data noise and model noise, in an on-line gradient-descent learning scenario for general two-layer student network with an arbitrary number of hidden units. Training examples are randomly drawn input vectors labeled by a two-layer teacher network with an arbitrary number of hidden units. Data is then corrupted by Gaussian noise affecting either the output or the model itself. We examine the effect of both types of noise on the evolution of order parameters and the generalization error in various phases of the learning process.

Finite-size effects in on-line learning of multilayer neural networks

We complement recent advances in thermodynamic limit analyses of mean on-line gradient descent learning dynamics in multi-layer networks by calculating fluctuations possessed by finite dimensional systems. Fluctuations from the mean dynamics are largest at the onset of specialisation as student hidden unit weight vectors begin to imitate specific teacher vectors, increasing with the degree of symmetry of the initial conditions. In light of this, we include a term to stimulate asymmetry in the learning process, which typically also leads to a significant decrease in training time.

Learning with regularizers in multilayer neural networks

We study the effect of regularization in an on-line gradient-descent learning scenario for a general two-layer student network with an arbitrary number of hidden units. Training examples are randomly drawn input vectors labelled by a two-layer teacher network with an arbitrary number of hidden units which may be corrupted by Gaussian output noise. We examine the effect of weight decay regularization on the dynamical evolution of the order parameters and generalization error in various phases of the learning process, in both noiseless and noisy scenarios.

Embedding e-portfolios for effective lifelong learning:a case study

Lifelong learning is a ‘keystone’ of educational policies (Faure, 1972) where the emphasis on learning shifts from teacher to learner. Higher Education (HE) institutions should be committed to developing lifelong learning, that is promoting learning that is flexible, diverse and relevant at different times, and in different places, and is pursued throughout life. Therefore the HE sector needs to develop effective strategies to encourage engagement in meaningful learning for diverse student populations. The use of e-portfolios, as a ‘purposeful aggregation of digital items’ (Sutherland & Powell, 2007), can meet the needs of the student community by encouraging reflection, the recording of experiences and achievements, and personal development planning (PDP). The use of e-portfolios also promotes inclusivity in learning as it provides students with the opportunity to articulate their aspirations and take the first steps along the pathway of lifelong learning. However, ensuring the uptake of opportunities within their learning is more complex than the students simply having access to the software. Therefore it is argued here that crucial to the effective uptake and engagement of the e-portfolio is embedding it purposefully within the curriculum. In order to investigate effective implementation of e-portfolios an explanatory case study on their use was carried out, initially focusing on 3 groups of students engaged in work-based learning and professional practice. The 3 groups had e-Portfolios embedded and assessed at different levels. Group 1 did not have the e-Portfolio embedded into their curriculum nor was the e-Portfolio assessed. Group 2 had the e-Portfolio embedded into the curriculum and formatively assessed. Group 3 also had the e-Portfolio embedded into the curriculum and were summatively assessed. Results suggest that the use of e-Portfolios needs to be integral to curriculum design in modules rather than used as an additional tool. In addition to this more user engagement was found in group 2 where the e-Portfolio was formatively assessed only. The implications of this case study are further discussed in terms of curriculum development.

Evaluation of the quality and promotion of open learning materials

In the UK, Open Learning has been used in industrial training for at least the last decade. Trainers and Open Learning practitioners have been concerned about the quality of the products and services being delivered. The argument put forward in this thesis is that there is ambiguity amongst industrialists over the meanings of `Open Learning' and `Quality in Open Learning'. For clarity, a new definition of Open Learning is proposed which challenges the traditional learner-centred approach favoured by educationalists. It introduces the concept that there are benefits afforded to the trainer/employer/teacher as well as to the learner. This enables a focussed view of what quality in Open Learning really means. Having discussed these issues, a new quantitative method of evaluating Open Learning is proposed. This is based upon an assessment of the degree of compliance with which products meet Parts 1 & 2 of the Open Learning Code of Practice. The vehicle for these research studies has been a commercial contract commissioned by the Training Agency for the Engineering Industry Training Board (EITB) to examine the quality of Open Learning products supplied to the engineering industry. A major part of this research has been the application of the evaluation technique to a range of 67 Open Learning products (in eight subject areas). The findings were that good quality products can be found right across the price range - so can average and poor quality ones. The study also shows quite convincingly that there are good quality products to be found at less than 50. Finally the majority (24 out of 34) of the good quality products were text based.

Qualitative psychology at M level: a dialogue between learner and teacher

There are now more postgraduate programmes that include qualitative methods in psychology than ever before. This poses problems for teaching qualitative methods at M level because we still lack consistency in what qualitative methods are taught at the undergraduate level. Although the British Psychological Society requires accredited undergraduate programmes to include qualitative methods, we hear very different stories from colleagues across the UK about provision and quality. In this article, we present a dialogue between learner and teacher about our own experiences of qualitative methods in psychology at M level. We report our own learning experiences of qualitative methods at the undergraduate level, reflect on current methods of teaching at M level, and consider ways of moving forward. As well as focusing specifically on current practice at our institution, our discussions also branch out into wider issues around the fundamental characteristics of qualitative methods, pragmatically and philosophically, as well as our own accounts of what we enjoy most about using qualitative methods in psychology.

Motivational state and process within the sociolinguistic context : an Anglo-French comparative study of school pupils learning foreign languages

The aim of this study was to investigate the effect of the socio-cultural environment upon the motivation school children have to learn foreign languages. Motivation was therefore considered from a sociolinguistic, rather than from a psycholinguistic perspective, giving primary importance to contextual, as opposed to personal factors. In order to examine the degree of relationship between motivational intensity and the contextual factors of parental attitudes, amount of foreign language exposure and the employment related value of foreign language learning (FLL), data obtained from school children living in two distinct sociolinguistic environments (Mulhouse, France and Walsall, England) were compared and contrasted. A structured sample drawn from pupils attending schools in Mulhouse and Walsall supplied the data base for this research. The main thrust of the study was quantitative in approach, involving the distribution of almost 1000 questionnaires to pupils in both towns. This was followed up by the use of qualitative methods, in the form of in-depth interviews with an individually matched sample of over 50 French/English pupils. The findings of the study indicate that FLL orientations, attitudes and motivation vary considerably between the two sociolinguistic environments. Levels of motivation were generally higher in the French sample than in the English one. Desire to learn foreign languages and a commitment to expend effort in order to fulfil this desire were key components of this motivation. The study also found evidence to suggest that the importance accorded to FLL by the socio-cultural context, communicated to the child through the socialisation agents of the family, the mass media and prospective employers, is of key importance in FLL motivation.

Speaking out of turn? Taking the initiative in teacher-fronted classroom interaction.

Teacher-fronted interaction is generally seen to place limitations on the contributions that learners can make to classroom discourse and the conclusion is that learners are unable to experiment with, for example, turn-taking mechanisms. This article looks at teacher-fronted interaction in the language classroom from the perspective of learner talk by examining how learners might take the initiative during this apparently more rigid form of interaction. Detailed microanalysis of classroom episodes, using a conversation analysis institutional discourse approach, shows how learners orient to the institutional context to make sophisticated and effective use of turn-taking mechanisms to take the initiative and direct the interaction, even in the controlled environment of teacher-fronted talk. The article describes some of the functions of such learner initiative, examines how learners and teachers co-construct interaction and how learners can create learning opportunities for themselves. It also briefly looks at teacher reactions to such initiative. The article concludes that learner initiative in teacher-fronted interaction may constitute a significant opportunity for learning and that teachers should find ways of encouraging such interaction patterns.

Learning in ultrametric committee machines

The problem of learning by examples in ultrametric committee machines (UCMs) is studied within the framework of statistical mechanics. Using the replica formalism we calculate the average generalization error in UCMs with L hidden layers and for a large enough number of units. In most of the regimes studied we find that the generalization error, as a function of the number of examples presented, develops a discontinuous drop at a critical value of the load parameter. We also find that when L>1 a number of teacher networks with the same number of hidden layers and different overlaps induce learning processes with the same critical points.

Training Primary School Teachers to use E-Learning Technologies – A Pilot Study

In this paper we present a blended learning scenario for training of students in master program “ICT in primary school” carried out in South-West University “Neofit Rilski”. Our approach is based on “face to face” lectures and seminars, SCORM compatible e-learning content with a lot of simulation demonstrations, trainings and self assessment, group problem based learning. Also we discuss the results of the course and attitude of the participants in the course towards used methods and possibilities of application of e-learning in primary schools.

Education in Computer Science and the Role of the Teacher in the Environment of Open Educational Resources

Report published in the Proceedings of the National Conference on "Education in the Information Society", Plovdiv, May, 2013

Technology enhanced learning in Higher Education

Technology-Enhanced Learning in Higher Education is an anthology produced by the international association, Learning in Higher Education (LiHE). LiHE, whose scope includes the activities of colleges, universities and other institutions of higher education, has been one of the leading organisations supporting a shift in the education process from a transmission-based philosophy to a student-centred, learning-based approach. Traditionally education has been envisaged as a process in which the teacher disseminates knowledge and information to the student, and directs them to perform – instructing, cajoling, encouraging them as appropriate – despite different students’ abilities. Yet higher education is currently experiencing rapid transformation, with the introduction of a broad range of technologies which have the potential to enhance student learning. This anthology draws upon the experiences of those practitioners who have been pioneering new applications of technology in higher education, highlighting not only the technologies themselves but also the impact which they have had on student learning. The anthology illustrates how new technologies – which are increasingly well-known and accepted by today’s ‘digital natives’ undertaking higher education – can be adopted and incorporated. One key conclusion is that learning remains a social process even in technology-enhanced learning contexts. So the technology-based proxies we construct need to retain and reflect the agency of the teacher. Technology-Enhanced Learning in Higher Education showcases some of the latest pedagogical technologies and their most creative, state-of-the-art applications to learning in higher education from around the world. Each of the chapters explores technology-enhanced learning in higher education in terms of either policy or practice. They contain detailed descriptions of approaches taken in very different curriculum areas, and demonstrate clearly that technology may and can enhance learning only if it is designed with the learning process of students at its core. So the use of technology in education is more linked to pedagogy than it is to bits and bytes.

Teacher use of personal narratives in the Japanese university english language classroom

While storytelling in conversation has been extensively investigated, much less is known about storytelling in the English language classroom, particularly teachers telling their personal experience stories, termed teacher personal narratives in this study. Teacher personal narratives, a combination of the ancient art of human storytelling and the current practices of teaching, offer an innovative approach to language teaching and learning. This thesis examines teacher personal narrative use in Japanese university English language classrooms and is of relevance to both practicing classroom teachers and teacher educators because it explores the role, significance, and effectiveness of personal stories told by teachers. The pedagogical implications which the findings may have for language teaching and learning as well as for teacher education programs are also discussed. Four research questions were posed: 1. What are the characteristics of teacher personal narratives? 2. When, how, and why do language teachers use personal narratives in the classroom? 3. What is the reaction of learners to teacher personal narratives? 4. How do teacher personal narratives provide opportunities for student learning? A mixed methods approach using the tradition of multiple case studies provided an in-depth exploration of the personal narratives of four teachers. Data collection consisted of classroom observations and audio recordings, teacher and student semi-structured interviews, student diaries, and Japan-wide teacher questionnaires. Ninety-seven teacher personal narratives were analyzed for their structural and linguistic features. The findings showed that the narrative elements of orientation, complication, and evaluation are almost always present in these stories, and that discourse and tense markers may aid in student noticing of the input which can lead to eventual student output. The data also demonstrated that reasons for telling narratives mainly fall into two categories: affectiveoriented and pedagogical-oriented purposes. This study has shown that there are significant differences between conversational storytelling and educational storytelling.