Evaluating the impact of a web-based resource on student learning

This paper reports on an experiment of using a publisher provided web-based resource to make available a series of optional practice quizzes and other supplementary material to all students taking a first year introductory microeconomics module. The empirical analysis evaluates the impact these supplementary resources had on student learning. First, we investigate which students decided to make use of the resources. Then, we analyse the impact this decision has on their subsequent performance in the examination at the end of the module. The results show that, even after taking into account the possibility of self-selection bias, using the web-based resource had a significant positive effect on student learning.

The UK MPharm (1) - are we over reliant on traditional teaching methods?

Introduction-The design of the UK MPharm curriculum is driven by the Royal Pharmaceutical Society of Great Britain (RPSGB) accreditation process and the EU directive (85/432/EEC).[1] Although the RPSGB is informed about teaching activity in UK Schools of Pharmacy (SOPs), there is no database which aggregates information to provide the whole picture of pharmacy education within the UK. The aim of the teaching, learning and assessment study [2] was to document and map current programmes in the 16 established SOPs. Recent developments in programme delivery have resulted in a focus on deep learning (for example, through problem based learning approaches) and on being more student centred and less didactic through lectures. The specific objectives of this part of the study were (a) to quantify the content and modes of delivery of material as described in course documentation and (b) having categorised the range of teaching methods, ask students to rate how important they perceived each one for their own learning (using a three point Likert scale: very important, fairly important or not important). Material and methods-The study design compared three datasets: (1) quantitative course document review, (2) qualitative staff interview and (3) quantitative student self completion survey. All 16 SOPs provided a set of their undergraduate course documentation for the year 2003/4. The documentation variables were entered into Excel tables. A self-completion questionnaire was administered to all year four undergraduates, using a pragmatic mixture of methods, (n=1847) in 15 SOPs within Great Britain. The survey data were analysed (n=741) using SPSS, excluding non-UK students who may have undertaken part of their studies within a non-UK university. Results and discussion-Interviews showed that individual teachers and course module leaders determine the choice of teaching methods used. Content review of the documentary evidence showed that 51% of the taught element of the course was delivered using lectures, 31% using practicals (includes computer aided learning) and 18% small group or interactive teaching. There was high uniformity across the schools for the first three years; variation in the final year was due to the project. The average number of hours per year across 15 schools (data for one school were not available) was: year 1: 408 hours; year 2: 401 hours; year 3: 387 hours; year 4: 401 hours. The survey showed that students perceived lectures to be the most important method of teaching after dispensing or clinical practicals. Taking the very important rating only: 94% (n=694) dispensing or clinical practicals; 75% (n=558) lectures; 52% (n=386) workshops, 50% (n=369) tutorials, 43% (n=318) directed study. Scientific laboratory practices were rated very important by only 31% (n=227). The study shows that teaching of pharmacy to undergraduates in the UK is still essentially didactic through a high proportion of formal lectures and with high levels of staff-student contact. Schools consider lectures still to be the most cost effective means of delivering the core syllabus to large cohorts of students. However, this does limit the scope for any optionality within teaching, the scope for small group work is reduced as is the opportunity to develop multi-professional learning or practice placements. Although novel teaching and learning techniques such as e-learning have expanded considerably over the past decade, schools of pharmacy have concentrated on lectures as the best way of coping with the huge expansion in student numbers. References [1] Council Directive. Concerning the coordination of provisions laid down by law, regulation or administrative action in respect of certain activities in the field of pharmacy. Official Journal of the European Communities 1985;85/432/EEC. [2] Wilson K, Jesson J, Langley C, Clarke L, Hatfield K. MPharm Programmes: Where are we now? Report commissioned by the Pharmacy Practice Research Trust., 2005.

The UK MPharm (2) - Do we over assess?

Introduction-The pace of structural change in the UK health economies, the new focus on regulation and the breaking down of professional boundaries means that the Royal Pharmaceutical Society of Great Britain (RPSGB) has to continually review the scope, range and outputs of education provided by schools of pharmacy (SOPs). In SOPs, the focus is on equipping students with the knowledge, skills and attitudes necessary to successfully engage with the pre-registration year. The aim of this study [1] was to map current programmes and undergraduate experiences to inform the RPSGB debate. The specific objectives of this paper are to describe elements of the survey of final year undergraduates, to explore student opinions and experiences of their workload, teaching, learning and assessment. Material and methods-The three main research techniques were: (1) quantitative course document review, (2) qualitative staff interview and (3) quantitative student self completion survey. The questions in the survey were based on findings from exploratory focus group work with BPSA (British Pharmaceutical Students’ Association) members and were designed to ascertain if views expressed in the focus groups on the volume and format of assessments were held by the general student cohort. The student self completion questionnaire consisting of 31 questions, was administered in 2005 to all (n=1847) final year undergraduates, using a pragmatic mixture of methods. The sample was 15 SOPs within the UK (1 SOP opted out). The total response rate was 50.62% (n=935): it varied by SOP from 14.42% to 84.62%. The survey data were analysed (n=741) using SPSS, excluding non-UK students who may have undertaken part of their studies within a non-UK university. Results and discussion • 76% (n=562) respondents considered that the amount of formal assessment was about right, 21% (n=158) thought it was too much. • There was agreement that the MPharm seems to have more assessment than other courses, with 63% (n=463) strongly agreeing or agreeing. • The majority considered the balance between examinations and coursework was about right (67%, n=498), with 27% (n=198) agreeing that the balance was too far weighted towards examinations. • 57% (n=421) agreed that the focus of MPharm assessment was too much towards memorised knowledge, 40% (n=290) that it was about right. • 78% (n= 575) agreed with the statement “Assessments don’t measure the skills for being a pharmacist they just measure your knowledge base”. Only 10% (n=77) disagreed. • Similarly 49% (n=358) disagreed with, and 35% (n=256) were not sure about the statement “I consider that the assessments used in the MPharm course adequately measure the skills necessary to be a pharmacist”. Only 17% (n=124) agreed. Experience from this study shows the difficulty of administering survey instruments through UK Schools of Pharmacy. It is heavily dependent on timing, goodwill and finding the right person. The variability of the response rate between SOPs precluded any detailed analysis by School. Nevertheless, there are some interesting results. Issues raised in the exploratory focus group work about amount of assessment and over reliance on knowledge have been confirmed. There is a real debate to be had about the extent to which the undergraduate course, which must instil scientific knowledge, can provide students with the requisite qualities, skills, attitudes and behaviour that are more easily acquired in the pre-registration year. References [1] Wilson K, Jesson J, Langley C, Clarke L, Hatfield K. MPharm Programmes: Where are we now? Report commissioned by the Pharmacy Practice Research Trust., 2005.

A novel adaptive weight selection algorithm for multi-objective multi-agent reinforcement learning

To solve multi-objective problems, multiple reward signals are often scalarized into a single value and further processed using established single-objective problem solving techniques. While the field of multi-objective optimization has made many advances in applying scalarization techniques to obtain good solution trade-offs, the utility of applying these techniques in the multi-objective multi-agent learning domain has not yet been thoroughly investigated. Agents learn the value of their decisions by linearly scalarizing their reward signals at the local level, while acceptable system wide behaviour results. However, the non-linear relationship between weighting parameters of the scalarization function and the learned policy makes the discovery of system wide trade-offs time consuming. Our first contribution is a thorough analysis of well known scalarization schemes within the multi-objective multi-agent reinforcement learning setup. The analysed approaches intelligently explore the weight-space in order to find a wider range of system trade-offs. In our second contribution, we propose a novel adaptive weight algorithm which interacts with the underlying local multi-objective solvers and allows for a better coverage of the Pareto front. Our third contribution is the experimental validation of our approach by learning bi-objective policies in self-organising smart camera networks. We note that our algorithm (i) explores the objective space faster on many problem instances, (ii) obtained solutions that exhibit a larger hypervolume, while (iii) acquiring a greater spread in the objective space.

Learning to be different:heterogeneity and efficiency in distributed smart camera networks

In this paper we study the self-organising behaviour of smart camera networks which use market-based handover of object tracking responsibilities to achieve an efficient allocation of objects to cameras. Specifically, we compare previously known homogeneous configurations, when all cameras use the same marketing strategy, with heterogeneous configurations, when each camera makes use of its own, possibly different marketing strategy. Our first contribution is to establish that such heterogeneity of marketing strategies can lead to system wide outcomes which are Pareto superior when compared to those possible in homogeneous configurations. However, since the particular configuration required to lead to Pareto efficiency in a given scenario will not be known in advance, our second contribution is to show how online learning of marketing strategies at the individual camera level can lead to high performing heterogeneous configurations from the system point of view, extending the Pareto front when compared to the homogeneous case. Our third contribution is to show that in many cases, the dynamic behaviour resulting from online learning leads to global outcomes which extend the Pareto front even when compared to static heterogeneous configurations. Our evaluation considers results obtained from an open source simulation package as well as data from a network of real cameras. © 2013 IEEE.

An eMathTeacher Tool for Active Learning Fleury’s Algorithm

An eMathTeacher [Sánchez-Torrubia 2007a] is an eLearning on line self assessment tool that help students to active learning math algorithms by themselves, correcting their mistakes and providing them with clues to find the right solution. The tool presented in this paper is an example of this new concept on Computer Aided Instruction (CAI) resources and has been implemented as a Java applet and designed as an auxiliary instrument for both classroom teaching and individual practicing of Fleury’s algorithm. This tool, included within a set of eMathTeacher tools, has been designed as educational complement of Graph Algorithm active learning for first course students. Its characteristics of visualization, simplicity and interactivity, make this tutorial a great value pedagogical instrument.

EnDNA-Prot:identification of DNA-binding proteins by applying ensemble learning

DNA-binding proteins are crucial for various cellular processes, such as recognition of specific nucleotide, regulation of transcription, and regulation of gene expression. Developing an effective model for identifying DNA-binding proteins is an urgent research problem. Up to now, many methods have been proposed, but most of them focus on only one classifier and cannot make full use of the large number of negative samples to improve predicting performance. This study proposed a predictor called enDNA-Prot for DNA-binding protein identification by employing the ensemble learning technique. Experiential results showed that enDNA-Prot was comparable with DNA-Prot and outperformed DNAbinder and iDNA-Prot with performance improvement in the range of 3.97-9.52% in ACC and 0.08-0.19 in MCC. Furthermore, when the benchmark dataset was expanded with negative samples, the performance of enDNA-Prot outperformed the three existing methods by 2.83-16.63% in terms of ACC and 0.02-0.16 in terms of MCC. It indicated that enDNA-Prot is an effective method for DNA-binding protein identification and expanding training dataset with negative samples can improve its performance. For the convenience of the vast majority of experimental scientists, we developed a user-friendly web-server for enDNA-Prot which is freely accessible to the public. © 2014 Ruifeng Xu et al.

String Measure Applied to String Self-Organizing Maps and Networks of Evolutionary Processors

* Supported by projects CCG08-UAM TIC-4425-2009 and TEC2007-68065-C03-02

Training Primary School Teachers to use E-Learning Technologies – A Pilot Study

In this paper we present a blended learning scenario for training of students in master program “ICT in primary school” carried out in South-West University “Neofit Rilski”. Our approach is based on “face to face” lectures and seminars, SCORM compatible e-learning content with a lot of simulation demonstrations, trainings and self assessment, group problem based learning. Also we discuss the results of the course and attitude of the participants in the course towards used methods and possibilities of application of e-learning in primary schools.

On a Virtual Learning Environment

Education in the Information Society is based on asynchronism in time and space, interactivity and virtual restructuring of the educational space. One way to implement such a model of training is web-based - use of the WWW as a virtual environment to access educational materials or to organize the learning process. This work presents a virtual learning environment (VLE) developed for students and made up of modules of dynamically changing content implemented by authorized users. The aim is, through advanced technology for e-learning, testing and self-testing to stimulate students’ activity to focus their potential on the acquisition of the necessary knowledge, skills and competences. The VLE was developed under the Human Resources Development Operational Programme.

Self-organising zooms for decentralised redundancy management in visual sensor networks

When visual sensor networks are composed of cameras which can adjust the zoom factor of their own lens, one must determine the optimal zoom levels for the cameras, for a given task. This gives rise to an important trade-off between the overlap of the different cameras’ fields of view, providing redundancy, and image quality. In an object tracking task, having multiple cameras observe the same area allows for quicker recovery, when a camera fails. In contrast having narrow zooms allow for a higher pixel count on regions of interest, leading to increased tracking confidence. In this paper we propose an approach for the self-organisation of redundancy in a distributed visual sensor network, based on decentralised multi-objective online learning using only local information to approximate the global state. We explore the impact of different zoom levels on these trade-offs, when tasking omnidirectional cameras, having perfect 360-degree view, with keeping track of a varying number of moving objects. We further show how employing decentralised reinforcement learning enables zoom configurations to be achieved dynamically at runtime according to an operator’s preference for maximising either the proportion of objects tracked, confidence associated with tracking, or redundancy in expectation of camera failure. We show that explicitly taking account of the level of overlap, even based only on local knowledge, improves resilience when cameras fail. Our results illustrate the trade-off between maintaining high confidence and object coverage, and maintaining redundancy, in anticipation of future failure. Our approach provides a fully tunable decentralised method for the self-organisation of redundancy in a changing environment, according to an operator’s preferences.

The political discourse and material practice of technology enhanced learning

Technology discloses man’s mode of dealing with Nature, the process of production by which he sustains his life, and thereby also lays bare the mode of formation of his social relations, and of the mental conceptions that flow from them (Marx, 1990: 372) My thesis is a Sociological analysis of UK policy discourse for educational technology during the last 15 years. My framework is a dialogue between the Marxist-based critical social theory of Lieras and a corpus-based Critical Discourse Analysis (CDA) of UK policy for Technology Enhanced Learning (TEL) in higher education. Embedded in TEL is a presupposition: a deterministic assumption that technology has enhanced learning. This conceals a necessary debate that reminds us it is humans that design learning, not technology. By omitting people, TEL provides a vehicle for strong hierarchical or neoliberal, agendas to make simplified claims politically, in the name of technology. My research has two main aims: firstly, I share a replicable, mixed methodological approach for linguistic analysis of the political discourse of TEL. Quantitatively, I examine patterns in my corpus to question forms of ‘use’ around technology that structure a rigid basic argument which ‘enframes’ educational technology (Heidegger, 1977: 38). In a qualitative analysis of findings, I ask to what extent policy discourse evaluates technology in one way, to support a Knowledge Based Economy (KBE) in a political economy of neoliberalism (Jessop 2004, Fairclough 2006). If technology is commodified as an external enhancement, it is expected to provide an ‘exchange value’ for learners (Marx, 1867). I therefore examine more closely what is prioritised and devalued in these texts. Secondly, I disclose a form of austerity in the discourse where technology, as an abstract force, undertakes tasks usually ascribed to humans (Lieras, 1996, Brey, 2003:2). This risks desubjectivisation, loss of power and limits people’s relationships with technology and with each other. A view of technology in political discourse as complete without people closes possibilities for broader dialectical (Fairclough, 2001, 2007) and ‘convivial’ (Illich, 1973) understandings of the intimate, material practice of engaging with technology in education. In opening the ‘black box’ of TEL via CDA I reveal talking points that are otherwise concealed. This allows me as to be reflexive and self-critical through praxis, to confront my own assumptions about what the discourse conceals and what forms of resistance might be required. In so doing, I contribute to ongoing debates about networked learning, providing a context to explore educational technology as a technology, language and learning nexus.

Approaches to Organization of Teaching for Creating Digital Learning Materials

Report published in the Proceedings of the National Conference on "Education in the Information Society", Plovdiv, May, 2013

How Students Study? An Analysis of Learning Strategies in Engineering and Technology Courses

Report published in the Proceedings of the National Conference on "Education and Research in the Information Society", Plovdiv, May, 2014

The effectiveness of workplace coaching:A meta-analysis of learning and performance outcomes; scale development; theoretical model of individual differences and longitudinal study

The extant literature on workplace coaching is characterised by a lack of theoretical and empirical understanding regarding the effectiveness of coaching as a learning and development tool; the types of outcomes one can expect from coaching; the tools that can be used to measure coaching outcomes; the underlying processes that explain why and how coaching works and the factors that may impact on coaching effectiveness. This thesis sought to address these substantial gaps in the literature with three linked studies. Firstly, a meta-analysis of workplace coaching effectiveness (k = 17), synthesizing the existing research was presented. A framework of coaching outcomes was developed and utilised to code the studies. Analysis indicated that coaching had positive effects on all outcomes. Next, the framework of outcomes was utilised as the deductive start-point to the development of the scale measuring perceived coaching effectiveness. Utilising a multi-stage approach (n = 201), the analysis indicated that perceived coaching effectiveness may be organised into a six factor structure: career clarity; team performance; work well-being; performance; planning and organizing and personal effectiveness and adaptability. The final study was a longitudinal field experiment to test a theoretical model of individual differences and coaching effectiveness developed in this thesis. An organizational sample of 84 employees each participated in a coaching intervention, completed self-report surveys, and had their job performance rated by peers, direct reports and supervisors (a total of 352 employees provided data on participant performance). The results demonstrate that compared to a control group, the coaching intervention generated a number of positive outcomes. The analysis indicated that coachees’ enthusiasm, intellect and orderliness influenced the impact of coaching on outcomes. Mediation analysis suggested that mastery goal orientation, performance goal orientation and approach motivation in the form of behavioural activation system (BAS) drive, were significant mediators between personality and outcomes. Overall, the findings of this thesis make an original contribution to the understanding of the types of outcomes that can be expected from coaching, and the magnitude of impact coaching has on outcomes. The thesis also provides a tool for reliably measuring coaching effectiveness and a theoretical model to understand the influence of coachee individual differences on coaching outcomes.