Does reviewing lead to better learning and decision making? Answers from a randomized stock market experiment

Background - The literature is not univocal about the effects of Peer Review (PR) within the context of constructivist learning. Due to the predominant focus on using PR as an assessment tool, rather than a constructivist learning activity, and because most studies implicitly assume that the benefits of PR are limited to the reviewee, little is known about the effects upon students who are required to review their peers. Much of the theoretical debate in the literature is focused on explaining how and why constructivist learning is beneficial. At the same time these discussions are marked by an underlying presupposition of a causal relationship between reviewing and deep learning. Objectives - The purpose of the study is to investigate whether the writing of PR feedback causes students to benefit in terms of: perceived utility about statistics, actual use of statistics, better understanding of statistical concepts and associated methods, changed attitudes towards market risks, and outcomes of decisions that were made. Methods - We conducted a randomized experiment, assigning students randomly to receive PR or non–PR treatments and used two cohorts with a different time span. The paper discusses the experimental design and all the software components that we used to support the learning process: Reproducible Computing technology which allows students to reproduce or re–use statistical results from peers, Collaborative PR, and an AI–enhanced Stock Market Engine. Results - The results establish that the writing of PR feedback messages causes students to experience benefits in terms of Behavior, Non–Rote Learning, and Attitudes, provided the sequence of PR activities are maintained for a period that is sufficiently long.

Learning to reflect through technology, to enhance employability

"Reflection, if managed in an ordered way, can provide great opportunities for learning, understanding and clarifying thought, both in one's personal life and in learning and professional development." Moon, J (1999). Aston Business School's (ABS) 12cmonth professional placement programme has a number of espoused learning objectives, including helping students: 1. To benefit from the integration of university study and work experience in ways which facilitate critical reflection on each ofthese aspects. 2. To build a personal awareness of their own interests, competencies, values and potential. These objectives focus students' development to self-reflect critically, to make sense of their experiences/learning whilst undertaking their placements. Students complete a placement year Reflective Learning Journal, supported by the workplace supervisor, through regular meetings where objectives are agreed and reviewed. As well as reflection providing opportunities for students to make sense of their learning, it is also challenging! ABS is undertaking a pilot in 2008/9 to encourage students to engage with reflective practice, but employer feedback indicates an ability to think and analyse is often missing from the skill sets of graduates. Business students are using the PebblePad e-portfolio system as a tool to record their learning, reflect on their experiences in the workplace and to create their journals.

IT and learning in Higher Education

Educational institutions are under pressure to provide high quality education to large numbers of students very efficiently. The efficiency target combined with the large numbers generally militates against providing students with a great deal of personal or small group tutorial contact with academic staff. As a result of this, students often develop their learning criteria as a group activity, being guided by comparisons one with another rather than the formal assessments made of their submitted work. IT systems and the World Wide Web are increasingly employed to amplify the resources of academic departments although their emphasis tends to be with course administration rather than learning support. The ready availability of information on the World Wide Web and the ease with which is may be incorporated into essays can lead students to develop a limited view of learning as the process of finding, editing and linking information. This paper examines a module design strategy for tackling these issues, based on developments in modules where practical knowledge is a significant element of the learning objectives. Attempts to make effective use of IT support in these modules will be reviewed as a contribution to the development of an IT for learning strategy currently being undertaken in the author’s Institution.

Facilitating intuitive-guided learning in a serious game through integration with a learning content management system

Increased global uptake of entertainment gaming has the potential to lead to high expectations of engagement and interactivity from users of technology-enhanced learning environments. Blended approaches to implementing game-based learning as part of distance or technology-enhanced education have led to demonstrations of the benefits they might bring, allowing learners to interact with immersive technologies as part of a broader, structured learning experience. In this article, we explore how the integration of a serious game can be extended to a learning content management system (LCMS) to support a blended and holistic approach, described as an 'intuitive-guided' method. Through a case study within the EU-Funded Adaptive Learning via Intuitive/Interactive, Collaborative and Emotional Systems (ALICE) project, a technical integration of a gaming engine with a proprietary LCMS is demonstrated, building upon earlier work and demonstrating how this approach might be realized. In particular, how this method can support an intuitive-guided approach to learning is considered, whereby the learner is given the potential to explore a non-linear environment whilst scaffolding and blending provide guidance ensuring targeted learning objectives are met. Through an evaluation of the developed prototype with 32 students aged 14-16 across two Italian schools, a varied response from learners is observed, coupled with a positive reception from tutors. The study demonstrates that challenges remain in providing high-fidelity content in a classroom environment, particularly as an increasing gap in technology availability between leisure and school times emerges.

Equality, diversity and discrimination:a student text

This text is designed specifically for the increasing number of students taking modules in Equality andDiversity, including those taking the CIPD specialist elective Managing Diversity and Equal Opportunities module. The authors’ combined experience is used to offer a mixture of a strong practical focus and a clear academic approach to create a balance of theory and practice. This text is the only accessible, up-to-date and student-focused text in the market that specifically features this subject area. his text is designed specifically for the increasing number of students taking a module in Equality and Diversity. The text contains a range of features to aid student learning, including: - Learning objectives - at the beginning of each chapter summarising the content of the chapter - Tasks - interactive tasks to encourage students to research around the subject - Case studies - thought-provoking examples of practice - Legal cases - examples of legal practice - Key Points - at the end of each chapter, a summary of key issues raised in the chapter - Examples to work through - at the end of each chapter, mini case examples with questions to check students' understanding.

‘Let’s talk about feedback’:an exploration of academic feedback practices in pharmacy education

Feedback is considered one of the most effective mechanisms to aid learning and achievement (Hattie and Timperley, 2007). However, in past UK National Student Surveys, perceptions of academic feedback have been consistently rated lower by final year undergraduate students than other aspects of the student experience (Williams and Kane, 2009). For pharmacy students in particular, Hall and colleagues recently reported that almost a third of students surveyed were dissatisfied with feedback and perceived feedback practice to be inconsistent (Hall et al, 2012). Aims of the Workshop: This workshop has been designed to explore current academic feedback practices in pharmacy education across a variety of settings and cultures as well as to create a toolkit for pharmacy academics to guide their approach to feedback. Learning Objectives: 1. Discuss and characterise academic feedback practices provided by pharmacy academics to pharmacy students in a variety of settings and cultures. 2. Develop academic feedback strategies for a variety of scenarios. 3. Evaluate and categorise feedback strategies with use of a feedback matrix. Description of Workshop Activities: Introduction to workshop and feedback on pre-reading exercise (5 minutes). Activity 1: A short presentation on theoretical models of academic feedback. Evidence of feedback in pharmacy education (10 minutes). Activity 2: Discussion of feedback approaches in participants’ organisations for differing educational modalities. Consideration of the following factors will be undertaken: experiential v. theoretical education, formative v. summative assessment, form of assessment and the effect of culture (20 minutes, large group discussion). Activity 3: Introduction of a feedback matrix (5 minutes). Activity 4: Development of an academic feedback toolkit for pharmacy education. Participants will be divided into 4 groups and will discuss how to provide effective feedback for 2 scenarios. Feedback strategies will be categorised with the feedback matrix. Results will be presented back to the workshop group (20 minutes, small group discussion, 20 minutes, large group presentation). Summary (10 minutes). Additional Information: Pre-reading: Participants will be provided with a list of definitions for academic feedback and will be asked to rank the definitions in order of perceived relevance to pharmacy education. References Archer, J. C. (2010). State of the science in health professional education: effective feedback. Medical education, 44(1), 101-108. Hall, M., Hanna, L. A., & Quinn, S. (2012). Pharmacy Students’ Views of Faculty Feedback on Academic Performance. American journal of pharmaceutical education, 76(1). Hattie, J., & Timperley, H. (2007). The power of feedback. Review of educational research, 77(1), 81-112. Medina, M. S. (2007). Providing feedback to enhance pharmacy students’ performance. American Journal of Health-System Pharmacy, 64(24), 2542-2545.

Content-based VLE designs improve learning efficiency in constructivist statistics education

Background: We introduced a series of computer-supported workshops in our undergraduate statistics courses, in the hope that it would help students to gain a deeper understanding of statistical concepts. This raised questions about the appropriate design of the Virtual Learning Environment (VLE) in which such an approach had to be implemented. Therefore, we investigated two competing software design models for VLEs. In the first system, all learning features were a function of the classical VLE. The second system was designed from the perspective that learning features should be a function of the course's core content (statistical analyses), which required us to develop a specific-purpose Statistical Learning Environment (SLE) based on Reproducible Computing and newly developed Peer Review (PR) technology. Objectives: The main research question is whether the second VLE design improved learning efficiency as compared to the standard type of VLE design that is commonly used in education. As a secondary objective we provide empirical evidence about the usefulness of PR as a constructivist learning activity which supports non-rote learning. Finally, this paper illustrates that it is possible to introduce a constructivist learning approach in large student populations, based on adequately designed educational technology, without subsuming educational content to technological convenience. Methods: Both VLE systems were tested within a two-year quasi-experiment based on a Reliable Nonequivalent Group Design. This approach allowed us to draw valid conclusions about the treatment effect of the changed VLE design, even though the systems were implemented in successive years. The methodological aspects about the experiment's internal validity are explained extensively. Results: The effect of the design change is shown to have substantially increased the efficiency of constructivist, computer-assisted learning activities for all cohorts of the student population under investigation. The findings demonstrate that a content-based design outperforms the traditional VLE-based design. © 2011 Wessa et al.

Network learning:Exploring learning by interorganizational networks

The importance of interorganizational networks in supporting or hindering the achievement of organizational objectives is now widely acknowledged. Network research is directed at understanding network processes and structures, and their impact upon performance. A key process is learning. The concepts of individual, group and organizational learning are long established. This article argues that learning might also usefully be regarded as occurring at a fourth system level, the interorganizational network. The concept of network learning - learning by a group of organizations as a group - is presented, and differentiated from other types of learning, notably interorganizational learning (learning in interorganizational contexts). Four cases of network learning are identified and analysed to provide insights into network learning processes and outcomes. It is proposed that 'network learning episode' offers a suitable unit of analysis for the empirical research needed to develop our understanding of this potentially important concept.

Firms’ innovation objectives and knowledge acquisition strategies:a comparative analysis

External partnerships play an important role in firms’ acquisition of the knowledge inputs to innovation. Such partnerships may be interactive – involving exploration and mutual learning by both parties – or non-interactive – involving exploitative activity and learning by only one party. Examples of non-interactive partnerships are copying or imitation. Here, we consider how firms’ innovation objectives influence their choice of interactive and/or non-interactive connections. We conduct a comparative analysis for the economies of Spain and the UK, which have contrasting innovation eco-systems and regulation burdens.