Motivating sustainable goal choices and providing effective feedback

Overconsumption of natural resources and the associated environmental hazards are one of today’s most pressing global issues. In the western world, individual consumption in homes and workplaces is a key contributor to this problem. Reflecting the importance of individual action in this domain, this thesis focuses on studying and influencing choices related to sustainability and energy consumption made by people in their daily lives. There are three main components to this work. Firstly, this thesis asserts that people frequently make ineffective consumption reduction goal choices and attempts to understand the rationale for these poor choices by fitting them to goalsetting theory, an established theoretical model of behavior change. Secondly, it presents two approaches that attempt to influence goal choice towards more effective targets, one of which deals with mechanisms for goal priming and the other of which explores the idea that carefully designed toys can exert influence on children’s long term consumption behavior patterns. The final section of this thesis deals with the design of feedback to support the performance of environmentally sound activities. Key contributions surrounding goals include the finding that people choose easy sustainable goals despite immediate feedback as to their ineffectiveness and the discussion and study of goal priming mechanisms that can influence this choice process. Contributions within the design of value instilling toys include a theoretically grounded framework for the design of such toys and a completed and tested prototype toy. Finally, contributions in designing effective and engaging energy consumption feedback include the finding that negative feedback is best presented verbally compared with visually and this is exemplified and presented within a working feedback system. The discussions, concepts, prototypes and empirical findings presented in this work will be useful for both environmental psychologists and for HCI researchers studying eco-feedback.

Learner-focused evaluation cycles : facilitating learning using feedforward, concurrent and feedback evaluation

There is a growing trend to offer students learning opportunities that are flexible, innovative and engaging. As educators embrace student-centred agile teaching and learning methodologies, which require continuous reflection and adaptation, the need to evaluate students’ learning in a timely manner has become more pressing. Conventional evaluation surveys currently dominate the evaluation landscape internationally, despite recognition that they are insufficient to effectively evaluate curriculum and teaching quality. Surveys often: (1) fail to address the issues for which educators need feedback, (2) constrain student voice, (3) have low response rates and (4) occur too late to benefit current students. Consequently, this paper explores principles of effective feedback to propose a framework for learner-focused evaluation. We apply a three-stage control model, involving feedforward, concurrent and feedback evaluation, to investigate the intersection of assessment and evaluation in agile learning environments. We conclude that learner-focused evaluation cycles can be used to guide action so that evaluation is not undertaken simply for the benefit of future offerings, but rather to benefit current students by allowing ‘real-time’ learning activities to be adapted in the moment. As a result, students become co-producers of learning and evaluation becomes a meaningful, responsive dialogue between students and their instructors.

Enhanced student learning in accounting utilising web-based technology, peer-review feedback and reflective practices: A learning community approach to assessment

Higher education is becoming a major driver of economic competitiveness in an increasingly knowledge-driven global economy. Maintaining the competitive edge has seen an increase in public accountability of higher education institutions through the mechanism of ranking universities based on the quality of their teaching and learning outcomes. As a result, assessment processes are under scrutiny, creating tensions between standardisation and measurability and the development of creative and reflective learners. These tensions are further highlighted in the context of large undergraduate subjects, learner diversity and time-poor academics and students. Research suggests that high level and complex learning is best developed when assessment, combined with effective feedback practices, involves students as partners in these processes. This article reports on a four-phase, cross-institution and cross-discipline project designed to embed peer-review processes as part of the assessment in two large, undergraduate accounting classes. Using a social constructivist view of learning, which emphasises the role of both teacher and learner in the development of complex cognitive understandings, we undertook an iterative process of peer review. Successive phases built upon students’ feedback and achievements and input from language/learning and curriculum experts to improve the teaching and learning outcomes.

Effects of training peer tutors in content knowledge versus tutoring skills on giving feedback to help tutees’ complex tasks

This study aims to investigate the effectiveness of training tutors in content knowledge of a particular domain versus training them in tutoring skills of pedagogical knowledge when tutoring on a complex tutee task. Forty-seven tutor-tutee pairs of fourth year secondary school students were created and assigned to one of two treatments. Twenty-two tutors received training in content knowledge and the other twenty-five tutors in tutoring skills. Tutors formulated written feedback immediately after the training. Tutees first interpreted the tutor feedback and then used it to revise their research questions. The results showed that tutors trained in tutoring skills formulated more effective feedback than tutors trained in content knowledge. In addition, tutees helped by tutoring-skills tutors found the feedback more motivating than those helped by content- knowledge tutors. However, no differences were found in tutee performance on revision. The findings are discussed in terms of the set-up of this study and implications for improving the effectiveness of peer tutoring.

Pharmacy Students’ Views of Faculty Feedback on Academic Performance

Objective: To investigate students' views on and satisfaction with faculty feedback on their academic performance.

Methods: A 41-item survey instrument was developed based on a literature review relating to effective feedback. All pharmacy undergraduate students were invited via e-mail to complete the self-administered electronic questionnaire relating to their views on feedback, including faculty feedback received to date regarding their academic performance.

Results: A response rate of 61% (343/561) was obtained. Only 32.3% of students (107/331) agreed that they were satisfied with the feedback they received; dissatisfaction with examination feedback was particularly high. The provision of faculty feedback was perceived to be variable in terms of quality and quantity.

Conclusions: There are some inconsistencies relating to provision of feedback within the MPharm degree program at Queen's University Belfast. Further work is needed to close the gap between student expectations and the faculty's delivery of feedback on academic performance.

Improving Learners’ Motivation through Feedback in English Language Teaching and Learning at Polytechnic School in Benguela, Angola

Currently, it is widely perceived among the English as a Foreign Language (EFL) teaching professionals, that motivation is a central factor for success in language learning. This work aims to examine and raise teachers’ awareness about the role of assessment and feedback in the process of language teaching and learning at polytechnic school in Benguela to develop and/or enhance their students’ motivation for learning. Hence the paper defines and discusses the key terms and, the techniques and strategies for an effective feedback provision in the context under study. It also collects data through the use of interview and questionnaire methods, and suggests the assessment and feedback types to be implemented at polytechnic school in Benguela

The role of gender in the construction and evaluation of feedback effectiveness

This study investigated factors that influence managers’ conceptions and subordinates’ perceptions of effective feedback. A social rules perspective was used to operationalize male and female managers’ conceptions of effective negative feedback. In the first study, 68 male and female managers identified their optimal strategies for providing feedback to subordinates. Male and female managers endorsed different goals and tactics for giving negative feedback, particularly in terms of levels of participation and directness. In the second study, 116 male and female subordinates evaluated the comparative effectiveness and difficulty of these and other standard approaches to feedback. The female manager strategy was evaluated by both men and women as generally more task and relationship effective but not more difficult to enact.

‘Let’s talk about feedback’:an exploration of academic feedback practices in pharmacy education

Feedback is considered one of the most effective mechanisms to aid learning and achievement (Hattie and Timperley, 2007). However, in past UK National Student Surveys, perceptions of academic feedback have been consistently rated lower by final year undergraduate students than other aspects of the student experience (Williams and Kane, 2009). For pharmacy students in particular, Hall and colleagues recently reported that almost a third of students surveyed were dissatisfied with feedback and perceived feedback practice to be inconsistent (Hall et al, 2012). Aims of the Workshop: This workshop has been designed to explore current academic feedback practices in pharmacy education across a variety of settings and cultures as well as to create a toolkit for pharmacy academics to guide their approach to feedback. Learning Objectives: 1. Discuss and characterise academic feedback practices provided by pharmacy academics to pharmacy students in a variety of settings and cultures. 2. Develop academic feedback strategies for a variety of scenarios. 3. Evaluate and categorise feedback strategies with use of a feedback matrix. Description of Workshop Activities: Introduction to workshop and feedback on pre-reading exercise (5 minutes). Activity 1: A short presentation on theoretical models of academic feedback. Evidence of feedback in pharmacy education (10 minutes). Activity 2: Discussion of feedback approaches in participants’ organisations for differing educational modalities. Consideration of the following factors will be undertaken: experiential v. theoretical education, formative v. summative assessment, form of assessment and the effect of culture (20 minutes, large group discussion). Activity 3: Introduction of a feedback matrix (5 minutes). Activity 4: Development of an academic feedback toolkit for pharmacy education. Participants will be divided into 4 groups and will discuss how to provide effective feedback for 2 scenarios. Feedback strategies will be categorised with the feedback matrix. Results will be presented back to the workshop group (20 minutes, small group discussion, 20 minutes, large group presentation). Summary (10 minutes). Additional Information: Pre-reading: Participants will be provided with a list of definitions for academic feedback and will be asked to rank the definitions in order of perceived relevance to pharmacy education. References Archer, J. C. (2010). State of the science in health professional education: effective feedback. Medical education, 44(1), 101-108. Hall, M., Hanna, L. A., & Quinn, S. (2012). Pharmacy Students’ Views of Faculty Feedback on Academic Performance. American journal of pharmaceutical education, 76(1). Hattie, J., & Timperley, H. (2007). The power of feedback. Review of educational research, 77(1), 81-112. Medina, M. S. (2007). Providing feedback to enhance pharmacy students’ performance. American Journal of Health-System Pharmacy, 64(24), 2542-2545.

Supporting learners’ agentic engagement with feedback:a systematic review and a taxonomy of recipience processes

Much has been written in the educational psychology literature about effective feedback and how to deliver it. However, it is equally important to understand how learners actively receive, engage with, and implement feedback. This article reports a systematic review of the research evidence pertaining to this issue. Through an analysis of 195 outputs published between 1985 and early 2014, we identified various factors that have been proposed to influence the likelihood of feedback being used. Furthermore, we identified diverse interventions with the common aim of supporting and promoting learners' agentic engagement with feedback processes. We outline the various components used in these interventions, and the reports of their successes and limitations. Moreover we propose a novel taxonomy of four recipience processes targeted by these interventions. This review and taxonomy provide a theoretical basis for conceptualizing learners' responsibility within feedback dialogues and for guiding the strategic design and evaluation of interventions. Receiving feedback on one's skills and understanding is an invaluable part of the learning process, benefiting learners far more than does simply receiving praise or punishment (Black & Wiliam, 1998 Black, P., & Wiliam, D. (1998). Assessment and classroom learning. Assessment in Education: Principles, Policy & Practice, 5, 7–74. doi:10.1080/0969595980050102[Taylor & Francis Online]; Hattie & Timperley, 2007 Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77, 81–112. doi:10.3102/003465430298487[CrossRef], [Web of Science ®]). Inevitably, the benefits of receiving feedback are not uniform across all circumstances, and so it is imperative to understand how these gains can be maximized. There is increasing consensus that a critical determinant of feedback effectiveness is the quality of learners' engagement with, and use of, the feedback they receive. However, studies investigating this engagement are underrepresented in academic research (Bounds et al., 2013 Bounds, R., Bush, C., Aghera, A., Rodriguez, N., Stansfield, R. B., & Santeen, S. A. (2013). Emergency medicine residents' self-assessments play a critical role when receiving feedback. Academic Emergency Medicine, 20, 1055–1061. doi:10.1111/acem.12231[CrossRef], [PubMed], [Web of Science ®]), which leaves a “blind spot” in our understanding (Burke, 2009 Burke, D. (2009). Strategies for using feedback students bring to higher education. Assessment & Evaluation in Higher Education, 34, 41–50. doi:10.1080/02602930801895711[Taylor & Francis Online], [Web of Science ®]). With this blind spot in mind, the present work sets out to systematically map the research literature concerning learners' proactive recipience of feedback. We use the term “proactive recipience” here to connote a state or activity of engaging actively with feedback processes, thus emphasizing the fundamental contribution and responsibility of the learner (Winstone, Nash, Rowntree, & Parker, in press Winstone, N. E., Nash, R. A., Rowntree, J., & Parker, M. (in press). ‘It'd be useful, but I wouldn't use it’: Barriers to university students' feedback seeking and recipience. Studies in Higher Education. doi: 10.1080/03075079.2015.1130032[Taylor & Francis Online]). In other words, just as Reeve and Tseng (2011 Reeve, J., & Tseng, M. (2011). Agency as a fourth aspect of student engagement during learning activities. Contemporary Educational Psychology, 36, 257–267. doi:10.1016/j.cedpsych.2011.05.002[CrossRef], [Web of Science ®]) defined “agentic engagement” as a “student's constructive contribution into the flow of the instruction they receive” (p. 258), likewise proactive recipience is a form of agentic engagement that involves the learner sharing responsibility for making feedback processes effective.

An integrated measure of student perceptions of feedback, engagement and school identification

Teacher feedback influences student learning, identity construction and trajectories. This study tests the measurement properties of a questionnaire designed to assess (a) student perceptions about teacher feedback; (b) student identification with school, and; (c) student engagement. 1089 students in grades 6 through 10 (mean age 13.4) participated in the study. Factor analyses yield dimensions of School Identification, Effective Feedback, Person-Centered Feedback, Engagement, and Social Acceptance. Internal consistency for principal dimensions varied between .77 and .89. The instrument is suitable for assessing student school identification, behavioral engagement, and perceptions of teacher feedback.

Escala de perceção dos alunos sobre o feedback dos professores: construção e validação

O presente estudo procura testar as propriedades psicométricas de um questionário que avalia (a) perceção do aluno sobre o feedback do professor; a identificação escolar do aluno; as trajetórias escolares (factos e expectativas) e; a perceção do aluno sobre o seu envolvimento escolar. O questionário foi aplicado a 1089 alunos dos 6º, 7º, 9º e 10º anos de escolaridade (M=13.4, DP=1.7), sendo que 52% são do sexo feminino. A amostra é composta por alunos essencialmente de nacionalidade portuguesa (95.9%). A partir dos resultados da análise factorial e seguindo o racional teórico, chegou-se a uma estrutura composta por oito dimensões principais. O QFITE apresenta bons índices de consistência interna, com sete das oito principais dimensões a obterem valores entre .77 e .89. Assim, as análises psicométricas realizadas revelam valores satisfatórios, concluindo-se que o QFITE é um instrumento útil e adequado para avaliar a identificação escolar dos alunos, o envolvimento comportamental escolar, e as perceções dos alunos sobre o feedback do professor.

An assessment system for evaluation of driving competencies

Automobiles have deeply impacted the way in which we travel but they have also contributed to many deaths and injury due to crashes. A number of reasons for these crashes have been pointed out by researchers. Inexperience has been identified as a contributing factor to road crashes. Driver’s driving abilities also play a vital role in judging the road environment and reacting in-time to avoid any possible collision. Therefore driver’s perceptual and motor skills remain the key factors impacting on road safety. Our failure to understand what is really important for learners, in terms of competent driving, is one of the many challenges for building better training programs. Driver training is one of the interventions aimed at decreasing the number of crashes that involve young drivers. Currently, there is a need to develop comprehensive driver evaluation system that benefits from the advances in Driver Assistance Systems. A multidisciplinary approach is necessary to explain how driving abilities evolves with on-road driving experience. To our knowledge, driver assistance systems have never been comprehensively used in a driver training context to assess the safety aspect of driving. The aim and novelty of this thesis is to develop and evaluate an Intelligent Driver Training System (IDTS) as an automated assessment tool that will help drivers and their trainers to comprehensively view complex driving manoeuvres and potentially provide effective feedback by post processing the data recorded during driving. This system is designed to help driver trainers to accurately evaluate driver performance and has the potential to provide valuable feedback to the drivers. Since driving is dependent on fuzzy inputs from the driver (i.e. approximate distance calculation from the other vehicles, approximate assumption of the other vehicle speed), it is necessary that the evaluation system is based on criteria and rules that handles uncertain and fuzzy characteristics of the driving tasks. Therefore, the proposed IDTS utilizes fuzzy set theory for the assessment of driver performance. The proposed research program focuses on integrating the multi-sensory information acquired from the vehicle, driver and environment to assess driving competencies. After information acquisition, the current research focuses on automated segmentation of the selected manoeuvres from the driving scenario. This leads to the creation of a model that determines a “competency” criterion through the driving performance protocol used by driver trainers (i.e. expert knowledge) to assess drivers. This is achieved by comprehensively evaluating and assessing the data stream acquired from multiple in-vehicle sensors using fuzzy rules and classifying the driving manoeuvres (i.e. overtake, lane change, T-crossing and turn) between low and high competency. The fuzzy rules use parameters such as following distance, gaze depth and scan area, distance with respect to lanes and excessive acceleration or braking during the manoeuvres to assess competency. These rules that identify driving competency were initially designed with the help of expert’s knowledge (i.e. driver trainers). In-order to fine tune these rules and the parameters that define these rules, a driving experiment was conducted to identify the empirical differences between novice and experienced drivers. The results from the driving experiment indicated that significant differences existed between novice and experienced driver, in terms of their gaze pattern and duration, speed, stop time at the T-crossing, lane keeping and the time spent in lanes while performing the selected manoeuvres. These differences were used to refine the fuzzy membership functions and rules that govern the assessments of the driving tasks. Next, this research focused on providing an integrated visual assessment interface to both driver trainers and their trainees. By providing a rich set of interactive graphical interfaces, displaying information about the driving tasks, Intelligent Driver Training System (IDTS) visualisation module has the potential to give empirical feedback to its users. Lastly, the validation of the IDTS system’s assessment was conducted by comparing IDTS objective assessments, for the driving experiment, with the subjective assessments of the driver trainers for particular manoeuvres. Results show that not only IDTS was able to match the subjective assessments made by driver trainers during the driving experiment but also identified some additional driving manoeuvres performed in low competency that were not identified by the driver trainers due to increased mental workload of trainers when assessing multiple variables that constitute driving. The validation of IDTS emphasized the need for an automated assessment tool that can segment the manoeuvres from the driving scenario, further investigate the variables within that manoeuvre to determine the manoeuvre’s competency and provide integrated visualisation regarding the manoeuvre to its users (i.e. trainers and trainees). Through analysis and validation it was shown that IDTS is a useful assistance tool for driver trainers to empirically assess and potentially provide feedback regarding the manoeuvres undertaken by the drivers.

Design of a knowledge base to teach programming

Programming is a subject that many beginning students find difficult. This paper describes a knowledge base designed for the purpose of analyzing programs written in the PHP web development language. The aim is to use this knowledge base in an Intelligent Tutoring System that will provide effective feedback to students. The main focus of this research is that a programming exercise can have many correct solutions. This paper presents an overview of how the proposed knowledge base can be utilized to accept different solutions to a given exercise

Academic Development Program : QUT University Wide

The QUT Sessional Academic Program (SAP) has scaffolded levels, each with experience-appropriate objectives: • SAP 1: Introduction to Learning and Teaching aims to develop confidence and build awareness of pedagogy and managing class-room scenarios. • SAP 2: Learning and Teaching in Large Units focuses on aligning curriculum and assessment through learning activities and builds a community of teaching practice with sessionals and subject coordinators. • SAP 3: Developing your Teaching Practice focuses on whole of university and classroom strategies to ensure student success through effective feedback; reflective practice and learning communities. • SAP 4: Enhancing your Teaching Practice applies these factors to teaching success. In conjunction with: • Sessional Career Advancement Development: for Higher Degree Research students/ sessional staff who aspire to become academics provides guidance on developing an academic portfolio in teaching, research and service. And • Sessional Academic Success program providing ongoing, local support (see separate nomination). A critical factor in its success is its praxis approach. Theoretical principles are modelled. Eg, ‘active learning’ is explained and modelled through learning activities, which participants evaluate ‘on the fly’ against the criteria of learning, engagement and connection with peers. The topics ‘learning communities’ and ‘reflective practice’ are explored as a learning community–then applied in participants’ classes, with reflections shared in the next session. This produces a ‘meta-awareness’ of theory and principles, as they are explained, applied in practice, and critically analysed for their effectiveness in workshops.