Mutual feedback in e-portfolio assessment : an approach to the netfolio system

Peer-reviewed

Feedback-related Brain Potential Activity Complies with Basic Assumptions of Associative Learning Theory

Feedback-related negativity (FRN) is an ERP component that distinguishes positive from negative feedback. FRN has been hypothesized to be the product of an error signal that may be used to adjust future behavior. In addition, associative learning models assume that the trial-to-trial learning of cueoutcome mappings involves the minimization of an error term. This study evaluated whether FRN is a possible electrophysiological correlate of this error term in a predictive learning task where human subjects were asked to learn different cueoutcome relationships. Specifically, we evaluated the sensitivity of the FRN to the course of learning when different stimuli interact or compete to become a predictor of certain outcomes. Importantly, some of these cues were blocked by more informative or predictive cues (i.e., the blocking effect). Interestingly, the present results show that both learning and blocking affect the amplitude of the FRN component. Furthermore, independent analyses of positive and negative feedback event-related signals showed that the learning effect was restricted to the ERP component elicited by positive feedback. The blocking test showed differences in the FRN magnitude between a predictive and a blocked cue. Overall, the present results show that ERPs that are related to feedback processing correspond to the main predictions of associative learning models. ■

Promoting Programming Learning. Engagement, Automatic Assessment with Immediate Feedback in Visualizations

The skill of programming is a key asset for every computer science student. Many studies have shown that this is a hard skill to learn and the outcomes of programming courses have often been substandard. Thus, a range of methods and tools have been developed to assist students’ learning processes. One of the biggest fields in computer science education is the use of visualizations as a learning aid and many visualization based tools have been developed to aid the learning process during last few decades. Studies conducted in this thesis focus on two different visualizationbased tools TRAKLA2 and ViLLE. This thesis includes results from multiple empirical studies about what kind of effects the introduction and usage of these tools have on students’ opinions and performance, and what kind of implications there are from a teacher’s point of view. The results from studies in this thesis show that students preferred to do web-based exercises, and felt that those exercises contributed to their learning. The usage of the tool motivated students to work harder during their course, which was shown in overall course performance and drop-out statistics. We have also shown that visualization-based tools can be used to enhance the learning process, and one of the key factors is the higher and active level of engagement (see. Engagement Taxonomy by Naps et al., 2002). The automatic grading accompanied with immediate feedback helps students to overcome obstacles during the learning process, and to grasp the key element in the learning task. These kinds of tools can help us to cope with the fact that many programming courses are overcrowded with limited teaching resources. These tools allows us to tackle this problem by utilizing automatic assessment in exercises that are most suitable to be done in the web (like tracing and simulation) since its supports students’ independent learning regardless of time and place. In summary, we can use our course’s resources more efficiently to increase the quality of the learning experience of the students and the teaching experience of the teacher, and even increase performance of the students. There are also methodological results from this thesis which contribute to developing insight into the conduct of empirical evaluations of new tools or techniques. When we evaluate a new tool, especially one accompanied with visualization, we need to give a proper introduction to it and to the graphical notation used by tool. The standard procedure should also include capturing the screen with audio to confirm that the participants of the experiment are doing what they are supposed to do. By taken such measures in the study of the learning impact of visualization support for learning, we can avoid drawing false conclusion from our experiments. As computer science educators, we face two important challenges. Firstly, we need to start to deliver the message in our own institution and all over the world about the new – scientifically proven – innovations in teaching like TRAKLA2 and ViLLE. Secondly, we have the relevant experience of conducting teaching related experiment, and thus we can support our colleagues to learn essential know-how of the research based improvement of their teaching. This change can transform academic teaching into publications and by utilizing this approach we can significantly increase the adoption of the new tools and techniques, and overall increase the knowledge of best-practices. In future, we need to combine our forces and tackle these universal and common problems together by creating multi-national and multiinstitutional research projects. We need to create a community and a platform in which we can share these best practices and at the same time conduct multi-national research projects easily.

Feedback como estratégia de aprendizado no ensino médico

Fornecer feedback aos alunos é um importante aspecto da aprendizagem e um papel essencial dos docentes. No contexto da educação médica clínica, feedback se refere às informações que descrevem o desempenho dos alunos em determinada situação ou atividade. A habilidade de dar e receber feedback melhora os resultados da aprendizagem, uma vez que fornece a base para a aprendizagem autodirecionada e para a reflexão crítica, auxilia os alunos a corrigirem seus erros, reforça comportamentos desejáveis e mostra como o aluno pode melhorar. Apesar da evidente falta de feedback durante o curso médico, os alunos desejam e valorizam essa ferramenta construtiva, considerando-a um aspecto importante do ensino de qualidade. O feedback eficaz deve ser: assertivo, respeitoso, descritivo, oportuno e específico. Docentes e alunos deveriam ser preparados para dar e receber feedback. Coordenadores e diretores deveriam reconhecer o papel do feedback como uma importante estratégia de ensino- aprendizagem na graduação.

Feedback de usuários como subsídio para avaliação do estudante de medicina

A avaliação é fundamental para o processo ensino-aprendizagem. Diferentes métodos de avaliação e diversos atores envolvidos na avaliação podem fornecer elementos distintos, que, somados, fornecem melhor compreensão sobre a efetividade do processo educacional em suas variadas dimensões. A avaliação de habilidades e atitudes de estudantes tem recebido grande atenção recentemente. O envolvimento de pacientes no processo pode ser contributivo, pois sua perspectiva acrescenta informações ímpares. O presente estudo avaliou a aquisição de competências e habilidades de estudantes de Medicina no internato de Obstetrícia, sob o ponto de vista de gestantes. As pacientes responderam a um questionário segundo escala de Likert, com itens de avaliação divididos em habilidades de comunicação, exame físico e profissionalismo. Os resultados mostraram boa avaliação dos estudantes em geral, o que atribuímos ao sentimento de gratidão das pacientes. Algumas questões com maiores frequências de respostas negativas, porém, apontam aspectos que merecem maior atenção da escola médica pelo impacto que podem trazer à prática profissional. A perspectiva de pacientes na avaliação do estudante de Medicina poderá balizar estratégias de feedback para qualificar a formação médica.

Development of Cost Estimation with Feedback Information in EPCM Business

Target company of this study is a large machinery company, which is, inter alia, engaged in energy and pulp engineering, procurement and construction management (EPCM) supply business. The main objective of this study was to develop cost estimation of the target company by providing more accurate, reliable and up-to-date information through enterprise resource planning (ERP) system. Another objective was to find cost-effective methods to collect total cost of ownership information to support more informed supplier selection decision making. This study is primarily action-oriented, but also constructive, and it can be divided in two sections: theoretical literature review and empirical study on the abovementioned part of the target company’s business. Development of information collection is, in addition to literature review, based on nearly 30 qualitative interviews of employees at various organizational units, functions and levels at the target company. At the core of development was to make initial data more accurate, reliable and available, a necessary prerequisite for informed use of the information. Certain development suggestions and paths were presented in order to regain confidence in ERP system as information source by reorganizing work breakdown structure and by complementing mere cost information with quantitative, technical and scope information. Several methods to use the information ever more effectively were also discussed. While implementation of the development suggestions outreached the scope of this study, it was forwarded in test environment and interest groups.

Theorizing Formal and Informal Feedback Practices in Management Accounting Through Three Dimensions

The purpose of this doctoral thesis is to widen and develop our theoretical frameworks for discussion and analyses of feedback practices in management accounting, particularly shedding light on its formal and informal aspects. The concept of feedback in management accounting has conventionally been analyzed within cybernetic control theory, in which feedback flows as a diagnostic or comparative loop between measurable outputs and pre-set goals (see e.g. Flamholtz et al. 1985; Flamholtz 1996, 1983), i.e. as a formal feedback loop. However, the everyday feedback practices in organizations are combinations of formal and informal elements. In addition to technique-driven feedback approaches (like budgets, measurement, and reward systems) we could also categorize social feedback practices that managers see relevant and effective in the pursuit of organizational control. While cybernetics or control theories successfully capture rational and measured aspects of organizational performance and offer a broad organizational context for the analysis, many individual and informal aspects remain vague and isolated. In order to discuss and make sense of the heterogeneous field of interpretations of formal and informal feedback, both in theory and practice, dichotomous approaches seem to be insufficient. Therefore, I suggest an analytical framework of formal and informal feedback with three dimensions (3D’s): source, time, and rule. Based on an abductive analysis of the theoretical and empirical findings from an interpretive case study around a business unit called Division Steelco, the 3Dframework and formal and informal feedback practices are further elaborated vis-á-vis the four thematic layers in the organizational control model by Flamholtz et al. (1985; Flamholtz 1996, 1983): core control system, organizational structure, organizational culture, and external environment. Various personal and cultural meanings given to the formal and informal feedback practices (“feedback as something”) create multidimensional interpretative contexts. Multidimensional frameworks aim to capture and better understand both the variety of interpretations and their implications to the functionality of feedback practices, important in interpretive research.

Quality of radiotherapy care by development of e-feedback knowledge

The aim of this three phase study was to develop quality of radiotherapy care by the e-Feedback knowledge of radiotherapy -intervention (e-Re-Know). In Phase I, the purpose was to describe the quality of radiotherapy care and its deficits experienced by cancer patients. Based on the deficits in patient education in Phase II, the purpose was to describe cancer patients’ e-knowledge expectations in radiotherapy. In Phase III, the purpose was to develop and evaluate the outcomes of the e-Re-Know among breast cancer patients. The ultimate aim was to develop radiotherapy care to support patients’ empowerment with patient e-education. In Phase I (2004-2005), the descriptive design was used, and 134 radiotherapy patients evaluated their experiences by Good Nursing Care Scale for Patients (GNCS-P) in the middle of RT period. In Phase II (2006-2008), the descriptive longitudinal design was used and 100 radiotherapy patients’ e-knowledge expectations of RT were evaluated using open-ended questionnaire developed for this study before commencing first RT, in the middle of the treatment, and concluding RT period. In Phase III, firstly (2009-2010), the e-Re-Know intervention, i.e. knowledge test and feedback, was developed in terms of empowering knowledge and implemented with e-feedback approach based on literature and expert reviews. Secondly (2011-2014), the randomized controlled study was used to evaluate the e-Re-Know. Breast cancer patients randomized to either the intervention group (n=65) receiving the e-Re-Know by e-mail before commencing first RT and standard education or the control group (n=63) receiving standard education. The data were collected before commencing first RT, concluding last RT and 3 months after last RT using RT Knowledge Test, Spielberger’s State Trait Inventory (STAI) and Functional Assessment of Cancer Therapy - Breast (FACT-B) –instruments. Data were analyzed using statistical methods and content analysis. The study showed radiotherapy patients experienced quality of care high. However, there were deficits in patient education. Furthermore, radiotherapy patients’ multidimensional e-knowledge expectations through Internet covered mainly bio-physiological and functional knowledge. Thus, the e-Re-Know was developed and evaluated. The study showed when breast cancer patients’ carried out the e-Re-Know their knowledge of side effects self-care was significantly increased and quality of life (QOL) significantly improved in line with decrease in anxiety from time before radiotherapy period to three months after. In addition, the e-Re-Know has potential to have positive effects on anxiety and QOL, regardless of patient characteristics or knowledge level. The results support the theory of empowering patient education suggesting that empowerment can be supported by confirming patients’ understanding of own knowledge level. In summary, the e-Feedback knowledge of radiotherapy (e-Re-Know) intervention can be recommended in development of quality of radiotherapy care experienced by breast cancer patients. Further research is needed to assess and develop patient-centred quality of care by patient education among cancer patients.

Neural regulation of the stress response: glucocorticoid feedback mechanisms

The mammalian stress response is an integrated physiological and psychological reaction to real or perceived adversity. Glucocorticoids are an important component of this response, acting to redistribute energy resources to both optimize survival in the face of challenge and to restore homeostasis after the immediate challenge has subsided. Release of glucocorticoids is mediated by the hypothalamo-pituitary-adrenal (HPA) axis, driven by a neural signal originating in the paraventricular nucleus (PVN). Stress levels of glucocorticoids bind to glucocorticoid receptors in multiple body compartments, including the brain, and consequently have wide-reaching actions. For this reason, glucocorticoids serve a vital function in negative feedback inhibition of their own secretion. Negative feedback inhibition is mediated by a diverse collection of mechanisms, including fast, non-genomic feedback at the level of the PVN, stress-shut-off at the level of the limbic system, and attenuation of ascending excitatory input through destabilization of mRNAs encoding neuropeptide drivers of the HPA axis. In addition, there is evidence that glucocorticoids participate in stress activation via feed-forward mechanisms at the level of the amygdala. Feedback deficits are associated with numerous disease states, underscoring the necessity for adequate control of glucocorticoid homeostasis. Thus, rather than having a single, defined feedback ‘switch’, control of the stress response requires a wide-reaching feedback ‘network’ that coordinates HPA activity to suit the overall needs of multiple body systems.

Imagery or video feedback : which is the "route" to strategic improvement?

The implementation of imagery and video feedback programs has become an important tool for aiding athletes in achieving peak performance (Halliwell, 1990). The purpose of the study was to determine the effect of strategic imagery training and video feedback on immediate performance. Participants were two university goaltenders. An alternating treatment design (ATD; Barlow & Hayes, 1979; Tawney & Gast, 1984) was employed. The strategies were investigated using three plays originating from the right side by a right-handed shooting defenceman from the blueline. The baseline condition consisted of six practices and was used to establish a stable and "ideal" measure of performance. The intervention conditions included alternating the use of strategic imagery (Cognitive general; Paivio, 1985) and video feedback. Both participants demonstrated an increase in the frequency of Cognitive general use. Specific and global performance measures were assessed to determine the relative effectiveness of the interventions. Poor inter-rater reliability resulted in the elimination of specific performance measures. Consequently, only the global measure (i.e., save percentage) was used in subsequent analyses. Visual inspection of participant save percentage was conducted to determine the benefits of the intervention. Strategic imagery training resulted in performance improvements for both participants. Video feedback facilitated performance for Participant 2, but not Participant 1. Results are discussed with respect to imagery and video interventions and the challenges associated with applied research. KEYWORDS: imagery, video, goaltenders, alternating treatment design.

Marketing Brock University in the 1980's: assessing freshman student feedback in strategic planning approach

Universities have entered a period of rapid change and upheaval due to an external environment beyond their control which includes shifting demographic patterns, accelerating technology, funding shortages, and keener competition for students. Strategic planning, a comprehensive vision which challenges universities to take bold and creative measures to meet the threats and opportunities of the future, is an institutional imperative in the 1980's. This paper examines freshman student feedback in an effort to incorporate this important element into a strategic plan for Brock University, a small, predominantly liberal arts university in St. Catharines, Ontario. The study was designed to provide information on the characteristics of the 1985-86 pool of freshman registrants: their attitudes towards Brock's recruitment measures, their general university priorities, and their influences in regard to university selection (along with other demographical and attitudinal data). A survey involving fixed-alternative questions of a subjective and objective nature was administered in two large freshman classes at Brock in which a broad cross-section of academic programs was anticipated. Computer analysis of the data for the 357 respondents included total raw frequencies and rounded percentages, as well as subgroup cross-tabulation by geographic home area of respondent, academic major, and high school graduating average. The four directional hypotheses put forward were all substantiatied by the survey data, indicating that 1) the university's current recruitment program had been a positive influence during their university search 2) parents were the most influential group in the students' decisions related to university 3) respondents viewed institutional reputation as less of a priority than an enjoyable university lifestyle in a personal learning atmosphere 4) students had a decided preference for co-operative study and internship programs. Strategic planning recommendations included a reduction in the faculty/student ratio through faculty hirings to restore the close rapport between professors and students, increased recruitment presentations in Ontario high schools to enlarge the applicant pool, creation of an Office of Co-operative Study and Internship Programs, institutional emphasis on a "customer orientation", and an extension of research into student demographics and attitudinal data.

An investigation on peer feedback for EFL students ages 10 to 14 /

The purpose of this study was to leam more about how EFL (English as Foreign Language) students interacted during peer feedback conferences. Thirty EFL students from Mexico aged 10 to 14 years old participated in this study. The following four main questions were addressed: 1 . What criteria did the students use to evaluate their peers' writing? 2. What revisions were made in relation to peer feedback comments? 3. What was the students' behaviour like during peer feedback conferences? 4. What were the students' perceived attitudes concerning peer feedback conferences? Each of the 30 students wrote a first and a second draft and then took part in a peer feedback conference. All students were interviewed and asked to rate a story and provide a peer feedback comment for the author during interview. The study found that the EFL students were able to provide comments to their peers' writing, but only after their third conference were they actually able to provide higher level comments. The majority of students said that they liked peer feedback sessions. The results also indicated that the students needed more practice with their revisions because they did not make a lot of revisions to make their writing clearer with fewer mistakes. This study concludes that there still needs to be further research. First of all, it would be useful to conduct a similar study with EFL students but one that is conducted over a longer period of time in order to determine if the students continued to develop their peer feedback comments and revision strategies.

Can a Manipulated Mind Alter Matter? : The Effects of Verbal Feedback on Self-Efficacy, Exercise Intention, and Exercise Behaviour among Low-Active College-Aged Women

Self-efficacy (SE), a person’s confidence in the ability to perform a task, is an important predictor of the adoption and maintenance of physical activity. The present study examined the effects of SE manipulated through verbal persuasion on exercise intentions and behaviour during a 4-week follow-up period and investigated the role of social physique anxiety (SPA) as a moderator. Female college infrequent exercisers (n = 66) were randomly assigned into one of three groups (high-efficacy [HE], low-efficacy [LE], or control) and asked to complete several questionnaires at baseline. The HE and LE groups were provided with positive and negative exercise adherence feedback, respectively. The HE group reported higher SE from pre- to post-feedback. Both the HE and LE groups reported increases in exercise behaviour at the 4-week follow-up. Pre- to post-feedback changes in SE, exercise intention, and exercise behaviour did not depend on level of SPA reported.