Collaborative design of assessment criteria to improve undergraduate student engagement and performance

Student engagement is vital in enhancing the student experience and encouraging deeper learning. Involving students in the design of assessment criteria is one way in which to increase student engagement. In 2011, a marking matrix was used at Aston University (UK) for logbook assessment (Group One) in a project-based learning module. The next cohort of students in 2012 (Group Two) were asked to collaboratively redesign the matrix and were given a questionnaire about the exercise. Group Two initially scored a lower average logbook mark than Group One. However, Group Two showed the greatest improvement between assessments, and the quality of, and commitment to, logbooks was noticeably improved. Student input resulted in a more defined, tougher mark scheme. However, this provided an improved feedback system that gave more scope for self-improvement. The majority of students found the exercise incorporated their ideas, enhanced their understanding, and was useful in itself.

Performance management and high performance work practices in emerging markets

In this chapter, we discuss performance management systems (PMSs) and high performance work systems (HPWSs) in emerging economies. We start by discussing PMSs, with specific emphasis on PMSs in global organizations. We follow this up with an introduction of HPWSs, and then discuss PMSs and HPWSs in emerging economies. While the list of emerging economies keeps changing, and is rather long, as one might expect, in this chapter we have concentrated on five key emerging economies – China, India, Mexico, South Korea, and Turkey. Performance management is the process through which organizations set goals, determine standards, assign and evaluate work, coach and give feedback, and distribute rewards (Fletcher, 2001). In this connection, organizations all over the world face the challenge of how best to manage performance, including finding ways to motivate employees to sustain high levels of performance. In other words, organizations must develop and implement PMSs that are appropriate for their environment in such a way that high levels of performance can be achieved and sustained over time (DeNisi, Varma and Budhwar, 2008). While all organizations need to address these issues, the way a firm decides to go about addressing these issues is dependent on its location and context. In other words, differences in local norms, culture, law, and technology, make it critical that organizations develop and/or adapt techniques, policies and practices that are appropriate to the setting (see for example, Hofstede, 1993).

‘Let’s talk about feedback’:an exploration of academic feedback practices in pharmacy education

Feedback is considered one of the most effective mechanisms to aid learning and achievement (Hattie and Timperley, 2007). However, in past UK National Student Surveys, perceptions of academic feedback have been consistently rated lower by final year undergraduate students than other aspects of the student experience (Williams and Kane, 2009). For pharmacy students in particular, Hall and colleagues recently reported that almost a third of students surveyed were dissatisfied with feedback and perceived feedback practice to be inconsistent (Hall et al, 2012). Aims of the Workshop: This workshop has been designed to explore current academic feedback practices in pharmacy education across a variety of settings and cultures as well as to create a toolkit for pharmacy academics to guide their approach to feedback. Learning Objectives: 1. Discuss and characterise academic feedback practices provided by pharmacy academics to pharmacy students in a variety of settings and cultures. 2. Develop academic feedback strategies for a variety of scenarios. 3. Evaluate and categorise feedback strategies with use of a feedback matrix. Description of Workshop Activities: Introduction to workshop and feedback on pre-reading exercise (5 minutes). Activity 1: A short presentation on theoretical models of academic feedback. Evidence of feedback in pharmacy education (10 minutes). Activity 2: Discussion of feedback approaches in participants’ organisations for differing educational modalities. Consideration of the following factors will be undertaken: experiential v. theoretical education, formative v. summative assessment, form of assessment and the effect of culture (20 minutes, large group discussion). Activity 3: Introduction of a feedback matrix (5 minutes). Activity 4: Development of an academic feedback toolkit for pharmacy education. Participants will be divided into 4 groups and will discuss how to provide effective feedback for 2 scenarios. Feedback strategies will be categorised with the feedback matrix. Results will be presented back to the workshop group (20 minutes, small group discussion, 20 minutes, large group presentation). Summary (10 minutes). Additional Information: Pre-reading: Participants will be provided with a list of definitions for academic feedback and will be asked to rank the definitions in order of perceived relevance to pharmacy education. References Archer, J. C. (2010). State of the science in health professional education: effective feedback. Medical education, 44(1), 101-108. Hall, M., Hanna, L. A., & Quinn, S. (2012). Pharmacy Students’ Views of Faculty Feedback on Academic Performance. American journal of pharmaceutical education, 76(1). Hattie, J., & Timperley, H. (2007). The power of feedback. Review of educational research, 77(1), 81-112. Medina, M. S. (2007). Providing feedback to enhance pharmacy students’ performance. American Journal of Health-System Pharmacy, 64(24), 2542-2545.

Transmission performance improvement using random DFB laser based Raman amplification and bidirectional second-order pumping

We demonstrate that a distributed Raman amplification scheme based on random distributed feedback (DFB) fiber laser enables bidirectional second-order Raman pumping without increasing relative intensity noise (RIN) of the signal. This extends the reach of 10 × 116 Gb/s DP-QPSK WDM transmission up to 7915 km, compared with conventional Raman amplification schemes. Moreover, this scheme gives the longest maximum transmission distance among all the Raman amplification schemes presented in this paper, whilst maintaining relatively uniform and symmetric signal power distribution, and is also adjustable in order to be highly compatible with different nonlinearity compensation techniques, including mid-link optical phase conjugation (OPC) and nonlinear Fourier transform (NFT).

Adolescent readers' self-perceptions of affective factors related to performance on standardized tests

The purpose of this study was to investigate which affective factors of adolescent high school readers were related to high-level readers, middle-level readers and low-level readers. The research problem was to determine the relationship between adolescent high school students' self-perceived reading self-efficacy factors and the students' reading performance on a standardized reading assessment considering demographic factors of age, gender and socio-economic status as covariates. The research design was ex post facto making inferences without direct intervention. The sample was obtained from one large, diverse, urban high school, consisting of 9th and 10th grade adolescent students (N = 176). Students voluntarily completed a self-report, reading self-efficacy survey. School records were used to obtain standardized reading level scores, age, gender, and socio-economic status data. An exploratory factor analysis of the self-efficacy survey responses resulted in the identification of 7 underlying factors. The striving (low-level) readers had significantly lower self-perceptions on 5 of the 7 affective factors than the middle-level readers, and strong (high-level) readers, p < .05. The 5 affective factors on which the striving readers had significantly lower self-perceptions were: (a) Observational Comparison, (b) Progress, (c) Lack of Progress, (d) Lack of Anxiety, and (e) Positive Social Feedback. The 2 affective factors which were not significantly different for reader level were Anxiety and Negative Social Feedback. Girls had significantly less anxiety than boys for both of the factors in the Anxiety category. Statistical results showed that none of the demographic covariates tested; age, gender, or socio-economic status, moderated the relationship between affective reader self-efficacy factors and reader level. This study concluded that there were distinguishable differences for striving, middle, and strong readers' self-efficacy factors. Determining affective factors related to reading can be used to create better instructional environments and instruction for adolescent students.

The impact of a Classroom Performance System on learning gains in a biology course for science majors

This study was conducted to determine if the use of the technology known as Classroom Performance System (CPS), specifically referred to as "Clickers", improves the learning gains of students enrolled in a biology course for science majors. CPS is one of a group of developing technologies adapted for providing feedback in the classroom using a learner-centered approach. It supports and facilitates discussion among students and between them and teachers, and provides for participation by passive students. Advocates, influenced by constructivist theories, claim increased academic achievement. In science teaching, the results have been mixed, but there is some evidence of improvements in conceptual understanding. The study employed a pretest-posttest, non-equivalent groups experimental design. The sample consisted of 226 participants in six sections of a college biology course at a large community college in South Florida with two instructors trained in the use of clickers. Each instructor randomly selected their sections into CPS (treatment) and non-CPS (control) groups. All participants filled out a survey that included demographic data at the beginning of the semester. The treatment group used clicker questions throughout, with discussions as necessary, whereas the control groups answered the same questions as quizzes, similarly engaging in discussion where necessary. The learning gains were assessed on a pre/post-test basis. The average learning gains, defined as the actual gain divided by the possible gain, were slightly better in the treatment group than in the control group, but the difference was statistically non-significant. An Analysis of Covariance (ANCOVA) statistic with pretest scores as the covariate was conducted to test for significant differences between the treatment and control groups on the posttest. A second ANCOVA was used to determine the significance of differences between the treatment and control groups on the posttest scores, after controlling for sex, GPA, academic status, experience with clickers, and instructional style. The results indicated a small increase in learning gains but these were not statistically significant. The data did not support an increase in learning based on the use of the CPS technology. This study adds to the body of research that questions whether CPS technology merits classroom adaptation.

Work Creativity as a Dimension of Job Performance

To stay competitive, many employers are looking for creative and innovative employees to add value to their organization. However, current models of job performance overlook creative performance as an important criterion to measure in the workplace. The purpose of this dissertation is to conduct two separate but related studies on creative performance that aim to provide support that creative performance should be included in models of job performance, and ultimately included in performance evaluations in organizations. Study 1 is a meta-analysis on the relationship between creative performance and task performance, and the relationship between creative performance and organizational citizenship behavior (OCB). Overall, I found support for a medium to large corrected correlation for both the creative performance-task performance (ρ = .51) and creative performance-OCB (ρ = .49) relationships. Further, I also found that both rating-source and study location were significant moderators. Study 2 is a process model that includes creative performance alongside task performance and OCB as the outcome variables. I test a model in which both individual differences (specifically: conscientiousness, extraversion, proactive personality, and self-efficacy) and job characteristics (autonomy, feedback, and supervisor support) predict creative performance, task performance, and OCB through engagement as a mediator. In a sample of 299 employed individuals, I found that all the individual differences and job characteristics were positively correlated with all three performance criteria. I also looked at these relationships in a multiple regression framework and most of the individual differences and job characteristics still predicted the performance criteria. In the mediation analyses, I found support for engagement as a significant mediator of the individual differences-performance and job characteristics-performance relationships. Taken together, Study 1 and Study 2 support the notion that creative performance should be included in models of job performance. Implications for both researchers and practitioners alike are discussed.

An automated approach for performance deviation analysis of evolving software systems

A manutenção e evolução de sistemas de software tornou-se uma tarefa bastante crítica ao longo dos últimos anos devido à diversidade e alta demanda de funcionalidades, dispositivos e usuários. Entender e analisar como novas mudanças impactam os atributos de qualidade da arquitetura de tais sistemas é um pré-requisito essencial para evitar a deterioração de sua qualidade durante sua evolução. Esta tese propõe uma abordagem automatizada para a análise de variação do atributo de qualidade de desempenho em termos de tempo de execução (tempo de resposta). Ela é implementada por um framework que adota técnicas de análise dinâmica e mineração de repositório de software para fornecer uma forma automatizada de revelar fontes potenciais – commits e issues – de variação de desempenho em cenários durante a evolução de sistemas de software. A abordagem define quatro fases: (i) preparação – escolher os cenários e preparar os releases alvos; (ii) análise dinâmica – determinar o desempenho de cenários e métodos calculando seus tempos de execução; (iii) análise de variação – processar e comparar os resultados da análise dinâmica para releases diferentes; e (iv) mineração de repositório – identificar issues e commits associados com a variação de desempenho detectada. Estudos empíricos foram realizados para avaliar a abordagem de diferentes perspectivas. Um estudo exploratório analisou a viabilidade de se aplicar a abordagem em sistemas de diferentes domínios para identificar automaticamente elementos de código fonte com variação de desempenho e as mudanças que afetaram tais elementos durante uma evolução. Esse estudo analisou três sistemas: (i) SIGAA – um sistema web para gerência acadêmica; (ii) ArgoUML – uma ferramenta de modelagem UML; e (iii) Netty – um framework para aplicações de rede. Outro estudo realizou uma análise evolucionária ao aplicar a abordagem em múltiplos releases do Netty, e dos frameworks web Wicket e Jetty. Nesse estudo foram analisados 21 releases (sete de cada sistema), totalizando 57 cenários. Em resumo, foram encontrados 14 cenários com variação significante de desempenho para Netty, 13 para Wicket e 9 para Jetty. Adicionalmente, foi obtido feedback de oito desenvolvedores desses sistemas através de um formulário online. Finalmente, no último estudo, um modelo de regressão para desempenho foi desenvolvido visando indicar propriedades de commits que são mais prováveis a causar degradação de desempenho. No geral, 997 commits foram minerados, sendo 103 recuperados de elementos de código fonte degradados e 19 de otimizados, enquanto 875 não tiveram impacto no tempo de execução. O número de dias antes de disponibilizar o release e o dia da semana se mostraram como as variáveis mais relevantes dos commits que degradam desempenho no nosso modelo. A área de característica de operação do receptor (ROC – Receiver Operating Characteristic) do modelo de regressão é 60%, o que significa que usar o modelo para decidir se um commit causará degradação ou não é 10% melhor do que uma decisão aleatória.

An automated approach for performance deviation analysis of evolving software systems

A manutenção e evolução de sistemas de software tornou-se uma tarefa bastante crítica ao longo dos últimos anos devido à diversidade e alta demanda de funcionalidades, dispositivos e usuários. Entender e analisar como novas mudanças impactam os atributos de qualidade da arquitetura de tais sistemas é um pré-requisito essencial para evitar a deterioração de sua qualidade durante sua evolução. Esta tese propõe uma abordagem automatizada para a análise de variação do atributo de qualidade de desempenho em termos de tempo de execução (tempo de resposta). Ela é implementada por um framework que adota técnicas de análise dinâmica e mineração de repositório de software para fornecer uma forma automatizada de revelar fontes potenciais – commits e issues – de variação de desempenho em cenários durante a evolução de sistemas de software. A abordagem define quatro fases: (i) preparação – escolher os cenários e preparar os releases alvos; (ii) análise dinâmica – determinar o desempenho de cenários e métodos calculando seus tempos de execução; (iii) análise de variação – processar e comparar os resultados da análise dinâmica para releases diferentes; e (iv) mineração de repositório – identificar issues e commits associados com a variação de desempenho detectada. Estudos empíricos foram realizados para avaliar a abordagem de diferentes perspectivas. Um estudo exploratório analisou a viabilidade de se aplicar a abordagem em sistemas de diferentes domínios para identificar automaticamente elementos de código fonte com variação de desempenho e as mudanças que afetaram tais elementos durante uma evolução. Esse estudo analisou três sistemas: (i) SIGAA – um sistema web para gerência acadêmica; (ii) ArgoUML – uma ferramenta de modelagem UML; e (iii) Netty – um framework para aplicações de rede. Outro estudo realizou uma análise evolucionária ao aplicar a abordagem em múltiplos releases do Netty, e dos frameworks web Wicket e Jetty. Nesse estudo foram analisados 21 releases (sete de cada sistema), totalizando 57 cenários. Em resumo, foram encontrados 14 cenários com variação significante de desempenho para Netty, 13 para Wicket e 9 para Jetty. Adicionalmente, foi obtido feedback de oito desenvolvedores desses sistemas através de um formulário online. Finalmente, no último estudo, um modelo de regressão para desempenho foi desenvolvido visando indicar propriedades de commits que são mais prováveis a causar degradação de desempenho. No geral, 997 commits foram minerados, sendo 103 recuperados de elementos de código fonte degradados e 19 de otimizados, enquanto 875 não tiveram impacto no tempo de execução. O número de dias antes de disponibilizar o release e o dia da semana se mostraram como as variáveis mais relevantes dos commits que degradam desempenho no nosso modelo. A área de característica de operação do receptor (ROC – Receiver Operating Characteristic) do modelo de regressão é 60%, o que significa que usar o modelo para decidir se um commit causará degradação ou não é 10% melhor do que uma decisão aleatória.

Beyond Winning and Losing: Guidelines for Evaluating High Performance Coaches

This paper proposes a three-step method of evaluating high performance coaches involving feedback from the athletes. First, data are collected using an instrument such as the Coaching Behavior Scale for Sport (CBS-S: Côté, Yardley, Hay, Sedgwick, & Baker, 1999). Second, a summary report is prepared with descriptive information regarding the frequency of behaviors demonstrated by the coach that can be compared to previous results or to a criterion measure. The third step involves appropriate personnel reviewing the report and subsequently providing guidance for individual coach development. This three-step appraisal method provides useful evaluative feedback to coaches and has been used in several sport programs in Canada, the United States, and Australia.

Can the British Heart Foundation PocketCPR Application Improve the Performance of Chest Compressions During Bystander Resuscitation: a Randomised Crossover Manikin Study

This study aims to determine whether the British Heart Foundation (BHF) PocketCPR application can improve the depth and rate of chest compression, and therefore be confidently recommended for bystander use. 118 candidates were recruited into a randomised crossover manikin trial. Each candidate performed CPR for two-minutes without instruction, or performed chest compressions using the PocketCPR application. Candidates then performed a further two minutes of CPR within the opposite arm. The number of chest compressions performed improved when PocketCPR was used compared to chest compressions when it was not (44.28% v40.57, P<0.001). The number of chest compressions performed to the required depth was higher in the PocketCPR group (90.86 v 66.26). The BHF PocketCPR application improved the percentage of chest compressions that were performed to the required depth. Despite this, more work is required in order to develop a feedback device that can improve bystander CPR without creating delay.

Pathfinder: a performance-game for the augmented drum-kit

Pathfinder is a performance-game for solo drummer, exploring the synergies between multiple contemporary creative practices. The work navigates between music composition, improvisation, projection/light art and game art. At its heart lies a bespoke electro-acoustic instrument, the augmented drum-kit, used not only to provide the sonic content of the work in real-time, but also as a highly expressive game controller that interacts with an instrument-specific game. The musical instrument offers a much wider range of expressive possibilities, control and tactile feedback in comparison to a traditional general-purpose game controller, and as a result it affords a more diverse and nuanced game play performance. Live electronics, lights, projections and the drum-kit all make up the performance-game’s universe, within which the performer has to explore, adapt, navigate and complete a journey.

Comparative performance analysis of drives for induction motors

The asynchronous polyphase induction motor has been the motor of choice in industrial settings for about the past half century because power electronics can be used to control its output behavior. Before that, the dc motor was widely used because of its easy speed and torque controllability. The two main reasons why this might be are its ruggedness and low cost. The induction motor is a rugged machine because it is brushless and has fewer internal parts that need maintenance or replacement. This makes it low cost in comparison to other motors, such as the dc motor. Because of these facts, the induction motor and drive system have been gaining market share in industry and even in alternative applications such as hybrid electric vehicles and electric vehicles. The subject of this thesis is to ascertain various control algorithms’ advantages and disadvantages and give recommendations for their use under certain conditions and in distinct applications. Four drives will be compared as fairly as possible by comparing their parameter sensitivities, dynamic responses, and steady-state errors. Different switching techniques are used to show that the motor drive is separate from the switching scheme; changing the switching scheme produces entirely different responses for each motor drive.

Interaction techniques with novel multimodal feedback for addressing gesture-sensing systems

Users need to be able to address in-air gesture systems, which means finding where to perform gestures and how to direct them towards the intended system. This is necessary for input to be sensed correctly and without unintentionally affecting other systems. This thesis investigates novel interaction techniques which allow users to address gesture systems properly, helping them find where and how to gesture. It also investigates audio, tactile and interactive light displays for multimodal gesture feedback; these can be used by gesture systems with limited output capabilities (like mobile phones and small household controls), allowing the interaction techniques to be used by a variety of device types. It investigates tactile and interactive light displays in greater detail, as these are not as well understood as audio displays. Experiments 1 and 2 explored tactile feedback for gesture systems, comparing an ultrasound haptic display to wearable tactile displays at different body locations and investigating feedback designs. These experiments found that tactile feedback improves the user experience of gesturing by reassuring users that their movements are being sensed. Experiment 3 investigated interactive light displays for gesture systems, finding this novel display type effective for giving feedback and presenting information. It also found that interactive light feedback is enhanced by audio and tactile feedback. These feedback modalities were then used alongside audio feedback in two interaction techniques for addressing gesture systems: sensor strength feedback and rhythmic gestures. Sensor strength feedback is multimodal feedback that tells users how well they can be sensed, encouraging them to find where to gesture through active exploration. Experiment 4 found that they can do this with 51mm accuracy, with combinations of audio and interactive light feedback leading to the best performance. Rhythmic gestures are continuously repeated gesture movements which can be used to direct input. Experiment 5 investigated the usability of this technique, finding that users can match rhythmic gestures well and with ease. Finally, these interaction techniques were combined, resulting in a new single interaction for addressing gesture systems. Using this interaction, users could direct their input with rhythmic gestures while using the sensor strength feedback to find a good location for addressing the system. Experiment 6 studied the effectiveness and usability of this technique, as well as the design space for combining the two types of feedback. It found that this interaction was successful, with users matching 99.9% of rhythmic gestures, with 80mm accuracy from target points. The findings show that gesture systems could successfully use this interaction technique to allow users to address them. Novel design recommendations for using rhythmic gestures and sensor strength feedback were created, informed by the experiment findings.

A new age of fuel performance code criteria studied through advanced atomistic simulation techniques

A fundamental step in understanding the effects of irradiation on metallic uranium and uranium dioxide ceramic fuels, or any material, must start with the nature of radiation damage on the atomic level. The atomic damage displacement results in a multitude of defects that influence the fuel performance. Nuclear reactions are coupled, in that changing one variable will alter others through feedback. In the field of fuel performance modeling, these difficulties are addressed through the use of empirical models rather than models based on first principles. Empirical models can be used as a predictive code through the careful manipulation of input variables for the limited circumstances that are closely tied to the data used to create the model. While empirical models are efficient and give acceptable results, these results are only applicable within the range of the existing data. This narrow window prevents modeling changes in operating conditions that would invalidate the model as the new operating conditions would not be within the calibration data set. This work is part of a larger effort to correct for this modeling deficiency. Uranium dioxide and metallic uranium fuels are analyzed through a kinetic Monte Carlo code (kMC) as part of an overall effort to generate a stochastic and predictive fuel code. The kMC investigations include sensitivity analysis of point defect concentrations, thermal gradients implemented through a temperature variation mesh-grid, and migration energy values. In this work, fission damage is primarily represented through defects on the oxygen anion sublattice. Results were also compared between the various models. Past studies of kMC point defect migration have not adequately addressed non-standard migration events such as clustering and dissociation of vacancies. As such, the General Utility Lattice Program (GULP) code was utilized to generate new migration energies so that additional non-migration events could be included into kMC code in the future for more comprehensive studies. Defect energies were calculated to generate barrier heights for single vacancy migration, clustering and dissociation of two vacancies, and vacancy migration while under the influence of both an additional oxygen and uranium vacancy.