Harnessing assessment and feedback in the first year to support learning success, engagement and retention

It has been argued that intentional first year curriculum design has a critical role to play in enhancing first year student engagement, success and retention (Kift, 2008). A fundamental first year curriculum objective should be to assist students to make the successful transition to assessment in higher education. Scott (2006) has identified that ‘relevant, consistent and integrated assessment … [with] prompt and constructive feedback’ are particularly relevant to student retention generally; while Nicol (2007) suggests that ‘lack of clarity regarding expectations in the first year, low levels of teacher feedback and poor motivation’ are key issues in the first year. At the very minimum, if we expect first year students to become independent and self-managing learners, they need to be supported in their early development and acquisition of tertiary assessment literacies (Orrell, 2005). Critical to this attainment is the necessity to alleviate early anxieties around assessment information, instructions, guidance, and performance. This includes, for example:  inducting students thoroughly into the academic languages and assessment genres they will encounter as the vehicles for evidencing learning success; and  making expectations about the quality of this evidence clear. Most importantly, students should receive regular formative feedback of their work early in their program of study to aid their learning and to provide information to both students and teachers on progress and achievement. Leveraging research conducted under an ALTC Senior Fellowship that has sought to articulate a research-based 'transition pedagogy' (Kift & Nelson, 2005) – a guiding philosophy for intentional first year curriculum design and support that carefully scaffolds and mediates the first year learning experience for contemporary heterogeneous cohorts – this paper will discuss theoretical and practical strategies and examples that should be of assistance in implementing good assessment and feedback practices across a range of disciplines in the first year.

Designing for engagement : building IT systems

Context The School of Information Technology at QUT has recently undertaken a major restructuring of their Bachelor of Information Technology (BIT) course. Some of the aims of this restructuring include a reduction in first year attrition and to provide an attractive degree course that meets both student and industry expectations. Emphasis has been placed on the first semester in the context of retaining students by introducing a set of four units that complement one another and provide introductory material on technology, programming and related skills, and generic skills that will aid the students throughout their undergraduate course and in their careers. This discussion relates to one of these four fist semester units, namely Building IT Systems. The aim of this unit is to create small Information Technology (IT) systems that use programming or scripting, databases as either standalone applications or web applications. In the prior history of teaching introductory computer programming at QUT, programming has been taught as a stand alone subject and integration of computer applications with other systems such as databases and networks was not undertaken until students had been given a thorough grounding in those topics as well. Feedback has indicated that students do not believe that working with a database requires programming skills. In fact, the teaching of the building blocks of computer applications have been compartmentalized and taught in isolation from each other. The teaching of introductory computer programming has been an industry requirement of IT degree courses as many jobs require at least some knowledge of the topic. Yet, computer programming is not a skill that all students have equal capabilities of learning (Bruce et al., 2004) and this is clearly shown by the volume of publications dedicated to this topic in the literature over a broad period of time (Eckerdal & Berglund, 2005; Mayer, 1981; Winslow, 1996). The teaching of this introductory material has been done pretty much the same way over the past thirty years. During this period of time that introductory computer programming courses have been taught at QUT, a number of different programming languages and programming paradigms have been used and different approaches to teaching and learning have been attempted in an effort to find the golden thread that would allow students to learn this complex topic. Unfortunately, computer programming is not a skill that can be learnt in one semester. Some basics can be learnt but it can take many years to master (Norvig, 2001). Faculty data typically has shown a bimodal distribution of results for students undertaking introductory programming courses with a high proportion of students receiving a high mark and a high proportion of students receiving a low or failing mark. This indicates that there are students who understand and excel with the introductory material while there is another group who struggle to understand the concepts and practices required to be able to translate a specification or problem statement into a computer program that achieves what is being requested. The consequence of a large group of students failing the introductory programming course has been a high level of attrition amongst first year students. This attrition level does not provide good continuity in student numbers in later years of the degree program and the current approach is not seen as sustainable.

Moderating drinking by correspondence : an evaluation of a new method of intervention

Recognizing the need to offer alternative methods of brief interventions, this study developed correspondence treatments for low-dependent problem drinkers and evaluated their impact. One hundred and twenty-one problem drinkers were recruited by media advertisements and were randomly allocated to a full cognitive behavioural treatment programme (CBT) or to a minimal intervention condition (MI) that gave information regarding alcohol misuse and instructions to record drinking. As predicted, CBT was more effective than MI in reducing alcohol consumption over the 4-month controlled trial period. CBT produced a 50% fall in consumption, bringing the average intake of subjects within recommended maximum levels. Treatment gains at 6 months were well maintained to 12 months. High levels of consumer satisfaction, a high representation of women and a substantial participation from isolated rural areas attested to the feasibility of the correspondence programme as an alternative treatment. However, some drinking occasions still involved high intake for a significant subgroup of subjects, and this issue will be addressed in future programmes. The results supported the use of correspondence delivery as a means of promoting early engagement and equity of access between city and country areas.

Towards a cognitive-behavioural intervention for adult grief reactions

Published accounts of behavioural interventions for grief have relied on exposure and habituation to grief cues as the primary strategy. Such an approach is excessively narrow, since it does not adequately confront the challenges that are posed by a bereavement. Many people cope with a bereavement by themselves, and for those, intervention may well be counterproductive. A cognitive-behavioural intervention, following models for depression/anxiety, can assist vulnerable individuals obtain a more rapid or complete adjustment. The proposed approach differs from dynamic treatments by placing less emphasis on defensive behavior, insight, and interpretation and more emphasis on training of coping skills.

Substance Treatment Options in Psychosis (STOP) : a new intervention for dual diagnosis

Despite the high co-occurrence of psychosis and substance abuse, there is very little research on the development of effective treatments for this problem. This paper describes a new intervention that facilitates reaching functional goals through collaboration between therapists, participants and families. Substance Treatment Options in Psychosis (STOP) integrates pharmacological and psycho-logical treatments for psychotic symptoms, with cognitive-behavioural approaches to substance abuse. STOP is tailored to participants' problems and abilities, and recognises that control of consumption and even engagement may take several attempts. Training in relevant skills is augmented by bibliotherapy, social support and environmental change. A case description illustrates the issues and challenges in implementation.

Issues in multidisciplinary training of cognitive-behavioural interventions

Argues that if brief workshop training is used as the primary method of disseminating behavior therapy skills across professions, it will provide an inadequate preparation, especially for higher levels of behavioral practice. In some circumstances, brief training may lead to an overestimation of behavioral skills by the trainees. These issues are discussed in the context of current moves toward providing health professionals with multiple skills. Examples are provided of situations in which generic health professionals received brief workshop training in behavior therapy and attempted to make use of that training in their jobs. There is no substitute for ongoing training and consultation by senior clinical psychologists who are expert in behavior therapy.

Application of cognitive-behavioural family intervention for schizophrenia in multidisciplinary teams : what can the matter be?

Surveyed 45 therapists who had participated in a family intervention for schizophrenia training program to examine the difficulties they had encountered, their recall of the intervention strategies, and the extent that they thought the approach had become integrated in their everyday work. Between 6 mo and 3 yrs after the family training, Ss reported the number of families they had systematically treated, and the difficulties they had encountered. Allowance of time to undertake the intervention, afterhours scheduling, and illness or holidays presented particular difficulties. Only 4% reported that their knowledge of behavioral techniques was a problem, but in a written test most therapists did not display minimum recall of the material of cognitive therapy, social skills training, or behavioral strategies. The study demonstrated significant problems in disseminating cognitive-behavioral approaches to multidisciplinary settings.

Prediction of outcome with group cognitive therapy for depression

Tested a social–cognitive model of depressive episodes and their treatment within a predictive study of treatment response. 42 clinically depressed volunteers (aged 22–60 yrs) were given self-efficacy (SE) questionnaires and other measures before and after treatment with cognitive therapy. Results support the idea that SE and skills regarding control of negative cognition mediates a sustained response to cognitive treatment for depression. Not only did mood-control variables correlate highly with concurrent changes in depression scores during treatment, but the posttreatment SE measure discriminated Ss who relapsed over the next 12 mo.

Intensive cognitive-behaviour therapy for depression : preliminary findings with four country residents

Describes a brief intensive program of cognitive therapy for depression that was designed for 4 adult residents of country towns in Australia, who resided some distance from treatment centers. Ss were assessed prior to treatment, at posttreatment, and at 4-wk, 8-wk, and 20-mo follow-ups. Treatments took place over 3 consecutive days for a total period of 15 hrs. Effects were highly consistent with the impact of group treatments delivered on a more traditional schedule. If confirmed in a controlled group study, these results suggest that cognitive therapy may be applied more economically and more widely than was previously realized.

Cognitive assessment in closed head injury : stability, validity and parallel forms for two neuropsychological measures of recovery

Investigated the psychometric properties of the original and alternate sets of the Trail Making Test (TMT) and the Controlled Oral Word Association Test (COWAT; A. L. Benton and D. Hamsher, 1978) in 50 orthopedic and 15 closed head injured (1 yr after trauma) patients (aged 15–59 yrs). Although the alternate forms of both measures proved to be stable and consistent with each other in both groups, only the parallel sets of TMT reliably discriminated the clinical group from controls. Practice effects in the head injured were significant only for Trail B of TMT. Factor analysis of the control group's results identified Verbal Knowledge as a major contributor to performance on COWAT, whereas TMT was more dependent on Rapid Visual Search and Visuomotor Sequencing.

Augmenting web service discovery by cognitive semantics and abduction

We argue that web service discovery technology should help the user navigate a complex problem space by providing suggestions for services which they may not be able to formulate themselves as (s)he lacks the epistemic resources to do so. Free text documents in service environments provide an untapped source of information for augmenting the epistemic state of the user and hence their ability to search effectively for services. A quantitative approach to semantic knowledge representation is adopted in the form of semantic space models computed from these free text documents. Knowledge of the user’s agenda is promoted by associational inferences computed from the semantic space. The inferences are suggestive and aim to promote human abductive reasoning to guide the user from fuzzy search goals into a better understanding of the problem space surrounding the given agenda. Experimental results are discussed based on a complex and realistic planning activity.

“Just try harder and you will shine” : a Study of 20 lazy children

Attributions of laziness, reflected in teacher comments such as “just try harder and you will shine” may mask specific cognitive, learning, attentional or emotional problems that could explain low motivation in some children. This paper reports findings from an investigation of 20 children, aged 7 to 10 years, who were regarded as lazy by their parents and teachers. Questionnaire measures provided evidence of low levels of motivation and classroom engagement. Psychometric assessments revealed the presence of a range of difficulties including phonologically-based learning disabilities and significant problems with attention in 17 of the 20 children. The paper concludes that the special needs of an unknown number of children may be overlooked because they are simply presumed to be lazy.

Heart versus mind : the functions of emotional and cognitive loyalty

While there is substantial research on attitudinal and behavioral loyalty, the deconstruction of attitudinal loyalty into its two key components – emotional and cognitive loyalty – has been largely ignored. Despite the existence of managerial strategies aimed at increasing each of these two components, there is little academic research to support these managerial efforts. This paper seeks to advance the understanding of emotional and cognitive brand loyalty by examining the psychological function that these dimensions of brand loyalty perform for the consumer. We employ Katz’s (1960) four functions of attitudes (utilitarian, knowledge, value-expression, ego-defence) to investigate this question. Surveys using a convenience sample were completed by 268 consumers in two metropolitan cities on a variety of goods, services and durable products. The relationship between the functions and dimensions of loyalty were examined using MANOVA. The results show that both the utilitarian and knowledge functions of loyalty are significantly positively related to cognitive loyalty while the ego-defensive function of loyalty is significantly positively related to emotional loyalty. The results for the value-expressive function of loyalty were nonsignificant.

Impact of simulated visual impairment on the cognitive test performance of young adults

Aims: This study investigated the effect of simulated visual impairment on the speed and accuracy of performance on a series of commonly used cognitive tests. ----- Methods: Cognitive performance was assessed for 30 young, visually normal subjects (M=22.0yrs ± 3.1 yrs) using the Digit Symbol Substitution Test (DSST), Trail Making Test (TMT) A and B and the Stroop Colour Word Test under three visual conditions: normal vision and two levels of visually degrading filters (VistechTM) administered in a random order. Distance visual acuity and contrast sensitivity were also assessed for each filter condition. ----- Results: The visual filters, which degraded contrast sensitivity to a greater extent than visual acuity, significantly increased the time to complete (p<0.05), but not the number of errors made, on the DSST and the TMT A and B and affected only some components of the Stroop test.----- Conclusions: Reduced contrast sensitivity had a marked effect on the speed but not the accuracy of performance on commonly used cognitive tests, even in young individuals; the implications of these findings are discussed.

Cognitive behavioral interviewing for adult disorders : a practical handbook

This is a guidebook for clinicians on how to conduct assessment interviews with patients presenting with common psychological disorders. The orientation is behavioural and cognitive; so the book has wide applicability, as most clinicians explicitly or implicitly accept this combination of models as a useful basis for assessing and treating these problems. The problem areas covered are: fear and anxiety problems; depression, obesity; interpersonal problems; sexual dysfunction; insomnia; headache; and substance abuse.