Discourse and assessment

Many contemporary currents in applied linguistics have favored discourse studies within assessment; there have been calls for cross-fertilization with other areas within applied linguistics, critiques of the positivist tradition within language testing research, and the growing impact of Conversation Analysis (CA) and sociocultural theory. This chapter focuses on the resulting increase in discourse-based studies of oral proficiency assessment techniques. These studies initially focused on the traditional oral proficiency interview but have since been extended to new test formats, including paired and group interaction. We discuss the research carried out on a number of factors in the assessment setting, including the role of the interlocutor, candidate, and rater, and the impact of tasks, task performance conditions, and rating criteria. Recent research has also concentrated more specifically on the assessment of pragmatic competence and on the applications of technology within the assessment of spoken language, including the comparability of semidirect and direct methods for such assessment and the use of computer corpora.

Discriminating between primary school students with high and low self-esteem.

From an initial sample of 747 primary school students, the top 16 percent (n =116) with high self-esteem (HSE) and the bottom 15 percent (n = I1 I) with low selfesteem (LSE) were se/eeted. These two groups were then compared on personal and classroom variables. Significant differences were found for all personal (self-talk, selfconcepts) and classroom (teacher feedback, praise, teacher-student relationship, and classroom environment) variables. Students with HSE scored more highly on all variables. Discriminant Function Analysis (DFA) was then used to determine which variables discriminated between these two groups of students. Learner self-concept, positive and negative self-talk, classroom environment, and effort feedback were the best discriminators of students with high and low self-esteem. Implications for educational psychologists and teachers are discussed.

Integrating concrete and virtual materials in an elementary mathematics classroom : a case study of success with fractions

This paper describes an approach to introducing fraction concepts using generic software tools such as Microsoft Office's PowerPoint to create "virtual" materials for mathematics teaching and learning. This approach replicates existing concrete materials and integrates virtual materials with current non-computer methods of teaching primary students about fractions. The paper reports a case study of a 12-year-old student, Frank, who had an extremely limited understanding of fractions. Frank also lacked motivation for learning mathematics in general and interacted with his peers in a negative way during mathematics lessons. In just one classroom session involving the seamless integration of off-computer and on-computer activities, Frank acquired a basic understanding of simple common equivalent fractions. Further, he was observed as the session progressed to be an enthusiastic learner who offered to share his learning with his peers. The study's "virtual replication" approach for fractions involves the manipulation of concrete materials (folding paper regions) alongside the manipulation of their virtual equivalent (shading screen regions). As researchers have pointed out, the emergence of new technologies does not mean old technologies become redundant. Learning technologies have not replaced print and oral language or basic mathematical understanding. Instead, they are modifying, reshaping, and blending the ways in which humankind speaks, reads, writes, and works mathematically. Constructivist theories of learning and teaching argue that mathematics understanding is developed from concrete to pictorial to abstract and that, ultimately, mathematics learning and teaching is about refinement and expression of ideas and concepts. Therefore, by seamlessly integrating the use of concrete materials and virtual materials generated by computer software applications, an opportunity arises to enhance the teaching and learning value of both materials.

The quality of interface design for educational courseware development in Malaysian educational context

Interactive educational courseware has been adopted in diverse education sectors such as primary, secondary, tertiary education, vocational and professional training. In Malaysian educational context, the ministry of education has implemented Smart School Project that aims to increase high level of academic achievement in primary and secondary schools by using interactive educational courseware. However, many researchers have reported that many coursewares fail to accommodate the learner and teacher needs. In particular, the interface design is not appropriately designed in terms of quality of learning. This paper reviews educational courseware development process in terms of defining quality of interface design and suggests a conceptual model of interface design through the integration of design components and interactive learning experience into the development process. As a result, it defines the concept of interactive learning experience in a more practical approach in order to implement each stage of the development process in a seamless and integrated way.

The Student Success Project : Helping students at-risk of failing or leaving a unit - a work in progress

In Semester 1 2007, a Monitoring Student Engagement study, conducted as part of the Enhancing Transition at Queensland University of Technology (ET@QUT) Project and extending earlier work in the Project by Arora (2006), aimed at mapping the processes and resources used at that time to identify, monitor and manage students in their first year who were at risk of leaving QUT (Shaw, 2007). This identified a lack of documentation of the processes and resources used and revealed an ad-hoc rather than holistic and systematic approach to monitoring student engagement. One of Shaw’s recommendations was to: “To introduce a centralised case management approach to student engagement” (p. 14). That provided the genesis for the Student Success Project that is being reported on here. The aim of the Student Success Project is to trial, evaluate and ultimately establish holistic and systematic ways of helping students who appear to be at-risk of failing or withdrawing from a unit to persist and succeed. Students are profiled as being at-risk if they are absent from more than 2 tutorials in a row without contacting their tutor or if they fail to submit their first assignment. A Project Officer makes personal contact with these students to suggest ways they can get further assistance depending on their situation.

Changing motorcycle rider safety attitudes and motives for risk taking : process evaluation of a rider training intervention

Risk-taking behaviour by motorcyclists has been shown to contribute to a substantial proportion of road crashes in Australia and abroad. Concern has been expressed that traditional motorcycle licence training programs do not sufficiently address such behaviour. Accordingly, the Three Steps to Safer Riding program was developed to address risk taking behaviour by riders as an adjunct to existing skills-based rider training. The program was designed to be delivered in a one hour classroom session at the start of training, with a 20 minute debrief to revise the key concepts at the end of training. This paper reports on the key training concepts, methodology and implementation of the pilot program with a major rider training organisation in Queensland and presents findings from a process evaluation. The Three Steps to Safer Riding intervention pilot was delivered to 518 learner riders over a three month period. Follow-up focus groups and one interview with intervention participants (N=18) five to eight months after completion of the program suggest that new riders (absolute novices) embraced and internalised many of the intervention concepts. However, some riders who had previous riding experience prior to training stated these issues were common sense, yet still expressed riding styles that were contrary to some of the key intervention messages. This is discussed in terms of raising awareness of risk issues for motorcyclists versus behaviour change. Additionally, interviews conducted with riding instructors are discussed regarding logistical challenges of implementation, training consistency, skills required to deliver the program, support for the program, and student engagement.

Learning to drive with cognitive impairment : the experience of young ADHD diagnosed drivers and their parent supervisors

A subset of novice drivers exhibit executive function impairments which may adversely impact on the learn-to-drive period and subsequent driving experience, potentially explaining their overrepresentation in traffic offences and crashes. This paper presents the results of a qualitative analysis of a small series of in-depth semi-structured interviews undertaken individually with affected young drivers (n = 7) and each of their parent supervisors (n = 6). Young drivers were selected on the basis of their ADHD diagnosis, as a sample particularly affected by executive function impairments. Standardised rating scale measures confirmed the currency of the young drivers’ ADHD symptoms and executive function impairment. Results are discussed in terms of common experiences of the young affected drivers and those of their parents as supervising drivers of the learn-to-drive process and subsequent driving behaviour. Key themes included difficulties that were related to core executive function impairments symptomatic of ADHD. Themes also included common emotions that the young drivers associated with driving, with particular types of impact on their driving behaviour. Common strategies that were used by both the young driver and their parent during this learning process and their perceived effectiveness are also discussed. Those that were perceived to be most effective tended to focus on reducing the cognitive load for the young driver when introducing new information and skills.

Levelling expectations across different years in an undergraduate degree to support work-related learning : evidence for a multi-pronged approach.

One of the ways in which university departments and faculties can enhance the quality of learning and assessment is to develop a ‘well thought out criterion‐referenced assessment system’ (Biggs, 2003, p. 271). In designing undergraduate degrees (courses) this entails making decisions about the levelling of expectations across different years through devising objectives and their corresponding criteria and standards: a process of alignment analogous to what happens in unit (subject) design. These decisions about levelling have important repercussions in terms of supporting students’ work‐related learning, especially in relation to their ability to cope with the increasing cognitive and skill demands made on them as they progress through their studies. They also affect the accountability of teacher judgments of students’ responses to assessment tasks, achievement of unit objectives and, ultimately, whether students are awarded their degrees and are sufficiently prepared for the world of work. Research reveals that this decision‐making process is rarely underpinned by an explicit educational rationale (Morgan et al, 2002). The decision to implement criterion referenced assessment in an undergraduate microbiology degree was the impetus for developing such a rationale because of the implications for alignment, and therefore ‘levelling’ of expectations across different years of the degree. This paper provides supporting evidence for a multi‐pronged approach to levelling, through backward mapping of two revised units (foundation and exit year). This approach adheres to the principles of alignment while combining a work‐related approach (via industry input) with the blended disciplinary and learner‐centred approaches proposed by Morgan et al. (2002). It is suggested that this multi‐pronged approach has the potential for making expectations, especially work‐related ones across different year levels of degrees, more explicit to students and future employers.

Assessment for learning : a sociocultural approach

Assessment for Learning (AfL) is a title given to classroom evaluative practices that share the purpose of diagnosing and informing teachers and students about learning progress, during the learning process. These practices also have the potential to develop learner autonomy by increasing student motivation and mastery through developing the learner's capacity to monitor and plan his or her own learning progress. Yet teacher adoption of the practices is not a straightforward implementation of techniques within an existing classroom repertoire. Recent research highlights a more complex interrelationship between teacher and student beliefs, identities, and traditions of power within assessment and learning in classroom contexts. These often hidden relationships can add layers of complexity for teachers implementing assessment change, and may act as barriers that frustrate efforts to realise the AfL goal of learner autonomy. By interpreting AfL practices from a sociocultural perspective, the social and cultural contexts that influence classroom assessment can be better understood. In turn teachers can thus be better supported in adopting AfL practices within the complexities of the social, cultural and policy contexts of schooling.

Scatter difference NAP for SVM speaker recognition

This paper presents Scatter Difference Nuisance Attribute Projection (SD-NAP) as an enhancement to NAP for SVM-based speaker verification. While standard NAP may inadvertently remove desirable speaker variability, SD-NAP explicitly de-emphasises this variability by incorporating a weighted version of the between-class scatter into the NAP optimisation criterion. Experimental evaluation of SD-NAP with a variety of SVM systems on the 2006 and 2008 NIST SRE corpora demonstrate that SD-NAP provides improved verification performance over standard NAP in most cases, particularly at the EER operating point.

The Quality of Interface Design for Educational Courseware Development in Malaysian Educational Context

Interactive educational courseware has been adopted in diverse education sectors such as primary, secondary, tertiary education, vocational and professional training. In Malaysian educational context, the ministry of education has implemented Smart School Project that aims to increase high level of academic achievement in primary and secondary schools by using interactive educational courseware. However, many researchers have reported that many coursewares fail to accommodate the learner and teacher needs. In particular, the interface design is not appropriately designed in terms of quality of learning. This paper reviews educational courseware development process in terms of defining quality of interface design and suggests a conceptual model of interface design through the integration of design components and interactive learning experience into the development process. As a result, it defines the concept of interactive learning experience in a more practical approach in order to implement each stage of the development process in a seamless and integrated way.

Wellness as higher education curriculum: A comprehensive framework for health education and promotion

A number of studies in relation to the place, impact and purpose of Wellness curricula provide insight into the perceived benefits of Wellness education in university environments. Of particular note is the recommendation by many authors that curriculum design fosters personal experiences, reflective practice and active self-managed learning approaches in order to legitimise (give permission for) the adoption of wellness as a personal lifestyle approach in the frenetic pace of student life. From a broader educational perspective, Wellness education provides opportunities for students to engage in learning self regulation skills both within and beyond the context of the Wellness construct.To realise the suggested potential of Wellness education in higher learning, it is necessary that curricula overlay the principles from the domains of both self-regulation and Wellness, to highlight authentic learning as a means to lifelong approaches. Currently, however, systematic development and empirical examination of the Wellness construct have received limited academic investigation. Despite having a multitude of intended purposes from the educative to the therapy oriented goals of the original authors, most wellness models appear to be limited to the “what” of Wellness. Investigations of the “how” and “why” aspects of Wellness may serve to enhance currently existing models by incorporating behaviour modification and learning approaches in order to create more comprehensive frameworks for health education and promotion.It is also important to note that none of the current Wellness models actually address the educative framework necessary for an individual to learn and thus become aware or understand and make choices about their own Wellness.The literature reviewed within this paper would suggest that learner success is optimised by giving learners authentic opportunities to develop and practice self regulation strategies. Such opportunities include learning experiences that: provide options for self determined outcomes; require skills development; recognise principles of successful learning as outlined by the APA; and are scaffolded according to learner needs rather than in generic ways. Thus, configuring a learner centred curriculum in Wellness Education would potentially benefit from overlaying principles from the domains of both SRL and Wellness to highlight authentic learning as a means to lifelong approaches, triggered by undergraduate experiences.Student perceptions are a rich and significant data base for the measurement of their experiences, activities, practices and behaviours. Wellness undergraduate education, such as the “Fitness, Health and Wellness” unit offered by Queensland University of Technology, offers a context in which to confirm possibilities suggested by the literature reviewed in this paper in a practical, Australian context.

Transforming Queensland VET : Challenges and Opportunities (Volume 3)

The volume is the third in a series that addresses change and development in the delivery of VET programs in Queensland. The chapters address a breadth of issues that relate to the changing landscape for teaching and learning in VET programs through e-learning. Organisational change is a key focus of this volume. James Waterson examines business and pedagogical perspectives for SkillsTech Australia to create teaching and learning environments that will enrich the learning experience for staff and students. Kerry Emerson explores the ways in which printing teachers might change current practices in order to deliver their training to apprentices and trainees – off-the-job, onthe- job and online, through e-learning. The chapter by Erik Dodwell takes up issues of user-friendly RPL interviews and the challenges to develop a model that may be applied consistently across all industry areas using conversational interviews. The chapters by Linda Roberston, Nina Woodrow, and Anushka Weerackody discuss teaching and learning for specific groups of students. Linda Roberston proposes a vision for learning support teachers in which the learner is encouraged to be a self-directed and autonomous learner who is capable of utilising e-learning resources and is information literate. Nina Woodrow presents a case for the diminished sense of occupational identity by adult literacy teachers and the implications of this loss of expertise across the VET sector. Constructive strategies for change are outlined. The chapter by Anushka Weerackody explores ideas to enhance the practices of ESL teachers in TAFE Queensland through an online community of practice. The issues of on-the-job training through e-learning for various trades is considered by Anne-Louise Johnston and the benefits and challenges for SkillsTech Australia in developing training partnerships with industry to deliver these changes. These papers were completed by the authors as a part of their postgraduate studies at QUT. The views reported are those of the authors and should not be attributed to the Queensland Department of Education and Training. Donna Berthelsen and Lauren Vogel Faculty of Education Queensland University of Technology December 2009

Mobility and safety are conflicting goals for transport policy makers when making decisions about graduated driver licensing

Policy decisions are frequently influenced by more than research results alone. This review examines one road safety countermeasure, graduated driver licensing, in three jurisdictions and identifies how the conflict between mobility and safety goals can influence policy decisions relating to this countermeasure. Evaluations from around the world of graduated driver licensing have demonstrated clear reductions in crashes for young drivers. However, the introduction of this countermeasure may be affected, both positively and negatively, by the conflict some policy makers experience between ensuring individuals remain both mobile and safe as drivers. This review highlights how this conflict in policy decision making can serve to either facilitate or hinder the introduction of graduated driver licensing systems. However, policy makers whose focus on mobility is too strong when compared with safety may be mistaken, with evidence suggesting that after a graduated driver licensing system is introduced young drivers adapt their behaviour to the new system and remain mobile. As a result, policy makers should consciously acknowledge the conflict between mobility and safety and consider an appropriate balance in order to introduce these systems. Improvements to the licensing system can then be made in an incremental manner as the balance between these two priorities change. Policy makers can achieve an appropriate balance by using empirical evidence as a basis for their decisions.