Complex skills and academic writing:a review of evidence about the types of learning required to meet core assessment criteria

Assessment criteria are increasingly incorporated into teaching, making it important to clarify the pedagogic status of the qualities to which they refer. We reviewed theory and evidence about the extent to which four core criteria for student writing-critical thinking, use of language, structuring, and argument-refer to the outcomes of three types of learning: generic skills learning, a deep approach to learning, and complex learning. The analysis showed that all four of the core criteria describe to some extent properties of text resulting from using skills, but none qualify fully as descriptions of the outcomes of applying generic skills. Most also describe certain aspects of the outcomes of taking a deep approach to learning. Critical thinking and argument correspond most closely to the outcomes of complex learning. At lower levels of performance, use of language and structuring describe the outcomes of applying transferable skills. At higher levels of performance, they describe the outcomes of taking a deep approach to learning. We propose that the type of learning required to meet the core criteria is most usefully and accurately conceptualized as the learning of complex skills, and that this provides a conceptual framework for maximizing the benefits of using assessment criteria as part of teaching. © 2006 Taylor & Francis.

Confluent Learning: Using a Design Approach to Develop Cognitive Abilities and Enhance Affective Capacities Through Change Management Curriculum

Purpose The aim of the study is to explore the role of confluent learning in supporting the development of change management knowledge, skills and attitudes and to inform the creation of a conceptual model based upon a priori and a posteriori knowledge gained from literature and the research. Design/methodology/approach The research adopts qualitative approach based on reflective inquiry methodology. There are two primary data sources, interviews with learners and the researchers’ reflective journals on learners’ opinions. Findings The confluent learning approach helped to stimulate affective states (e.g. interest and appreciation) to further reinforce cognitive gains (e.g. retention of knowledge) as a number of higher order thinking skills were further developed. The instructional design premised upon confluent learning enabled learners to further appreciate the complexities of change management. Research implications/ limitations The confluent learning approach offers another explanation to how learning takes place, contingent upon the use of a problem solving framework, instructional design and active learning in developing inter- and trans-disciplinary competencies. Practical implications This study not only explains how effective learning takes place but is also instructive to learning and teaching, and human resource development (HRD) professionals in curriculum design and the potential benefits of confluent learning. Social implications The adoption of a confluent learning approach helps to re-naturalise learning that appeals to learners affect. Originality/value This research is one of the few studies that provide an in-depth exploration of the use of confluent learning and how this approach co-develops cognitive abilities and affective capacity in the creation of a conceptual model.

Experience of problem-based learning (PBL) in virtual space : a phenomenographical study

This thesis reports the outcomes of an investigation into students’ experience of Problem-based learning (PBL) in virtual space. PBL is increasingly being used in many fields including engineering education. At the same time many engineering education providers are turning to online distance education. Unfortunately there is a dearth of research into what constitutes an effective learning experience for adult learners who undertake PBL instruction through online distance education. Research was therefore focussed on discovering the qualitatively different ways that students experience PBL in virtual space. Data was collected in an electronic environment from a course, which adopted the PBL strategy and was delivered entirely in virtual space. Students in this course were asked to respond to open-ended questions designed to elicit their learning experience in the course. Data was analysed using the phenomenographical approach. This interpretative research method concentrated on mapping the qualitative differences in students’ interpretations of their experience in the course. Five qualitatively different ways of experiencing were discovered: Conception 1: ‘A necessary evil for program progression’; Conception 2: ‘Developing skills to understand, evaluate, and solve technical Engineering and Surveying problems’; Conception 3: ‘Developing skills to work effectively in teams in virtual space’; Conception 4: ‘A unique approach to learning how to learn’; Conception 5: ‘Enhancing personal growth’. Each conception reveals variation in how students attend to learning by PBL in virtual space. Results indicate that the design of students’ online learning experience was responsible for making students aware of deeper ways of experiencing PBL in virtual space. Results also suggest that the quality and quantity of interaction with the team facilitator may have a significant impact on the student experience in virtual PBL courses. The outcomes imply pedagogical strategies can be devised for shifting students’ focus as they engage in the virtual PBL experience to effectively manage the student learning experience and thereby ensure that they gain maximum benefit. The results from this research hold important ramifications for graduates with respect to their ease of transition into professional work as well as their later professional competence in terms of problem solving, ability to transfer basic knowledge to real-life engineering scenarios, ability to adapt to changes and apply knowledge in unusual situations, ability to think critically and creatively, and a commitment to continuous life-long learning and self-improvement.

Psychological predictors of the propensity to omit short-response items on a high-stakes achievement test

This article presents the findings of a study of the psychological variables that discriminate between high and low omitters on a high-stakes achievement test using a short-response format. Data were obtained from a questionnaire administered to a random sample (N = 1,908) of students prior to sitting the 1997 Queensland Core Skills (QCS) Test (N = 29,273). Fourteen psychological variables were measured including test anxiety (four subscales), emotional stability, achievement motivation, self-esteem, academic self-concept, self-estimate of ability, locus of control (three subscales), and approaches to learning (two subscales). The results were analyzed using descriptive discriminant analysis and suggested that the psychological predictors of the propensity to omit short-response items include test-irrelevant thinking and academic self-concept, with sex of candidate being a mediating variable.

Literacy, numeracy and learning in school-aged children identified as having speech and language impairment in early childhood

The progress of a nationally representative sample of 3632 children was followed from early childhood through to primary school, using data from the Longitudinal Study of Australian Children (LSAC). The aim was to examine the predictive effects of different aspects of communicative ability, and of early vs. sustained identification of speech and language impairment, on children's achievement and adjustment at school. Four indicators identified speech and language impairment: parent-rated expressive language concern; parent-rated receptive language concern; use of speech-language pathology services; below average scores on the adapted Peabody Picture Vocabulary Test-III. School outcomes were assessed by teachers' ratings of language/literacy ability, numeracy/mathematical thinking and approaches to learning. Comparison of group differences, using ANOVA, provided clear evidence that children who were identified as having speech and language impairment in their early childhood years did not perform as well at school, two years later, as their non-impaired peers on all three outcomes: Language and Literacy, Mathematical Thinking, and Approaches to Learning. The effects of early speech and language status on literacy, numeracy, and approaches to learning outcomes were similar in magnitude to the effect of family socio-economic factors, after controlling for child characteristics. Additionally, early identification of speech and language impairment (at age 4-5) was found to be a better predictor of school outcomes than sustained identification (at aged 4-5 and 6-7 years). Parent-reports of speech and language impairment in early childhood are useful in foreshadowing later difficulties with school and providing early intervention and targeted support from speech-language pathologists and specialist teachers.

Serious playground : using Second Life to engage high school students in urban planning

Virtual world platforms such as Second Life have been successfully used in educational contexts to motivate and engage learners. This article reports on an exploratory workshop involving a group of high school students using Second Life for an urban planning project. Young people are traditionally an under-represented demographic when it comes to participating in urban planning and decision making processes. The research team developed activities that combined technology with a constructivist approach to learning. Real world experiences and purposes ensured that the workshop enabled students to see the relevance of their learning. Our design also ensured that play remained an important part of the learning. By conceiving of the workshop as a ‘serious playground’ we investigated the ludic potential of learning in a virtual world.

Ageing and learning in Australia

Powerpoint presentation of keynote speech

Learning barriers in continuous product innovation

In today's dynamic and turbulent environment companies are required to increase their effectiveness and efficiency, exploit synergy and learn product innovation processes in order to build competitive advantage. To be able to stimulate and facilitate learning in product innovation, it is necessary to gain an insight into factors that hinder learning and to design effective intervention strategies that may help remove barriers to learning. This article reports on learning barriers identified by product innovation managers in over 70 companies in the UK, Ireland, Italy, Netherlands, Sweden and Australia. The results show that the majority of the barriers identified can be labelled as organisational defensive routines leading to a chain of behaviours; lack of resources leads to under-appreciation of the value of valid information, absence of informed choice and lack of personal responsibility. An intervention theory is required which enables individuals and organisations to interrupt defensive patterns in ways that prevents them from recurring.

Mobile learning, social learning

Understanding the future development of interaction design as it applies to learning and training scenarios is crucial to effective development of curriculum and appropriate application of social and mobile communication technologies. As Attewell & Saville-Smith have recognised (2004), the use of mobile communication devices for improved literacy and numeracy is a desirable prospect among young people who represent the average age of undergraduate students. Further, with the growing penetration of broadband internet access, the ubiquity of wireless access in educational locations, the rise of ultra-mobile portable computers and the proliferation of social software applications in educational contexts, there are a growing number of channels for facilitation of learning. Nevertheless, there has been insufficient consideration of the interaction design issues that affect the effective facilitation of such learning. This paper contends that there is a clear need to design mobile and social learning to accommodate the benefits of these diverse channels for interaction. Additionally, there is a need to implement suitable testing processes to ensure participants in mobile and social learning are contributing effectively and maximising their learning. Through the presentation of case studies in mobile and social learning, the paper attempts to demonstrate how considered interaction design techniques can improve the effectiveness of new learning channels.

Learning approach and perception of learning context in economics education : a causality test

In the study of student learning literature, the traditional view holds that when students are faced with heavy workload, poor teaching, and content that they cannot relate to – important aspects of the learning context, they will more likely utilise the surface approach to learning due to stresses, lack of understanding and lack of perceived relevance of the content (Kreber, 2003; Lizzio, Wilson, & Simons, 2002; Ramdsen, 1989; Ramsden, 1992; Trigwell & Prosser, 1991; Vermunt, 2005). For example, in studies involving health and medical sciences students, courses that utilised student-centred, problem-based approaches to teaching and learning were found to elicit a deeper approach to learning than the teacher-centred, transmissive approach (Patel, Groen, & Norman, 1991; Sadlo & Richardson, 2003). It is generally accepted that the line of causation runs from the learning context (or rather students’ self reported data on the learning context) to students’ learning approaches. That is, it is the learning context as revealed by students’ self-reported data that elicit the associated learning behaviour. However, other research studies also found that the same teaching and learning environment can be perceived differently by different students. In a study of students’ perceptions of assessment requirements, Sambell and McDowell (1998) found that students “are active in the reconstruction of the messages and meanings of assessment” (p. 391), and their interpretations are greatly influenced by their past experiences and motivations. In a qualitative study of Hong Kong tertiary students, Kember (2004) found that students using the surface learning approach reported heavier workload than students using the deep learning approach. According to Kember if students learn by extracting meanings from the content and making connections, they will more likely see the higher order intentions embodied in the content and the high cognitive abilities being assessed. On the other hand, if they rote-learn for the graded task, they fail to see the hierarchical relationship in the content and to connect the information. These rote-learners will tend to see the assessment as requiring memorising and regurgitation of a large amount of unconnected knowledge, which explains why they experience a high workload. Kember (2004) thus postulate that it is the learning approach that influences how students perceive workload. Campbell and her colleagues made a similar observation in their interview study of secondary students’ perceptions of teaching in the same classroom (Campbell et al., 2001). The above discussions suggest that students’ learning approaches can influence their perceptions of assessment demands and other aspects of the learning context such as relevance of content and teaching effectiveness. In other words, perceptions of elements in the teaching and learning context are endogenously determined. This study attempted to investigate the causal relationships at the individual level between learning approaches and perceptions of the learning context in economics education. In this study, students’ learning approaches and their perceptions of the learning context were measured. The elements of the learning context investigated include: teaching effectiveness, workload and content. The authors are aware of existence of other elements of the learning context, such as generic skills, goal clarity and career preparation. These aspects, however, were not within the scope of this present study and were therefore not investigated.

Revisiting 'how we learn' in academia : practice-based learning exchanges in three Australian universities

Ideas of 'how we learn' in formal academic settings have changed markedly in recent decades. The primary position that universities once held on shaping what constitutes learning has come into question from a range of experience-led and situated learning models. Drawing on findings from a study conducted across three Australian universities, the article focuses on the multifarious learning experiences indicative of practice-based learning exchanges such as student placements. Building on both experiential and situated learning theories, the authors found that students can experience transformative and emotional elucidations of learning, that can challenge tacit assumptions and transform the ways they understand the world. It was found that all participants (hosts, students, academics) both teach and learn in these educative scenarios and that, contrary to common (mis)perceptions that academics live in 'ivory towers', they play a crucial role in contributing to learning that takes place in the so-called 'real world'.

Generalised self-efficacy in relation to the life transitions of adult learners in a university setting : towards a narrative constructivist model of self-regulation

This paper demonstrates a model of self-regulation based on a qualitative research project with adult learners undertaking an undergraduate degree. The narrative about the participant’s life transitions, co-constructed with the researcher, yielded data about their generalised self-efficacy and resulted in a unique self-efficacy narrative for each participant. A model of self-regulation is proposed with potential applications for coaching, counselling and psychotherapy. A narrative method was employed to construct narratives about an individual’s self-efficacy in relation to their experience of learning and life transitions. The method involved a cyclical and iterative process using qualitative interviews to collect life history data from participants. In addition, research participants completed reflective homework tasks, and this data was included in the participant’s narratives. A highly collaborative method entailed narratives being co-constructed by researcher and research participants as the participants were guided in reflecting on their experience in relation to learning and life transitions; the reflection focused on behaviour, cognitions and emotions that constitute a sense of self-efficacy. The analytic process used was narrative analysis, in which life is viewed as constructed and experienced through the telling and retelling of stories and hence the analysis is the creation of a coherent and resonant story. The method of constructing self-efficacy narratives was applied to a sample of mature aged students starting an undergraduate degree. The research outcomes confirmed a three-factor model of self-efficacy, comprising three interrelated stages: initiating action, applying effort, and persistence in overcoming difficulties. Evaluation of the research process by participants suggested that they had gained an enhanced understanding of self-efficacy from their participation in the research process, and would be able to apply this understanding to their studies and other endeavours in the future. A model of self-regulation is proposed as a means for coaches, counsellors and psychotherapists working from a narrative constructivist perspective to assist clients facing life transitions by helping them generate selfefficacious cognitions, emotions and behaviour.

Strategies to engage engineering students in group project work

Project focused group work is significant in developing social and personal skills as well as extending the ability to identify, formulate and solve engineering problems. As a result of increasing undergraduate class sizes, along with the requirement for many students to work part-time, group projects, peer and collaborative learning are seen as a fundamental part of engineering education. Group formation, connection to learning objectives and fairness of assessment has been widely reported as major issues that leave students dissatisfied with group project based units. Several strategies were trialled including a study of formation of groups by different methods across two engineering disciplines over the past 2 years. Other strategies involved a more structured approach to assessment practices of civil and electrical engineering disciplines design units. A confidential online teamwork management tool was used to collect and collate student self and peer assessment ratings and used for both formative feedback as well as assessment purposes. Student satisfaction and overall academic results in these subjects have improved since the introduction of these interventions. Both student and staff feedback highlight this approach as enhancing student engagement and satisfaction, improved student understanding of group roles, reducing number of dysfunctional groups whilst requiring less commitment of academic resources.

Enhancing the use of Internet and Web services for quality learning : an action research

Internet and Web services have been used in both teaching and learning and are gaining popularity in today’s world. E-Learning is becoming popular and considered the latest advance in technology based learning. Despite the potential advantages for learning in a small country like Bhutan, there is lack of eServices at the Paro College of Education. This study investigated students’ attitudes towards online communities and frequency of access to the Internet, and how students locate and use different sources of information in their project tasks. Since improvement was at the heart of this research, an action research approach was used. Based on the idea of purposeful sampling, a semi-structured interview and observations were used as data collection instruments. 10 randomly selected students (5 girls and 5 boys) participated in this research as the controlled group. The study findings indicated that there is a lack of educational information technology services, such as e-learning at the college. Internet connection being very slow was the main barrier to learning using e-learning or accessing Internet resources. There is a strong relationship between the quality of written task and the source of the information, and between Web searching and learning. The source of information used in assignments and project work is limited to books in the library which are often outdated and of poor quality. Project tasks submitted by most of the students were of poor quality.