The educational design ladder : creation of a multi-discipline design thinking program

As global industries change and technology advances, traditional education systems may no longer be able to supply companies with graduates possessing an appropriate mix of skills and experience. The recent increased interest in Design Thinking as an approach to innovation has resulted in its adoption by non-design trained professionals. This necessitates a new method of teaching Design Thinking related skills and processes. This research investigates what (content) and how (assessment and learning modes) Design Thinking is being taught from fifty-one (51) selected courses across twenty-eight (28) international universities. Their approaches differ, with some universities specifically investing in design schools and programs, while others embed Design Thinking holistically throughout the university. Business, engineering and design schools are all expanding their efforts to teach students how to innovate, often through multi-disciplinary classes. This paper presents ‘The Educational Design Ladder’ a resource model, which suggests a process for the organisation and structuring of units for a multi-disciplinary Design Thinking program. The intention is to provide 21st century graduates with the right combination of skills and experience to solve workplace design problems regardless of their core discipline.

Chinese EFL students' response to an assessment policy change

In light of its documented potential for enhancing learning, formative assessment has been adopted across a range of educational contexts to improve the quality of education. The assessment innovation that the Chinese Ministry of Education (CMoE) proposed to College English in 2007 via the College English Curriculum Requirements (CECR) (CMoE, 2007), is an initiative of this kind. Considering the acknowledged influence of assessment on students’ learning, it is instructive to explore the ways in which Chinese university students respond to an assessment policy change of this magnitude, particularly as it positions them as more active learners, having the potential for increased agency and engagement in their English language learning and assessment practices. In order to explore the response of students to this assessment initiative, a case study was conducted in the context of a College English classroom. Data included an interview with a College English teacher and four students from her classes, and classroom observations and a survey of her two classes of 100 students. Analysis of the data reveals that Chinese students’ responses to the assessment policy change are influenced by a variety of sociocultural factors, including their previous English language learning and assessment experience and the extent to which they are willing to play the ‘assessment game’. These findings have implications for policy and practice.

Teachers using annotations to engage students in assessment conversations : recontextualising knowledge

Assessment for Learning practices with students such as feedback, and self- and peer assessment are opportunities for teachers and students to develop a shared understanding of how to create quality learning performances. Quality is often represented through achievement standards. This paper explores how primary school teachers in Australia used the process of annotating work samples to develop shared understanding of achievement standards during their curriculum planning phase, and how this understanding informed their teaching so that their students also developed this understanding. Bernstein's concept of the pedagogic device is used to identify the ways teachers recontextualised their assessment knowledge into their pedagogic practices. Two researchers worked alongside seven primary school teachers in two schools over a year, gathering qualitative data through focus groups and interviews. Three general recontextualising approaches were identified in the case studies; recontextualising standards by reinterpreting the role of rubrics, recontextualising by replicating the annotation process with the students and recontextualising by reinterpreting practices with students. While each approach had strengths and limitations, all of the teachers concluded that annotating conversations in the planning phase enhanced their understanding, and informed their practices in helping students to understand expectations for quality.

Valuable learning, unwelcome assessment : what LLB and JD students really think about group work

This article contributes to current debates about the appropriate role of group work in legal curricula by providing insights into the attitudes of Bachelor of Laws (‘LLB’) and Juris Doctor (‘JD’) students towards such tasks. It begins by reviewing arguments for incorporating group work in legal education, both as a result of the recognition of its educational benefits, and as a response to increasing regulatory expectations regarding student collaboration skills. The article then reports the findings of a UNSW Law School Student Assessment Survey designed to determine how law students perceive group work and its assessment in law. One of the most striking findings is that many of the law students surveyed recognise and appreciate the learning and skills development benefits of group tasks, but are resistant to summative assessment of group work. Moreover, there are marked differences in attitude between LLB and JD students, and across year cohorts within those degrees. These findings suggest that further thought needs to be directed towards the specific purposes underpinning the choice of group work as a pedagogical tool, and assessment that is congruent with those purposes, taking into account the varying needs and experiences of different cohorts of students. The article concludes by considering whether meaningful group work can exist without summative assessment.

Geography and international assessment: Opportunity or distraction

Assessments of students in primary and secondary education are debated among practitioners, policy-makers, and parents. In some countries, assessment scores serve a criterion for passage between levels of education, for example, from secondary school to post-secondary education. Those practices are often traditions and while they come under criticism, they are a long-accepted part of the educational practices within a country. In those countries, the students’ assessment and examination scores are posted in public places or published in local news media. In other countries, assessments are used for the periodic checks on individual student progress. The results of assessments may be used for rating schools, and in some cases, they are used for evaluating the performance of teachers. Assessments are used less often to analyze student performance and make judgments regarding the performance of the curriculum. Even less often, assessments serve to critically establish strategies for the improvement of student learning and educational practices. The ends on the continuum of the assessment debate often focus on the opportunities that assessments present to improve education on one end. The other end is that assessments serve as a major distraction from the important work of teachers by removing classroom room time from instruction. The debate on those issues continues.

International trends in the implementation of assessment for learning: Implications for policy and practice

This paper discusses the emergence of assessment for learning (AfL) across the globe with particular attention given to Western educational jurisdictions. Authors from Australia, Canada, Ireland, Israel, New Zealand, Norway, and the USA explain the genesis of AfL, its evolution and impact on school systems, and discuss current trends in policy directions for AfL within their respective countries. The authors also discuss the implications of these various shifts and the ongoing tensions that exist between AfL and summative forms of assessment within national policy initiatives.

CLEIMS: Outcomes of a randomised educational trial of extended immersion in medical simulation

To report the outcomes of a randomised educational trial of a new methodology for extended immersion in medical simulation for senior medical students. Clinical Learning through Extended Immersion in Medical Simulation (CLEIMS) is a new methodology for medical student learning. It involves senior students working in teams of 4-5 through the clinical progress of one or more patients over a week, utilising a range of simulation methodologies (simulated patient assessment, simulated significant other briefing, virtual story continuations, pig-trotter wound repair, online simulated on-call modules, interprofessional simulated ward rounds and high fidelity mannequin-based emergency simulations), to enhance learning in associated workshops and seminars. A randomised educational trial comparing the methodology to seminars and workshops alone began in 2010 and interim results were reported at last year’s conference. Updated results are presented here and final primary endpoint outcomes will be available by the time of the conference.

Education in stroke prevention: Efficacy of an educational counselling intervention to increase knowledge in stroke survivors

BACKGROUND Motivational interviewing and stages of change are approaches to increasing knowledge and effecting behavioural change. This study examined the application of this approach on stroke knowledge acquisition and changing individual lifestyle risk factors in an outpatient clinic. METHODS RCT in which 200 participants were allocated to an education-counselling interview (ECI) or a control group. ECI group participants mapped their individual risk factors on a stage of change model and received an appointment to the next group lifestyle class. Participants completed a stroke knowledge questionnaire at baseline (T1), post-appointment, and three months (T3) post-appointment. Passive to active changes in lifestyle behaviour were self-reported at three months. RESULTS There was a statistically significant difference between groups from T1 toT3 in stroke knowledge (p < 0.001). While there was a significant shift from a passive to active stage of change for the overall study sample (p < 0.000), there was no significant difference between groups on the identified risk factors. CONCLUSIONS Although contact with patients in ambulatory clinical settings is limited due to time constraints, it is still possible to improve knowledge and initiate lifestyle changes utilizing motivational interviewing and a stage of change model. Stroke nurses may wish to consider these techniques in their practice setting.

Educational interventions for preventing vascular catheter bloodstream infections in critical care: Evidence map, systematic review and economic evaluation

Background Bloodstream infections resulting from intravascular catheters (catheter-BSI) in critical care increase patients' length of stay, morbidity and mortality, and the management of these infections and their complications has been estimated to cost the NHS annually £19.1–36.2M. Catheter-BSI are thought to be largely preventable using educational interventions, but guidance as to which types of intervention might be most clinically effective is lacking. Objective To assess the effectiveness and cost-effectiveness of educational interventions for preventing catheter-BSI in critical care units in England. Data sources Sixteen electronic bibliographic databases – including MEDLINE, MEDLINE In-Process & Other Non-Indexed Citations, Cumulative Index to Nursing and Allied Health Literature (CINAHL), NHS Economic Evaluation Database (NHS EED), EMBASE and The Cochrane Library databases – were searched from database inception to February 2011, with searches updated in March 2012. Bibliographies of systematic reviews and related papers were screened and experts contacted to identify any additional references. Review methods References were screened independently by two reviewers using a priori selection criteria. A descriptive map was created to summarise the characteristics of relevant studies. Further selection criteria developed in consultation with the project Advisory Group were used to prioritise a subset of studies relevant to NHS practice and policy for systematic review. A decision-analytic economic model was developed to investigate the cost-effectiveness of educational interventions for preventing catheter-BSI. Results Seventy-four studies were included in the descriptive map, of which 24 were prioritised for systematic review. Studies have predominantly been conducted in the USA, using single-cohort before-and-after study designs. Diverse types of educational intervention appear effective at reducing the incidence density of catheter-BSI (risk ratios statistically significantly < 1.0), but single lectures were not effective. The economic model showed that implementing an educational intervention in critical care units in England would be cost-effective and potentially cost-saving, with incremental cost-effectiveness ratios under worst-case sensitivity analyses of < £5000/quality-adjusted life-year. Limitations Low-quality primary studies cannot definitively prove that the planned interventions were responsible for observed changes in catheter-BSI incidence. Poor reporting gave unclear estimates of risk of bias. Some model parameters were sourced from other locations owing to a lack of UK data. Conclusions Our results suggest that it would be cost-effective and may be cost-saving for the NHS to implement educational interventions in critical care units. However, more robust primary studies are needed to exclude the possible influence of secular trends on observed reductions in catheter-BSI.

Design thinking pedagogy: The educational design ladder

As global industries change and technology advances, traditional education systems might no longer be able to supply companies with graduates who possess an appropriate mix of skills and experience. The recent increased interest in Design Thinking as an approach to innovation has resulted in its adoption by non-design-trained professionals. This development necessitates a new method of teaching Design Thinking and its related skills and processes. As a basis for such a method, this research investigated 51 selected courses across 28 international universities to determine what Design Thinking is being taught (content), and how it is being taught (assessment and learning modes). To support the teaching and assessment of Design Thinking, this paper presents The Educational Design Ladder, an innovative resource/model that provides a process for the organisation and structuring of units for a multidisciplinary Design Thinking programme.

PW376 A pilot study of a post-discharge nurse-led, educational intervention on cardiac self-efficacy and anxiety in post-PCI patients

Introduction Hospitalisation for percutaneous coronary intervention (PCI) is often short, with limited nurse-teaching time and poor information absorption. Currently, patients are discharged home only to wait up to 4-8 weeks to commence a secondary prevention program and visit their cardiologist. This wait is an anxious time for patients and confidence or self-efficacy (SE) to self-manage may be low. Objectives To determine the effects of a nurse-led, educational intervention on participant SE and anxiety in the early post-discharge period. Methods A pilot study was undertaken as a randomised controlled clinical trial. Thirty-three participants were recruited, with n=13 randomised to the intervention group. A face-to-face, nurse-led, educational intervention was undertaken within the first 5-7 days post-discharge. Intervention group participants received standard post-discharge education, physical assessment, with a strong focus on the emotional impact of cardiovascular events and PCI. Early reiteration of post-discharge education was offered, along with health professional support with the aim to increase patients’ SE and to effectively manage their post-discharge health and well being, as well as anxieties. Self-efficacy to return to normal activities was measured to gauge participants’ abilities to manage post-PCI after attending the intervention using the cardiac self-efficacy (CSE) scale. State and trait anxiety was also measured using the State-Trait Anxiety Inventory (STAI) to determine if an increase in SE would influence participant anxiety. Results There were some increases in mean CSE scores in the intervention group participants over time. Areas of increase included return to normal social activities and confidence to change diet. Although reductions were observed in mean state and trait anxiety scores in both groups, an overall larger reduction in intervention group participants was observed over time. Conclusion It is essential that patients are given the education, support, and skills to self-manage in the early post-discharge period so that they have greater SE and are less anxious. This study provides some initial evidence that nurse-led support and education during this period, particularly the first week following PCI, is beneficial and could be trialled using alternate modes of communication to support remote and rural PCI patients and extend to other cardiovascular patients.

An exploratory investigation of the practice of assessment for learning in Vietnamese higher education: Three case studies of lecturers' practice

In response to limited research conducted on the practice of assessment for learning (AfL) in higher education and in Asian educational settings, this qualitative study, using sociocultural theories of learning and a multiple case study approach, investigates how AfL was implemented by three lecturers in one Vietnamese university. Findings revealed that the lecturers engaged with AfL principles and practices to some extent. However, despite the lecturers' significant efforts, Vietnamese sociocultural factors such as respect for harmony, hierarchy, and examination-oriented learning, impacted on their practice of AfL. This study therefore argues that AfL requires adaptation for it to be effective in the Vietnamese tertiary context.

Perceptions of audio feedback in higher education assessment

The aim of this paper is to present results of research investigating the effectiveness of audio feedback in a third year undergraduate unit. While there is a large and growing body of literature about providing assessment feedback, there is little focussing on the use of audio media. This study employs a mixed method approach, involving semi-structured interviews with academic staff and a survey of students. Analysis of the interview data suggests that there are a number of issues surrounding acceptance of using audio feedback by lecturers. The next stage of the study is to examine the extent to which lecturers change their perceptions as they use audio feedback and to analyse the perceptions of the students (n=120), including the perceived importance of feedback, the ways in which they used the audio feedback and the extent to which they believe they control events that affect them. Ultimately, this study seeks to provide recommendations appropriate to the implementation of audio feedback in higher education.

The Systems Theory Framework of career development: Applications to career counselling and career assessment

Since its inception, the Systems Theory Framework of career development has afforded ready translation into practice, especially into career counselling and qualitative career assessment. Through its clearly articulated constructs and the clarity of its diagrammatic representation, the Systems Theory Framework has facilitated the development of qualitative career assessment instruments as well as a quantitative measure. This article briefly overviews these practical applications of the Systems Theory Framework as well as its application in career counselling through a story telling approach. The article concludes by offering a synthesis of and considering future directions for the Systems Theory Framework’s practical applications.

The pedagogic prosthetic: Augmented learning as content-in-motion in hybrid educational spheres

This article draws on the design and implementation of three mobile learning projects introduced by Flanagan in 2011, 2012 and 2014 engaging a total of 206 participants. The latest of these projects is highlighted in this article. Two other projects provide additional examples of innovative strategies to engage mobile and cloud systems describing how electronic and mobile technology can help facilitate teaching and learning, assessment for learning and assessment as learning, and support communities of practice. The second section explains the theoretical premise supporting the implementation of technology and promulgates a hermeneutic phenomenological approach. The third section discusses mobility, both in terms of the exploration of wearable technology in the prototypes developed as a result of the projects, and the affordances of mobility within pedagogy. Finally the quantitative and qualitative methods in place to evaluate m-learning are explained.