Group Design-Build-Test Projects as the Core of an Integrated Curriculum in Product Design and Development

The School of Mechanical and Aerospace Engineering at Queen’s University Belfast introduced a new degree programme in Product Design and Development (PDD) in 2004. As well as setting out to meet all UK-SPEC requirements, the entirely new curriculum was developed in line with the syllabus and standards defined by the CDIO Initiative, an international collaboration of universities aiming to improve the education of engineering students. The CDIO ethos is that students are taught in the context of conceiving, designing, implementing and operating a product or system. Fundamental to this is an integrated curriculum with multiple Design-Build-Test (DBT) experiences at the core. Unlike most traditional engineering courses the PDD degree features group DBT projects in all years of the programme. The projects increase in complexity and challenge in a staged manner, with learning outcomes guided by Bloom’s taxonomy of learning domains. The integrated course structure enables the immediate application of disciplinary knowledge, gained from other modules, as well as development of professional skills and attributes in the context of the DBT activity. This has a positive impact on student engagement and the embedding of these relevant skills, identified from a stakeholder survey, has also been shown to better prepare students for professional practice. This paper will detail the methodology used in the development of the curriculum, refinements that have been made during the first five years of operation and discuss the resource and staffing issues raised in facilitating such a learning environment.

'Murder or Mercy?' an innovative module helping UK medical students to articulate their own ethical standpoints regarding end-of-life decisions

Objectives This student selected component (SSC) was designed to equip United Kingdom (UK) medical students to respond ethically and with sensitivity to requests they might receive as qualified doctors in regard to euthanasia and assisted dying. The aim was to expose students to relevant opinions and experiences and to provide opportunities to explore and justify their own views and rehearse ethical decision making in a safe learning environment. Method The module is delivered by specialists from a number of disciplines including law, theology, medicine and nursing, each providing students with a working knowledge allowing them to actively discuss cases, articulate their own views and practise ethical reasoning through group and individual study. Visits to local intensive care units, palliative care wards and hospices are integrated effectively with theory. Student assessment comprises a dissertation, student-led debate and reflective commentary. Module impact was evaluated by analysis of student coursework and a questionnaire. Results Students found the content stimulating and relevant to their future career and agreed that the module was well-structured and that learning outcomes were achieved. They greatly appreciated the clinical context provided by the visits and opportunities to apply ethical reasoning to real cases and to debate ethical issues with peers. Students reported an increased discernment of the ethical and legal position and practical considerations and a greater awareness of the range of professional and lay viewpoints held. Student perceptions were confirmed on analysis of their submitted coursework. Many participants were less strongly in favour of euthanasia and assisted dying on module completion than at the outset but all felt better equipped to justify their own viewpoint and to respond appropriately to patient requests. Conclusions The multi-disciplinary nature of this course is helpful in preparing students to deal effectively and sensitively with ethical dilemmas they will encounter in their medical career. Use of an integrated, learner-centred approach equips students to actively engage with their peers in discussion of such issues and to formulate and defend their own position.

Peer Rating for Feedback in Group Projects

The National Student Survey (NSS) in the UK has since 2005 questioned final year
undergraduate students on a broad range of issues relating to their university experience.
Across disciplines and universities students have expressed least satisfaction in the areas of
assessment and feedback. In response to these results many educational practitioners have
reviewed and revised their procedures and the UK Higher Education Academy (HEA) has
produced guidelines of best practice to assist academics in improving these specific areas.
The Product Design and Development (PDD) degree at Queen’s University Belfast is
structured with an integrated curriculum with group Design Build Test (DBT) projects as the
core of each year of the undergraduate programme. Based on the CDIO syllabus and
standards the overall learning outcomes for the programme are defined and developed in a
staged manner, guided by Bloom’s taxonomy of learning domains.
Feedback in group DBT projects, especially in relation to the development of personal and
professional skills, represents a different challenge to that of individual assignment feedback.
A review of best practice was carried out to establish techniques which could be applied to
the particular context of the PDD degree without modification and also to identify areas
where a different approach would need to be applied.
A revised procedure was then developed which utilised the structure of the PDD degree to
provide a mechanism for enhanced feedback in group project work, while at the same time
increasing student development of self and peer evaluation skills. Key to this improvement
was the separation of peer ratings from assessment in the perception of the students and the
introduction of more frequent face to face feedback interviews.
This paper details the new procedures developed and additional issues which have been
raised and addressed, with reference to the published literature, during 3 years of operation.

Evaluation of the contribution of theatre attendance to medical undergraduate neuroscience teaching - a pilot study.

Introduction: Medical students often attend the neurosurgical theatre during their clinical neurosciences attachment. However, few studies have been performed to objectively assess the value of this theatre-based learning experience. The main aim of this study was to explore student perceptions on the contribution of neurosurgical theatre attendance to clinical neuroscience teaching.

Materials and Methods: Third-year medical students undergoing their 2-week clinical neurosciences rotation at the Royal Hospitals Belfast were invited to participate in this study. A multi-method strategy was employed using a survey questionnaire comprising of closed and open-ended questions followed by semi-structured interviews to gain a greater 'in-depth' analysis of the potential contribution of neurosurgical theatre attendance to neuroscience teaching.

Results: Based on the completed survey responses of 22 students, the overall experience of neurosurgical theatre-based learning was a positive one. 'In-depth' analysis from semi-structured interviews indicated that students felt that some aspects of their neurosurgical theatre attendance could be improved. Better preparation such as reading up on the case in hand and an introduction to simple theatre etiquette to put the student at ease (in particular, for students who had never attended theatre previously), would improve the learning experience. In addition, having an expectation of what students are expected to learn in theatre making it more learning outcomes-based would probably make it feel a more positive experience by the student.

Conclusions: The vast majority of students acknowledged the positive learning outcomes of neurosurgical theatre attendance and felt that it should be made a mandatory component of the curriculum.

An accelerated method of developing DBT projects using CDIO partner institutions as parallel processors

The cycle of the academic year impacts on efforts to refine and improve major group design-build-test (DBT) projects since the time to run and evaluate projects is generally a full calendar year. By definition these major projects have a high degree of complexity since they act as the vehicle for the application of a range of technical knowledge and skills. There is also often an extensive list of desired learning outcomes which extends to include professional skills and attributes such as communication and team working. It is contended that student project definition and operation, like any other designed product, requires a number of iterations to achieve optimisation. The problem however is that if this cycle takes four or more years then by the time a project’s operational structure is fine tuned it is quite possible that the project theme is no longer relevant. The majority of the students will also inevitably experience a sub-optimal project experience over the 5 year development period. It would be much better if the ratio were flipped so that in 1 year an optimised project definition could be achieved which had sufficient longevity that it could run in the same efficient manner for 4 further years. An increased number of parallel investigators would also enable more varied and adventurous project concepts to be examined than a single institution could undertake alone in the same time frame.
This work-in-progress paper describes a parallel processing methodology for the accelerated definition of new student DBT project concepts. This methodology has been devised and implemented by a number of CDIO partner institutions in the UK & Ireland region. An agreed project theme was operated in parallel in one academic year with the objective of replacing a multi-year iterative cycle. Additionally the close collaboration and peer learning derived from the interaction between the coordinating academics facilitated the development of faculty teaching skills in line with CDIO standard 10.

Precision Teaching in IV Fluid Prescribing and Patient Safety

OBJECTIVES: Precision Teaching (PT) has been shown to be an effective intervention to assess teaching method effectiveness and evaluate learning outcomes. SAFMEDS (Say All Fast Minute Every Day Shuffled) are a practice/assessment procedure within the PT framework to assist learning and fluency. We explored the effects of a brief intervention with PT, to impart high frequency performance in safe intravenous fluid prescription in a group of final year undergraduate medical students.
METHODS: 133 final year undergraduate medical students completed a multiple choice question (MCQ) test on safe IV fluid prescription at the beginning and end of the study. The control group (n= 76) of students were taught using a current standardized teaching method. Students allocated to the intervention arm of the study were additionally instructed on PT and the use of SAFMEDS. The study group (n = 57) received 50 SAFMEDS cards containing information on the principles of IV fluid prescription scenarios. These students were trained/tested twice per day for 1 minute.
RESULTS: Interim analysis showed that the study group displayed an improvement in fluency and accuracy as the study progressed. There was a statistically significant improvement in MCQ performance for the PT group compared with the control group between the beginning and end of the study (35% vs 15%).
CONCLUSION: These results suggest PT employing SAFMEDS is an effective method for improving fluency, accuracy and patient safety in intravenous fluid prescribing amongst undergraduate medical students.

How should teaching on whole person medicine, including spiritual issues, be delivered in the undergraduate medical curriculum in the United Kingdom?

Background

Although the General Medical Council recommends that United Kingdom medical students are taught ‘whole person medicine’, spiritual care is variably recognised within the curriculum. Data on teaching delivery and attainment of learning outcomes is lacking. This study ascertained views of Faculty and students about spiritual care and how to teach and assess competence in delivering such care.

A questionnaire comprising 28 questions exploring attitudes to whole person medicine, spirituality and illness, and training of healthcare staff in providing spiritual care was designed using a five-point Likert scale. Free text comments were studied by thematic analysis. The questionnaire was distributed to 1300 students and 106 Faculty at Queen’s University Belfast Medical School.

351 responses (54 staff, 287 students; 25 %) were obtained. >90 % agreed that whole person medicine included physical, psychological and social components; 60 % supported inclusion of a spiritual component within the definition. Most supported availability of spiritual interventions for patients, including access to chaplains (71 %), counsellors (62 %), or members of the patient’s faith community (59 %). 90 % felt that personal faith/spirituality was important to some patients and 60 % agreed that this influenced health. However 80 % felt that doctors should never/rarely share their own spiritual beliefs with patients and 67 % felt they should only do so when specifically invited. Most supported including training on provision of spiritual care within the curriculum; 40-50 % felt this should be optional and 40 % mandatory. Small group teaching was the favoured delivery method. 64 % felt that teaching should not be assessed, but among assessment methods, reflective portfolios were most favoured (30 %). Students tended to hold more polarised viewpoints but generally were more favourably disposed towards spiritual care than Faculty. Respecting patients’ values and beliefs and the need for guidance in provision of spiritual care were identified in the free-text comments.

Students and Faculty generally recognise a spiritual dimension to health and support provision of spiritual care to appropriate patients. There is lack of consensus whether this should be delivered by doctors or left to others. Spiritual issues impacting patient management should be included in the curriculum; agreement is lacking about how to deliver and assess.

Architecture as Pedagogy: Alive and Kicking

This workshop draws on an emerging collaborative body of research by Lovett, Morrow and McClean that aims to understand architecture and its processes as a form of pedagogical practice: a civic pedagogy.

Architectural education can be valued not only as a process that delivers architecture-specific skills and knowledges, but also as a process that transforms people into critically active contributors to society. We are keen to examine how and where those skills are developed in architectural education and trace their existence and/or application within practice. We intend to examine whether some architectural and spatial practices are intrinsically pedagogical in their nature and how the level of involvement of clients, users and communities can mimic the project-based learning of architectural education – in particularly in the context of ‘live project learning’

1. This workshop begins with a brief discussion paper from Morrow that sets out the arguments behind why and how architecture can be understood as pedagogy. It will do so by presenting firstly the relationship between architectural practice and pedagogy, drawing out both contemporary and historical examples of architecture and architects acting pedagogically. It will also consider some other forms of creative practice that explicitly frame themselves pedagogically, and focus on participatory approaches in architectural practice that overlap with inclusive and live pedagogies, concluding with a draft and tentative abstracted pedagogical framework for architectural practice.

2. Lovett will examine practices of architectural operation that have a pedagogical approach, or which recognise within themselves an educational subtext/current. He is most interested in a 'liveness' beyond the 'Architectural Education' of university institutions. The presentation will question the scope for both spatial empowerment / agency and a greater understanding and awareness of the value of good design when operating as architects with participant-clients younger than 18, older than 25 or across varied parts of society. Positing that the learning might be greatest when there are no prescribed 'Learning Outcomes' and that such work might depend on risk-taking and playfulness, the presentation will be a curated showcase drawing on his own ongoing work.

Both brief presentations will inform the basis of the workshop’s discussion which hopes to draw on participants views and expereinces to enrich the research process. The intention is that the overall workshop will lead to a call for contributors and respondents to a forthcoming publication on ‘Architecture as Pedagogy’.

Preparing assessments and examinations. Common errors and good practice.

Assessment forms an important part of the student learning experience and students place a high value on the quality of feedback that they receive from academic staff on where they might improve on their examinations or assignments. However while feedback is important the quality of the actual assessment itself before students undertake an examination or commence writing an assignment is also important. It is imperative that students are clear in their understanding of what is expected of them in order to achieve a particular grade and that there is lack of ambiguity in examinations or assignments. Biggs (2003) highlighted the importance of clarity in what students are expected to be able to do at the end of a unit of study, and that intended learning outcomes should be clearly aligned to the assessment and communicated to students so that they can structure their learning activities to optimize their assessment performance. However as Rust (2002) highlighted there are often inconsistencies in assessment practices ranging from a mis-match of assessment and learning outcomes to the inclusion of additional learning criteria and lack of clarity in the instructions. Such inconsistencies and unacceptable errors in examination papers can undermine student confidence in the assessment process
In order to try and minimise such inconsistencies an internal assessment group was set up October 2013 within the School of Nursing and Midwifery at Queens University Belfast, consisting of representative academic staff from across the range of undergraduate and post graduate courses in nursing and midwifery. The assessment group was to be a point of reference for all school examinations with a particular remit to develop an assessment strategy for all nursing and midwifery programmes and to ensure that all assessments comply with current best practice and with Nursing and Midwifery Council (NMC) requirements.
Aim
This paper aims to highlight some examples of good practice and common errors that were found in assignments and examinations that were submitted to the assessment group for review.
References

Biggs. J. (2003) Teaching for Quality Learning at University – What the Student Does 2nd Edition SRHE / Open University Press, Buckingham.
Rust, C.( 2002) The impact of assessment on student learning, Active Learning in Higher education Vol3(2):145-158

Undergraduate interprofessional education using high-fidelity paediatric simulation

BACKGROUND: High-fidelity simulation is becoming increasingly important in the delivery of teaching and learning to health care professionals within a safe environment. Its use in an interprofessional context and at undergraduate level has the potential to facilitate the learning of good communication and teamworking, in addition to clinical knowledge and skills.

METHODS: Interprofessional teaching and learning workshops using high-fidelity paediatric simulation were developed and delivered to undergraduate medical and nursing students at Queen's University Belfast. Learning outcomes common to both professions, and essential in the clinical management of sick children, included basic competencies, communication and teamworking skills. Quantitative and qualitative evaluation was undertaken using published questionnaires.

RESULTS: Quantitative results - the 32-item questionnaire was analysed for reliability using spss. Responses were positive for both groups of students across four domains - acquisition of knowledge and skills, communication and teamworking, professional identity and role awareness, and attitudes to shared learning. Qualitative results - thematic content analysis was used to analyse open-ended responses. Students from both groups commented that an interprofessional education (IPE) approach to paediatric simulation improved clinical and practice-based skills, and provided a safe learning environment. Students commented that there should be more interprofessional and simulation learning opportunities.

DISCUSSION: High-fidelity paediatric simulation, used in an interprofessional context, has the potential to meet the requirements of undergraduate medical and nursing curricula. Further research is needed into the long-term benefits for patient care, and its generalisability to other areas within health care teaching and learning.

O questionamento no alinhamento do ensino, aprendizagem e avaliação

O questionamento dos alunos é reconhecido como uma capacidade fundamental, de nível superior, associada ao desenvolvimento de outras competências centrais, como o pensamento crítico, a resolução de problemas ou a capacidade de reflexão, assumindo especial relevância no contexto de disciplinas científicas. O presente estudo surge no atual enquadramento de reestruturação curricular do ensino universitário em Portugal, como um caso de colaboração estreita entre investigadores do Departamento de Educação e professores das Unidades Curriculares de “Microbiologia”, “Genética” e “Temas e Laboratórios de Biologia”, do Departamento de Biologia, na Universidade de Aveiro. Estas unidades curriculares, dirigidas a alunos de várias licenciaturas, são sobretudo frequentadas por alunos do primeiro ano das licenciaturas em Biologia e Biologia/Geologia. Um dos principais objetivos era identificar contextos de prática no âmbito dos quais pudéssemos sugerir estratégias inovadoras de Ensino, Aprendizagem e Avaliação (EAA), que promovessem o questionamento dos estudantes, numa lógica de alinhamento construtivo. Outro dos objetivos era também o de analisar e caracterizar o questionamento dos alunos, associado à diversidade de estratégias adotadas. A presente investigação adota princípios dos paradigmas naturalista e sociocrítico, seguindo uma abordagem metodológica sobretudo de natureza qualitativa. As várias situações de EAA foram desenhadas, implementadas e adaptadas atendendo às particularidades de cada Unidade Curricular (UC), ao longo de dois estudos (2007/2008 e 2008/2009). O questionamento dos alunos foi caracterizado nos diversos contextos de EAA, atendendo ao seu nível cognitivo. Realizaram-se entrevistas semiestruturadas com alunos selecionados, no fim de cada estudo (17 alunos no total), e também com os professores envolvidos (4 professores), no fim do segundo estudo. A análise do questionamento dos alunos nos variados contextos, permitiu confirmar um questionamento espontâneo pouco frequente e tendencialmente de baixo nível cognitivo associado à expressão oral. No entanto, em situações com efeitos sumativos na avaliação, verificou-se um maior envolvimento e uma maior participação dos alunos, associados a uma maior frequência e qualidade do questionamento. Confirmamos o papel fundamental que a avaliação desempenha no decurso da aprendizagem, valorizando o seu papel formativo bem como o feedback proporcionado pelos professores no sentido de alcançar melhores desempenhos em termos de questionamento e, em última análise, em termos de aprendizagem. Todas as evidências recolhidas permitem afirmar que o questionamento constituiu um importante motor para um alinhamento construtivo entre o ensino, a aprendizagem e a avaliação, devidamente articulados com os objetivos de aprendizagem de cada UC. Comprovamos, também, que se não forem criadas situações em que os alunos sejam incentivados a questionar, situações que constituam para si um desafio, um estímulo extrínseco, apenas teremos acesso ao seu questionamento oral e espontâneo, com as características que já lhe são conhecidas. Afirmamos, assim, a relevância de se desenharem situações de ensino, aprendizagem e avaliação, que promovam nos alunos o desenvolvimento da competência de questionamento. Um outro objetivo central de investigação a que nos tínhamos proposto era a caracterização do questionamento dos alunos numa perspetiva mais holística, situando-o como uma competência fundamental que deverá ser desenvolvida em contextos educativos, mas também ao longo da vida. Avançamos com uma proposta de modelo de competência de questionamento, como um dos resultados principais do presente estudo. Este modelo surge de toda a experiência investigativa e, sobretudo, do estudo aprofundado de dois casos, correspondentes a dois alunos selecionados, que permitiu a elucidação das dimensões de competência. Assumindo o questionamento como competência, consideramos que o modelo proposto, e ainda em evolução, poderá representar um importante contributo para a teoria e para a prática do questionamento.

Web 2.0 e a competência comunicativa em língua inglesa

O presente projeto pretende investigar as potencialidades das ferramentas Web 2.0 no desenvolvimento da competência comunicativa em língua inglesa no ensino superior. O referencial teórico que serve de sustentáculo ao estudo ancorou-se nas diretrizes emanadas pelos organismos nacionais e europeus no âmbito do Processo de Bolonha, analisando, por um lado, o papel da língua inglesa na consecução das metas de Bolonha e, por outro, os desafios ao nível pedagógico e metodológico decorrentes dos objetivos e linhas de ação traçados. Por sua vez, o Processo de Bolonha tem de ser enquadrado num vasto conjunto de mudanças de cariz económico e social, a que não são alheias as constantes inovações ao nível das Tecnologias de Informação e Comunicação, que têm gerado um ritmo acelerado de produção e disseminação da informação à escala global. Esta realidade implicou novos desafios e oportunidades, nomeadamente a criação de um contexto de aprendizagem dinâmico, potenciador de uma aprendizagem dialógica e dialética, contribuindo para um incremento de oportunidades para comunicar e agir em língua inglesa. A abordagem metodológica arquitetada caraterizou-se pela conceção e implementação de um projeto de investigação-ação ao longo de dois semestres nas unidades curriculares de Inglês II e Inglês III no curso de licenciatura em Turismo da Escola Superior de Tecnologia e Gestão do Instituto Politécnico de Viseu. Tomando como ponto de partida os resultados de aprendizagem e o tema aglutinador de cada unidade curricular, implementaram-se tarefas interacionais com recurso a ferramentas Web 2.0 (rede social, wiki, podcast) que implicaram a criação e manutenção de processos dialógicos com vista à produção de outputs colaborativos. A análise da informação recolhida aponta para um impacto marcadamente positivo da implementação de tarefas dialógicas com recurso à Web social no âmbito da aprendizagem da língua inglesa no ensino superior. Destaca-se, nomeadamente, um envolvimento ativo dos estudantes na resolução de atividades autênticas do ponto de vista situacional e interacional, a harmonização entre o estudo contextualizado da língua com a descoberta da cultura, bem como o desenvolvimento de capacidades de gestão do processo individual e colaborativo de aprendizagem.

Reconhecimento, validação e certificação de competências em adultos : dificuldades e aprendizagens na área de linguagem e comunicação

Trabalho de projecto de mestrado, Ciências da Educação (Formação de Adultos), Universidade de Lisboa, Instituto de Educação, 2010

Avaliação das aprendizagens no âmbito do Projecto Metas de Aprendizagem

Relatório de estágio de mestrado, Ciências da Educação (Avaliação em Educação), Universidade de Lisboa, Instituto de Educação, 2011

Avaliação para as aprendizagens de alunos com necessidades educativas especiais no 1º ciclo de ensino básico : da diversidade da avaliação à avaliação da diversidade

Tese de doutoramento, Educação (Avaliação em Educação), Universidade de Lisboa, Instituto de Educação, 2014