Enhancing and assessing group and team learning in architecture and related design contexts

EXECUTIVE SUMMARYTeamwork skills are essential in the design industry where practitioners negotiate often-conflicting design options in multi-disciplinary teams. Indeed, many of the bodies that accredit design courses explicitly list teamwork skills as essential attributes of design graduates e.g., the Australian Institute of Architects (AIA), Royal Institute of British Architects (RIBA), the National Council of Architectural Registration Boards (NCARB) of the United States and the Institution of Engineers, Australia (IEAust). In addition to the need to meet the demands of the accrediting bodies, there are many reasons for the ubiquitous use of teamwork assignments in design schools. For instance, teamwork learning is seen as being representative of work in practice where design is nearly always a collaborative activity. Learning and teaching in teamwork contexts in design education are not without particular challenges. In particular, two broad issues have been identified: first, many students leave academia without having been taught the knowledge and skills of how to design in teams; second, teaching, assessment and assignment design need to be better informed by a clear understanding of what leads to effective teamwork and the learning of teamwork skills. In recognition of the lack of a structured approach to integrating teamwork learning into the curricula of design programs, this project set out to answer three primary research questions: • How do we teach teamwork skills in the context of design? • How do we assess teamwork skills?• How do design students best learn teamwork skills?In addition, four more specific questions were investigated:1. Is there a common range of learning objectives for group-and-team-work in architecture and related design disciplines that will enable the teaching of consistent and measurable outcomes?2. Do group and team formation methods, learning styles and team-role preferences impact students’ academic and course satisfaction outcomes?3. What combinations of group-and-team formation methods, teaching and assessment models significantly improve learning outcomes?4. For design students across different disciplines with different learning styles and cultural origins, are there significant differences in performance, student satisfaction (as measured through questionnaires and unit evaluations), group-and-team working abilities and student participation?To elucidate these questions, a design-based research methodology was followed comprising an iterative series of enquiries: (a) A literature review was completed to investigate: what constitutes effective teamwork, what contributes to effectiveness in teams, what leads to positive design outcomes for teams, and what leads to effective learning in teams. The review encompassed a range of contexts: from work-teams in corporate settings, to professional design teams, to education outside of and within the design disciplines. The review informed a theoretical framework for understanding what factors impact the effectiveness of student design teams. (b) The validity of this multi-factorial Framework of Effectiveness in Student Design Teams was tested via surveys of educators’ teaching practices and attitudes, and of students’ learning experiences. 638 students and 68 teachers completed surveys: two pilot surveys for participants at the four partner institutions, which then informed two national surveys completed by participants from the majority of design schools across Australia. (c) The data collected provided evidence for 22 teamwork factors impacting team effectiveness in student design teams. Pedagogic responses and strategies to these 22 teamwork factors were devised, tested and refined via case studies, focus groups and workshops. (d) In addition, 35 educators from a wide range of design schools and disciplines across Australia attended two National Teaching Symposiums. The first symposium investigated the wider conceptualisation of teamwork within the design disciplines, and the second focused on curriculum level approaches to structuring the teaching of teamwork skills identified in the Framework.The Framework of Effectiveness in Student Design Teams identifies 22 factors impacting effective teamwork, along with teaching responses and strategies that design educators might use to better support student learning. The teamwork factors and teaching strategies are categorised according to three groups of input (Task Characteristics, Individual Level Factors and Team Level Factors), two groups of processes (Teaching Practice & Support Structures and Team Processes), and three categories of output (Task Performance, Teamwork Skills, and Attitudinal Outcomes). Eight of the 22 teamwork factors directly relate to the skills that need to be developed in students, one factor relates to design outputs, and the other thirteen factors inform pedagogies that can be designed for better learning outcomes. In Table 10 of Section 4, we outline which of the 22 teamwork factors pertain to each of five stakeholder groups (curriculum leaders, teachers, students, employers and the professional bodies); thus establishing who will make best use the information and recommendations we make. In the body of this report we summarise the 22 teamwork factors and teaching strategies informed by the Framework of Effectiveness in Student Design Teams, and give succinct recommendations arising from them. This material is covered in depth by the project outputs. For instance, the teaching and assessment strategies will be expanded upon in a projected book on Teaching Teamwork in Design. The strategies are also elucidated by examples of good practice presented in our case studies, and by Manuals on Teamwork for Teachers and Students. Moreover, the project website (design.com index.html=""> visited by representatives of stakeholder groups in Australia and Canada), is seeding a burgeoning community of practice that promises dissemination, critical evaluation and the subsequent refinement of our materials, tools, strategies and recommendations. The following three primary outputs have been produced by the project in answer to the primary research questions:1. A theoretical Framework of Effectiveness in Student Design Teams;2. Manuals on Teamwork for Teachers and Students (available from the website);3. Case studies of good/innovative practices in teaching and assessing teamwork in design;In addition, five secondary outputs/outcomes have been produced that provide more nuanced responses:4. Detailed recommendations for the professional accrediting bodies and curriculum leaders;5. Online survey data (from over 700 participants), plus Team Effectiveness Scale to determine the factors influencing effective learning and successful outputs for student design teams;6. A community of practice in policy, programs, practice and dialogue;7. A detailed book proposal (with sample chapter), submitted to prospective publishers, on Teaching Teamwork in Design; 8. An annotated bibliography (accessed via the project website) on learning, teaching and assessing teamwork.The project has already had an international impact. As well as papers presented in Canada and New Zealand, the surveys were participated in by six Canadian schools of architecture, whose teaching leaders also provided early feedback on the project aims and objectives during visits made to them by the project leader. In addition, design schools in Vancouver, Canada, and San Diego in the USA have already utilised the Teacher’s Manual, and in February 2014 the project findings were discussed at Tel Aviv University in a forum focusing on the challenges for sustainability in architectural education.design.com>

Project-oriented design-based learning in engineering education

The School of Engineering at Deakin University (SOE-DU) is committed to provide authentic and unique learning experiences to students. Over the last five years, SOE-DU has undertaken a study to develop a unique teaching and learning model. The proposed model was based on the Project- Oriented Design Based Learning (PODBL) philosophy which is unique within Australia and in the world. Fundamentally, the framework balances project-driven pedagogy with a design-focused practice in response to industry needs. This paper focuses on the development of PODBL and articulating how it helps nurture creative and industry-ready professional engineers.

The role of the facilitator in a project/design based learning environment

The Project Oriented Design Based Learning (PODBL) is a teaching and learning approach (TLA) that is based on engineering design activities undertaken during a project. PODBL encourages independent learning and a deep approach to student learning outcomes. The Centre for Advanced Design in Engineering Training (CADET) is a new engineering building with cutting edge technology facilities at Deakin University. It acts as a catalyst for a pedagogical change in the way that Engineering is delivered. This paper is focused on the role of the facilitator in a project/design based learning environment and it also looks in to appropriate staff development training for a project/design based learning environment.

Evaluating assessment practices in design based learning environment

This investigation is focused on evaluating assessment practices in design based learning environment. The School of Engineering at Deakin University practices project/design based learning as one of its learning and teaching approach. When identifying graduate attributes particularly for undergraduate engineering programs in Australia, the program accrediting body Engineers Australia (EA) initiates a set of graduate attribute elements which was mentioned in “Stage1 competencies and elements of competency”. Stage1 competencies state that one of the important engineering application ability for graduates is ‘application of systematic engineering synthesis and design processes’. By practicing the design focused learning environment and evaluating students perceptions, This investigation examines students’ experiences of assessment practices in their curriculum through an online survey given to the same cohort of students in third year and fourth year undergraduate engineering.

Assessing team learning practices in project/ design based learning approach

Team learning is considered as a constructive way for enhancing students learning in collaborative environment. It involves interaction between students through peer-to-peer learning, which makes students to be problem solver, an excellent communicator, a good reviewer and a manager. The School of Engineering at Xxx University practices project/design based learning as one of its learning and teaching approach. The project/design based learning process helps students to be self directed leaners which enhances the student learning outcomes towards attaining graduate career expected skills. An Overarching goal of this study is assessing the team learning experiences of cohort of students from third year civil undergraduate engineering in a project/design based learning approach at Xxx University. From the students’ experiences and views, this study will investigate and visualize the students choice of a unique team learning practice which enhances their learning outcomes in project/design based curriculum.

The use of video recording in professional development of teachers and teacher educators in Indonesia

Design-based research has gained currency in educational research over the past decade due to its strength to bridge the divide between theoretical research and educational practice in naturalistic settings. Design based approaches involve a process of designing mathematical tasks, observing the enacted design in classrooms and reflecting on the process from analysing the classroom artifacts. Video plays a central role in supporting teachers and teacher educators to study and reflect on students’ mathematical thinking and in capturing the dynamic of classroom teaching and learning process.

This chapter will examine and analyse practitioner’s lenses in capturing the dynamic and complexity of classroom mathematical learning using video segments, and classroom artifacts including digital photos of classroom moments and students’ work. Practitioners’ lenses are taken as a window to capture key teaching and learning moments from the lessons. Analysis of this selection of these video segments along with other classroom artifacts based on practitioners’ lenses provide insights into practitioners’ views on key teaching and learning moments in mathematics lessons.

The Use of Videos and Classroom Artefacts in Professional Development of Teachers and Teacher Educators in Indonesia

This study is grounded on adaptations of Realistic Mathematics Education, Lesson Study and design-based research in Indonesian classroom contexts. Design-based research has gained currency in educational research over the past decade due to its strength to bridge the divide between theoretical research and educational practice in naturalistic settings. Design-based approaches involve a process of designing mathematical tasks, observing the enacted design in classrooms and reflecting on the process from analysing the classroom artefacts. Video plays a central role in supporting teachers and teacher educators to study and reflect on students’ mathematical thinking and in capturing the dynamic of classroom teaching and learning process. This chapter will examine and analyse practitioners’ lenses in capturing the dynamic and complexity of classroom mathematical learning using video vignettes and classroom artefacts including digital photos of classroom moments and students’ work. Practitioners’ lenses are taken as a window to capture key teaching and learning moments from the lessons. Analysis of this selection of these video vignettes along with other classroom artefacts based on practitioners’lenses provides insights into practitioners’ views on key teaching and learning moments in mathematics lessons.

Design, format, validity and reliability of mutiple choice questions for use in nursing research and education

Multiple choice questions are used extensively in nursing research and education and play a fundamental role in the design of research studies or educational programs. Despite their widespread use, there is a lack of evidence-based guidelines relating to design and use of multiple choice questions. Little is written about their format, structure, validity and reliability of in the context of nursing research and/or education and most of the current literature in this area is based on opinion or consensus. Systematic multiple choice question design and use of valid and reliable multiple choice questions are vital if the results of research or educational testing are to be considered valid. Content and face validity schould be established by expert panel review and construct validity should be established using ‘key check’, item discrimination and item difficulty analyses. Reliability measures include internal consistency and equivalence. Internal consistency should be established by determination of internal consistency using reliability coefficients while equivalence should be established using alternate form correlation. This paper reviews literature related to the use of multiple choice questions, current design recommendations and processes to establish reliability and validity, and discusses implications for their use in nursing research and education.

Keeping connected: the design and overview of the research

The special issue Keeping Connected: Identity, Social Connection and Education for Young People opens with a paper that discusses the research design and overview of a three-year project by a Melbourne (Australia)-based multi-disciplinary team. Over 2007–2009, the Keeping Connected team of 10 researchers investigated the lives of adolescents with ongoing health conditions. The project centrally is developed by the young people's perspectives, their identity and wellbeing, relationships with others and engagement within changing contexts and their altered opportunities in the world. The research design includes image production underpinned by visual methods and a narrative-informed approach to interview and interpretation of images. The study, which crosses the health and education interface, set out to highlight differences of perspectives adopted by 31 young people, their families and the professional groups, such as teachers and health professionals. The special issue discusses key project findings and contributes a body of scholarship that expands our knowledge of evidence-based research across the education and health interface. The longitudinal study highlighted two themes of importance for education, and poorly catered for in current policies and guidelines: that the situation of these young people needs to be addressed by schools as a process over time (including prospectively); and that the young people's identity is strongly marked by a desire to be seen and treated as ‘normal’ combined with an awareness of being vulnerable.

Is it only 'what works' that 'counts' in new knowledge economies? Evidence-based practice, educational research and teacher education in Australia

Recent texts on globalisation and education policy refer to the rapid flow of education policy texts producing or responding to common trends across nation states with the emergence of new knowledge economies. These educational policies are shaping what counts as research and the dynamics between research, policy, and practice in schools, creating new types of relationships between universities, the public, the professions, government, and industry. The trend to evidence-based policy and practice in Australian schools is used to identify key issues within wider debates about the ‘usefulness’ of educational research and the role of universities and university-based research in education in new knowledge economies.