Bringing engineering education to life – an empirical approach to learning and teaching

Learning and teaching approaches to engineering are generally perceived to be difficult and academically challenging. Such challenges are reflected in high levels of student attrition and failure. In addressing this issue, a unique approach to engineering education has been developed by the paper authors. This approach, which is suitable for undergraduate and postgraduate levels, brings together pedagogic and engineering epistemologies in an empirically grounded framework. It is underpinned by three distinctive concepts: Relationships, Variety & Synergy. Based upon research, the R + V + S approach to Engineering Education provides a learning and teaching strategy, which in enhancing the student experience, increases retention and positively impacts student success [S2]. Based on the study findings, this paper shows how, by designing engineering education around the concepts of Relationships, Variety and Synergy, the student learning experience becomes one that is academically challenging yet beneficial to both students and engineering educators. The challenge is to widen and test the approach in other areas of engineering education, before going on to investigate the value of the approach in other disciplines.

Engineering education research - the UK perspective at a time of change

Engineering education in the United Kingdom is at the point of embarking upon an interesting journey into uncharted waters. At no point in the past have there been so many drivers for change and so many opportunities for the development of engineering pedagogy. This paper will look at how Engineering Education Research (EER) has developed within the UK and what differentiates it from the many small scale practitioner interventions, perhaps without a clear research question or with little evaluation, which are presented at numerous staff development sessions, workshops and conferences. From this position some examples of current projects will be described, outcomes of funding opportunities will be summarised and the benefits of collaboration with other disciplines illustrated. In this study, I will account for how the design of task structure according to variation theory, as well as the probe-ware technology, make the laws of force and motion visible and learnable and, especially, in the lab studied make Newton's third law visible and learnable. I will also, as a comparison, include data from a mechanics lab that use the same probe-ware technology and deal with the same topics in mechanics, but uses a differently designed task structure. I will argue that the lower achievements on the FMCE-test in this latter case can be attributed to these differences in task structure in the lab instructions. According to my analysis, the necessary pattern of variation is not included in the design. I will also present a microanalysis of 15 hours collected from engineering students' activities in a lab about impulse and collisions based on video recordings of student's activities in a lab about impulse and collisions. The important object of learning in this lab is the development of an understanding of Newton's third law. The approach analysing students interaction using video data is inspired by ethnomethodology and conversation analysis, i.e. I will focus on students practical, contingent and embodied inquiry in the setting of the lab. I argue that my result corroborates variation theory and show this theory can be used as a 'tool' for designing labs as well as for analysing labs and lab instructions. Thus my results have implications outside the domain of this study and have implications for understanding critical features for student learning in labs. Engineering higher education is well used to change. As technology develops the abilities expected by employers of graduates expand, yet our understanding of how to make informed decisions about learning and teaching strategies does not without a conscious effort to do so. With the numerous demands of academic life, we often fail to acknowledge our incomplete understanding of how our students learn within our discipline. The journey facing engineering education in the UK is being driven by two classes of driver. Firstly there are those which we have been working to expand our understanding of, such as retention and employability, and secondly the new challenges such as substantial changes to funding systems allied with an increase in student expectations. Only through continued research can priorities be identified, addressed and a coherent and strong voice for informed change be heard within the wider engineering education community. This new position makes it even more important that through EER we acquire the knowledge and understanding needed to make informed decisions regarding approaches to teaching, curriculum design and measures to promote effective student learning. This then raises the question 'how does EER function within a diverse academic community?' Within an existing community of academics interested in taking meaningful steps towards understanding the ongoing challenges of engineering education a Special Interest Group (SIG) has formed in the UK. The formation of this group has itself been part of the rapidly changing environment through its facilitation by the Higher Education Academy's Engineering Subject Centre, an entity which through the Academy's current restructuring will no longer exist as a discrete Centre dedicated to supporting engineering academics. The aims of this group, the activities it is currently undertaking and how it expects to network and collaborate with the global EER community will be reported in this paper. This will include explanation of how the group has identified barriers to the progress of EER and how it is seeking, through a series of activities, to facilitate recognition and growth of EER both within the UK and with our valued international colleagues.

Knowledge creation in dynamic learning environments

Researchers have extensively discussed using knowledge management to achieve sustainable competitive advantages; however, the successful implementation of knowledge management programs in organizations remains challenging. Problems with knowledge management arise primarily from issues related to inter-subjective creation of meaning by diverse individuals in a dynamic learning environment. ^ The first part of this dissertation examined the concepts of shared interpretive resources referring to background assumptions, shared language, and symbolic resources upon which individuals draw in their interactions in the community. The discussion adopted an interpretive research approach to underscore how community members develop shared interpretive resources over time. The second part examined how learners' behaviors influence knowledge acquisition in the community, emphasizing the associations between learners' learning approaches and learning contexts. An empirical survey of learners provided significant evidence to demonstrate the influences of learners' learning approaches. The third part examined an instructor's strategy—namely, advance organizer—to enhance learners' knowledge assimilation process. Advance organizer is an instructor strategy that refers to a set of inclusive concepts that introduce and sum up new material, and refers to a method of bridging and linking old information with something new. In this part, I underscore the concepts of advance organizer, and the implementations of advance organizer in one learning environment. A study was conducted in one higher educational environment to show the implementation of advance organizer. Additionally, an advance organizer instrument was developed and tested, and results from learners' feedback were analyzed. The significant empirical evidence showed the association between learners' learning outcomes and the implementation of advance organizer strategy. ^

Exploring the goals, content, and methods of entrepreneurship professors: A multiple case study

Along with the accumulation of evidence supporting the role of entrepreneurship in economic development (Acs & Armington, 2006; Kuratko, 2005, Reynolds, 2007), governments have persisted in encouraging people to become entrepreneurs (Acs & Stough, 2008; Brannback & Carsrud, 2008). These efforts have tried to reproduce the conditions under which entrepreneurship emerges. One of these conditions is to develop entrepreneurial skills among students and scientists (Fan & Foo, 2004). Entrepreneurship education within higher education has experienced a remarkable expansion in the last 20 years (Green, 2008). To develop entrepreneurial skills among students, scholars have proposed different teaching approaches. However, no clear relationship has been demonstrated between entrepreneurship education, learning outcomes, and business creation (Hostager & Decker, 1999). Despite policy makers demands for more accountability from educational institutions (Klimoski, 2007) and entrepreneurship instructors demands for consistency about what should be taught and how (Maidment, 2009), the appropriate content for entrepreneurship programs remains under constant discussion (Solomon, 2007). Entrepreneurship education is still in its infancy, professors propose diverse teaching goals and radically different teaching methods. This represents an obstacle to development of foundational and consistent curricula across the board (Cone, 2008). Entrepreneurship education is in need of a better conceptualization of the learning outcomes pursued in order to develop consistent curriculum. Many schools do not have enough qualified faculty to meet the growing student demand and a consistent curriculum is needed for faculty development. Entrepreneurship instructors and their teaching practices are of interest because they have a role in producing the entrepreneurs needed to grow the economy. This study was designed to understand instructors’ perspectives and actions related to their teaching. The sample studied consisted of eight college and university entrepreneurship instructors. Cases met predetermined criteria of importance followed maximum variation strategies. Results suggest that teaching content were consistent across participants while different teaching goals were identified: some instructors inspire and develop general skills of students while others envision the creation of a real business as the major outcome of their course. A relationship between methods reported by instructors and their disciplinary background, teaching perspective, and entrepreneurial experience was found.

The development of rubrics to measure undergraduate students' global awareness and global perspective: A validity study

Higher education institutions across the United States have developed global learning initiatives to support student achievement of global awareness and global perspective, but assessment options for these outcomes are extremely limited. A review of research for a global learning initiative at a large, Hispanic-serving, urban, public, research university in South Florida found a lack of instruments designed to measure global awareness and global perspective in the context of an authentic performance assessment. This quasi-experimental study explored the development of two rubrics for the global learning initiative and the extent to which evidence supported the rubrics' validity and reliability. One holistic rubric was developed to measure students' global awareness and the second to measure their global perspective. The study utilized a pretest/posttest nonequivalent group design. Multiple linear regression was used to ascertain the rubrics' ability to discern and compare average learning gains of undergraduate students enrolled in two global learning courses and students enrolled in two non-global learning courses. Parallel pretest/posttest forms of the performance task required students to respond to two open-ended questions, aligned with the learning outcomes, concerning a complex case narrative. Trained faculty raters read responses and used the rubrics to measure students' global awareness and perspective. Reliability was tested by calculating the rates of agreement among raters. Evidence supported the finding that the global awareness and global perspective rubrics yielded scores that were highly reliable measures of students' development of these learning outcomes. Chi-square tests of frequency found significant rates of inter-rater agreement exceeding the study's .80 minimum requirement. Evidence also supported the finding that the rubrics yielded scores that were valid measures of students' global awareness and global perspective. Regression analyses found little evidence of main effects; however, post hoc analyses revealed a significant interaction between global awareness pretest scores and the treatment, the global learning course. Significant interaction was also found between global perspective pretest scores and the treatment. These crossover interactions supported the finding that the global awareness and global perspective rubrics could be used to detect learning differences between the treatment and control groups as well as differences within the treatment group.

The examination of the relationships among secondary principals' leadership behaviors, school climate, and student achievement in an urban context

School principals' leadership is key to successful school reform, as is increased student achievement. This nonexperimental ex post facto study tested relationships among secondary school principals' leadership behaviors, school climate, and student achievement. Of 165 secondary school principals from the three largest school districts in South Florida, 58 completed three online survey instruments: the Leadership Practices Inventory, School Climate Inventory-Revised, and researcher-designed Demographic Questionnaire. Student achievement was measured by students' scores on the reading and mathematics Florida Comprehensive Assessment Tests. Three null hypotheses tested relationships among (a) five principals' leadership behaviors and seven domains of school climate; (b) principals' leadership behaviors and student achievement; and (c) principals' leadership behaviors, school climate, and student achievement. Multiple linear regressions were used to determine the degree to which the independent variables predicted the dependent variables for the first two hypotheses. ANOVAs tested possible group differences between the demographic and research variables as controls for the third hypothesis. Partial correlational analyses tested the strength and direction of relationships among leadership behaviors, climate, and achievement. Results revealed partial support of the hypotheses. None of the leadership variables significantly predicted school climate. No significant relationships were found among the five leadership behaviors and student achievement. Demographic group differences in school climate and student achievement were marginally significant. The leadership behaviors of Inspiring a Shared Vision and Enabling Others to Act were positively linked to reading achievement. Partial correlations were found (r .27 to −.35) among school climate variables of Order, Involvement, and Expectation and achievement variables. The Modeling the Way leadership variable was negatively associated with reading achievement. After controlling for gender, years at current school, and years in the district, partial positive correlations were found among leadership, school climate, and student achievement. Inspiring a Shared Vision, Enabling Others to Act, Encouraging the Heart, and Challenging the Process leadership variables were partially correlated to Order, Leadership (Instructional), and Expectation climate variables. Study results should provide policymakers and educators with a leadership profile for school leaders challenging the status quo who can create schools for enhanced student learning and relevance to the needs of students, families, and society.

Developing a process to create and validate an instrument assessing student attainment of competencies at an intercultural university in Mexico

This study took place at one of the intercultural universities (IUs) of Mexico that serve primarily indigenous students. The IUs are pioneers in higher education despite their numerous challenges (Bertely, 1998; Dietz, 2008; Pineda & Landorf, 2010; Schmelkes, 2009). To overcome educational inequalities among their students (Ahuja, Berumen, Casillas, Crispín, Delgado et al., 2004; Schmelkes, 2009), the IUs have embraced performance-based assessment (PBA; Casillas & Santini, 2006). PBA allows a shared model of power and control related to learning and evaluation (Anderson, 1998). While conducting a review on PBA strategies of the IUs, the researcher did not find a PBA instrument with valid and reliable estimates. The purpose of this study was to develop a process to create a PBA instrument, an analytic general rubric, with acceptable validity and reliability estimates to assess students' attainment of competencies in one of the IU's majors, Intercultural Development Management. The Human Capabilities Approach (HCA) was the theoretical framework and a sequential mixed method (Creswell, 2003; Teddlie & Tashakkori, 2009) was the research design. IU participants created a rubric during two focus groups, and seven Spanish-speaking professors in Mexico and the US piloted using students' research projects. The evidence that demonstrates the attainment of competencies at the IU is a complex set of actual, potential and/or desired performances or achievements, also conceptualized as "functional capabilities" (FCs; Walker, 2008), that can be used to develop a rubric. Results indicate that the rubric's validity and reliability estimates reached acceptable estimates of 80% agreement, surpassing minimum requirements (Newman, Newman, & Newman, 2011). Implications for practice involve the use of PBA within a formative assessment framework, and dynamic inclusion of constituencies. Recommendations for further research include introducing this study's instrument-development process to other IUs, conducting parallel mixed design studies exploring the intersection between HCA and assessment, and conducting a case study exploring assessment in intercultural settings. Education articulated through the HCA empowers students (Unterhalter & Brighouse, 2007; Walker, 2008). This study aimed to contribute to the quality of student learning assessment at the IUs by providing a participatory process to develop a PBA instrument.

Effects of real -time captioning and sign language interpreting on the learning of college students who are deaf or hard of hearing

College personnel are required to provide accommodations for students who are deaf and hard of hearing (D/HoH), but few empirical studies have been conducted on D/HoH students as they learn under the various accommodation conditions (sign language interpreting, SLI, real-time captioning, RTC, and both). Guided by the experiences of students who are D/HoH at Miami-Dade College (MDC) who requested RTC in addition to SLI as accommodations, the researcher adopted Merten’s transformative-emancipatory theoretical framework that values perceptions and voice of students who are D/HoH. A mixed methods design addressed two research questions: Did student learning differ for each accommodation? What did students experience while learning through accommodations? Participants included 30 students who were D/HoH (60% women). They represented MDC’s majority minority population: 10% White (non-Hispanic), 20% Black (non-Hispanic, including Haitian/Caribbean), 67% Hispanic, and 3% other. Hearing loss, ranged from severe-profound (70%) to mild-moderate (30%). All were able to communicate with American Sign Language: Learning was measured while students who were D/HoH viewed three lectures under three accommodation conditions (SLI, RTC, SLI+RTC). The learning measure was defined as the difference in pre- and post-test scores on tests of the content presented in the lectures. Using repeated measure ANOVA and ANCOVA, confounding variables of fluency in American Sign Language and literacy skills were treated as covariates. Perceptions were obtained through interviews and verbal protocol analysis that were signed, videotaped, transcribed, coded, and examined for common themes and metacognitive strategies. No statistically significant differences were found among the three accommodations on the learning measure. Students who were D/HoH expressed thoughts about five different aspects of their learning while they viewed lectures: (a) comprehending the information, (b) feeling a part of the classroom environment, (c) past experiences with an accommodation, (d) individual preferences for an accommodation, (e) suggestions for improving an accommodation. They exhibited three metacognitive strategies: (a) constructing knowledge, (b) monitoring comprehension, and (c) evaluating information. No patterns were found in the types of metacognitive strategies used for any particular accommodation. The researcher offers recommendations for flexible applications of the standard accommodations used with students who are D/HoH.

Investigating the Effects of Cognitive Apprenticeship-Based Instructional Coaching on Science Teaching Efficacy Beliefs

The overall purpose of this collected papers dissertation was to examine the utility of a cognitive apprenticeship-based instructional coaching (CAIC) model for improving the science teaching efficacy beliefs (STEB) of preservice and inservice elementary teachers. Many of these teachers perceive science as a difficult subject and feel inadequately prepared to teach it. However, teacher efficacy beliefs have been noted as the strongest indicator of teacher quality, the variable most highly correlated with student achievement outcomes. The literature is scarce on strong, evidence-based theoretical models for improving STEB. This dissertation is comprised of two studies. STUDY #1 was a sequential explanatory mixed-methods study investigating the impact of a reformed CAIC elementary science methods course on the STEB of 26 preservice teachers. Data were collected using the Science Teaching Efficacy Belief Instrument (STEBI-B) and from six post-course interviews. A statistically significant increase in STEB was observed in the quantitative strand. The qualitative data suggested that the preservice teachers perceived all of the CAIC methods as influential, but the significance of each method depended on their unique needs and abilities. STUDY #2 was a participatory action research case study exploring the utility of a CAIC professional development program for improving the STEB of five Bahamian inservice teachers and their competency in implementing an inquiry-based curriculum. Data were collected from pre- and post-interviews and two focus group interviews. Overall, the inservice teachers perceived the intervention as highly effective. The scaffolding and coaching were the CAIC methods portrayed as most influential in developing their STEB, highlighting the importance of interpersonal relationship aspects in successful instructional coaching programs. The teachers also described the CAIC approach as integral in supporting their learning to implement the new inquiry-based curriculum. The overall findings hold important implications for science education reform, including its potential to influence how preservice teacher training and inservice teacher professional development in science are perceived and implemented. Additionally, given the noteworthy results obtained over the relatively short durations, CAIC interventions may also provide an effective means of achieving improvements in preservice and inservice teachers’ STEB more expeditiously than traditional approaches.

Educación superior y competencias para el empleo. El punto de vista de los empresarios

La relevancia del conocimiento como input del proceso productivo ha aumentado la complejidad de la contratación en el mercado de trabajo cualificado. Como consecuencia de ello, se ha generado un proceso de reflexión sobre la adecuación de la acreditación universitaria a las necesidades del mercado de trabajo. Académicos, gerentes y expertos en el mercado de trabajadores altamente cualificados han tenido parte en esta reflexión durante mucho tiempo. Este trabajo tiene como objetivo la identificación de las competencias profesionales con mayor relevancia en la empleabilidad de los graduados en Economía y Empresa. El análisis se basa en una investigación cualitativa que toma como fuentes de información las opiniones de los empleadores. La información para el estudio ha sido obtenida mediante entrevistas en profundidad y la realización de un grupo de discusión. En este proceso han participado empresarios, responsables del servicio de prácticas de la Universidad de Barcelona, expertos y responsables de empresa de colocación, representantes de organizaciones empresariales y profesores universitarios. La atención se centra en la percepción que los entrevistados tienen del requerimiento de conocimientos, habilidades y actitudes, en el grado en que los desarrollan y en los cambios que se necesitarían para lograr una mejor correspondencia entre las competencias adquiridas por los graduados y las requeridas por el mercado de trabajo. A partir de la clasificación de las competencias profesionales (proyecto Tuning), el estudio pone de relieve la importancia otorgada por los empleadores a de las competencias genéricas. No obstante, se observan diferencias valorativas según la tipología de empresas. Asimismo, se evidencian déficits en algunos aspectos relevantes, como la formación práctica y la capacidad de iniciativa, de análisis o de organización. Por último, de las opiniones recogidas también se constata la necesidad de aproximar la universidad al sistema productivo, al menos en el campo económico-empresarial.

Diagnóstico del rendimiento académico de estudiantes de una escuela de educación superior en México

El objetivo del artículo es realizar un diagnóstico sobre la percepción de los factores que intervienen en el rendimiento académico de los estudiantes de cinco carreras universitarias en una escuela de educación superior en México, para así reconocer las áreas de oportunidad que permitan sugerir políticas y estrategias para elevar su rendimiento. Se utilizó una muestra de 1651 estudiantes, se obtuvieron los datos a partir de un cuestionario con treinta preguntas que estudian la percepción del rendimiento académico en escala tipo Likert. Se realizó un análisis factorial exploratorio que permitiera reducir los datos, facilitar la interpretación y validar el instrumento. Se identificaron tres factores: a) el rol de los profesores, b) la evaluación y c) la motivación de los estudiantes. Se llevó a cabo un análisis comparativo por carrera. Se encontró que los estudiantes perciben que la mayoría de los maestros no se preocupan por la condición de los jóvenes en situación de reprobación. Además, casi no motivan y carecen de expresiones de sentimientos de orgullo por los logros académicos de los estudiantes. La mitad de los participantes piensa que los docentes no cubren el temario en su totalidad. Se detectó que los estudiantes poseen una alta motivación siendo esto positivo porque son alumnos dedicados y responsables. Se concluye realizando una serie de sugerencias y explicando las implicaciones que tiene este trabajo para las instituciones de educación superior.

La carpeta de aprendizaje y la evaluación entre iguales de los estudiantes. Resultados de una innovación docente en los estudios universitarios de las artes

Students reflect more on their learning in course subjects when they participate in managing their teaching–learning environment. As a form of guided participation, peer assessment serves the following purposes: (a) it improves the student’s understanding of previously established learning objectives; (b) it is a powerful metacognitive tool; (c) it transfers to the student part of the responsibility for assessing learning, which means deciding which learning activities are important and choosing the degree of effort a course subject will require; (d) it emphasizes the collective aspect of the nature of knowledge; and (e) the educational benefits derived from peer assessment clearly justify the efforts required to implement activities. This paper reports on the relative merits of a learning portfolio compiled during fine arts-related studies in which peer assessment played an important role. The researchers analyzed the student work load and the final marks students received for compulsory art subjects. They conclude that the use of a closed learning portfolio with a well-structured, sequential and analytical design can have a positive effect on student learning and that, although implementing peer assessment may be complex and students need to become familiar with it, its use is not only feasible but recommendable.

Creating New Design-Build-Test Experiences as Outputs of Undergraduate Design-Build-Test Projects

This paper describes a methodology of using individual engineering undergraduate student projects as a means of effectively and efficiently developing new Design-Build-Test (DBT) learning experiences and challenges.
A key aspect of the rationale for this approach is that it benefits all parties. The student undertaking the individual project gets an authentic experience of producing a functional artefact, which has been the result of a design process that addresses conception, design, implementation and operation. The supervising faculty member benefits from live prototyping of new curriculum content and resources with a student who is at a similar level of knowledge and experience as the intended end users of the DBT outputs. The multiple students who ultimately undertake the DBT experiences / challenges benefit from the enhanced nature of a learning experience which has been “road tested” and optimised.
To demonstrate the methodology the paper will describe a case study example of an individual project completed in 2015. This resulted in a DBT design challenge with a theme of designing a catapult for throwing table tennis balls, the device being made from components laser cut from medium density fibreboard (MDF). Further three different modes of operation will be described which use the same resource materials but operate over different timescales and with different learning outcomes, from an icebreaker exercise focused on developing team dynamics through to full DBT where students get an opportunity to experience the full impact of their design decisions by competing against other students with a catapult they have designed and built themselves.

How Good Am I? Crude Self-Assessment vs. Examination

With the new academic year structure encouraging more in-term assessment to replace end-of-year examinations one of the problems we face is assessing students and keeping track of individual student learning without overloading the students and staff with excessive assessment burdens.
In the School of Electronics, Electrical Engineering and Computer Science, we have constructed a system that allows students to self-assess their capability on a simple Yes/No/Don’t Know scale against fine grained learning outcomes for a module. As the term progresses students update their record as appropriately, including selecting a Learnt option to reflect improvements they have gained as part of their studies.
In the system each of the learning outcomes are linked to the relevant teaching session (lectures and labs) and to online resources that students can access at any time. Students can structure their own learning experience to their needs and preferences in order to attain the learning outcomes.
The system keeps a history of the student’s record, allowing the lecturer to observe how the students’ abilities progress over the term and to compare it to assessment results. The system also keeps of any of the resource links that student has clicked on and the related learning outcome.
The initial work is comparing the accuracy of the student self-assessments with their performance in the related questions in the traditional end-of-year examination.

The Evolution of 'Design Build Fly' Led Teaching in Aerospace Engineering

This paper describes the evolution of a ‘Design - Build-Fly’ (DBF) approach to the delivery and assessment of a Stage Three Aircraft Design module. It focuses on the primary learning outcomes around the design and manufacturing functions associated with the development of a remotely controlled aircraft. The work covers a six year period from 2011 to present mapping the transformation of the module from report based assessment to a more hands on approach resulting in a fully functioning remotely controlled aircraft. Results show that both the staff and student experience improved across key performance metrics including student feedback, learning and competency development. Challenges still remain in methods of placing students within teams and maintaining technical rigour in reporting as students develop vocational skills and more reflective writing styles.