eVALUate: an evaluation instrument for measuring students’ perceptions of their engagement and learning outcomes

In the current climate in Australian higher education, quality assurance in university teaching is a priority. In particular, the introduction of the Learning and Teaching Performance Fund (LTPF) has refocused attention on universities’ internal student evaluation survey instruments. This paper reports the development, validation and implementation of a new unit survey instrument which prompts students to reflect on what helps their achievement of unit learning outcomes, and to report their levels of motivation, engagement and overall satisfaction with a semester‐long course or unit of study. The instrument (eVALUate) was created from precepts reported in the research literature, current practices in evaluating teaching, and sound quality assurance practices appropriate to a university outcomes‐focused education paradigm.

Assessing the clinical competence of psychology students through Objective Structured Clinical Examinations (OSCEs): student and staff views

Objective Structured Clinical Examinations (OSCEs) are a well-known, reliable, and valid assessment method used across the healthcare sector. In the present study, we applied OSCEs in three units within professional postgraduate psychology courses, with the broad aims of identifying staff and student perceptions of the assessment. At the conclusion of each OSCE, staff and students completed a feedback questionnaire that contained both scaled and open-ended questions. Results suggest that clinical psychology OSCEs can be stressful for students, but are also well regarded. Both staff and students felt that the OSCEs were realistic, valid, and aligned well with professional practice. Students reported differences in the way in which they prepared for the OSCEs compared with a written exam or other form of assessment, while staff noted that models of OSCE development must be flexible, to adequately assess the objectives of individual units. Further, because they can be a costly exercise, OSCEs need to be applied judiciously within the tertiary sector.

Chinese students’ perceptions of the teaching in an Australian accounting programme – an exploratory study

This exploratory study is designed to elicit and understand the views of Mainland Chinese students concerning their learning experience in an Australian accounting education programme. The article contributes to the literature by investigating the issues and implications associated with international students’ perceptions of teaching, as little research has been undertaken in this context. Data were obtained from focus group interviews at two Australian universities, comprising students who had no prior experience of Western education. Based on an adaptation of Ramsden's 2003 model [Learning to teach in higher education (2nd ed.). London: Routledge], the data show that the students’ educational experience in China has a direct and negative influence on their perceptions of the teaching and learning experience in Australia. The negativity is particularly strong for entry-level students but dissipates to some extent with time. Issues concerning teachers’ enthusiasm, commitment, delivery skills and students’ expectations also emerged as important factors affecting student perceptions.

Student opportunities in materials design and manufacture: Introducing a new manufacturing with composites course

The shift towards strong and lightweight fibre reinforced polymer-matrix composites for many high performance applications has resulted in an increasing need to expose students to composite design and manufacture courses in the undergraduate curriculum. In contrast, student exposure to composite materials is often still limited to a topic within a materials or manufacturing related course (unit). This paper presents the initial offering of a composite materials elective at Griffith University in Australia. The course also addresses environmental concerns through the inclusion of natural fibre composites. An evaluation of student perceptions is considered from Griffith’s Student Experience of Course (SEC) and separate Student Experience of Teaching (SET) surveys. These evaluations demonstrate the high level of student engagement with the course, but also highlighted areas for improvement, including the need to incorporate even more hands-on practical work. Interestingly, the inclusion of natural fibre composites and the related discussion surrounding environmental and societal issues are not focused on in student feedback.

Development, evaluation and use of a student experience survey in undergraduate science laboratories: the advancing science by enhancing learning in the laboratory student laboratory learning experience survey

Student experience surveys have become increasingly popular to probe various aspects of processes and outcomes in higher education, such as measuring student perceptions of the learning environment and identifying aspects that could be improved. This paper reports on a particular survey for evaluating individual experiments that has been developed over some 15 years as part of a large national Australian study pertaining to the area of undergraduate laboratories—Advancing Science by Enhancing Learning in the Laboratory. This paper reports on the development of the survey instrument and the evaluation of the survey using student responses to experiments from different institutions in Australia, New Zealand and the USA. A total of 3153 student responses have been analysed using factor analysis. Three factors, motivation, assessment and resources, have been identified as contributing to improved student attitudes to laboratory activities. A central focus of the survey is to provide feedback to practitioners to iteratively improve experiments. Implications for practitioners and researchers are also discussed.

The Relationship between Adolescent Social Network Structure and Perceptions of School Climate

Thesis (Ph.D.)--University of Washington, 2016-06

Power perceptions and modes of complaining in higher education

This study examines the relationship between student perceptions of different types of educator power and different modes of student complaining behaviour in the case of university education. A large sample of marketing students in the business school responded to the study from a state university in Northeastern United States. Factor analysis and canonical correlation analysis are used to explore the relationships between five bases of power perceptions (referent, expert, reward, legitimate, and punishment) and four modes of complaining behaviour (voice, negative word of mouth, third party, and exit). The results indicate that students engage in different modes of complaining as they perceive different types of educator power. The predominant complaining mode is found to be voice under referent or expert power, third party under legitimate power, and exit under reward or punishment power. Our findings offer important implications for student satisfaction, retention, and completion rates in higher education.

Accounting students' perceptions of a Learning Management System:an international comparison

Purpose - The purpose of this study is to investigate student perceptions of the design features included in an off the shelf Learning Management System (LMS) in teaching undergraduate accounting students. Design/methodology/approach - Questionnaire responses from 846 accounting students studying in the UK, Australia and New Zealand provide international data to develop a model to explain student perception of the LMS. Findings - The final model shows student satisfaction with the use of a LMS is positively associated with three variables: usefulness of lecture notes, bulletin boards and discussion forums, and other LMS tools. Further, the comparison of cultural differences of the three countries shows all students treat the provision of notes as a desirable attribute on a LMS. Findings also suggest that although students find the provision of materials over the LMS does not enhance student engagement in class, overall a comparison of the three countries shows all students treat the provision of notes as a desirable attribute of a LMS. Research limitations/implications - Future research should collect ethnicity data to enable an analysis of cultural influence on student perceptions of the LMS. Practical implications - As increased motivation to learn is found to contribute to improved achievement of learning outcomes, the study's findings have implications for faculty contemplating the adoption of a LMS in their courses. The findings specifically confirm that usefulness of lecture notes, use of bulletin/discussion boards, and other LMS tools are positively endorsed by students and hence increase their motivation to learn. Originality/value - The current paper adds to the literature as the motivation to use and engage with LMSs by accounting students is not well understood. © Emerald Group Publishing Limited.

Student Achievement of Experiential Learning Objectives

Experiential learning is an important component of undergraduate hospitality programs, but most of the research in this area has focused on administrative and design issues. The author reports on a study undertaken to ascertain student perceptions as they relate to three commonly stated goals of experiential programs: the application of classroom studies, technical training, and management development.

Undergraduate Students’ Perceptions of Study Abroad and Their Level of Achievement of Global Learning Outcomes

This study expanded on current research on study abroad and global learning, using the Global Perspective Inventory (GPI), and conducted at Florida International University (FIU) in Miami, FL. The GPI assesses the holistic development of a global perspective in higher education within three domains and their respective FIU-determined equivalents: cognitive (global awareness), intrapersonal (global perspective), and interpersonal (global engagement). The main purpose of this study was to assess FIU’s undergraduate students’ perceptions of study abroad on their level of achievement of global awareness, global perspective, and global engagement. The secondary purpose was to determine how the students described their study abroad experience and achievement of global learning. The research design for this study consisted of parallel mixed methods. The quantitative component was an ex post facto with hypothesis design, using a pretest/posttest nonequivalent group methodology. FIU undergraduates (N=147) who studied abroad for one semester or more completed the GPI pre- and post-tests. Descriptive statistics and paired t-tests were conducted to compare the means. The interviews included 10 students, and were analyzed through Structural coding, Saldaña’s In Vivo coding, and Value coding. Quantitative analyses indicated positive changes in the students’ global awareness and global perspective. These analyses also showed that the FIU students achieved higher post-test means on all the domains of the GPI compared to other studies. Qualitative analyses showed that the students’ experiences incorporated all three global learning outcomes, most notably global awareness and perspective.

Reimagining Reflection: Gender, Student Perception, and Reflective Writing in the Composition Classroom

The purpose of this thesis is to discover any existing correlation between gender and student perceptions of reflective writing in the composition classroom. Seventy-five students at Florida International University participated in a survey that explored their approaches to and understanding of reflective writing. In order to connect the specific results of this study to the larger context of composition theory, this thesis includes an examination of the theoretical background of gender and reflective writing. The results of the survey indicate that the only identifiable difference between male and female student responses resulted from their definitions of reflective writing. Beyond this difference, however, there were no significant variances in student perceptions of reflective writing. The response of these students at FIU indicates a shift in expected gender norms and suggests a reconsideration of what it means to be a gendered writer in the composition classroom.

An exploration of students’ perceptions and attitudes towards creativity in engineering education

This study used a mixed methods approach to develop a broad and deep understanding of students’ perceptions towards creativity in engineering education. Studies have shown that students’ attitudes can have an impact on their motivation to engage in creative behavior. Using an ex-post facto independent factorial design, attitudes of value towards creativity, time for creativity, and creativity stereotypes were measured and compared across gender, year of study, engineering discipline, preference for open-ended problem solving, and confidence in creative abilities. Participants were undergraduate engineering students at Queen’s University from all years of study. A qualitative phenomenological methodology was adopted to study students’ understandings and experiences with engineering creativity. Eleven students participated in oneon- one interviews that provided depth and insight into how students experience and define engineering creativity, and the survey included open-ended items developed using the 10 Maxims of Creativity in Education as a guiding framework. The findings from the survey suggested that students had high value for creativity, however students in fourth year or higher had less value than those in other years. Those with preference for open-ended problem solving and high confidence valued creative more than their counterparts. Students who preferred open-ended problem solving and students with high confidence reported that time was less of a hindrance to their creativity. Males identified more with creativity stereotypes than females, however overall they were both low. Open-ended survey and interview results indicated that students felt they experienced creativity in engineering design activities. Engineering creativity definitions had two elements: creative action and creative characteristic. Creative actions were associated with designing, and creative characteristics were predominantly associated with novelty. Other barriers that emerged from the qualitative analysis were lack of opportunity, lack of assessment, and discomfort with creativity. It was concluded that a universal definition is required to establish clear and aligned understandings of engineering creativity. Instructors may want to consider demonstrating value by assessing creativity and establishing clear criteria in design projects. It is recommended that students be given more opportunities for practice through design activities and that they be introduced to design and creative thinking concepts early in their engineering education.

Cooperative or collaborative learning: Is there a difference in university students’ perceptions?

The hypothesis that the same educational objective, raised as cooperative or collaborative learning in university teaching does not affect students’ perceptions of the learning model, leads this study. It analyses the reflections of two students groups of engineering that shared the same educational goals implemented through two different methodological active learning strategies: Simulation as cooperative learning strategy and Problem-based Learning as a collaborative one. The different number of participants per group (eighty-five and sixty-five, respectively) as well as the use of two active learning strategies, either collaborative or cooperative, did not show differences in the results from a qualitative perspective.

Concerns and Expectations of Students Participating in Study Abroad Programs: Blogging to Reveal the Dynamic Student Voice

Study abroad programmes (SAP) have become increasingly popular with university students and within academia. They are often seen as an experiential opportunity to expand student learning and development, including increases in global, international, and intercultural competences. However, despite the increasing popularity of and participation in study abroad programmes, many student concerns and uncertainties remain. This research investigates initial pre-departure concerns and apprehensions of students undertaking a one-semester study abroad programme and uses these as context for an examination of violated expectations of students during their programme. The research uses interpretative phenomenological analysis to interpret data collected from regularly-updated blogs composed by students throughout their SAP experience. The process of using blogs to collect data is less formalised than many other approaches of interpretative phenomenological analysis, enabling ‘in the moment’ feedback during the SAP and lending greater depth to the understanding of student perceptions.

STUDENTS’ PERCEPTIONS OF TEACHER INSTRUMENTAL SUPPORT AS A PREDICTOR OF MOTIVATION IN READING AND MATH AND ACHIEVEMENT FROM SECOND THROUGH TWELFTH GRADE

In this study, relations among students’ perceptions of instrumental help/support from their teachers and their reading and math ability beliefs, subjective task values, and academic grades, were explored from elementary through high school. These relations were examined in an overall sample of 1,062 students from the Childhood and Beyond (CAB) study dataset, a cohort-sequential study that followed students from elementary to high school and beyond. Multi-group structural equation model (SEM) analyses were used to explore these relations in adjacent grade pairs (e.g., second grade to third grade) in elementary school and from middle school through high school separately for males and females. In addition, multi-group latent growth curve (LGC) analyses were used to explore the associations among change in the variables of interest from middle school through high school separately for males and females. The results showed that students’ perceptions of instrumental help from teachers significantly positively predicted: (a) students’ math ability beliefs and reading and math task values in elementary school within the same grade for both girls and boys, and (b) students’ reading and math ability beliefs, reading and math task values, and GPA in middle and high school within the same grade for both girls and boys. Overall, students’ perceptions of instrumental help from teachers more consistently predicted ability beliefs and task values in the academic domain of math than in the academic domain of reading. Although there were some statistically significant differences in the models for girls and boys, the direction and strength of the relations in the models were generally similar for both girls and boys. The implications for these findings and suggestions for future research are discussed.