Kaleidoscope : Reframing learning and teaching evaluation through a shared stakeholder lens

Sector wide interest in Reframe: QUT’s Evaluation Framework continues with a number of institutions requesting finer details as QUT embeds the new approach to evaluation across the university in 2013. This interest, both nationally and internationally has warranted QUT’s collegial response to draw upon its experiences from developing Reframe into distilling and offering Kaleidoscope back to the sector. The word Reframe is a relevant reference for QUT’s specific re-evaluation, reframing and adoption of a new approach to evaluation; whereas Kaleidoscope reflects the unique lens through which any other institution will need to view their own cultural specificity and local context through an extensive user-led stakeholder engagement approach when introducing new approaches to learning and teaching evaluation. Kaleidoscope’s objectives are for QUT to develop its research-based stakeholder approach to distil the successful experience exhibited in the Reframe Project into a transferable set of guidelines for use by other tertiary institutions across the sector. These guidelines will assist others to design, develop, and deploy, their own culturally specific widespread organisational change informed by stakeholder engagement and organisational buy-in. It is intended that these guidelines will promote, support and enable other tertiary institutions to embark on their own evaluation projects and maximise impact. Kaleidoscope offers an institutional case study of widespread organisational change underpinned by Reframe’s (i) evidence-based methodology; (ii) research including published environmental scan, literature review (Alderman, et al., 2012), development of a conceptual model (Alderman, et al., in press 2013), project management principles (Alderman & Melanie, 2012) and national conference peer reviews; and (iii) year-long strategic project with national outreach to collaboratively engage the development of a draft set of National Guidelines. Kaleidoscope’s aims are to inform Higher Education evaluation policy development through national stakeholder engagement, the finalisation of proposed National Guidelines. In correlation with the conference paper, the authors will present a Draft Guidelines and Framework ready for external peer review by evaluation practitioners from the Higher Education sector, as part of Kaleidoscope’s dissemination strategy (Hinton & Gannaway, 2011) applying illuminative evaluation theory (Parlett & Hamilton, 1976), through conference workshops and ongoing discussions (Shapiro, et al., 1983; Jacobs, 2000). The initial National Guidelines will be distilled from the Reframe: QUT’s Evaluation Framework’s Policy, Protocols, and incorporated Business Rules. It is intended that the outcomes of Kaleidoscope are owned by and reflect sectoral engagement, including iterative evaluation through multiple avenues of dissemination and collaboration including the Higher Education sector. The dissemination strategy with the inclusion of Illuminative Evaluation methodology provides an inclusive opportunity for other institutions and stakeholders across the Higher Education sector to give voice through the information-gathering component of evaluating the draft Guidelines, providing a comprehensive understanding of the complex realities experienced across the Higher Education sector, and thereby ‘illuminating’ both the shared and unique lenses and contexts. This process will enable any final guidelines developed to have broader applicability, greater acceptance, enhanced sustainability and additional relevance benefiting the Higher Education sector, and the adoption and adaption by any single institution for their local contexts.

Framing student evaluations of university learning and teaching : discursive strategies and textual outcomes

Evaluation in higher education is an evolving social practice, that is, it involves what people, institutions and broader systems do and say, how they do and say it, what they value, the effects of these practices and values, and how meanings are ascribed. The textual products (verbal, written, visual, gestural) that inform and are produced by, for and through evaluative practices are important as they promulgate particular kinds of meanings and values in specific contexts. This paper reports on an exploratory study that sought to investigate, using discourse analysis, the types of evaluative practices that were ascribed value, and the student responses that ensued, in different evaluative instruments. Findings indicate that when a reflective approach is taken to evaluation, students’ responses are more considered, they interrogate their own engagement in the learning context and they are more likely to demonstrate reconstructive thought. These findings have implications for reframing evaluation as reflective learning.

The paradox of creative uncertainty in learning and teaching

In an ever-changing and globalised world there is a need for higher education to adapt and evolve its models of learning and teaching. The old industrial model has lost traction, and new patterns of creative engagement are required. These new models potentially increase relevancy and better equip students for the future. Although creativity is recognised as an attribute that can contribute much to the development of these pedagogies, and creativity is valued by universities as a graduate capability, some educators understandably struggle to translate this vision into practice. This paper reports on selected survey findings from a mixed methods research project which aimed to shed light on how creativity can be designed for in higher education learning and teaching settings. A social constructivist epistemology underpinned the research and data was gathered using survey and case study methods. Descriptive statistical methods and informed grounded theory were employed for the analysis reported here. The findings confirm that creativity is valued for its contribution to the development of students’ academic work, employment opportunities and life in general; however, tensions arise between individual educator’s creative pedagogical goals and the provision of institutional support for implementation of those objectives. Designing for creativity becomes, paradoxically, a matter of navigating and limiting complexity and uncertainty, while simultaneously designing for those same states or qualities.

A case study of teaching English and multimodality with ICTs: Constraints and possibilities

Current Australian policies and curricular frameworks demand that teachers and students use technology creatively and meaningfully in classrooms to develop students into 21C technological citizens. English teachers and students also have to learn new metalanguage around visual grammar since multimodal tasks often combine creative with critical General Capabilities (GC) with that of the of ICTs and literacy in the Australian Curriculum: English (AC:E). Both teachers and learners come to these tasks with varying degrees of techno-literacy, skills and access to technologies. This paper reports on case-study research following a technology based collaborative professional development (PD) program between a university Lecturer facilitator and English Teachers in a secondary Catholic school. The study found that the possibilities for creative and critical engagement are rich, but there are real grounded constraints such as lack of time, impeding teachers’ ability to master and teach new technologies in classrooms. Furthermore, pedagogical approaches are affected by technical skill levels and school infrastructure concerns which can militate against effective use of ICTs in school settings. The research project was funded by the Brisbane Catholic Education Office and focused on how teachers can be supported in these endeavours in educational contexts as they prepare students of English to be creative global citizens who use technology creatively.

The association of faculty's teaching philosophy and teaching behaviour, and critical thinking and self- direction in learning

The intent in this study was to investigate in what ways teachers· beliefs about education and teaching are expressed in the specific teaching behaviours they employ, and whether teaching behaviours, as perceived by their students, are correlated with students· critical thinking and self-directed learning. To this end the relationships studied were: among faCUlty members· philosophy of teaching, locus of control orientation, psychological type, and observed teaching behaviour; and among students· psychological type, perceptions of teaching behaviour, self-directed learning readiness, and critical thinking. The overall purpose of the study was to investigate whether the implicit goals of higher education, critical thinking and self-direction, were actually accounted for in the university classroom. The research was set within the context of path-goal theory, adapted from the leadership literature. Within this framework, Mezirow·s work on transformative learning, including the influences of Habermas· writings, was integrated to develop a theoretical perspective upon which to base the research methodology. Both qualitative and quantitative methodologies were incorporated. Four faCUlty and a total of 142 students participated in the study. Philosophy of teaching was described through faCUlty interviews and completion of a repertory grid. Faculty completed a descriptive locus of control scale, and a psychological type test. Observations of their teaching behaviour were conducted. Students completed a Teaching Behaviour Assessment Scale, the Self-Directed Learning Readiness Scale, a psychological type test, and the Watson-Glaser Critical Thinking Appraisal. A small sample of students were interviewed. Follow-up discussions with faculty were used to validate the interview, observation, teaching behaviour, and repertory grid data. Results indicated that some discrepancies existed between faculty's espoused philosophy of teaching and their observed teaching behaviour. Instructors' teaching behaviour, however, was a function of their personal theory of practice. Relationships were found between perceived teaching behaviour and students· self-directed learning and critical thinking, but these varied across situations, as would be predicted from path-goal theory. Psychological type of students and instructor also accounted for some of the variability in the relationships studied. Student psychological type could be shown as a partial predictor of self-directed learning readiness. The results were discussed in terms of theory development and implications for further research and practice.

Introduction to engineering : a case study of an interdisciplinary course in Mathematics, Science and Technology

This thesis research was a qualitative case study of a single class of Interdisciplinary Studies: Introduction to Engineering taught in a secondary school. The study endeavoured to explore students' experiences in and perceptions of the course, and to investigate the viability of engineering as an interdisciplinary theme at the secondary school level. Data were collected in the form of student questionnaires, the researcher's observations and reflections, and artefacts representative of students' work. Data analysis was performed by coding textual data and classifying text segments into common themes. The themes that emerged from the data were aligned with facets of interdisciplinary study, including making connections, project-based learning, and student engagement and affective outcomes. The findings of the study showed that students were positive about their experiences in the course, and enjoyed its project-driven nature. Content from mathematics, physics, and technological design was easily integrated under the umbrella of engineering. Students felt that the opportunity to develop problem solving and teamwork skills were two of the most important aspects of the course and could be relevant not only for engineering, but for other disciplines or their day-to-day lives after secondary school. The study concluded that engineering education in secondary school can be a worthwhile experience for a variety of students and not just those intending postsecondary study in engineering. This has implications for the inclusion of engineering in the secondary school curriculum and can inform the practice of curriculum planners at the school, school board, and provincial levels. Suggested directions for further research include classroom-based action research in the areas of technological education, engineering education in secondary school, and interdisciplinary education.

African American and Teaching in Higher Education IS a Course on Race and Culture

Using theoretical applications, the authors present an overview of theories that highlight approaches for teaching culturally sensitive content, personal experiences as educator and colleague in a predominantly white college campus and strategies for addressing culturally insensitive experiences in and outside the classroom. Presenters focus on the recruitment and retention of people of color and stress the need for today's predominantly white institutions to become more knowledgeable, tolerant and sensitive about their environments in an effort to make them more accepting.

An experimental study on Aerobic Gymnastic: performance analysis as an effective evaluation for technique and teaching of motor gestures

Aerobic Gymnastic is the ability to perform complex movements produced by the traditional aerobic exercises, in a continuous manner, with high intensity, perfectly integrated with soundtracks. This sport is performed in an aerobic/anaerobic lactacid condition and expects the execution of complex movements produced by the traditional aerobic exercises integrated with difficulty elements performed with a high technical level. An inaccuracy about this sport is related to the name itself “aerobic” because Aerobic Gymnastic does not use just the aerobic work during the competition, due to the fact that the exercises last among 1’30” and 1’45” at high rhythm. Agonistic Aerobics exploit the basic movements of amateur Aerobics and its coordination schemes, even though the agonistic Aerobics is so much intense than the amateur Aerobics to need a completely different mix of energetic mechanisms. Due to the complexity and the speed with which you perform the technical elements of Aerobic Gymnastic, the introduction of video analysis is essential for a qualitative and quantitative evaluation of athletes’ performance during the training. The performance analysis can allow the accurate analysis and explanation of the evolution and dynamics of a historical phenomenon and motor sports. The notational analysis is used by technicians to have an objective analysis of performance. Tactics, technique and individual movements can be analyzed to help coaches and athletes to re-evaluate their performance and gain advantage during the competition. The purpose of the following experimental work will be a starting point for analyzing the performance of the athletes in an objective way, not only during competitions, but especially during the phases of training. It is, therefore, advisable to introduce the video analysis and notational analysis for more quantitative and qualitative examination of technical movements. The goal is to lead to an improvement of the technique of the athlete and the teaching of the coach.

Algebra, or universal mathematics: revived 1738 with notes and additions : manuscript, [after 1738]

Instructional book in algebra with exercises.

On the study and difficulties of mathematics /

First edition, 1831.

Real mathematics, intended mainly for practical engineers, as an aid to the study and comprehension of mathematics,

Mode of access: Internet.

The literary and scientific class book : embracing the leading facts and principles of science, illustrated with engravings, with many difficult words explained at the heads of the lessons, and questions annexed for examination : designed as exercises for the reading and study of the higher classes in common schools : selected from the Rev. John Platts' Literary and scientific class book, and from various other sources and adapted to the wants and condition of youth in the United States / by Levi W. Leonard.

"Select books": p. vii-viii.

The literary and scientific class book, embracing the leading facts and principles of science. Illustrated by engravings, with many difficult words explained at the heads of the lessons, and questions annexed for examination; designed as exercises for the reading and study of the higher classes in common schools. Selected from the rev. John Platts' Literary and scientific class book, and from verious other sources, and adapted to the wants and condition of youth in the United States /

"Select books" : p. vii-viii.