Teaching the scientific method in the curriculum

 In chemistry education, students not only learn chemical knowledge and skills, but about the culture of chemistry – how scientists think about, and practise, chemistry. Students often learn that science is practised according to the “scientific method”, which is a model of scientific discovery, expounded by science historians and philosophers. The idealised “scientific method” has a number of steps: the collection of information about a phenomenon; the development of a hypothesis to explain those observations; an experiment to test a prediction that arises from the hypothesis, perhaps including more observations and collection of more information; improvement of the hypothesis; and so on.

The problem is that students (and even some science professionals) often do not understand the philosophy behind the scientific method and paradoxically, the scientific method does not seem to apply to most careers in science. The true nature of science is that concepts have been developed though variants of the “scientific method”, and that a process of testing the predictive value of these concepts has lead to advances in that conceptual knowledge. Hence the “scientific method” applies to the development of scientific ideas, not necessarily to the work of all scientists. It is not whether we personally use the scientific method in our day-today work, but how we use, apply, think about and communicate scientific knowledge and skills that makes us chemists.

Discovering the value that the library can contribute to quality teaching and learning through student evaluation data

Large surveys of library user service quality perception are common. However, student evaluation of teaching (SET) data often show a disparity between ratings of library service quality and library resource quality. In this situation, perhaps SET data can also provide insights into what contributes to the perception of library resource quality, and hence identify leverage points for quality improvement interventions. This paper documents an analysis of available Deakin University SET data relating to student interaction with, and evaluation of, library resources. It highlights significant correlations associated with library-related SET items, and from them infers actions that the library could undertake to improve the value and perception of the quality of library resources. The following results were observed. High ratings for library resources were likely to be associated with high general ratings of teaching and unit quality. Postgraduate coursework students rated library resources significantly higher than students in the first three years of undergraduate programs. Students in one faculty (Health) rated library resources significantly higher than students in all other faculties. There was a strong correlation observed in Australasian Survey of Student Engagement data for both 2009 and 2010 between the two items “Used library resources on campus or online” and “Worked on an essay or assignment that required integrating ideas or information from various sources”. These findings suggest the following conclusions. Well-planned learning environments are likely to integrate meaningful student interaction with the library. Initiatives to improve the value and perception of the quality of library resources should be focussed on the specific characteristics and needs of particular student cohorts to have maximum impact. More sophisticated assessment tasks that require students to interact with the library have the potential to result in higher student ratings of the value of library resources.

Knowledge mobilization on decision making for school improvement : Canadian principals learning network.

Principals duties have expanded beyond instructional leadership. Roles now include being curriculum leader, supervisor, manager, head of finance, administration, compliance, and legal matters, and so on. These additional responsibilities impact their decision-making in relation to teaching, learning and school improvement in general. How, and on what basis, they make these decisions is crucial both to their development as instructional leaders and to educational reform processes. To contribute to knowledge on principals’ decision making skills, we have created a strategic knowledge mobilization initiative called 'Canadian Principals Learning Network (CPLN)'. Through a variety of face-to-face and online activities, it collaboratively links together an international group of practicing principals and university-based researchers with related expertise. This paper describes the initiative and outcomes.

Student evaluation of teaching : keeping in touch with reality

Student evaluation of teaching is commonplace in many universities and may be the predominant input into the performance evaluation of staff and organisational units. This article used publicly available student evaluation of teaching data to present examples of where institutional responses to evaluation processes appeared to be educationally ineffective and where the pursuit of the ‘right’ student evaluation results appears to have been mistakenly equated with the aim of improved teaching and learning. If the vast resources devoted to student evaluation of teaching are to be effective, then the data produced by student evaluation systems must lead to real and sustainable improvements in teaching quality and student learning, rather than becoming an end in itself.

A preliminary evaluation of the use of graphic novels in teaching information systems

As a result of declining student numbers, and poor satisfaction ratings, an introductory information systems unit was completely redeveloped. A number of innovative initiatives were designed and implemented and the unit has seen a significant improvement in student satisfaction rates. This paper describes the development of a series of graphic novels as a strategy to both increase student engagement with the unit content and enhance the attainment of learning outcomes. It also discusses how the graphic novels were used in lectures, workshops, and competitions to increase student engagement (with varying degrees of success). Students have generally found the graphic novels to be a valuable learning resource. There is a paucity of studies on the impact of graphic novels as a teaching tool, particularly within the context of higher education, and this research is a contribution to this evident gap in the literature.

The performance of a student evaluation of teaching system

Student evaluation of teaching (SET) is now commonplace in many universities internationally. While much effort has been devoted to examining the statistical validity of SET instruments, there has been limited examination of the methodological and consequential validity (together referred to as ‘utility’) of the ways in which SET data are used. This paper examines the SET system at Deakin University from the perspective of utility. It draws on publicly available SET results for an entire annual cycle of unit offerings. Consideration is given to the representativeness of the data produced, and to the utility of the data reported, by the system. While this investigation focuses on the SET system currently employed at Deakin University, it offers both an analysis methodology and conclusions that can be applied more generally.

O where are you going? O do you imagine? Reproduction and response : a reflexive sociology of scholarship of teaching and learning in practical legal training

My doctoral research studies Australian PLT practitioners’ engagement with scholarship of teaching and learning. I argue that many PLT practitioners are motivated to engage with scholarship of teaching and learning in their work. There are, however, individual and extra-individual impediments.
PLT practitioners are lawyers that teach in institutional practical legal training (“PLT”). Satisfactory completion of mandatory PLT is an eligibility requirement for admission to the Australian legal profession. The PLT requirement is additional to academic legal qualifications. PLT is undertaken at a post-graduate level with, or after, the academic law degree.
My study investigates PLT practitioners’ motivations and capabilities to engage with scholarship of teaching and learning (“SoTL”). I study organisational symbolic support for SoTL in PLT, and organisational allocation of resources to SoTL in PLT.
The study involves individual and extra-individual domains of PLT practitioners’ work. It considers how social structures (e.g. “the juridical”) are inscribed into individuals’ practices (“teaching”) and, conversely, whether practices influence social structures.
My research adopts qualitative methodologies. These involve inter-disciplinary exchanges between law, legal education, practice research, sociology of law, cultural theory, and theory and practice of teaching and learning. My theoretical framework draws on Pierre Bourdieu’s “reflexive sociology”, and Michel de Certeau’s “heterological science”.
I sourced data from documents, and semi-structured interviews with 36 Australian PLT practitioners. Documentary sources include statutory instruments, speeches, reports, practice directions, histories, and scholarly publications.
To analyse the data I adopted Kelle’s characterisation of “theoretical sensitivity”, drawing on “explicit” and “emergent” analysis strategies derived from “grounded theory”. The explicit strategies were based on my theoretical framework. The emergent strategy involved sensitivity to non-explicit concepts and theories that emerged from the data. Computer-aided qualitative data analysis software expedited these methods.
My findings to date question dominant legal structures’ readiness for change, the implications of this for teaching and learning in PLT, and in particular for PLT practitioners’ engagement with SoTL in PLT.
The espoused rationale for mandatory PLT (in statutes) is improvement for the protection of clients, the administration of justice, and to assure quality legal services. The tacit rationale is improved quality of legal education, and experiences, for lawyers-to-be. My thesis argues dominant structures in legal education impede the espoused and tacit objectives, and impede PLT practitioners’ engagement with scholarship of teaching and learning.

Principal led school improvement and teacher capacity building in the Barwon South Network : final report, May 2013

The period of interest for this report is the beginning of 2011 to the end of 2012. The period commenced when the Regional Network Leader of the Barwon South Network of schools in the Barwon South Region of the Department of Education and Early Childhood contacted the School of Education at Deakin University, Waurn Ponds Campus Geelong. The Regional Network Leader outlined a desire to engage with Deakin University to research a short-term-cycle model of school improvement to be implemented in the region. While the model was expected to be taken on by all schools in the region the research was limited to the 23 schools in the Barwon South Network with four schools to be investigated more closely for each of two years (2001 & 2012) – eight focus schools in total.

Many positive outcomes flowed from the implementation of short-term-cycle school improvement plans and their associated practices but there was wide variation in the nature and degrees of success and of the perception of the process. The research team asked the following questions of the data:

1. What aspects of the School Improvement Plan (SIP) approach were important for initiating and supporting worthwhile change?
2. What might we take from this, to provide guidance on how best to support change in teaching and learning processes in schools?

The School Improvement Plan (SIP) worked in a range of ways. At one level it was strongly focused on school leadership, and a need to improve principals’ capacity to initiate worthwhile teaching and learning processes in their schools. Underlying this intent, one might think an assumption is operation is that the leadership process involves top down decision-making and a willingness to hold staff accountable for the quality of their practice.

The second strong focus was on the translation into practice and the consequent effect on student learning, involving an emphasis on data and evidence led practice. Hence, along with the leadership focus there was a demand for the process of school improvement to reach down into students and classrooms. Thus, the SIP process inevitably involved a chain of decision-making by which student learning quality drove the intervention, and teachers responsible for this had a common view. The model therefore should not be seen as an intervention only on the principal, but rather on the school decision-making system and focus. Even though it was the principal receiving the SIP planning template, and reporting to the network, the reporting was required to include description of the operation of the school processes, of classroom processes, and of student learning. This of course placed significant constraints on principals, which may help explain the variation in responses and outcomes described above.

The findings from this study are based on multiple data sources: analysis of both open and closed survey questions which all teachers in the 23 schools in the network were invited to complete; interviews with principals, teachers and leaders in the eight case study schools; some interviews with students in the case study schools; and interviews with leaders who worked in the regional network office; and field notes from network meetings including the celebrations days. Celebrations days occurred each school term when groups of principals came together to share and celebrate the improvements and processes happening in their schools. Many of the themes emerging from the analysis of the different data sources were similar or overlapping, providing some confidence in the evidence-base for the findings.

The study, conducted over two years of data collection and analysis, has demonstrated a range of positive outcomes in at the case study schools relating to school communication and collaboration processes, professional learning of principals, leadership teams and classroom teachers. There was evidence in the survey responses and field notes from ‘celebration days’ that these outcomes were also represented in other schools in the network. The key points of change concerned the leadership processes of planning for improvement, and the rigorous attention to student data in framing teaching and learning processes. This latter point of change had the effect of basing SIP processes on a platform of evidence-based change. The research uncovered considerable anecdotal and observational evidence of improvements in student learning, in teacher accounts in interview, and presentations of student work. Interviews with students, although not as representative as the team would have liked, showed evidence of student awareness of learning goals, a key driver in the SIP improvement model. It was, however, not possible over this timescale to collect objective comparative evidence of enhanced learning outcomes.

A number of features of the short-term-cycle SIP were identified that supported positive change across the network. These were: 1) the support structures represented by the network leader and support personnel within schools, 2) the nature of the SIP model – focusing strongly on change leadership but within a collaborative structure that combined top-down and bottom-up elements, 3) the focus on data-led planning and implementation that helped drill down to explicit elements of classroom practice, and 4) the accountability regimes represented by network leader presence, and the celebration days in which principals became effectively accountable to their peers. We found that in the second year of the project, momentum was lost in the case study schools, as the network was dismantled. This raised issues also for the conduct of research in situations of systemic change.

Alongside the finding of evidence of positive outcomes in the case study schools overall, was the finding that the SIP processes and outcomes varied considerably across schools. A number of contextual factors were identified that led to this variation, including school histories of reform, principal management style, and school size and structure that made the short-term-cycle model unmanageable. In some cases there was overt resistance to the SIP model, at least in some part, and this led to an element of performativity in which the language of the SIP was conscripted to other purposes. The study found that even with functioning schools the SIP was understood differently and the processes performed differently, raising the question of whether in the study we are dealing with one SIP or many. The final take home message from the research is that schools are complex institutions, and models of school improvement need to involve both strong principled features, and flexibility in local application, if all schools’ interests in improving teaching and learning processes and outcomes are to be served.

Responding to student evaluation of teaching : closing the loop

Our undergraduate curriculum focuses on preparing students to be critical thinkers, problem solvers, and knowledgeable, responsible information technology (IT) professionals. Students often question the relevance of core subjects which are designed to introduce and develop these attributes; such units regularly perform poorly in student evaluation of teaching. Although these subjects are strongly grounded in meeting industry expectations regarding employability skills, students do not value the learning as the curriculum is deemed non-technical and not worthy of inclusion in an IT qualification. As these are core subjects, improving student perceptions and learning outcomes is of critical importance. Simply responding to student feedback received via student evaluation of teaching had not resulted in any improvement; so a holistic approach was adopted. A workshop was organised to explore the issues and develop a strategy to improve outcomes and perceptions of these subjects. Rather than addressing student feedback specifically, the underlying issues that led to students’ negative perceptions were identified and addressed. Recommendations were implemented in 2014 resulting in improvements in student evaluation for relevant subjects. In this paper, we will discuss the process that was adopted to respond effectively to student evaluations, and explore the impact that this had on them.

Role of ADRI model in teaching and assessing novice programmers

In this research, an ADRI approach was introduced in the teaching and learning process of an introductory programming course. The result shows that the ADRI approach impacted positively on the students learning outcomes. The ADRI approach not only reduced the failure rate but also improved student’s retention in the course.

An Examination of the merits of a human rights-based approach to higher education teaching and learning, compared with welfare and market-based approaches.

The thesis concludes that a human rights-based approach to higher education will produce better teaching and learning outcomes than welfare state or market-based approaches. It is intended that this research might influence an improvement in policy-making, identify a ‘feasible utopia’ for higher education, and contribute to discussion about the public interest role of higher education.