Kaleidoscope : Reframing learning and teaching evaluation through a shared stakeholder lens

Sector wide interest in Reframe: QUT’s Evaluation Framework continues with a number of institutions requesting finer details as QUT embeds the new approach to evaluation across the university in 2013. This interest, both nationally and internationally has warranted QUT’s collegial response to draw upon its experiences from developing Reframe into distilling and offering Kaleidoscope back to the sector. The word Reframe is a relevant reference for QUT’s specific re-evaluation, reframing and adoption of a new approach to evaluation; whereas Kaleidoscope reflects the unique lens through which any other institution will need to view their own cultural specificity and local context through an extensive user-led stakeholder engagement approach when introducing new approaches to learning and teaching evaluation. Kaleidoscope’s objectives are for QUT to develop its research-based stakeholder approach to distil the successful experience exhibited in the Reframe Project into a transferable set of guidelines for use by other tertiary institutions across the sector. These guidelines will assist others to design, develop, and deploy, their own culturally specific widespread organisational change informed by stakeholder engagement and organisational buy-in. It is intended that these guidelines will promote, support and enable other tertiary institutions to embark on their own evaluation projects and maximise impact. Kaleidoscope offers an institutional case study of widespread organisational change underpinned by Reframe’s (i) evidence-based methodology; (ii) research including published environmental scan, literature review (Alderman, et al., 2012), development of a conceptual model (Alderman, et al., in press 2013), project management principles (Alderman & Melanie, 2012) and national conference peer reviews; and (iii) year-long strategic project with national outreach to collaboratively engage the development of a draft set of National Guidelines. Kaleidoscope’s aims are to inform Higher Education evaluation policy development through national stakeholder engagement, the finalisation of proposed National Guidelines. In correlation with the conference paper, the authors will present a Draft Guidelines and Framework ready for external peer review by evaluation practitioners from the Higher Education sector, as part of Kaleidoscope’s dissemination strategy (Hinton & Gannaway, 2011) applying illuminative evaluation theory (Parlett & Hamilton, 1976), through conference workshops and ongoing discussions (Shapiro, et al., 1983; Jacobs, 2000). The initial National Guidelines will be distilled from the Reframe: QUT’s Evaluation Framework’s Policy, Protocols, and incorporated Business Rules. It is intended that the outcomes of Kaleidoscope are owned by and reflect sectoral engagement, including iterative evaluation through multiple avenues of dissemination and collaboration including the Higher Education sector. The dissemination strategy with the inclusion of Illuminative Evaluation methodology provides an inclusive opportunity for other institutions and stakeholders across the Higher Education sector to give voice through the information-gathering component of evaluating the draft Guidelines, providing a comprehensive understanding of the complex realities experienced across the Higher Education sector, and thereby ‘illuminating’ both the shared and unique lenses and contexts. This process will enable any final guidelines developed to have broader applicability, greater acceptance, enhanced sustainability and additional relevance benefiting the Higher Education sector, and the adoption and adaption by any single institution for their local contexts.

A state-wide systems approach to embedding the learning and teaching of sustainability in teacher education

Education systems have a key role to play in preparing future citizens to engage in sustainable living practices and help create a more sustainable world. Many schools throughout Australia have begun to develop whole-school approaches to sustainability education that are supported by national and state policies and curriculum frameworks. Preservice teacher education, however, lags behind in building the capacity of new teachers to initiate and implement such approaches (ARIES, 2010). This proposed project seeks to develop a state-wide systems approach to embedding Education for Sustainability (EfS) in teacher education that is aligned with the Australian National Curriculum and the aspirations for EfS in the Melbourne Declaration and other national documents. Representatives from all teacher education institutions and other agents of change in the Queensland education system will be engaged in a multilevel systems approach, involving collaboration at the state, institutional and course levels, to develop curriculum practices that reflect a shared vision of EfS.

Benchmarking potential factors leading to education quality : a study of Cambodian higher education

Purpose To study the quality in higher education in Cambodia and explore the potential factors leading to quality in Cambodian higher education. Design/methodology/approach Five main factors that were deemed relevant in providing quality in Cambodian higher education were proposed: academic curriculum and extra-curricular activities, teachers' qualification and methods, funding and tuition, school facilities, and interactive network. These five propositions were used to compare Shu-Te University, Taiwan with the top five universities in Cambodia. The data came in the forms of questionnaire and desk research. Descriptive analytical approach is then carried out to describe these five factors. Findings Only 6 per cent of lecturers hold PhD degree and about 85 per cent never published any papers; some private universities charge as low as USD200 per academic year, there is almost no donation from international organizations, and annual government funding on higher education sector nationwide in 2005 was only about USD3.67 million; even though there is a library at each university, books, study materials etc. are not up-to-date and inadequate; 90 per cent of the lecturers never have technical discussion or meeting and about 60 per cent of students felt that their teachers did not have time for them to consult with. Originality/value A useful insight was gained into the perceived importance of quality in higher education that can stimulate debate and discussion on the role of government in building the standard quality in higher education. Also, the findings from this research can assist in the development of a framework of developing human resource.

Let’s talk about lex: Narrative analysis as both research method and teaching technique in law

Law is narration: it is narrative, narrator and the narrated. As a narrative, the law is constituted by a constellation of texts – from official sources such as statutes, treaties and cases, to private arrangements such as commercial contracts, deeds and parenting plans. All are a collection of stories: cases are narrative contests of facts and rights; statutes are recitations of the substantive and procedural bases for social, economic and political interactions; private agreements are plots for future relationships, whether personal or professional. As a narrator, law speaks in the language of modern liberalism. It describes its world in abstractions rather than in concrete experience, universal principles rather than individual subjectivity. It casts people into ‘parties’ to legal relationships; structures human interactions into ‘issues’ or ‘problems’; and tells individual stories within larger narrative arcs such as ‘the rule of law’ and ‘the interests of justice’. As the narrated, the law is a character in its own story. The scholarship of law, for example, is a type of story-telling with law as its central character. For positivists, still the dominant group in the legal genre, law is a closed system of formal rules with an “immanent rationality” and its own “structure, substantive content, procedure and tradition,” dedicated to finality of judgment. For scholars inspired by the interpretative tradition in the humanities, law is a more ambivalent character, susceptible to influences from outside its realm and masking a hidden ideological agenda under its cloak of universality and neutrality. For social scientists, law is a protagonist on a wider social stage, impacting on society, the economy and the polity is often surprising ways.

A case study of teaching English and multimodality with ICTs: Constraints and possibilities

Current Australian policies and curricular frameworks demand that teachers and students use technology creatively and meaningfully in classrooms to develop students into 21C technological citizens. English teachers and students also have to learn new metalanguage around visual grammar since multimodal tasks often combine creative with critical General Capabilities (GC) with that of the of ICTs and literacy in the Australian Curriculum: English (AC:E). Both teachers and learners come to these tasks with varying degrees of techno-literacy, skills and access to technologies. This paper reports on case-study research following a technology based collaborative professional development (PD) program between a university Lecturer facilitator and English Teachers in a secondary Catholic school. The study found that the possibilities for creative and critical engagement are rich, but there are real grounded constraints such as lack of time, impeding teachers’ ability to master and teach new technologies in classrooms. Furthermore, pedagogical approaches are affected by technical skill levels and school infrastructure concerns which can militate against effective use of ICTs in school settings. The research project was funded by the Brisbane Catholic Education Office and focused on how teachers can be supported in these endeavours in educational contexts as they prepare students of English to be creative global citizens who use technology creatively.

How Jung's concept of the wounded healer can guide learning and teaching in social work and human services

The concept of the “wounded healer” has been used to explain why those with adverse childhood histories often enter helping professions such as social work and human services (SWHS). Psychotherapist Carl Jung (1875–1961) believed wounded healers developed insight and resilience from their own experiences, enabling transformative interventions to occur with clients. Concerns exist that students with adverse childhood histories in SWHS may display unresolved emotional issues. This journal article explores how Jung’s interpretation of the wounded healer can be critically applied to understanding the learning needs of SWHS students with histories of abuse, neglect or other childhood adversity. The relevance of the wounded healer to SWHS education is explored in three key areas: - 1) the increased possibility of the occurrence of countertransference; - 2) the potential for vicarious traumatisation and burnout, and; - 3) personal and professional resilience displayed by SWHS students with a history of childhood adversity. The wounded healer metaphor allows for a more nuanced understanding of SWHS students with these histories. It also provides insight into the pedagogical considerations associated with teaching this student cohort.

Arrested Drunk Drivers : Trends, social background, recidivism and mortality

The aim of this study was to examine the trends, incidence and recidivism of drunken driving during a 20-year period (1988 - 2007) using the data on all suspected drunken driving in this period. Furthermore, the association between social background and drunken driving, and the mortality of drunk drivers were studied by using administrative register data provided by Statistics Finland. The study was completely register-based. In 1989 - 1991, every year 30,000 drivers were suspected of drunken driving, but the number fell to less than 20,000 by 1994, during the economic recession. The changes in the arrest incidence of the youngest age groups were especially pronounced, most of all in the age group of 18 - 19-year olds. Even though the incidence among youth decreased dramatically, their incidence rate was still twice that of the general population aged 15 - 84 years. Drunken driving was associated with a poor social background among youth and working-aged men and women. For example, a low level of education, unemployment, divorce, and parental factors in youth were associated with a higher risk of being arrested for drunken driving. While a low income was related to more drunken driving among working-aged people, the effect among young persons was the opposite. Every third drunk driver got rearrested during a 15-year period, whereas the estimated rearrest rate was 44%. Findings of drugs only or in combination with alcohol increased the risk of rearrest. The highest rearrest rates were seen among drivers who were under the influence of amphetamines or cannabis. Also male gender, young age, high blood alcohol concentration, and arrest during weekdays and in the daytime predicted rearrest. When compared to the general population, arrested drunk drivers had significant excess mortality. The greatest relative differences were seen in alcohol-related causes of death (including alcohol diseases and alcohol poisoning), accidents, suicides and violence. Also mortality due to other than alcohol-related diseases was elevated among drunk drivers. Drunken driving was associated with multiple factors linked to traffic safety, health and social problems. Social marginalization may expose a person to harmful use of alcohol and drunken driving, and the associations are seen already among the youth. Recidivism is common among drunk drivers, and driving under the influence of illicit and/or medicinal drugs is likely to indicate worse substance abuse problems, judging from the high rearrest rates. High alcohol-related mortality in this population shows that drunken driving is clearly an indicator of alcohol abuse. More effective measures of preventing alcohol-related harms are needed, than merely preventing convicted drunk drivers from driving again.

Fostering 'habits of reflection, independent study and free inquiry': an analysis of the short-lived phenomenon of General/Liberal Studies in English vocational education and training

In 1957, 12 years after the end of World War II, the Ministry of Education issued Circular 323 to promote the development of an element of ‘liberal studies’ in courses offered by technical and further education (FE) colleges in England. This was perceived to be in some ways a peculiar or uncharacteristic development. However, it lasted over 20 years, during which time most students on courses in FE colleges participated in what were termed General or Liberal Studies classes that complemented and/or contrasted with the technical content of their vocational programmes. By the end of the 1970s, these classes had changed in character, moving away from the concept of a ‘liberal education’ towards a prescribed diet of ‘communication studies’. The steady decline in apprenticeship numbers from the late 1960s onwards accelerated in the late 1970s, resulting in a new type of student (the state-funded ‘trainee’) into colleges whose curriculum would be prescribed by the Manpower Services Commission. This paper examines the Ministry’s thinking and charts the rise and fall of a curriculum phenomenon that became immortalised in the ‘Wilt’ novels of Tom Sharpe. The paper argues that the Ministry of Education’s concerns half a century ago are still relevant now, particularly as fresh calls are being made to raise the leaving age from compulsory education to 18, and in light of attempts in England to develop new vocational diplomas for full-time students in schools and colleges.

New public management of Higher education, Foucault and power

The theory of New Public Management (NPM) suggest that one of the features of advanced liberal rule is the tendency to define social, economic and political issues as problems to be solved through management. This paper argues that the restructuring of Higher Education (HE) in many Western countries since the 1980s has involved a shift from an emphasis on administration and policy to one of its efficient management. Utilising Foucault’s concept of governmentality rather than the liberal discourse of management as a politically neutral technology, managerialism can be seen as a newly emergent and increasingly rationalised disciplinary regime of governmentalising practices in advanced liberalism. As such the contemporary University as an institution governed by NPM can be demonstrated to have emerged not as the direct outcome of democratic policies that have rationalised its activities (so that the emancipatory aims of personal development, an educated workforce and of true research can be fully realised), nor can it be understood as the instrument through which individuals or self-realising classes are defeated through the calculations of the state acting on behalf of economic interests, rather it can be seen as the contingent and intractable outcome of the complex power/knowledge relations of advanced liberalism. I analyse the interlocking of the ‘tutor-subject’ and ‘student-subject’ as a local enacting of policy discourse informed by the NPM of HE that reshapes subjectivity and retunes the relationship between tutor and student. I put forward suggestions for how resistance to these new modes of disciplinary subjectification can be enacted.

Development of Social Relationships, Interactions and Behaviours in Early Education Settings

Recent research and policy regarding the advantages of early years provision has focused largely on the enhancement and development of cognitive skills for preschoolers. This study, based in the United Kingdom, focuses on a range of cognitive and social skills and identifies beneficial characteristics of a government pilot scheme for 2-year-olds in areas of social disadvantage. Data were collected from nursery managers and parents across six early years settings using a combination of qualitative and quantitative methods centred around in-depth observational techniques focused on children. Results indicate that in addition to the development of cognitive skills, children showed increased confidence and modes of communication and interaction and that these were associated with the varied activities and routines established within the early years settings. Some variations in terms of frequency and quality of interactions, activities and practice were identified in settings; however, interpersonal support for learning and development was consistent across settings.

A Study of role conflict, role ambiguity, locus of control, job satisfaction and participation in decision making among front-line vocational service workers for mentally retarded adults

This study was an investigation of individual and organizational factors, as perceived by front-line vocational service workers from Adult Rehabilitation Centres (ARC Industries) for mentally retarded adults. The specific variables which were measured included role conflict/role ambiguity (role factors), internal/external locus of control (individual differences), job satisfaction with work and supervision (job attitudes) and participation in deci~ion making (organizational factor). The exploration of these constructs was conducted by means of self-report questionnaires which were completed by sixty-nine out of a total of ninety front-line employees. The surveys were distributed in booklet form to nine distinct rehabilitation facilities from St. Catharines, West Lincoln, Greater Niagara, Port Colborne, WeIland, Fort Erie, Hamilton, Guelph and Brantford. The survey data was evaluated by the statisti.cal Package for the Social Sciences (SPSS) which used the Pearson Product Moment Correlation procedure and a compar~son of means test. A comparison of correlation coefficients test was also conducted. This statistical procedure was calculated mathematically. The results obtained from the statistical evaluation confirmed the prediction that self-reported measures of participation in decision making and satisfaction (work and supervision) would be negatively correlated with role conflict and role ambiguity. As well, the speculation that perceived satisfaction (work and supervision) would be positively correlated with participation in decision making was empirically supported. Internal and external locus of control did not contribute to a significant difference in r~sponses to role perceptions (conflict and ambiguity) , satisfaction (work and supervision) or the correlational relationship between participation in decision making and satisfaction (work and supervision). Overall, the findings from this study substantiated the importance of examining employee perceptions in the workplace and the interrelationships among individual and organizational variables. This research was considered a contribution to the general area of occupational stress and to the study of individuals in work organizations.

The association of faculty's teaching philosophy and teaching behaviour, and critical thinking and self- direction in learning

The intent in this study was to investigate in what ways teachers· beliefs about education and teaching are expressed in the specific teaching behaviours they employ, and whether teaching behaviours, as perceived by their students, are correlated with students· critical thinking and self-directed learning. To this end the relationships studied were: among faCUlty members· philosophy of teaching, locus of control orientation, psychological type, and observed teaching behaviour; and among students· psychological type, perceptions of teaching behaviour, self-directed learning readiness, and critical thinking. The overall purpose of the study was to investigate whether the implicit goals of higher education, critical thinking and self-direction, were actually accounted for in the university classroom. The research was set within the context of path-goal theory, adapted from the leadership literature. Within this framework, Mezirow·s work on transformative learning, including the influences of Habermas· writings, was integrated to develop a theoretical perspective upon which to base the research methodology. Both qualitative and quantitative methodologies were incorporated. Four faCUlty and a total of 142 students participated in the study. Philosophy of teaching was described through faCUlty interviews and completion of a repertory grid. Faculty completed a descriptive locus of control scale, and a psychological type test. Observations of their teaching behaviour were conducted. Students completed a Teaching Behaviour Assessment Scale, the Self-Directed Learning Readiness Scale, a psychological type test, and the Watson-Glaser Critical Thinking Appraisal. A small sample of students were interviewed. Follow-up discussions with faculty were used to validate the interview, observation, teaching behaviour, and repertory grid data. Results indicated that some discrepancies existed between faculty's espoused philosophy of teaching and their observed teaching behaviour. Instructors' teaching behaviour, however, was a function of their personal theory of practice. Relationships were found between perceived teaching behaviour and students· self-directed learning and critical thinking, but these varied across situations, as would be predicted from path-goal theory. Psychological type of students and instructor also accounted for some of the variability in the relationships studied. Student psychological type could be shown as a partial predictor of self-directed learning readiness. The results were discussed in terms of theory development and implications for further research and practice.

Expanding the research horizon in higher education : master's students' perceptions of research assistantships

This study explores how effectively current research assistantships impart research methods, skills, and attitudes; and how well those experiences prepare the next generation of researchers to meet the evolving needs of an ever-expanding, knowledge- based economy and society. Through personal interviews, 7 graduate student research assistants expressed their perceptions regarding their research assistantships. The open- ended interview questions emphasized (a) what research knowledge and skills the graduate students acquired; (b) what other lessons they took away from the experience; and (c) how the research assistantships influenced their graduate studies and future academic plans. After participants were interviewed, the data were transcribed, memberchecked, and then analyzed using a grounded theory research design. The findings show that research assistantships are valuable educational venues that can not only promote research learning but also benefit research assistants' master's studies and stimulate reflection regarding their future educational and research plans. Although data are limited to the responses of 7 students, findings can contribute to the enhancement of research assistantship opportunities as a means of developing skilled future researchers that in tum will benefit Canada as an emerging leader in research and development. The study is meant to serve as an informative source for (a) experienced researchers who have worked with research assistants; (b) researchers who are planning to hire research assistants; and (c) experienced and novice research assistants. Further, the study has the potential to inform future research training initiatives as well as related policies and practices.