Kaleidoscope : Reframing learning and teaching evaluation through a shared stakeholder lens

Sector wide interest in Reframe: QUT’s Evaluation Framework continues with a number of institutions requesting finer details as QUT embeds the new approach to evaluation across the university in 2013. This interest, both nationally and internationally has warranted QUT’s collegial response to draw upon its experiences from developing Reframe into distilling and offering Kaleidoscope back to the sector. The word Reframe is a relevant reference for QUT’s specific re-evaluation, reframing and adoption of a new approach to evaluation; whereas Kaleidoscope reflects the unique lens through which any other institution will need to view their own cultural specificity and local context through an extensive user-led stakeholder engagement approach when introducing new approaches to learning and teaching evaluation. Kaleidoscope’s objectives are for QUT to develop its research-based stakeholder approach to distil the successful experience exhibited in the Reframe Project into a transferable set of guidelines for use by other tertiary institutions across the sector. These guidelines will assist others to design, develop, and deploy, their own culturally specific widespread organisational change informed by stakeholder engagement and organisational buy-in. It is intended that these guidelines will promote, support and enable other tertiary institutions to embark on their own evaluation projects and maximise impact. Kaleidoscope offers an institutional case study of widespread organisational change underpinned by Reframe’s (i) evidence-based methodology; (ii) research including published environmental scan, literature review (Alderman, et al., 2012), development of a conceptual model (Alderman, et al., in press 2013), project management principles (Alderman & Melanie, 2012) and national conference peer reviews; and (iii) year-long strategic project with national outreach to collaboratively engage the development of a draft set of National Guidelines. Kaleidoscope’s aims are to inform Higher Education evaluation policy development through national stakeholder engagement, the finalisation of proposed National Guidelines. In correlation with the conference paper, the authors will present a Draft Guidelines and Framework ready for external peer review by evaluation practitioners from the Higher Education sector, as part of Kaleidoscope’s dissemination strategy (Hinton & Gannaway, 2011) applying illuminative evaluation theory (Parlett & Hamilton, 1976), through conference workshops and ongoing discussions (Shapiro, et al., 1983; Jacobs, 2000). The initial National Guidelines will be distilled from the Reframe: QUT’s Evaluation Framework’s Policy, Protocols, and incorporated Business Rules. It is intended that the outcomes of Kaleidoscope are owned by and reflect sectoral engagement, including iterative evaluation through multiple avenues of dissemination and collaboration including the Higher Education sector. The dissemination strategy with the inclusion of Illuminative Evaluation methodology provides an inclusive opportunity for other institutions and stakeholders across the Higher Education sector to give voice through the information-gathering component of evaluating the draft Guidelines, providing a comprehensive understanding of the complex realities experienced across the Higher Education sector, and thereby ‘illuminating’ both the shared and unique lenses and contexts. This process will enable any final guidelines developed to have broader applicability, greater acceptance, enhanced sustainability and additional relevance benefiting the Higher Education sector, and the adoption and adaption by any single institution for their local contexts.

From policy borrowing to implementation : an illuminative evaluation of learning and teaching in higher education in Australia (2002 to 2008)

This study documents and theorises the consequences of the 2003 Australian Government Reform Package focussed on learning and teaching in Higher Education during the period 2002 to 2008. This is achieved through the perspective of program evaluation and the methodology of illuminative evaluation. The findings suggest that the three national initiatives of that time, Learning and Teaching Performance Fund (LTPF), Australian Learning and Teaching Council (ALTC), and Australian Universities Quality Agency (AUQA), were successful in repositioning learning and teaching as a core activity in universities. However, there were unintended consequences brought about by international policy borrowing, when the short-lived nature of LTPF suggests a legacy of quality compliance rather than one of quality enrichment.

Framing student evaluations of university learning and teaching : discursive strategies and textual outcomes

Evaluation in higher education is an evolving social practice, that is, it involves what people, institutions and broader systems do and say, how they do and say it, what they value, the effects of these practices and values, and how meanings are ascribed. The textual products (verbal, written, visual, gestural) that inform and are produced by, for and through evaluative practices are important as they promulgate particular kinds of meanings and values in specific contexts. This paper reports on an exploratory study that sought to investigate, using discourse analysis, the types of evaluative practices that were ascribed value, and the student responses that ensued, in different evaluative instruments. Findings indicate that when a reflective approach is taken to evaluation, students’ responses are more considered, they interrogate their own engagement in the learning context and they are more likely to demonstrate reconstructive thought. These findings have implications for reframing evaluation as reflective learning.

Caught in the headlights: Designing for creative learning and teaching in higher education

This study was an exploration of the different ways that educators conceptualise and approach creative learning and teaching. The research revealed theoretical and practice-based insights, demonstrating that exemplary teachers adopt an ecological approach to designing for student creativity; this approach acknowledges and works with the complexity of the higher education environment and the dynamic relationships between students, peers and teachers. The inquiry confirmed the value of using learning design patterns to uncover hidden creative processes.

Feeling the pressure: Early childhood educators’ reported views about learning and teaching phonics in Australian prior-to-school settings

Early childhood educators’ beliefs about literacy teaching can impact on the types of phonics experiences educators provide for children in prior-to-school settings. The Australian Early Years Learning Framework supports a play-based, intentional approach to teaching phonics, however little is known about what Australian early childhood educators believe is important in teaching phonics in the prior-to-school years. Using a qualitative content analysis, this research study investigates 115 early childhood educators’ views about how phonics should be taught and the use of commercially produced phonics programs (e.g. Jolly Phonics and Letterland) in prior-to-school settings. This study further investigates educators’ perceived pressures to include structured phonics lessons, as a way of addressing parental notions of ‘school readiness’. The results of this study indicate conflicting views were held about how phonics should be taught. Some educators also experienced external pressures to engage in literacy practices that may be in opposition with their own beliefs about how literacy is learnt. This study provides insights into the pedagogical practices early childhood educators believe are appropriate when teaching phonics. The educational implications are discussed.

The paradox of creative uncertainty in learning and teaching

In an ever-changing and globalised world there is a need for higher education to adapt and evolve its models of learning and teaching. The old industrial model has lost traction, and new patterns of creative engagement are required. These new models potentially increase relevancy and better equip students for the future. Although creativity is recognised as an attribute that can contribute much to the development of these pedagogies, and creativity is valued by universities as a graduate capability, some educators understandably struggle to translate this vision into practice. This paper reports on selected survey findings from a mixed methods research project which aimed to shed light on how creativity can be designed for in higher education learning and teaching settings. A social constructivist epistemology underpinned the research and data was gathered using survey and case study methods. Descriptive statistical methods and informed grounded theory were employed for the analysis reported here. The findings confirm that creativity is valued for its contribution to the development of students’ academic work, employment opportunities and life in general; however, tensions arise between individual educator’s creative pedagogical goals and the provision of institutional support for implementation of those objectives. Designing for creativity becomes, paradoxically, a matter of navigating and limiting complexity and uncertainty, while simultaneously designing for those same states or qualities.

The gradual release of responsibility: A case study of teaching science inquiry skills

This thesis investigated how a year-4 teacher used a pedagogical approach referred to as the Gradual Release of Responsibility (GRR) model of instruction for teaching Science Inquiry Skills in a primary classroom. Through scaffolding her students' learning using the GRR, the teacher guided her students towards developing an understanding about Scientific Inquiry leading to the foundations of scientific literacy. A learning environment was established in which students engaged in rich conversations, designed and conducted experiments using fair testing procedures, analysed and offered justifications for results, and negotiated knowledge claims in ways similar to some of those in the scientific community.

Subject Teacher Training and Teaching in English

The purpose of this Master s thesis is on one hand to find out how CLIL (Content and Language Integrated Learning) teachers and English teachers perceive English and its use in teaching, and on the other hand, what they consider important in subject teacher education in English that is being planned and piloted in STEP Project at the University of Helsinki Department of Teacher Education. One research question is also what kind of language requirements teachers think CLIL teachers should have. The research results are viewed in light of previous research and literature on CLIL education. Six teachers participate in this study. Two of them are English teachers in the comprehensive school, two are class teachers in bilingual elementary education, and two are subject teachers in bilingual education, one of whom teaches in a lower secondary school and the other in an upper secondary school. One English teacher and one bilingual class teacher have graduated from a pilot class teacher program in English that started at the University of Helsinki in the middle of the 1990 s. The bilingual subject teachers are not trained in English but they have learned English elsewhere, which is a particular focus of interest in this study because it is expected that a great number of CLIL teachers in Finland do not have actual studies in English philology. The research method is interview and this is a qualitative case study. The interviews are recorded and transcribed for the ease of analysis. The English teachers do not always use English in their lessons and they would not feel confident in teaching another subject completely in English. All of the CLIL teachers trust their English skills in teaching, but the bilingual class teachers also use Finnish during lessons either because some teaching material is in Finnish, or they feel that rules and instructions are understood better in mother tongue or students English skills are not strong enough. One of the bilingual subject teachers is the only one who consciously uses only English in teaching and in discussions with students. Although teachers good English skills are generally considered important, only the teachers who have graduated from the class teacher education in English consider it important that CLIL teachers would have studies in English philology. Regarding the subject teacher education program in English, the respondents hope that its teachers will have strong enough English skills and that it will deliver what it promises. Having student teachers of different subjects studying together is considered beneficial. The results of the study show that acquiring teaching material in English continues to be the teachers own responsibility and a huge burden for the teachers, and there has, in fact, not been much progress in the matter since the beginning of CLIL education. The bilingual subject teachers think, however, that using one s own material can give new inspiration to teaching and enable the use of various pedagogical methods. Although it is questionable if the language competence requirements set for CLIL teachers by the Finnish Ministry of Education are not adhered to, it becomes apparent in the study that studies in English philology do not necessarily guarantee strong enough language skills for CLIL teaching, but teachers own personality and self-confidence have significance. Keywords: CLIL, bilingual education, English, subject teacher training, subject teacher education in English, STEP

Fish tracking technology development. Phases 1 and 2, project definition desk study and equipment

The document reports on the major findings from a definition study to appraise the options to develop fish tracking equipment, in particular tags and data logging systems, in order to improve the effeciency of the Agency tracking studies and to obtain a greater understanding of fish biology. The definition study was in two parts. The first, Phase 1, collated and evaluated all the known tracking systems that may be suitable for studies of fish which are either produced commercially or have been constructed for specific in-house studies. Phase 2 was an evaluation of all the tracking equipment considered to merit further investigation in Phase 1. The deficiencies between existing and required technologies to improve the efficiency of Agency's tracking studies and to obtain a greater understanding of fish biology are also identified.

Morphometric study and length-weight relationship of Therapon jarbua, Forsskal

The different morphometric characters of Therapon jarbua showed a linear relationship and uniformity in the various biometric measurements whereas the length-weight relationship showed a curvilinear graph. The studies also indicate that there is no significant difference, in the morphometric characters and length-weight relationship between the males and females. Ponderal index values for males and females was found to fluctuate between 1.3 to 1.5 for most of their life times with the peaks and crests appearing at different lengths for males and females.

Disabled Children Negotiating School Life: Agency, Difference and Teaching Practice

This paper explores the school experiences of seven 11–14 year old disabled children, and focuses on their agency as they negotiated a complex, changing, and often challenging social world at school where “difference” was experienced in negative ways. The paper draws on ethnographic data from a wider three-year study that explores the influence of school experiences on both disabled and non-disabled children’s identity as they make the transition from primary to secondary school in regular New Zealand schools (although the focus of the present paper is only on the experiences of disabled children). The wider study considers how Maori (indigenous people of Aotearoa/New Zealand) and Pakeha (New Zealanders of NZ European descent) disabled children and their non- disabled matched peers (matched for age, gender and classroom) understand their personal identity, and how factors relating to transition (from primary to secondary school); culture; impairment (in the case of disabled children); social relationships; and school experience impact on children’s identities. Data on Maori children’s school experiences is currently being collected, and is not yet available for inclusion in this paper. On the basis of our observations in schools we will illustrate how disabled children felt and were made to feel different through an array of structural barriers such as separate provision for disabled students, and peer and teacher attitudes to diversity. However, we agree with Davis, Watson, Shakespeare and Corker’s (2003) interpretation that disabled children’s rights and participation at school are also under attack from a “deeper cultural division” (p. 205) in schools based on discourses of difference and normality. While disabled students in our study were trying to actively construct and shape their social and educational worlds, our data also show that teachers and peers have the capacity to either support or supplant these attempts to be part of the group of “all children”. We suggest that finding solutions that support disabled children’s full inclusion and participation at school requires a multi-faceted and systemic approach focused on a pedagogy for diverse learners, and on a consistent and explicitly inclusive policy framework centred on children’s rights.

Genetic susceptibility to invasive meningococcal disease: MBL2 structural polymorphisms revisited in a large case–control study and a systematic review

Invasive infection caused by Neisseria meningitidis is a worldwide public health problem. Previous reports have indicated that carriage of common ‘defective’ structural polymorphisms of the host mannose-binding lectin gene (MBL2) greatly increases an individual’s risk of developing the disease. We report the largest case–control study so far to investigate the effect of these polymorphisms in meningococcal disease (296 PCR-positive cases and 5196 population controls, all of European ancestry) and demonstrate that no change in risk is associated with the polymorphisms overall or in any age-defined subgroup. This finding contrasts with two smaller studies that reported an increase in risk. A systematic review of all studies of MBL2 polymorphisms in people of European ancestry published since 1999, including 24 693 individuals, revealed a population frequency of the combined ‘defective’MBL2 allele of 0.230 (95% confidence limits: 0.226–0.234). The past reported associations of increased risk of meningococcal disease were because of low ‘defective’ allele frequencies in their study control populations (0.13 and 0.04) that indicate systematic problems with the studies. The data from our study and all other available evidence indicate that MBL2 structural polymorphisms do not predispose children or adults to invasive meningococcal disease.

Genetic susceptibility to invasive meningococcal disease: MBL2 structural polymorphisms revisited in a large case-control study and a systematic review.

AbstractInvasive infection caused by Neisseria meningitidis is a worldwide public health problem. Previous reports have indicated that carriage of common 'defective' structural polymorphisms of the host mannose-binding lectin gene (MBL2) greatly increases an individual's risk of developing the disease. We report the largest case-control study so far to investigate the effect of these polymorphisms in meningococcal disease (296 PCR-positive cases and 5196 population controls, all of European ancestry) and demonstrate that no change in risk is associated with the polymorphisms overall or in any age-defined subgroup. This finding contrasts with two smaller studies that reported an increase in risk. A systematic review of all studies of MBL2 polymorphisms in people of European ancestry published since 1999, including 24 693 individuals, revealed a population frequency of the combined 'defective'MBL2 allele of 0.230 (95% confidence limits: 0.226-0.234). The past reported associations of increased risk of meningococcal disease were because of low 'defective' allele frequencies in their study control populations (0.13 and 0.04) that indicate systematic problems with the studies. The data from our study and all other available evidence indicate that MBL2 structural polymorphisms do not predispose children or adults to invasive meningococcal disease.