Reframing evaluation of learning and teaching: An approach to change

Evaluation practices in the Higher Education sector have been criticised for having unclear purpose and principles; ignoring the complexity and changing nature of learning and teaching and the environments in which they occur; relying almost exclusively on student ratings of teachers working in classroom settings; lacking reliability and validity; using data for inappropriate purposes; and focusing on accountability and marketing rather than the improvement of learning and teaching. In response to similar criticism from stakeholders, in 2011 Queensland University of Technology (QUT) began a project which aims to reframe the organisation’s approach to the evaluation of learning and teaching. This paper describes the existing evaluation system; the emergence and early development of the project; and formulation of a conceptual framework identifying key dimensions of evaluation. It then compares the draft framework with other conceptualisations and models of evaluation identified in the literature, to determine its validity and suitability for supporting QUT’s plans for the future. Overall, the paper represents a structured evaluation of the REFRAME project at a particular point in its lifecycle. Given that the project follows an evidence based, practice-led process and applies an ongoing action research cycle, the findings are presented in the belief that QUT’s experience is broadly applicable to other institutions which may be contemplating change in relation to evaluation of learning and teaching.

Art in early childhood : the discourse of 'proper' teaching

This thesis is a problematisation of the teaching of art to young children. To problematise a domain of social endeavour, is, in Michel Foucault's terms, to ask how we come to believe that "something ... can and must be thought" (Foucault, 1985:7). The aim is to document what counts (i.e., what is sayable, thinkable, feelable) as proper art teaching in Queensland at this point ofhistorical time. In this sense, the thesis is a departure from more recognisable research on 'more effective' teaching, including critical studies of art teaching and early childhood teaching. It treats 'good teaching' as an effect of moral training made possible through disciplinary discourses organised around certain epistemic rules at a particular place and time. There are four key tasks accomplished within the thesis. The first is to describe an event which is not easily resolved by means of orthodox theories or explanations, either liberal-humanist or critical ones. The second is to indicate how poststructuralist understandings of the self and social practice enable fresh engagements with uneasy pedagogical moments. What follows this discussion is the documentation of an empirical investigation that was made into texts generated by early childhood teachers, artists and parents about what constitutes 'good practice' in art teaching. Twenty-two participants produced text to tell and re-tell the meaning of 'proper' art education, from different subject positions. Rather than attempting to capture 'typical' representations of art education in the early years, a pool of 'exemplary' teachers, artists and parents were chosen, using "purposeful sampling", and from this pool, three videos were filmed and later discussed by the audience of participants. The fourth aspect of the thesis involves developing a means of analysing these texts in such a way as to allow a 're-description' of the field of art teaching by attempting to foreground the epistemic rules through which such teacher-generated texts come to count as true ie, as propriety in art pedagogy. This analysis drew on Donna Haraway's (1995) understanding of 'ironic' categorisation to hold the tensions within the propositions inside the categories of analysis rather than setting these up as discursive oppositions. The analysis is therefore ironic in the sense that Richard Rorty (1989) understands the term to apply to social scientific research. Three 'ironic' categories were argued to inform the discursive construction of 'proper' art teaching. It is argued that a teacher should (a) Teach without teaching; (b) Manufacture the natural; and (c) Train for creativity. These ironic categories work to undo modernist assumptions about theory/practice gaps and finding a 'balance' between oppositional binary terms. They were produced through a discourse theoretical reading of the texts generated by the participants in the study, texts that these same individuals use as a means of discipline and self-training as they work to teach properly. In arguing the usefulness of such approaches to empirical data analysis, the thesis challenges early childhood research in arts education, in relation to its capacity to deal with ambiguity and to acknowledge contradiction in the work of teachers and in their explanations for what they do. It works as a challenge at a range of levels - at the level of theorising, of method and of analysis. In opening up thinking about normalised categories, and questioning traditional Western philosophy and the grand narratives of early childhood art pedagogy, it makes a space for re-thinking art pedagogy as "a game oftruth and error" (Foucault, 1985). In doing so, it opens up a space for thinking how art education might be otherwise.

Feeling the pressure: Early childhood educators’ reported views about learning and teaching phonics in Australian prior-to-school settings

Early childhood educators’ beliefs about literacy teaching can impact on the types of phonics experiences educators provide for children in prior-to-school settings. The Australian Early Years Learning Framework supports a play-based, intentional approach to teaching phonics, however little is known about what Australian early childhood educators believe is important in teaching phonics in the prior-to-school years. Using a qualitative content analysis, this research study investigates 115 early childhood educators’ views about how phonics should be taught and the use of commercially produced phonics programs (e.g. Jolly Phonics and Letterland) in prior-to-school settings. This study further investigates educators’ perceived pressures to include structured phonics lessons, as a way of addressing parental notions of ‘school readiness’. The results of this study indicate conflicting views were held about how phonics should be taught. Some educators also experienced external pressures to engage in literacy practices that may be in opposition with their own beliefs about how literacy is learnt. This study provides insights into the pedagogical practices early childhood educators believe are appropriate when teaching phonics. The educational implications are discussed.

A longitudinal study of motivation and competence in children with Down syndrome : early childhood to early adolescence

Background Motivation has been identified as an area of difficulty for children with Down syndrome. Although individual differences in mastery motivation are presumed to have implications for subsequent competence, few longitudinal studies have addressed the stability of motivation and the predictive validity of early measures for later academic achievement, especially in atypical populations. Method The participants were 25 children with Down syndrome. Mastery motivation, operationalised as persistence, was measured in early childhood and adolescence using tasks and parent report. At the older age, preference for challenge, another aspect of mastery motivation, was also measured and the children completed assessments of academic competence. Results There were significant concurrent correlations among measures of persistence at both ages, and early task persistence was associated with later persistence. Persistence in early childhood was related to academic competence in adolescence, even when the effects of cognitive ability at the younger age were controlled. Conclusions For children with Down syndrome, persistence appears to be an individual characteristic that is relatively stable from early childhood to early adolescence. The finding that early mastery motivation is significant for later achievement has important implications for the focus of early interventions.

Teaching design thinking and design led innovation to non-designers : a tertiary facilitator multidisciplinary study

This paper aims to address the knowledge gap in regards to the potential intermediary role tertiary institutions can play in developing generic design thinking/design led innovation capabilities in non-designers. Specifically, it investigates the value derived from the contribution of postgraduate design students as facilitators/educators for undergraduate non-design student cohorts. It examines a design immersion workshop designed to encourage the use of design thinking capabilities for project brief development for undergraduate multi-disciplinary student teams involved in a community service learning project for a social enterprise. The workshop was facilitated by design led innovation masters students embedded in industry organisations to research the integration of design led innovation capabilities in business. Data was collected from participating non-design students and postgraduate facilitators’ in the form of reflective journals and semi-structured interviews. The thematic analysis provided insight into the value of design thinking/design led innovation immersion programs for both the postgraduate facilitators and the undergraduate non-design students. The research results will inform a tentative foundation prototype framework to allow for ongoing program developments and research in design thinking/design led innovation integration in higher education, facilitating the development of generic capabilities required to empower future generations for business innovation and active citizenship in the 21st century knowledge economy.

What works and why? Early childhood professionals' perspectives on effective early childhood education and care services for Indigenous families

Investment in early childhood education and care (ECEC) programs is a cornerstone policy of the Australian Government directed toward increasing the educational opportunities and life chances made available to Australian Aboriginal and Torres Strait Islander (Indigenous) children. Yet, ECEC programs are not always effective in supporting sustained attendance of Indigenous families. A site-case analysis of Mount Isa, Queensland was conducted to identify program features that engage and support attendance of Indigenous families. This first study, reports the perspectives of early childhood professionals from across the entire range of group-based licensed (kindergarten and long day care) and non-licensed (playgroups, parent-child education) programs (n=19). Early childhood professionals reported that Indigenous families preferred non-licensed over licensed programs. Reasons suggested for this choice were that non-licensed services provided integration with family supports, were responsive to family circumstance and had a stronger focus on relationship building. Implications for policy and service provision are discussed.

How well are Australian infants and children aged 4 to 5 years doing? Findings from the Longitudinal Study of Australian Children Wave 1

This report presents an analysis of the data from the first wave of the Longitudinal Study of Australian Children (LSAC) to explore the wellbeing of 5,107 children in the infant cohort of the study and the 4,983 children, aged 4 to 5 years, in the child cohort. Wave 1 of LSAC includes measures of multiple aspects of children’s early development. These developmental measures are summarised in the LSAC Outcome Index, a composite measure which includes an overall index as well as three separate domain scores, tapping physical development, social and emotional functioning, and learning and cognitive development.