Formative evaluation for improving collaborative planning : a case study at the regional scale

In an earlier paper (Cameron & Johnson 2004) we introduced the idea of formative evaluation (or evaluation for development), the purpose of which is to provide information for improving planning programs and activities. This type of evaluation differs from the two other types: outcome evaluation which aims to judge the success or otherwise of a program; and evaluation for knowledge which seeks to contribute to theoretical work on planning processes and activities. In the earlier paper we also outlined the first stage of formative evaluation in the SEQ 2021 regional planning exercise showing how the process of planning for community engagement was modified in light of the evaluation findings. This current paper details the second stage of formative evaluation in which the collaborative planning component of SEQ 2021 was evaluated, as such it further demonstrates how formative evaluation can be used to improve planning programs. The evaluation findings also provide insights into strategies for more effective collaborative planning. We begin with an overview of collaborative approaches to regional planning, including the SEQ 2021 regional planning program. We then outline formal and informal evaluations of various collaborative regional planning exercises, including the predecessor of SEQ 2021 - SEQ 2001. This sets the scene for discussion of the approach used to evaluate the collaborative component of SEQ 2021. After outlining the main findings from the evaluation and the ways these findings were used to refine the collaborative planning process we conclude with a series of recommendations, relevant not only to SEQ 2021 but to other collaborative planning exercises

Writing eBooks to support first year students

A potential use of eBooks is to write them to specifically support first year students. Such eBooks have many advantages over published books, including tailored content and flexibility. One initiative was to write an eBook called “Getting Started” as part of a bridging course for 100-200 accelerated students in Nursing, who were about to have their first year at University at second year level. This was a formative activity to be undertaken by the students prior to the start of study. Another initiative was the writing of an eBook called “Pharmacology in One Semester”, which is available to all students, including the accelerated students, in a second year Unit. This is a plain English language version of pharmacology, which has been unpacked from the standard textbooks to improve the learning of the students. Both of these initiatives have been welcomed by the accelerated students.

A Strategy for supporting students given Advanced Standing into Nursing

A strategy for supporting students, given Advanced Standing into the second year of a Nursing degree in bioscience and pharmacology, is being rolled out at QUT.

Continuing success of a strategy to support accelerated nursing students at two diverse campuses

A strategy initiated in 2010 to support and improve the retention rate of diverse cohorts of accelerated nursing students at two QUT campuses continued to be successful in 2012. An additional procedure involving the formation of learning communities was trialled in 2012 to address the social dimension of learning and assist in enhancing the quality of accelerated nurse’s first year university experience. A supported formative assessment activity was planned to allow the students to collaborate in learning communities.

Surviving Bioscience and Pharmacology – an eBook for accelerated students in Nursing

An eBook to support accelerated nursing students is being developed at QUT. The first component of this is a formative activity comprising key bioscience and pharmacology concepts and self-help quizzes. This initiative has been reviewed favourably by the students. The eBook will also cover requisite academic skills and revision bioscience material.

Understanding the impact of legislative changes on child car seating and restraint practices in regional Queensland

Road crashes contribute to a significant amount of child mortality and morbidity in Australia. In fact, passenger injuries contribute to the majority of child crash road trauma. A number of factors contribute to child injury and death in motor vehicles, including inappropriate seating position, inappropriate choice of restraint, and incorrect installation and use of child restraints. Prior to March 2010, child restraint legislation in Queensland only required children twelve months and younger to be seated in a properly adjusted and fastened child restraint. This legislation left older infants and young children potentially suboptimally protected. From March 2010, new legislation specified seating position and type of child restraint required, depending on the age of the child. This research was underpinned by the Health Belief Model (HBM), which explores health related behaviour, behaviour change, environmental factors influencing behaviour change (including legislative changes) and is flexible enough to be used in relation to parents' health practices for their children, rather than parent health directly. This thesis investigates the extent to which the changes to child restraint legislation have led parents in regional areas of Queensland to use appropriate restraint practices for their children and determines the extent to which the constructs of the HBM, parental perceptions, barriers and environmental factors contribute to the appropriateness of child seating and restraint use. Study One included three sets of observations taken in two regional cities of Queensland prior to the legislative amendment, during an educative period of six months, and after the enactment of the legislation. Each child's seating position and restraint type were recorded. Results showed that the proportion of children observed occupying the front seat decreased by 15.6 per cent with the announcement the legislation. There was no decrease in front seat use at the enactment of the legislation. The proportion of children observed using dedicated child restraints increased by 8.8 per cent with the announcement of the legislation when there was one child in the vehicle. Further, there was a 10.1 per cent increase in the proportion of children observed using a seat belt that fit with the announcement when there was one child in the vehicle and with the enactment of the legislation regardless of the number of children in the vehicle (21.8 per cent for one child, 39.7 per cent for two children and 40.2 per cent for three or more children). Study Two comprised initial intercept interviews, later followed up by telephone, with parents with children aged eight years and younger at the announcement and telephone interviews at the enactment of the legislation in one regional city in Queensland. Parents reported their child restraint practices, and opinions, knowledge and understanding of the requirements of the new legislation. Parent responses were analysed in terms of the constructs in the HBM. When asked which seating position their child 'usually' used, parents reported child front seat use was nil (0.0 per cent) and did not change with the enactment of the legislative amendment. However, when parents were asked whether they allowed children to use the front seat at some point within the six months prior to the interview, reported child front seat use was 7 (5.4 per cent) children at T2 and 10 (9.6 per cent) at T3. Reported use of age-appropriate child restraints did not increase with the enactment of the legislation (p = 0.77, ns). Parents reported restraint practices were classed as either appropriate or inappropriate. Parents who reported appropriate restraint practices were those whose children were sitting in optimal restraints and seating positions for their age according to the requirements of the legislation. Parents who reported inappropriate restraint practices were those who had one or more children who were suboptimally restrained or seated for their age according to the requirements of the legislation. Neither parents' perceptions about their susceptibility of being in a crash nor the likelihood of severity of child injury if involved in a crash yielded significant differences in the appropriateness of reported parent restraint practices over time with the enactment of the legislation. A trend in the data suggested parents perceived a benefit to using appropriate restraint practices was to avoid fines and demerit points. Over 75 per cent of parents who agreed that child restraints provide better protection for children than an adult seat belt reported appropriately seating and restraining their children (2 (1) = 8.093, p<.05). The self-efficacy measure regarding parents' confidence in installing a child restraint showed a significant association with appropriate parental restraint practices (2 (1) = 7.036, p<.05). Results suggested that some parents may have misinterpreted the announcement of the legislative amendment as the announcement of the enforcement of the legislation instead. Some parents who correctly reported details of the legislation did not report appropriate child restraint practices. This finding shows that parents' knowledge of the legislative amendment does not necessarily have an impact on their behaviour to appropriately seat and restrain children. The results of these studies have important implications for road safety and the prevention of road-related injury and death to children in Queensland. Firstly, parents reported feeling unsure of how to install restraints, which suggests that there may be children travelling in restraints that have not been installed correctly, putting them at risk. Interventions to alert and encourage parents to seek advice when unsure about the correct installation of child restraints could be considered. Secondly, some parents in this study although they were using the most appropriate restraint for their children, reported using a type that was not the most appropriate restraint for the child's age according to the legislation. This suggests that intervention may be effective in helping parents make a more accurate choice of the most appropriate type of restraint to use with children, especially as the child ages and child restraint requirements change. Further research could be conducted to ascertain the most effective methods of informing and motivating parents to use the most appropriate restraints and seating positions for their children, as these results show a concerning disparity between reported restraint practices and those that were observed.

Middle schooling and scientific literacy : bringing the students to science

This study is about young adolescents' engagement in learning science. The middle years of schooling are critical in the development of students' interest and engagement with learning. Successful school experiences enhance dispositions towards a career related to those experiences. Poor experiences lead to negative attitudes and rejection of certain career pathways. At a time when students are becoming more aware, more independent and focused on peer relationships and social status, the high school environment in some circumstances offers more a content-centred curriculum that is less personally relevant to their lives than the social melee surrounding them. Science education can further exacerbate the situation by presenting abstract concepts that have limited contextual relevance and a seemingly difficult vocabulary that further alienates adolescents from the curriculum. In an attempt to reverse a perceived growing disinterest by students to science (Goodrum, Druhan & Abbs, 2011), a study was initiated based on a student-centred unit designed to enhance and sustain adolescent engagement in science. The premise of the study was that adolescent students are more responsive toward learning if they are given an appropriate learning environment that helps connect their learning with life beyond the school. The purpose of this study was to examine the experiences of young adolescents with the aim of transforming school learning in science into meaningful experiences that connected with their lives. Two areas were specifically canvassed and subsumed within the study to strengthen the design base. One area that of the middle schooling ideology, offered specific pedagogical approaches and a philosophical framework that could provide opportunities for reform. The other area, the construct of scientific literacy (OECD, 2007) as defined by Holbrook and Rannikmae, (2009) appeared to provide a sense of purpose for students to aim toward and value for becoming active citizens. The study reported here is a self-reflection of a teacher/researcher exploring practice and challenging existing approaches to the teaching of science in the middle years of schooling. The case study approach (Yin, 2003) was adopted to guide the design of the study. Over a 6-month period, the researcher, an experienced secondary-science teacher, designed, implemented and documented a range of student-centred pedagogical practices with a Year-7 secondary science class. Data for this case study included video recordings, journals, interviews and surveys of students. Both quantitative and qualitative data sources were employed in a partially mixed methods research approach (Leech & Onwuegbuzie, 2009) dominated by qualitative data with the concurrent collection of quantitative data to corroborate interpretations as a means of analysing and developing a model of the dynamic learning environment. The findings from the case study identified five propositions that became the basis for a model of a student-centred learning environment that was able to sustain student participation and thus engagement in science. The study suggested that adolescent student engagement can be promoted and sustained by providing a classroom climate that encourages and strengthens social interaction. Engagement in science can be enhanced by presenting developmentally appropriate challenges that require rigorous exploration of contextually relevant learning environments; supporting students to develop connections with a curriculum that aligns with their own experiences. By setting an environment empathetic to adolescent needs and understandings, students were able to actively explore phenomena collaboratively through developmentally appropriate experiences. A significant outcome of this study was the transformative experiences of an insider, the teacher as researcher, whose reflections provide an authentic model for reforming pedagogy. The model and theory presented became an adjunct to my repertoire for science teaching in the middle years of schooling. The study was rewarding in that it helped address a void in my understanding of middle years of schooling by prompting me to re-think the notion of adolescence in the context of the science classroom. This study is timely given the report "The Status and Quality of Year 11 and 12 Science in Australian Schools" (Goodrum, Druhan & Abbs, 2011) and national curricular changes that are being proposed for science (ACARA, 2009).

On-road driving studies to understand why drivers behave as they do at regional rail level crossings

Improving safety at rail level crossings is an important part of both road and rail safety strategies. While low in number, crashes between vehicles and trains at level crossings are catastrophic events typically involving multiple fatalities and serious injuries. Advances in driving assessment methods, such as the provision of on-road instrumented test vehicles with eye and head tracking, provide researchers with the opportunity to further understand driver behaviour at such crossings in ways not previously possible. This paper describes a study conducted to further understand the factors that shape driver behaviour at rail level crossings using instrumented vehicles. Twenty-two participants drove an On-Road Test Vehicle (ORTeV) on a predefined route in regional Victoria with a mix of both active (flashing lights with/without boom barriers) and passively controlled (stop, give way) crossings. Data collected included driving performance data, head checks, and interview data to capture driver strategies. The data from an integrated suite of methods demonstrated clearly how behaviour differs at active and passive level crossings, particularly for inexperienced drivers. For example, the head check data clearly show the reliance and expectancies of inexperienced drivers for active warnings even when approaching passively controlled crossings. These studies provide very novel and unique insights into how level crossing design and warnings shape driver behaviour.

A living laboratory proposition for revitalising regional Australia

A strong Small and Medium Enterprises (SMEs) sector is said to underpin a competitive advantage of the Australian regions that are struggling to grow the economy, distribute the growth fairly, and in the process not degrade the environment. The concept of Regional Innovation Systems that draws on industrial cluster theory has gained currency as an umbrella framework for enabling the SMEs sector. However, there are significant gaps between research and innovation of such ‘one-size-fits-all’ approach. This paper responds to this gap and proposes a Living Laboratory – an open multidisciplinary and multi-stakeholder action research platform where innovations can be co-created, tested, and evaluated in the every-day environment of SME – as a way to strengthen the SMEs sector in regional Australia.

The role of motivation and motivational strategies in Saudi students' communicative competence in English

This study explored how motivation and motivational strategies influence the communicative competence of students from Saudi Arabia. Participants included Saudi students enrolled in English courses in Australian educational institutions, and Saudi students living in Saudi Arabia studying in English language institutes in Saudi Arabia. Phase One involved interviews with16 participants. In Phase Two, 279 participants completed a questionnaire. Findings included differences between participants’ measured and self-reported communicative competence, with the Australian group having higher levels of measured and self-reported communicative competence. In addition, motivation teaching strategies were found to affect students’ motivation, but not their communicative competence.

Social enterprises and regional development : opportunities and constraints in Australia

This thesis examines the role of social enterprises in regional development and is based on comparative case studies of two regions in NSW. With a specific focus on 10 social enterprises, including both Indigenous and non-Indigenous organisations, 63 interviews were conducted with a wide range of community stakeholders. Utilising a decolonising methodological approach, the study examined the social and financial needs of these organisations, as well as their contributions as regional development actors.

Understanding VET teachers' dilemmas in providing quality education to international students in Brisbane

In the past fifteen years, increasing attention has been given to the role of Vocational Education and Training (VET) in attracting large numbers of international students and its contribution to the economic development of Australia. This trend has given rise to many challenges in vocational education, especially with regard to providing quality education that ensures international students' stay in Australia is a satisfactory experience. Teaching and learning is continuously scrutinized, teaching quality and student assessment are subject to regular audit (Takerei, 2010). VET teachers are key stakeholders in international education and share responsibility for ensuring international students gain quality learning experiences and positive outcomes, however, their experiences are generally not well understood. Therefore, this thesis, investigates particular challenges and associated dilemmas that VET teachers experience when teaching international students. The research participants were 15 teachers from several public and private VET institutions in Brisbane, Australia. The method involved responsive interviewing and inductive data analysis to identify and categorize teachers' challenges and dilemmas. The research reveals qualitatively different ways in which the 15 VET educators experienced challenges and associated dilemmas in their culturally diverse teaching context. The research shows that VET teachers experience numerous challenges and various inter-related professional, educational and personal dilemmas. These dilemmas result from ethical tensions teachers experience in their interactions with international students, teaching colleagues and their employment institutions. The dilemmas are often influenced by current economic and political conditions of international education. The dilemmas raised in the study by 15 VET teachers might be familiar to other teachers in VET and universities but to date they have received limited attention by researchers. This study's findings indicate significant implications for VET teachers, students, VET institutions and the government at a time of rapid economic, political, cultural and educational change. The findings are of potential interest to VET policy makers, managers and teachers. By giving voice to VET teachers, who are key stakeholders in the sustainability and future growth of VET, they contribute evidence for ongoing review and development of quality learning and teaching in the culturally diverse VET sector.

The impact of a social-cognitive teaching strategy on students with learning difficulties

This study examined the impact of a social-cognitive teaching strategy, the community of inquiry, on the functioning of six Year 4 students with learning difficulties. Results indicated that the students became more self-regulated in their learning and developed greater academic self-efficacy and stronger reading comprehension skills. Although the degree of development varied across the group, the results indicated that all six students (in addition to their class peers) benefited from actively engaging in scaffolded opportunities for intellectual and social exchange in a whole class setting. Accordingly, the findings of this study have implications for approaches to supporting the development and learning of students with learning difficulties.

The recruitment of STEM-talented students into teacher education programs

This paper begins by identifying three main reasons why many of the more STEM-Talented students at our universities do not consider enrolling in STEM teacher education programs. Then based on a review of the literature, a framework for addressing this dilemma is presented and discussed. This framework consists of a set of three principles together with eleven strategies for the operationalization of these principles. During the presentation of the framework, the roles of governments and of universities at the institutional, faculty/division and departmental levels in the operationalization of the framework are examined.

Students' cultural capital : a study of assessment for learning as a field of exchange

This study was conducted within the context of a flexible education institution where conventional educational assessment practices and tests fail to recognise and assess the creativity and cultural capital of a cohort of marginalised young people. A new assessment model which included an electronic-portfolio-social-networking system (EPS) was developed and trialled to identify and exhibit evidence of students' learning. The study aimed to discern unique forms of cultural capital (Bourdieu, 1986) possessed by students who attend the Edmund Rice Education Australia Flexible Learning Centre Network (EREAFLCN). The EPS was trialled at the case study schools in an intervention and developed a space where students could make evident culturally specific forms of capital and funds of knowledge (Gonzalez, Moll, & Amanti, 2005). These resources were evaluated, modified and developed through dialogic processes utilising assessment for learning approaches (Qualifications and Curriculum Development Agency, 2009) in online and classroom settings. Students, peers and staff engaged in the recognition, judgement, revision and evaluation of students' cultural capital in a subfield of exchange (Bourdieu, 1990). The study developed the theory of assessment for learning as a field of exchange incorporating an online system as a teaching and assessment model. The term efield has been coined to describe this particular capital exchange model. A quasi-ethnographic approach was used to develop a collective case study (Stake, 1995). This case study involved an in-depth exploration of five students' forms of cultural capital and the ways in which this capital could be assessed and exchanged using the efield model. A comparative analysis of the five cases was conducted to identify the emergent issues of students' recognisable cultural capital resources and the processes of exchange that can be facilitated to acquire legitimate credentials for these students in the Australian field of education. The participants in the study were young people at two EREAFLC schools aged between 12 and 18 years. Data was collected through interviews, observations and examination of documents made available by the EREAFLCN. The data was coded and analysed using a theoretical framework based on Bourdieu's analytical tools and a sociocultural psychology theoretical perspective. Findings suggest that processes based on dialogic relationships can identify and recognise students' forms of cultural capital that are frequently misrecognised in mainstream school environments. The theory of assessment for learning as a field of exchange was developed into praxis and integrated in an intervention. The efield model was found to be an effective sociocultural tool in converting and exchanging students' capital resources for legitimated cultural and symbolic capital in the field of education.