Kaleidoscope : Reframing learning and teaching evaluation through a shared stakeholder lens

Sector wide interest in Reframe: QUT’s Evaluation Framework continues with a number of institutions requesting finer details as QUT embeds the new approach to evaluation across the university in 2013. This interest, both nationally and internationally has warranted QUT’s collegial response to draw upon its experiences from developing Reframe into distilling and offering Kaleidoscope back to the sector. The word Reframe is a relevant reference for QUT’s specific re-evaluation, reframing and adoption of a new approach to evaluation; whereas Kaleidoscope reflects the unique lens through which any other institution will need to view their own cultural specificity and local context through an extensive user-led stakeholder engagement approach when introducing new approaches to learning and teaching evaluation. Kaleidoscope’s objectives are for QUT to develop its research-based stakeholder approach to distil the successful experience exhibited in the Reframe Project into a transferable set of guidelines for use by other tertiary institutions across the sector. These guidelines will assist others to design, develop, and deploy, their own culturally specific widespread organisational change informed by stakeholder engagement and organisational buy-in. It is intended that these guidelines will promote, support and enable other tertiary institutions to embark on their own evaluation projects and maximise impact. Kaleidoscope offers an institutional case study of widespread organisational change underpinned by Reframe’s (i) evidence-based methodology; (ii) research including published environmental scan, literature review (Alderman, et al., 2012), development of a conceptual model (Alderman, et al., in press 2013), project management principles (Alderman & Melanie, 2012) and national conference peer reviews; and (iii) year-long strategic project with national outreach to collaboratively engage the development of a draft set of National Guidelines. Kaleidoscope’s aims are to inform Higher Education evaluation policy development through national stakeholder engagement, the finalisation of proposed National Guidelines. In correlation with the conference paper, the authors will present a Draft Guidelines and Framework ready for external peer review by evaluation practitioners from the Higher Education sector, as part of Kaleidoscope’s dissemination strategy (Hinton & Gannaway, 2011) applying illuminative evaluation theory (Parlett & Hamilton, 1976), through conference workshops and ongoing discussions (Shapiro, et al., 1983; Jacobs, 2000). The initial National Guidelines will be distilled from the Reframe: QUT’s Evaluation Framework’s Policy, Protocols, and incorporated Business Rules. It is intended that the outcomes of Kaleidoscope are owned by and reflect sectoral engagement, including iterative evaluation through multiple avenues of dissemination and collaboration including the Higher Education sector. The dissemination strategy with the inclusion of Illuminative Evaluation methodology provides an inclusive opportunity for other institutions and stakeholders across the Higher Education sector to give voice through the information-gathering component of evaluating the draft Guidelines, providing a comprehensive understanding of the complex realities experienced across the Higher Education sector, and thereby ‘illuminating’ both the shared and unique lenses and contexts. This process will enable any final guidelines developed to have broader applicability, greater acceptance, enhanced sustainability and additional relevance benefiting the Higher Education sector, and the adoption and adaption by any single institution for their local contexts.

A wound management education and training needs analysis of health consumers and the relevant health workforce and stocktake of available education and training activities and resources

The goals of this project were to determine the education and training needs of health consumers and the relevant health workforce and to identify and map the available education and training activities and resources. The methods used to collect the data included online surveys and one on one interviews of relevant patients and their carers. The project manager actively sought to engage with the key wound management leaders and advanced clinicians to gain their support and views on the priority education and training issues. The response to all data collection methods was pleasing with almost five hundred responses to the general wound workforce online survey. The data supported the need for more wound management education and training and identified some particular topics of need, such as utilising wound investigations and understanding wound products, pharmaceuticals and devices. The occupational groups with the highest need appear to be those working in primary health care, such as practice nurses and GPs, and those working in residential aged care facilities. The education and training stocktake identified a wide range of activities currently available, the majority being provided in a face to face format. The next stage of the project will be to form some clear and achievable priority action areas based on the available data. An online directory of wound management education and training activities and resources will be developed and further development will be undertaken on a knowledge and skills framework for the wound management workforce. Additionally, transfer of learning factors in the general practice environment will be assessed and strategies will be developed to improve the pre-entry or undergraduate wound management training within relevant higher education programs.

A critical analysis of business process management education and alignment with industry demand : an Australian perspective

Business Process Management (BPM) is accepted globally as an organizational approach to enhance productivity and drive cost efficiencies. Studies confirm a shortage of BPM skilled professionals with limited opportunities to develop the required BPM expertise. This study investigates this gap starting from a critical analysis of BPM courses offered by Australian universities and training institutions. These courses were analyzed and mapped against a leading BPM capability framework to determine how well current BPM education and training offerings in Australia address the core capabilities required by BPM professionals globally. To determine the BPM skill-sets sought by industry, online recruitment advertisements were collated, analyzed, and mapped against this BPM capability framework. The outcomes provide a detailed overview on the alignment of available BPM education/training and industry demand. These insights are useful for BPM professionals and their employers to build awareness of the BPM capabilities required for a BPM mature organization. Universities and other training institutions will benefit from these results by understanding where demand is, where the gaps are, and what other BPM education providers are supplying. This structured comparison method could continue to provide a common ground for future discussion across university-industry boundaries and continuous alignment of their respective practices.

A state-wide systems approach to embedding the learning and teaching of sustainability in teacher education

Education systems have a key role to play in preparing future citizens to engage in sustainable living practices and help create a more sustainable world. Many schools throughout Australia have begun to develop whole-school approaches to sustainability education that are supported by national and state policies and curriculum frameworks. Preservice teacher education, however, lags behind in building the capacity of new teachers to initiate and implement such approaches (ARIES, 2010). This proposed project seeks to develop a state-wide systems approach to embedding Education for Sustainability (EfS) in teacher education that is aligned with the Australian National Curriculum and the aspirations for EfS in the Melbourne Declaration and other national documents. Representatives from all teacher education institutions and other agents of change in the Queensland education system will be engaged in a multilevel systems approach, involving collaboration at the state, institutional and course levels, to develop curriculum practices that reflect a shared vision of EfS.

Differences in physical activity between black and white girls living in rural and urban areas

This study examined the relationship of race and rural/urban setting to physical, behavioral, psychosocial, and environmental factors associated with physical activity. Subjects included 1,668 eighth-grade girls from 31 middle schools: 933 from urban settings, and 735 from rural settings. Forty-six percent of urban girls and 59% of rural girls were Black. One-way and two-way ANOVAs with school as a covariate were used to analyze the data. Results indicated that most differences were associated with race rather than setting. Black girls were less active than White girls, reporting significantly fewer 30-minute blocks of both vigorous and moderate-to-vigorous physical activity. Black girls also spent more time watching television, and had higher BMIs and greater prevalence of overweight than White girls. However, enjoyment of physical education and family involvement in physical activity were greater among Black girls titan White girls. Rural White girls and urban Black girls had more favorable attitudes toward physical activity. Access to sports equipment, perceived safety of neighborhood, and physical activity self-efficacy were higher in White girls than Black girls.

Adherence to physical activity and electronic media guidelines in Australian pre-school children

The aim of this study was to determine compliance with the National Association for Sport and Physical Education (NASPE) guideline for physical activity and American Academy of Pediatrics (AAP) recommendation for electronic media use among urban pre-school children in two large cities on the East Coast of Australia. Cross-sectional data were collected from 266 parents. Time spent using electronic media (watching television, DVDs or on the computer) and in physical activity were parent reported. The proportion who met each guideline was calculated. 56 per cent and 79% of children met the NASPE guideline on weekdays and weekends, respectively, while 73% and 70% met the AAP recommendation on weekdays and weekends, with no difference between boys and girls. A substantial minority do not meet physical activity and electronic media use recommendations, highlighting the need to better understand what factors contribute to physical activity and electronic media use among this group of pre-schoolers.

A peaking and tailing approach to education and curriculum renewal for sustainable development

Contextual factors for sustainable development such as population growth, energy, and resource availability and consumption levels, food production yield, and growth in pollution, provide numerous complex and rapidly changing education and training requirements for a variety of professions including engineering. Furthermore, these requirements may not be clearly understood or expressed by designers, governments, professional bodies or the industry. Within this context, this paper focuses on one priority area for greening the economy through sustainable development—improving energy efficiency—and discusses the complexity of capacity building needs for professionals. The paper begins by acknowledging the historical evolution of sustainability considerations, and the complexity embedded in built environment solutions. The authors propose a dual-track approach to building capacity building, with a short-term focus on improvement (i.e., making peaking challenges a priority for postgraduate education), and a long-term focus on transformational innovation (i.e., making tailing challenges a priority for undergraduate education). A case study is provided, of Australian experiences over the last decade with regard to the topic area of energy efficiency. The authors conclude with reflections on implications for the approach.

Framing student evaluations of university learning and teaching : discursive strategies and textual outcomes

Evaluation in higher education is an evolving social practice, that is, it involves what people, institutions and broader systems do and say, how they do and say it, what they value, the effects of these practices and values, and how meanings are ascribed. The textual products (verbal, written, visual, gestural) that inform and are produced by, for and through evaluative practices are important as they promulgate particular kinds of meanings and values in specific contexts. This paper reports on an exploratory study that sought to investigate, using discourse analysis, the types of evaluative practices that were ascribed value, and the student responses that ensued, in different evaluative instruments. Findings indicate that when a reflective approach is taken to evaluation, students’ responses are more considered, they interrogate their own engagement in the learning context and they are more likely to demonstrate reconstructive thought. These findings have implications for reframing evaluation as reflective learning.

Feeling the pressure: Early childhood educators’ reported views about learning and teaching phonics in Australian prior-to-school settings

Early childhood educators’ beliefs about literacy teaching can impact on the types of phonics experiences educators provide for children in prior-to-school settings. The Australian Early Years Learning Framework supports a play-based, intentional approach to teaching phonics, however little is known about what Australian early childhood educators believe is important in teaching phonics in the prior-to-school years. Using a qualitative content analysis, this research study investigates 115 early childhood educators’ views about how phonics should be taught and the use of commercially produced phonics programs (e.g. Jolly Phonics and Letterland) in prior-to-school settings. This study further investigates educators’ perceived pressures to include structured phonics lessons, as a way of addressing parental notions of ‘school readiness’. The results of this study indicate conflicting views were held about how phonics should be taught. Some educators also experienced external pressures to engage in literacy practices that may be in opposition with their own beliefs about how literacy is learnt. This study provides insights into the pedagogical practices early childhood educators believe are appropriate when teaching phonics. The educational implications are discussed.

Medical education and law: Withholding/withdrawing treatment from adults without capacity

BACKGROUND Law is increasingly involved in clinical practice, particularly at the end of life, but undergraduate and postgraduate education in this area remains unsystematic. We hypothesised that attitudes to and knowledge of the law governing withholding/withdrawing treatment from adults without capacity (the WWLST law) would vary and demonstrate deficiencies among medical specialists. AIMS We investigated perspectives, knowledge and training of medical specialists in the three largest (populations and medical workforces) Australian states, concerning the WWLST law. METHODS Following expert legal review, specialist focus groups, pre-testing and piloting in each state, seven specialties involved with end-of-life care were surveyed, with a variety of statistical analyses applied to the responses. RESULTS Respondents supported the need to know and follow the law. There were mixed views about its helpfulness in medical decision-making. Over half the respondents conceded poor knowledge of the law; this was mirrored by critical gaps in knowledge that varied by specialty. There were relatively low but increasing rates of education from the undergraduate to continuing professional development (CPD) stages. Mean knowledge score did not vary significantly according to undergraduate or immediate postgraduate training, but CPD training, particularly if recent, resulted in greater knowledge. Case-based workshops were the preferred CPD instruction method. CONCLUSIONS Teaching of current and evolving law should be strengthened across all stages of medical education. This should improve understanding of the role of law, ameliorate ambivalence towards the law, and contribute to more informed deliberation about end-of-life issues with patients and families.

Skilling up for a low-carbon future: Vocational education and training

Given the need for both short and long-term training for sustainability discussed in the first of this three-part series (ECOS 158, pp 22–24), it is clear that the vocational education and training sector will play a major role in building capacity for our nation over the next five years.

The paradox of creative uncertainty in learning and teaching

In an ever-changing and globalised world there is a need for higher education to adapt and evolve its models of learning and teaching. The old industrial model has lost traction, and new patterns of creative engagement are required. These new models potentially increase relevancy and better equip students for the future. Although creativity is recognised as an attribute that can contribute much to the development of these pedagogies, and creativity is valued by universities as a graduate capability, some educators understandably struggle to translate this vision into practice. This paper reports on selected survey findings from a mixed methods research project which aimed to shed light on how creativity can be designed for in higher education learning and teaching settings. A social constructivist epistemology underpinned the research and data was gathered using survey and case study methods. Descriptive statistical methods and informed grounded theory were employed for the analysis reported here. The findings confirm that creativity is valued for its contribution to the development of students’ academic work, employment opportunities and life in general; however, tensions arise between individual educator’s creative pedagogical goals and the provision of institutional support for implementation of those objectives. Designing for creativity becomes, paradoxically, a matter of navigating and limiting complexity and uncertainty, while simultaneously designing for those same states or qualities.

Transforming higher education and student engagement through collaborative review to inform educational design

This paper reports on staff perceptions arising from a review process designed to assist staff in making informed decisions regarding educational design, approaches to engage students in learning, and the technology to support engagement in the classroom and across multiple locations and delivery modes. The aim of the review process was to transform the level of student engagement in the business faculty of an Australian university. The process took a collaborative approach through consultation with academic staff involved in the design and delivery of the units under review, and included targeted professional development as necessary. An institutional framework that characterises engagement indicator contexts and their attributes facilitated dialog during the review process. This paper reports on a mixed method study that included a survey of participants, and purposeful interviews to evaluate the effectiveness of the process. Although the study identified factors that hindered implementation and operationalization of review recommendations in some instances, study participants were generally of the view that recommendations would enhance student engagement. It is demonstrated that the bottom-up approach described in this paper is consistent with theoretical frameworks for transformational change in teaching and learning and the adoption of innovations.