An evaluation framework for sustaining the impact of educational development

Notwithstanding significant efforts by international aid agencies, aid ineffectiveness became apparent in 1990s as the impact of continued development intervention did not endure the expected outcomes. Conventional monitoring and evaluation by those agencies is critiqued for focusing on measuring project outcomes and giving little attention to aspects of sustainability. As a result, devising a rigorous evaluation framework for educational development has been sought in light of recent paradigm shifts in international development. This paper reports on a case study of an Egyptian educational development project highlighting the importance of transforming the evaluation procedures to process evaluation so as to enhance project impact and longevity. This requires building evaluation capacity of the aid recipient country.

Exporting educational services : an Australian university’s experience in delivering offshore project management programs

Increasingly, Australian universities are facing the challenges of global education. While overseas students studying in Australia provide the primary source of export earnings for educational institutions, a number of institutions, including QUT, are also involved in international trade in educational services by providing services offshore. This paper discusses driving forces behind moves by Australian universities to enter the international education market. It then briefly describes Queensland University of Technology’s internationalisation strategy. The paper concludes with a case study describing how the School of Construction Management has pioneered the development of offshore courses at QUT. The introduction of the Master of Project Management and Graduate Diploma of Project Management programs in Singapore in November 1993 represented QUT’s first experience in this area. With the experience of 18 months of operation, the School now has the opportunity to reflect on the outcomes of this venture and consider future options.

Generalising across borders : policy and the limits of educational science.

AERA Distinguished Lecture, Annual Meetings of the American Educational Research Association, New Orleans, 8 April 2011. How well does educational policy, innovation and science cross borders? What are the parameters of a generalisable cultural science of education? What constitutes a principled policy 'borrowing'?

Design for inspiration : children, personal connections and educational technology

The project is working towards building an understanding of the personal interests and experiences of children with the aim of designing appropriate, usable and, most importantly, inspirational educational technology. kidprobe, an adaptation of the technology probe concept, has been used as a lightweight method of gaining contextual information about children's interactions with 'fun' technology. kidprobe has produced design inspiration which focuses primarily on the social and emotional connections children made. The use of kidprobe has generated some important ideas for improving the use of probes with children. It is an important first step in understanding how to effectively adapt probing techniques to inspire the design of technology for children.

Educational policy for citizenship in the early years in Australia

This paper explores how young children are constructed in educational policy for citizenship in Australia, investigating tensions between early childhood educational discourses that construct young children as active citizens and the broader discourses of citizenship in Australian educational policy. There is a widespread discourse within early childhood education that regards young children as citizens and democratic participants in their own lives. This view is a reflection of the oft cited Article 12 in the UN Convention on the Rights of the Child (UNCRC 1989). However, educational policy and curriculum for citizenship in Australia, by and large, adheres to age and stage understandings of children, implicitly deeming young children unable to conceptualise abstract ideas of what it means to ‘be a good citizen’. This paper is located in the borders and intersections between discourses of early childhood education, young children as active participants in their own lives and what it means to be an active citizen in Australia. We are concerned with the interweaving of these ideas and how they are played out in educational policy making. This is an important perspective to take for governing and policy making are exercises in harnessing existing ideas and discourses, thereby rendering strategies and tactics for managing populations thinkable and sayable (Rose 1999). The ‘views from the margins’ (Burman 2008, p. 7) can provide alternative perspectives on policymaking, illuminating discursive tactics and strategies.

Assessment reform and educational change in Australia

This chapter addresses the changing climate of assessment policy and practice in Australia in response to global trends in education and the mounting accountability demands of standards-driven reform. Queensland, a State of Australia, has a tradition of respecting and trusting teacher judgment through the practice of, and policy commitment to, externally moderated school-based assessment. This chapter outlines the global trends in curriculum and assessment reform, and then analyzes the impact of international comparisons on national policy. The creation of the Australian Curriculum, Assessment and Reporting Authority (ACARA) together with the intent of establishing a standards-referenced framework raises tensions and challenges for teachers’ practice. The argument for sustaining confidence in teacher-based assessment is developed with reference to research evidence pertaining to the use of more authentic assessments and moderation practices for the purposes of improving learning, equity and accountability. Evidence is drawn from local studies of teacher judgment practice and used to demonstrate these developments and in so doing illuminate the complex issues of engaging the demands of policy while sustaining confidence in teacher assessment.

Restructuring instructional material in vocational education to enhance learning

This paper reviews research findings regarding the design of instructional material and its effectiveness in facilitating learning. Firstly, a discussion of memory processes engaged in when learning from different types of instructional material is presented. Secondly, referring to empirical research, the implications of the above discussion for vocational education instruction, and in particular, for engineering graphics, CNC programming and learning to use equipment from manuals are presented.

International regional planning educational experience : learnings from Malaysia, Korea and Turkey study trips

In an era of rapidly changing economic, social and environmental conditions, urban and regional planning education must be resilient, innovative and able to deal with the complex political and socio-economic fabric of post-modern cities. As a consequence, urban and regional planning education plays a fundamental role in educating and forming planning practitioners that will be able to tackle such complexity. However, not many tertiary education institutions provide a trans-cultural engagement opportunity for students, where the need to internationalise planning education has been widely recognised worldwide. The aim of this paper is to communicate the findings of three overseas study trips (Kuala Lumpur-Malaysia, Daejeon-Korea, Istanbul and Gallipoli-Turkey) that students of Queensland University of Technology are taken to where these study trips trailed the provision of an innovative tertiary education experience of teaching regional planning in an international context. The findings of the pedagogic analyses of the study reveal that the exposure of students to different planning processes and practices give them a new outlook on what they knew from their own country and provide them with useful insights on international planning issues and cultural differences and barriers.

An examination of the relationship between emotional intelligence, leadership style and perceived leadership outcomes in Australian educational institutions

In the field of leadership studies transformational leadership theory (e.g., Bass, 1985; Avolio, Bass, & Jung, 1995) has received much attention from researchers in recent years (Hughes, Ginnet, & Curphy, 2009; Hunt, 1999). Many previous studies have found that transformational leadership is related to positive outcomes such as the satisfaction, motivation and performance of followers in organisations (Judge & Piccolo, 2004; Lowe, Kroeck, & Sivasubramaniam, 1996), including in educational institutions (Chin, 2007; Leithwoood & Jantzi, 2005). Hence, it is important to explore constructs that may predict leadership style in order to identify potential transformational leaders in leadership assessment and selection procedures. Several researchers have proposed that emotional intelligence (EI) is one construct that may account for hitherto unexplained variance in transformational leadership (Mayer, 2001; Watkin, 2000). Different models of EI exist (e.g., Goleman, 1995, 2001; Bar-On, 1997; Mayer & Salovey, 1997) but momentum is growing for the Mayer and Salovey (1997) model to be considered the most useful (Ashkanasy & Daus, 2005; Daus & Ashkanasy, 2005). Studies in non-educational settings claim to have found that EI is a useful predictor of leadership style and leader effectiveness (Harms & Crede, 2010; Mills, 2009) but there is a paucity of studies which have examined the Mayer and Salovey (1997) model of EI in educational settings. Furthermore, other predictor variables have rarely been controlled in previous studies and only self-ratings of leadership behaviours, rather than multiple ratings, have usually been obtained. Therefore, more research is required in educational settings to answer the question: to what extent is the Mayer and Salovey (1997) model of EI a useful predictor of leadership style and leadership outcomes? This project, set in Australian educational institutions, was designed to move research in the field forward by: using valid and reliable instruments, controlling for other predictors, obtaining an adequately sized sample of real leaders as participants and obtaining multiple ratings of leadership behaviours. Other variables commonly used to predict leadership behaviours (personality factors and general mental ability) were assessed and controlled in the project. Additionally, integrity was included as another potential predictor of leadership behaviours as it has previously been found to be related to transformational leadership (Parry & Proctor-Thomson, 2002). Multiple ratings of leadership behaviours were obtained from each leader and their supervisors, peers and followers. The following valid and reliable psychological tests were used to operationalise the variables of interest: leadership styles and perceived leadership outcomes (Multifactor Leadership Questionnaire, Avolio et al., 1995), EI (Mayer–Salovey–Caruso Emotional Intelligence Test, Mayer, Salovey, & Caruso, 2002), personality factors (The Big Five Inventory, John, Donahue, & Kentle, 1991), general mental ability (Wonderlic Personnel Test-Quicktest, Wonderlic, 2003) and integrity (Integrity Express, Vangent, 2002). A Pilot Study (N = 25 leaders and 75 raters) made a preliminary examination of the relationship between the variables included in the project. Total EI, the experiential area, and the managing emotions and perceiving emotions branches of EI, were found to be related to transformational leadership which indicated that further research was warranted. In the Main Study, 144 leaders and 432 raters were recruited as participants to assess the discriminant validity of the instruments and examine the usefulness of EI as a predictor of leadership style and perceived leadership outcomes. Scores for each leadership scale across the four rating levels (leaders, supervisors, peers and followers) were aggregated with the exception of the management-by-exception active scale of transactional leadership which had an inadequate level of interrater agreement. In the descriptive and measurement component of the Main Study, the instruments were found to demonstrate adequate discriminant validity. The impact of role and gender on leadership style and EI were also examined, and females were found to be more transformational as leaders than males. Females also engaged in more contingent reward (transactional leadership) behaviours than males, whilst males engaged in more passive/avoidant leadership behaviours than females. In the inferential component of the Main Study, multiple regression procedures were used to examine the usefulness of EI as a predictor of leadership style and perceived leadership outcomes. None of the EI branches were found to be related to transformational leadership or the perceived leadership outcomes variables included in the study. Openness, emotional stability (the inverse of neuroticism) and general mental ability (inversely) each predicted a small amount of variance in transformational leadership. Passive/avoidant leadership was inversely predicted by the understanding emotions branch of EI. Overall, EI was not found to be a useful predictor of leadership style and leadership outcomes in the Main Study of this project. Implications for researchers and human resource practitioners are discussed.

The power of educational podcasting : using short-format podcasts to reinforce tertiary student learning experiences in science

In 2007 I introduced short-format educational podcast resources that reinforced conceptual teaching and learning in an interdisciplinary tertiary science study area (biochemistry). This study aims to determine student attitudes to the perceived usefulness and benefit of short-format educational podcasts, and presents the findings (qualitative and quantitative) from surveys obtained from three offerings of the science teaching unit (2007, 2008 and 2009). Podcasts were recorded (MP3 audio files) separately from the instructive lecture sessions, and subsequent to the weekly lecture, short-format podcasts summarising the key learning objectives were integrated within the resources presented through the students learning management system (Blackboard). The vast majority (>88%) of students utilised the podcast resources, indicating a high level of acceptance and uptake for this portable educational technology. The respondents reported that podcasts focused their attention to core learning concepts and supported their understanding and learning of the lecture material. Furthermore, the data showed that respondents agreed strongly that podcasts assisted with study and revision for examinations and, somewhat surprisingly, there was a perception that podcasts positively impacted on examination performance. Overall, student users perceived that podcasting is as an effective and valuable educational tool that offers convenience and flexibility for their learning and understanding of a tertiary science study area, such as biochemistry.

Aspiration levels and educational choices: An experimental study

The explanation of social inequalities in education is still a debated issue in economics. Recent empirical studies tend to downplay the potential role of credit constraint. This article tests a different potential explanation of social inequalities in education, specifically that social differences in aspiration level result in different educational choices. Having existed for a long time in the sociology of education, this explanation can be justified if aspiration levels are seen as reference points in a prospect theory framework. In order to test this explanation, this article applies the method of experimental economics to the issue of education choice and behaviour. One hundred and twenty-nine individuals participated in an experiment in which they had to perform a task over 15 stages grouped in three blocks or levels. In order to continue through the experiment, a minimum level of success was required at the end of each level. Rewards were dependent on the final level successfully reached. At the end of each level, participants could either choose to stop and take their reward or to pay a cost to continue further in order to possibly receive higher rewards. To test the impact of aspiration levels, outcomes were either presented as gains or losses relative to an initial sum. In accordance with the theoretical predictions, participants in the loss framing group choose to go further in the experiment. There was also a significant and interesting gender effect in the loss framing treatment, such that males performed better and reached higher levels.

Evaluating educational software : a historical overview and the challenges ahead

Teachers are under increasing pressure from government and school management to incorporate technology into lessons. They need to consider which technologies can most effectively enhance subject learning, encourage higher order thinking skills and support the performance of authentic tasks. This chapter reviews the practical and theoretical tools that have been developed to aid teachers in selecting software and reviews the software assessment methodologies from the 1980s to the present day. It concludes that teachers need guidance to structure the evaluation of technology, to consider its educational affordances, its usability, its suitability for the students and the classroom environment and its fit to the teachers’ preferred pedagogies.

Entrepreneurial becoming : an educational pathway out of poverty

This paper reports a longitudinal analysis of 20 necessity driven micro-entrepreneurs operating in Beira, Central Mozambique, who received funding and training from the same NGO to establish or grow their business activities and reports the development of these entrepreneurs in terms of their acquired entrepreneurial potential for long-term success. The results indicate there is a process of entrepreneurial becoming that is not just about access to finance but especially learning and, when successful, this process supports the transformation of survival micro-enterprises into entrepreneurial micro-businesses. The concept of ‘becoming’ contains an implicit temporal dimension. Becoming suggests a transformation over time: a change from what one is already. In this study, we witness a significant change in understanding how a business needs to operate, in recognizing opportunities, thinking more creatively, and building self-confidence.

Augmenting mobile computing with video game elements to support, motivate and engage young people in educational, real-world events

Video games have shown great potential as tools that both engage and motivate players to achieve tasks and build communities in fantasy worlds. We propose that the application of game elements to real world activities can aid in delivering contextual information in interesting ways and help young people to engage in everyday events. Our research will explore how we can unite utility and fun to enhance information delivery, encourage participation, build communities and engage users with utilitarian events situated in the real world. This research aims to identify key game elements that work effectively to engage young digital natives, and provide guidelines to influence the design of interactions and interfaces for event applications in the future. This research will primarily contribute to areas of user experience and pervasive gaming.