Assurance of learning – are academics and senior management singing from the same hymn sheet?

Assurance of learning (AoL) is an important process in quality education, designed to measure the accomplishment of educational aims at the core of an institution’s programs, whilst encouraging faculty to continuously develop and improve the programs and courses. This paper reports on a study of Australian business schools to investigate current AoL practices through semi structured interviews with senior faculty leaders followed by focus group interviews with groups of senior program leaders and groups of academic teaching staff. Initial findings indicate there are significant challenges in encouraging academic staff to commit to the process and recognise the benefits of assuring learning. The differences in understanding between the various leaders and the academics were highlighted through the different focus groups. Leaders’ stressed strategic issues such as staff engagement and change, while academics focussed on process issues such as teaching graduate attributes and external accreditation. Understanding the differences in the perspectives of leaders and faculty is important, as without a shared understanding between the two groups, there is likely to be limited engagement, which creates difficulties in developing effective assurance of learning processes. Findings indicate that successful strategies developed to foster shared values on assurance of learning include: strong senior leaders’ commitment; developing champions among program and unit level staff; providing professional development opportunities; promoting and celebrating success and effectiveness; and ensuring an inclusive process with academics of all levels collaborating in the development and implementation of the process.

Strategies to engage academics in assuring graduate attributes

Assurance of learning (AoL) is a predominant feature in both quality assurance and quality enhancement in higher education. The process may be used for program development, and to inform external accreditation and evaluation bodies. However, there is an obvious challenge in trying to get academic staff to buy into the benefits of the AoL process. This project conducted an audit across 25 Australian Business Schools. The majority of those interviewed stated that academic staff considered AoL to be extra work and viewed the process as a box ticking exercise for external bodies rather than sound educational practice. A change management process is required to promote the necessary cultural change to embed AoL into practice. This paper showcases some of the educational leadership strategies that have been successfully implemented across Australia to foster staff engagement in the AoL process. These include: strong senior management commitment and leadership demonstrating a constant and high level drive for staff engagement until AoL becomes an institutional norm; developing leadership and champions among unit and program level staff, to share practices and promote the benefits that come from engaging in the process; providing professional development opportunities to discuss and resolve difficulties and tensions around AoL; demonstrating success and effectiveness by selling staff on the evidence that AoL makes a difference; and making the process inclusive with academics collaborating in the development and implementation of the process.

Front page schools, back page schools : a case study of factors perceived to affect academic performance in five Papua New Guinea secondary schools

Papua New Guinea has reformed its colonial established education system and made huge investments with the help of donors to achieve equal access and quality education for all its citizens. Despite this national aspiration and these policy reforms and investments, secondary schools that enrol grade 9 students who are relatively equal in education ability show huge disparities in their grade 10 academic performances. This study examined perceptions of students, teachers and principals regarding factors affecting the disparity in academic performance in the context of a developing country. The central question for the study is: What are the perceptions of students and teachers of the factors that affect disparities in secondary schools' academic performance? This qualitative case study involved two high and three low academic performing secondary schools in Western Highlands Province of Papua New Guinea. Primary data were collected through focus groups and semi-structured interviews involving 112 participants. Students and teachers are key participants in this study, as it intends to find out the realities of schools, yet they are an under-researched group. A postcolonial and sense of community conceptual framework was developed for the analysis of the participants. perceptions. In addition, scholarship on school effectiveness and equity in education informed the interpretation of the findings. Three themes were evident in participants. views. First, participants expressed their view that differences in academic performance were related to the adequacy and equitability of resources. The inequities in resource inputs led some of them to coin the metaphor of .back page and front page. schools. Second, many expressed the view that deficiencies in implementing bilingual education, given the difficulty of catering for 800 vernacular languages, contribute to poor English proficiency and subsequent poor academic performance. Finally, participants believed that, in order to have a positive school culture, it is necessary for educators to recognise and respect contemporary students. identities, communal/tribal membership and needs. This study has implications for national education policy on resource allocation to address equality and equity, bilingual education and teacher education. Moreover, as the study found that high academic performance in this context is also influenced by intra-school social relationships, these relationships need to be nurtured. When appropriately nurtured, they become an important factor in sustaining quality education for all secondary school students. This thesis has laid the foundations for further research and invites further investigations into policy and implementation of school reforms aimed at improving academic achievement.

An exploratory study of ethical dilemmas faced by academic leaders in three Australian universities

Being an academic in universities today is characterised by change and increasing complexity in response to a multitude of factors impacting on the university sector. Among the consequences of such changes are that many academics, and academic leaders in particular, are subjected to both increasing stress and scrutiny in many of the decisions they make. Some of these decisions require critical choices that involve contestation of values (including personal, professional, institutional, and community), resulting in ethical dilemmas for the decisionmakers. This article reports on an exploratory study into ethical dilemmas faced by middle-level academic leaders, drawing on the results of an on-line survey distributed to relevant academics in three universities in Australia. Here, middle-level academic leaders are defined as those holding course coordination roles, locating them between senior university staff and other academics on the one hand, and students on the other hand. As a consequence, these diverse groups of staff and students potentially have an array of conflicting interests in, and expectations on, middle-level academics’ decision-making processes. The findings of the study are clear: ethical dilemmas are evident, and commonly so, for many middle-level academic leaders. While exploratory in nature, the findings of this study suggest that much more attention to ethics and ethical dilemmas is needed in our universities.

The relationship between academic library usage and perceived personal performance in Kuwait

Academic libraries around the world often have to justify high maintenance costs. High maintenance costs of university libraries are often justified by the belief that regular use of an academic library improves the grades of students. However, this is a difficult statement to support, therefore demonstrating the link between library use and student outcomes is critical to ensuring that library investment continues. Questionnaires and interviews were conducted and the findings were analysed to derive users’ perceptions. The findings revealed interesting results regarding how users make use of the library and how users feel the library improves their personal performance. Overall, the perception of all three groups of the academic libraries within Kuwait is positive, however many users are dissatisfied with some academic library services. Students answered positively regarding their grades and use of the academic library. Academics and administrators were generally positive and offered an experienced insight into the quality of the library. This study offers the first perception based results in Kuwait. The inclusion of administrators’ perceptions is also novel in terms of the Gulf States. A refined model was designed based on the overall findings within the study. This model can be applied to any academic library, regardless of size or collection type. Based on findings, the researcher recommends taking the following points into consideration in order to improve library services and facilities for all users. Improvements could be made in the structure of library training courses and academic libraries should be providing flexible spaces for individuals and group study as well as social activities.

Evaluating the success of large-scale, integrated information systems through the lens of IS-impact and IS-support

This study proceeds from a central interest in the importance of systematically evaluating operational large-scale integrated information systems (IS) in organisations. The study is conducted within the IS-Impact Research Track at Queensland University of Technology (QUT). The goal of the IS-Impact Track is, "to develop the most widely employed model for benchmarking information systems in organizations for the joint benefit of both research and practice" (Gable et al, 2009). The track espouses programmatic research having the principles of incrementalism, tenacity, holism and generalisability through replication and extension research strategies. Track efforts have yielded the bicameral IS-Impact measurement model; the ‘impact’ half includes Organisational-Impact and Individual-Impact dimensions; the ‘quality’ half includes System-Quality and Information-Quality dimensions. Akin to Gregor’s (2006) analytic theory, the ISImpact model is conceptualised as a formative, multidimensional index and is defined as "a measure at a point in time, of the stream of net benefits from the IS, to date and anticipated, as perceived by all key-user-groups" (Gable et al., 2008, p: 381). The study adopts the IS-Impact model (Gable, et al., 2008) as its core theory base. Prior work within the IS-Impact track has been consciously constrained to Financial IS for their homogeneity. This study adopts a context-extension strategy (Berthon et al., 2002) with the aim "to further validate and extend the IS-Impact measurement model in a new context - i.e. a different IS - Human Resources (HR)". The overarching research question is: "How can the impacts of large-scale integrated HR applications be effectively and efficiently benchmarked?" This managerial question (Cooper & Emory, 1995) decomposes into two more specific research questions – In the new HR context: (RQ1): "Is the IS-Impact model complete?" (RQ2): "Is the ISImpact model valid as a 1st-order formative, 2nd-order formative multidimensional construct?" The study adhered to the two-phase approach of Gable et al. (2008) to hypothesise and validate a measurement model. The initial ‘exploratory phase’ employed a zero base qualitative approach to re-instantiating the IS-Impact model in the HR context. The subsequent ‘confirmatory phase’ sought to validate the resultant hypothesised measurement model against newly gathered quantitative data. The unit of analysis for the study is the application, ‘ALESCO’, an integrated large-scale HR application implemented at Queensland University of Technology (QUT), a large Australian university (with approximately 40,000 students and 5000 staff). Target respondents of both study phases were ALESCO key-user-groups: strategic users, management users, operational users and technical users, who directly use ALESCO or its outputs. An open-ended, qualitative survey was employed in the exploratory phase, with the objective of exploring the completeness and applicability of the IS-Impact model’s dimensions and measures in the new context, and to conceptualise any resultant model changes to be operationalised in the confirmatory phase. Responses from 134 ALESCO users to the main survey question, "What do you consider have been the impacts of the ALESCO (HR) system in your division/department since its implementation?" were decomposed into 425 ‘impact citations.’ Citation mapping using a deductive (top-down) content analysis approach instantiated all dimensions and measures of the IS-Impact model, evidencing its content validity in the new context. Seeking to probe additional (perhaps negative) impacts; the survey included the additional open question "In your opinion, what can be done better to improve the ALESCO (HR) system?" Responses to this question decomposed into a further 107 citations which in the main did not map to IS-Impact, but rather coalesced around the concept of IS-Support. Deductively drawing from relevant literature, and working inductively from the unmapped citations, the new ‘IS-Support’ construct, including the four formative dimensions (i) training, (ii) documentation, (iii) assistance, and (iv) authorisation (each having reflective measures), was defined as: "a measure at a point in time, of the support, the [HR] information system key-user groups receive to increase their capabilities in utilising the system." Thus, a further goal of the study became validation of the IS-Support construct, suggesting the research question (RQ3): "Is IS-Support valid as a 1st-order reflective, 2nd-order formative multidimensional construct?" With the aim of validating IS-Impact within its nomological net (identification through structural relations), as in prior work, Satisfaction was hypothesised as its immediate consequence. The IS-Support construct having derived from a question intended to probe IS-Impacts, too was hypothesised as antecedent to Satisfaction, thereby suggesting the research question (RQ4): "What is the relative contribution of IS-Impact and IS-Support to Satisfaction?" With the goal of testing the above research questions, IS-Impact, IS-Support and Satisfaction were operationalised in a quantitative survey instrument. Partial least squares (PLS) structural equation modelling employing 221 valid responses largely evidenced the validity of the commencing IS-Impact model in the HR context. ISSupport too was validated as operationalised (including 11 reflective measures of its 4 formative dimensions). IS-Support alone explained 36% of Satisfaction; IS-Impact alone 70%; in combination both explaining 71% with virtually all influence of ISSupport subsumed by IS-Impact. Key study contributions to research include: (1) validation of IS-Impact in the HR context, (2) validation of a newly conceptualised IS-Support construct as important antecedent of Satisfaction, and (3) validation of the redundancy of IS-Support when gauging IS-Impact. The study also makes valuable contributions to practice, the research track and the sponsoring organisation.

Qualitative and quantitative analysis of six sigma in service organizations

The concept of Six Sigma was initiated in the 1980s by Motorola. Since then it has been implemented in several manufacturing and service organizations. Till now Six Sigma implementation is mostly limited to healthcare and financial services in private sector. Its implementation is now gradually picking up in services such as call center, education, construction and related engineering etc. in private as well as public sector. Through a literature review, a questionnaire survey, and multiple case study approach the paper develops a conceptual framework to facilitate widening the scope of Six Sigma implementation in service organizations. Using grounded theory methodology, this study develops theory for Six Sigma implementation in service organizations. The study involves a questionnaire survey and case studies to understand and build a conceptual framework. The survey was conducted in service organizations in Singapore and exploratory in nature. The case studies involved three service organizations which implemented Six Sigma. The objective is to explore and understand the issues highlighted by the survey and the literature. The findings confirm the inclusion of critical success factors, critical-to-quality characteristics, and set of tools and techniques as observed from the literature. In case of key performance indicator, there are different interpretations about it in literature and also by industry practitioners. Some literature explain key performance indicator as performance metrics whereas some feel it as key process input or output variables, which is similar to interpretations by practitioners of Six Sigma. The response of not relevant and unknown to us as reasons for not implementing Six Sigma shows the need for understanding specific requirements of service organizations. Though much theoretical description is available about Six Sigma, but there has been limited rigorous academic research on it. This gap is far more pronounced about Six Sigma implementation in service organizations, where the theory is not mature enough. Identifying this need, the study contributes by going through theory building exercise and developing a conceptual framework to understand the issues involving its implementation in service organizations.

Forecasting success on large projects : developing reliable scales to predict multiple perspectives by multiple stakeholders over multiple time frames

Our aim is to develop a set of leading performance indicators to enable managers of large projects to forecast during project execution how various stakeholders will perceive success months or even years into the operation of the output. Large projects have many stakeholders who have different objectives for the project, its output, and the business objectives they will deliver. The output of a large project may have a lifetime that lasts for years, or even decades, and ultimate impacts that go beyond its immediate operation. How different stakeholders perceive success can change with time, and so the project manager needs leading performance indicators that go beyond the traditional triple constraint to forecast how key stakeholders will perceive success months or even years later. In this article, we develop a model for project success that identifies how project stakeholders might perceive success in the months and years following a project. We identify success or failure factors that will facilitate or mitigate against achievement of those success criteria, and a set of potential leading performance indicators that forecast how stakeholders will perceive success during the life of the project's output. We conducted a scale development study with 152 managers of large projects and identified two project success factor scales and seven stakeholder satisfaction scales that can be used by project managers to predict stakeholder satisfaction on projects and so may be used by the managers of large projects for the basis of project control.

The evolution of QUT’s Student Success Program : 20,000 students later

“The Student Success Program (SSP) is a monitoring and early intervention program in operation at QUT designed to identify and support those students deemed to be at risk of disengaging for their learning and their institution” (Nelson, Quinn, Marrington & Clarke, 2011, p. 83). This report reflects on the development of the program since its inception in 2007. In acknowledging similar initiatives within the sector that monitor student learning engagement, the Nuts & Bolts session allows for identification and discussion of the critical success factors for these intervention and support programs.

Academic stress among adolescents in China

Pressure from study has long been identified as a significant contributor to many mental health problems in school children and adolescents. Students are often stressed by heavy workload, high academic expectation and dissatisfaction with their grades. Excessive amount of this special type of stress (academic stress or educational stress) may then lead to severe psychological symptoms, such as depressed mood, anxious feelings and even suicide thoughts and acts when coping recourses are exhausted. Chinese students are believed to have high academic burden and pressure due to high expectations of their parents and fierce competitions with their peers. Knowledge of the nature and health effects of academic stress may be useful to inform quality education and mental health promotions. This review aims to provide a comprehensive analysis of reported literature regarding educational stress and its relationships with mental health problems worldwide and the current research progress in Chinese adolescents, and to provide directions for future research into this topic in Chinese adolescent populations.

Verifying a Student Engagement, Success and Retention Maturity Model (SESR-MM): A reality check of the model using data derived from three universities

Australian higher education institutions (HEIs) have entered a new phase of regulation and accreditation which includes performance-based funding relating to the participation and retention of students from social and cultural groups previously underrepresented in higher education. However, in addressing these priorities, it is critical that HEIs do not further disadvantage students from certain groups by identifying them for attention because of their social or cultural backgrounds, circumstances which are largely beyond the control of students. In response, many HEIs are focusing effort on university-wide approaches to enhancing the student experience because such approaches will enhance the engagement, success and retention of all students, and in doing so, particularly benefit those students who come from underrepresented groups. Measuring and benchmarking student experiences and engagement that arise from these efforts is well supported by extensive collections of student experience survey data. However no comparable instrument exists that measures the capability of institutions to influence and/or enhance student experiences where capability is an indication of how well an organisational process does what it is designed to do (Rosemann & de Bruin, 2005). We have proposed that the concept of a maturity model (Marshall, 2010; Paulk, 1999) may be useful as a way of assessing the capability of HEIs to provide and implement student engagement, success and retention activities and we are currently articulating a Student Engagement, Success and Retention Maturity Model (SESR-MM), (Clarke, Nelson & Stoodley, 2012; Nelson, Clarke & Stoodley, 2012). Our research aims to address the current gap by facilitating the development of an SESR-MM instrument that aims (i) to enable institutions to assess the capability of their current student engagement and retention programs and strategies to influence and respond to student experiences within the institution; and (ii) to provide institutions with the opportunity to understand various practices across the sector with a view to further improving programs and practices relevant to their context. Our research extends the generational approach which has been useful in considering the evolutionary nature of the first year experience (FYE) (Wilson, 2009). Three generations have been identified and explored: First generation approaches that focus on co-curricular strategies (e.g. orientation and peer programs); Second generation approaches that focus on curriculum (e.g. pedagogy, curriculum design, and learning and teaching practice); and third generation approaches—also referred to as transition pedagogy—that focus on the production of an institution-wide integrated holistic intentional blend of curricular and co-curricular activities (Kift, Nelson & Clarke, 2010). Our research also moves beyond assessments of students’ experiences to focus on assessing institutional processes and their capability to influence student engagement. In essence, we propose to develop and use the maturity model concept to produce an instrument that will indicate the capability of HEIs to manage and improve student engagement, success and retention programs and strategies. The issues explored in this workshop are (i) whether the maturity model concept can be usefully applied to provide a measure of institutional capability for SESR; (ii) whether the SESR-MM can be used to assess the maturity of a particular set of institutional practices; and (iii) whether a collective assessment of an institution’s SESR capabilities can provide an indication of the maturity of the institution’s SESR activities. The workshop will be approached in three stages. Firstly, participants will be introduced to the key characteristics of maturity models, followed by a discussion of the SESR-MM and the processes involved in its development. Secondly, participants will be provided with resources to facilitate the development of a maturity model and an assessment instrument for a range of institutional processes and related practices. In the final stage of the workshop, participants will “assess” the capability of these practices to provide a collective assessment of the maturity of these processes. References Australian Council for Educational Research. (n.d.). Australasian Survey of Student Engagement. Retrieved from http://www.acer.edu.au/research/ausse/background Clarke, J., Nelson, K., & Stoodley, I. (2012, July). The Maturity Model concept as framework for assessing the capability of higher education institutions to address student engagement, success and retention: New horizon or false dawn? A Nuts & Bolts presentation at the 15th International Conference on the First Year in Higher Education, “New Horizons,” Brisbane, Australia. Department of Education, Employment and Workplace Relations. (n.d.). The University Experience Survey. Advancing quality in higher education information sheet. Retrieved from http://www.deewr.gov.au/HigherEducation/Policy/Documents/University_Experience_Survey.pdf Kift, S., Nelson, K., & Clarke, J. (2010) Transition pedagogy - a third generation approach to FYE: A case study of policy and practice for the higher education sector. The International Journal of the First Year in Higher Education, 1(1), pp. 1-20. Marshall, S. (2010). A quality framework for continuous improvement of e-Learning: The e-Learning Maturity Model. Journal of Distance Education, 24(1), 143-166. Nelson, K., Clarke, J., & Stoodley, I. (2012). An exploration of the Maturity Model concept as a vehicle for higher education institutions to assess their capability to address student engagement. A work in progress. Submitted for publication. Paulk, M. (1999). Using the Software CMM with good judgment, ASQ Software Quality Professional, 1(3), 19-29. Wilson, K. (2009, June–July). The impact of institutional, programmatic and personal interventions on an effective and sustainable first-year student experience. Keynote address presented at the 12th Pacific Rim First Year in Higher Education Conference, “Preparing for Tomorrow Today: The First Year as Foundation,” Townsville, Australia. Retrieved from http://www.fyhe.com.au/past_papers/papers09/ppts/Keithia_Wilson_paper.pdf

Engagement, persistence, progress and success as theoretically distinct aspects of business creation processes

Starting from the vantage point that explaining success at creating a venture should be the unique contribution—or at least one unique contribution—of entrepreneurship research, we argue that this success construct has not yet been adequately defined an operationalized. We thus offer suggestions for more precise conceptualization and measurement of this central construct. Rather than regarding various success proxies used in prior research as poor operationalizations of success we argue that they represent other important aspects of the venture creation process: engagement, persistence and progress. We hold that in order to attain a better understanding of venture creation these constructs also need to be theoretically defined. Further, their respective drivers need to be theorized and tested separately. We suggest theoretical definitions of each. We then develop and test hypotheses concerning how human capital, venture idea novelty and business planning has different impact on the different assessments of the process represented by engagement, persistence, progress and success. The results largely confirm the stated hypotheses, suggesting that the conceptual and empirical approach we are suggesting is a path towards improved understanding of the central entrepreneurship phenomenon of new venture creation.

The red mist? red shirts, success and team sports

Baron von Richthofen (the Red Baron) arguably the most famous fighter pilot of all time painted his plane the vividest of red hues, making it visible and identifiable at great distance, showing an aggressive pronouncement of dominance to other pilots. Can colour affect aggression and performance and if so is it observable within team sports? This study explores the effect of red on sporting performances within a team sports arena, through empirical analysis of match results from the Australian Rugby League spanning a period of 30 years. Both the descriptive analysis and the multivariate analysis report a positive relationship. Nevertheless, more evidence is required to better understand whether teams in red do enjoy greater success controlling explicitly in a multivariate analysis for many factors that simultaneously affect performance.

Collaboration and competition on a Wiki : the praxis of online social learning to improve academic writing and research in under-graduate students

The number of internet users in Australia has been steadily increasing, with over 10.9 million people currently subscribed to an internet provider (ABS, 2011). Over the past year, the most avid users of the Internet were 15 – 24 year olds, with approximately 95% accessing the internet on a regular basis (ABS, Social Trends, 2011). While the internet, in particularly Web 2.0, has been described as fundamental to higher education students, social and leisure internet tools are also increasingly being used by these students to generate and maintain their social and professional networks and interactions (Duffy & Bruns, 2006). Rapid technological advancements have enabled greater and faster access to information for learning and education (Hemmi et al, 2009; Glassman & Kang, 2011). As such, we sought to integrate interactive, online social media into the assessment profile of a Public Health undergraduate cohort at the Queensland University of Technology (QUT). The aim of this exercise was to engage undergraduate students to both develop and showcase their research on a range of complex, contemporary health issues within the online forum of Wikispaces for review and critique by their peers. We applied Bandura’s Social Learning Theory (SLT) to analyse the interactive processes from which students developed deeper and more sustained learning, and via which their overall academic writing standards were enriched. This paper outlines the assessment task, and the students’ feedback on their learning outcomes in relation to the Attentional, Retentional, Motor Reproduction, and Motivational Processes outlined by Bandura in SLT. We conceptualise the findings in a theoretical model, and discuss the implications for this approach within the broader tertiary environment.