Evaluating the success of large-scale, integrated information systems through the lens of IS-impact and IS-support

This study proceeds from a central interest in the importance of systematically evaluating operational large-scale integrated information systems (IS) in organisations. The study is conducted within the IS-Impact Research Track at Queensland University of Technology (QUT). The goal of the IS-Impact Track is, "to develop the most widely employed model for benchmarking information systems in organizations for the joint benefit of both research and practice" (Gable et al, 2009). The track espouses programmatic research having the principles of incrementalism, tenacity, holism and generalisability through replication and extension research strategies. Track efforts have yielded the bicameral IS-Impact measurement model; the ‘impact’ half includes Organisational-Impact and Individual-Impact dimensions; the ‘quality’ half includes System-Quality and Information-Quality dimensions. Akin to Gregor’s (2006) analytic theory, the ISImpact model is conceptualised as a formative, multidimensional index and is defined as "a measure at a point in time, of the stream of net benefits from the IS, to date and anticipated, as perceived by all key-user-groups" (Gable et al., 2008, p: 381). The study adopts the IS-Impact model (Gable, et al., 2008) as its core theory base. Prior work within the IS-Impact track has been consciously constrained to Financial IS for their homogeneity. This study adopts a context-extension strategy (Berthon et al., 2002) with the aim "to further validate and extend the IS-Impact measurement model in a new context - i.e. a different IS - Human Resources (HR)". The overarching research question is: "How can the impacts of large-scale integrated HR applications be effectively and efficiently benchmarked?" This managerial question (Cooper & Emory, 1995) decomposes into two more specific research questions – In the new HR context: (RQ1): "Is the IS-Impact model complete?" (RQ2): "Is the ISImpact model valid as a 1st-order formative, 2nd-order formative multidimensional construct?" The study adhered to the two-phase approach of Gable et al. (2008) to hypothesise and validate a measurement model. The initial ‘exploratory phase’ employed a zero base qualitative approach to re-instantiating the IS-Impact model in the HR context. The subsequent ‘confirmatory phase’ sought to validate the resultant hypothesised measurement model against newly gathered quantitative data. The unit of analysis for the study is the application, ‘ALESCO’, an integrated large-scale HR application implemented at Queensland University of Technology (QUT), a large Australian university (with approximately 40,000 students and 5000 staff). Target respondents of both study phases were ALESCO key-user-groups: strategic users, management users, operational users and technical users, who directly use ALESCO or its outputs. An open-ended, qualitative survey was employed in the exploratory phase, with the objective of exploring the completeness and applicability of the IS-Impact model’s dimensions and measures in the new context, and to conceptualise any resultant model changes to be operationalised in the confirmatory phase. Responses from 134 ALESCO users to the main survey question, "What do you consider have been the impacts of the ALESCO (HR) system in your division/department since its implementation?" were decomposed into 425 ‘impact citations.’ Citation mapping using a deductive (top-down) content analysis approach instantiated all dimensions and measures of the IS-Impact model, evidencing its content validity in the new context. Seeking to probe additional (perhaps negative) impacts; the survey included the additional open question "In your opinion, what can be done better to improve the ALESCO (HR) system?" Responses to this question decomposed into a further 107 citations which in the main did not map to IS-Impact, but rather coalesced around the concept of IS-Support. Deductively drawing from relevant literature, and working inductively from the unmapped citations, the new ‘IS-Support’ construct, including the four formative dimensions (i) training, (ii) documentation, (iii) assistance, and (iv) authorisation (each having reflective measures), was defined as: "a measure at a point in time, of the support, the [HR] information system key-user groups receive to increase their capabilities in utilising the system." Thus, a further goal of the study became validation of the IS-Support construct, suggesting the research question (RQ3): "Is IS-Support valid as a 1st-order reflective, 2nd-order formative multidimensional construct?" With the aim of validating IS-Impact within its nomological net (identification through structural relations), as in prior work, Satisfaction was hypothesised as its immediate consequence. The IS-Support construct having derived from a question intended to probe IS-Impacts, too was hypothesised as antecedent to Satisfaction, thereby suggesting the research question (RQ4): "What is the relative contribution of IS-Impact and IS-Support to Satisfaction?" With the goal of testing the above research questions, IS-Impact, IS-Support and Satisfaction were operationalised in a quantitative survey instrument. Partial least squares (PLS) structural equation modelling employing 221 valid responses largely evidenced the validity of the commencing IS-Impact model in the HR context. ISSupport too was validated as operationalised (including 11 reflective measures of its 4 formative dimensions). IS-Support alone explained 36% of Satisfaction; IS-Impact alone 70%; in combination both explaining 71% with virtually all influence of ISSupport subsumed by IS-Impact. Key study contributions to research include: (1) validation of IS-Impact in the HR context, (2) validation of a newly conceptualised IS-Support construct as important antecedent of Satisfaction, and (3) validation of the redundancy of IS-Support when gauging IS-Impact. The study also makes valuable contributions to practice, the research track and the sponsoring organisation.

The development of teacher assessment identity through participation in online moderation

Teachers’ professional conversations regarding the qualities evidenced in student work provide opportunities to develop a shared understanding of achievement standards. This research investigates social moderation conducted in a synchronous online mode as a specific form of professional conversation. The discussion considers the different factors that influenced these conversations which included the technologic medium of the meeting. The focus of the discussion is how participation in online moderation can support teachers to develop an assessment identity as one who works within a standards-based assessment system. Qualitative data were gathered from middle school teachers from different year levels, in different curriculum areas, in diverse geographic locations, and in a range of sociocultural contexts within Queensland, Australia. Analysis of the data through a sociocultural lens of becoming suggests that participation in online moderation, while challenging for teachers, can also provide opportunities to construct and to negotiate an identity as an assessor of student work.

Professional development in the contemporary educational context : encouraging practice wisdom

Preparing social work students to be effective practitioners is a complex and challenging task undertaken in a dynamic environment both in terms of the field of social work and the higher education sector. There have been recommendations that self knowledge, empirical knowledge, theoretical knowledge and procedural knowledge are the keys to high standards of social work practice. This paper suggests that the concept of practice wisdom is a useful focus for integrating these different aspects of informed practice and for focusing educational programmes for social work. As practice wisdom is more about process than possessed characteristics then there are important motivational and value-based considerations in developing wise practitioners. This discussion considers motivational and personal narrative aspects of practice wisdom so that it can be integrated into social work teaching.

A randomised controlled trial of an enhanced interdisciplinary community based group program for people with Parkinson’s disease: study rationale and protocol

Parkinson’s disease (PD) is a progressive, chronic neurodegenerative disorder for which there is no known cure. Physical exercise programs may be used to assist with the physical management of PD. Several studies have demonstrated that community based physical therapy programs are effective in reducing physical aspects of disability among people with PD. While multidisciplinary therapy interventions may have the potential to reduce disability and improve the quality of life of people with PD, there is very limited clinical trial evidence to support or refute the use of a community based multidisciplinary or interdisciplinary programs for people with PD. A two group randomized trial is being undertaken within a community rehabilitation service in Brisbane, Australia. Community dwelling adults with a diagnosis of Idiopathic Parkinson’s disease are being recruited. Eligible participants are randomly allocated to a standard exercise rehabilitation group program or an intervention group which incorporates physical, cognitive and speech activities in a multi-tasking framework. Outcomes will be measured at 6-week intervals for a period of six months. Primary outcome measures are the Montreal Cognitive Assessment (MoCA) and the Timed Up and Go (TUG) cognitive test. Secondary outcomes include changes in health related quality of life, communication, social participation, mobility, strength and balance, and carer burden measures. This study will determine the immediate and long-term effectiveness of a unique multifocal, interdisciplinary, dual-tasking approach to the management of PD as compared to an exercise only program. We anticipate that the results of this study will have implications for the development of cost effective evidence based best practice for the treatment of people with PD living in the community.

Joined-up practice : five areas of exemplary practice for social workers and educators to re-engage homeless youth

Young people seen as ‘at risk’ are a substantial focus across a wide range of policy and practice fields in national and international contexts. This article addresses two of those fields, youth homelessness and youth failing to obtain a basic education that will give them access to employment and full community participation as active citizens. By comparing solutions to the problems of youth homelessness and youth educationally at risk, the article distils key meta-characteristics useful for both social workers and educators in mutually supporting some of the most at risk young people in our communities today. This is what the authors term ‘a joined-up practice’.

Public realm and transport, international best practice case studies and opportunities for Brisbane

This report was prepared for Lat 27 Pty Ltd for the purpose of conducting a City Centre Public Realm and Active Transport Study for Urban Renewal Brisbane, Brisbane City Council. In this review, we highlight some key learnings and recommendations from innovative projects across the globe to inform public realm design and help facilitate active transport in subtropical Brisbane. Traditionally, Australian cities have been have been based on northern European models. This report is informed by the view that planners and urban designers must look beyond that paradigm to redefine and re-conceptualise our city in a different way, one that values our unique local identity and climate. In re-designing Brisbane’s public realm, therefore, design interventions and responses must celebrate our unique identity and outdoor lifestyle and address the subtropical climate's reality of life in warm humid summers and cool dry winters. The current period of rapid urban change, and the imperative to adapt to climate change, together offer an opportunity to prioritise and integrate design features that provide shade and shelter from sun and summer rain, open and permeable urban environments that facilitate cooling air movement, and connections to water and nature, so that the urban built form co-exists within an inviting, functional and memorable natural landscape. To inform this transformation, this review provides insight into international experiences and best practices. To date, although there is much practice-based knowledge, academic studies outlining learnings and recommendations from case studies (especially in a subtropical context) remain rare. Thus, a range of sources (industry reports, websites, journal articles and books) have been utilised.

Will Queensland tort reform change valuation practice and valuers liability

It has been common practice over past property boom and bust cycles in Australia for financial institutions and property owners who have suffered a loss in the property downturn to sue valuers for negligence. Damages claimed are based on the price differential between the valuation at or nearing the peak of the market and the subsequent sale in the market downturn. However, the context of valuers liability has become increasingly complex as a result of statutory reforms introduced in response to the Review of the Law of Negligence Final Report 2002), in particular the introduction of Civil Liability Acts introducing proportionate liability provisions. Legislative reforms have had some positive outcomes for Valuers, however valuers need to continue to maintain high ethical standards, independence and professionalism in valuation practice.

Striving to achieve best practice in heart failure disease management

Based on a national audit of chronic heart failure (CHF) management programmes (CHF-MPs) conducted in 2006, Driscoll et al identified a disproportionate distribution ranging from 0 to 4.2 programmes/million population in the various states of Australia with many programmes not following best practice.1 We welcome their proposal to develop national benchmarks for CHF management and acknowledge the contributions of the Heart Foundation and health professionals in finalising these recommendations.2 We would like to share the Queensland experience in striving towards best practice with the number of CHF-MPs increasing from four (at the time of the 2006 survey) to 23, equating to 5.0 programmes/million population. Queensland now has a state-wide heart failure service steering committee with a focus on the development of CHF-MPs supported by a central coordinator...

Reflection in Integrated Problem Based Learning : 20 years of continuing application to the teaching of architecture

In 1984 the School of Architecture and Built Environment within the University of Newcastle, Australia introduced an integrated program based on real design projects and using Integrated Problem Based Learning (IPBL) as the teaching method. Since 1984 there have been multiple changes arising from the expectations of the architectural fraternity, enrolling students, lecturers, available facilities, accreditation authorities and many others. These challenges have been successfully accommodated whilst maintaining the original purposes and principles of IPBL. The Architecture program has a combined two-degree structure consisting of a first degree, Bachelor of Science (Architecture), followed by a second degree, Bachelor of Architecture. The program is designed to simulate the problem-solving situations that face a working architect in every day practice. This paper will present the degree structure where each student is enrolled in a single course per semester incorporating design integration and study areas in design studies, professional studies, historical studies, technical studies, environmental studies and communication skills. Each year the design problems increase in complexity and duration set around an annual theme. With 20 years of successful delivery of any program there are highlights and challenges along the way and this paper will discuss some of the successes and barriers experienced within the School of Architecture and Built Environment in delivering IPBL. In addition, the reflective process investigates the currency of IPBL as an appropriate vehicle for delivering the curriculum in 2004 and any additional administrative or staff considerations required to enhance the continuing application of IPBL.

Catherine or Kate, the royal name dilemma : humour and performance in collaborative art practice

The traditional model of visual arts practice is one that privileges highly individuated reflection and research on studio based, predominately material outcomes. This archetypal approach to thinking about cultural production tends to overlook all of the conceptual and contextual collaborations that take place, both informally and formally in the process of making artworks. The aim of this practice-led research project is to creatively and critically explore the potential for actively engaging in a collaborative process for making artworks. It will focus on this approach to research and making through performance and video based works made in conjunction with Kate Woodcroft. Through doing this it aims to explore the possibilities for thinking and working beyond singular, materially based practices and develop new understandings for this as a model for generating new and unexpected creative outcomes. Key departure points for this discussion include; tertiary performance, conceptual art, and humour.

Six rules for practice-led research

Recent experience of practice-led postgraduate supervision has prompted me to conclude that the practice-led research method, as it is currently construed, produces good outcomes, especially in permitting practitioners in the creative arts, design and media into the research framework, but at the same time it also generates certain recurring difficulties. What are these difficulties? Practice-led candidates tend to rely on a narrow range of formulations with the result that they assume: (i) the innovative nature of practice-led research; (ii) that its novelty is based in opposition to other research methods; (iii) that practice is intrinsically research, often leading to tautological formulations; (iv) the hyper-self-reflexive nature of practice-led research. This set of guidelines was composed in order to circumvent the shortcomings that result from these recurring formulations. My belief is that, if these shortcomings are avoided, there is nothing to prevent practice-led from further developing as a research inquiry and thus achieving rewarding and successful research outcomes. Originally composed for the purposes of postgraduate supervision, these six rules are presented here in the context of a wider analysis of the emergence of practice-led research and its current conditions of possibility as a research method.

An index of best practice performance reporting for Malaysian local authorities

Abstract Purpose – The purpose of this paper is to identify stakeholders’ expectations of information to be conveyed in local authorities’ annual reports and to develop an index of best practice performance reporting. Design/methodology/approach – The paper describes the development of a disclosure index emphasizing the public interest aspect of reporting and the need to provide relevant and meaningful information to stakeholders. The index was crafted from a public accountability perspective and based on the expectations of stakeholders as reconciled and validated by a Delphi panel of experts. Findings – The wide scope of information that was dentified as being important for disclosure by local authorities is consistent with the public accountability paradigm which requires the reporting of comprehensive information (both financial and non financial), about the condition, performance, activities and progress of the entity. Originality/value – The research posits a model of best practice performance reporting for Malaysian, and other, local authorities to meet the need for greater accountability by these entities.

Intractable differences : artistic research and the problem of practice

The purpose of this paper is to analyse the complex nature of practice within Artistic research. This will be done by considering practice through the lens of Bourdieu’s conceptualisation of practice. The focus of the paper is on developing an understanding of practice-led approaches to research and how these are framed by what Coessens et al. (2009) call the artistic turn in research. The paper begins with a brief introduction to the nature of practice and then continues on to discuss the broader field of artistic research, describing the environment which has shaped its evolution and foregrounding several of its key dispositions. The paper aims to not simply describe existing methodology but to rethink what is meant by artistic research and practice-led strategies.

Young Children, Pedagogy, and the Arts

"Young Children, Pedagogy and the Arts is an innovative text that describes practices and research that cross all five strands of the arts—visual, drama, music, dance, and media—and illuminates ways of understanding children and their arts practices that go beyond the common traditions. The book: - Offers practical and rich illustrations of teachers’ and children’s work based on international research that integrates theory with practice; - Brings a critical lens to arts education; - Includes summaries, reflective questions, and recommended further readings with every chapter. Young Children, Pedagogy and the Arts provides a more nuanced understanding of the arts through an exploration of specific instances in which committed teachers and researchers are discovering what contemporary multimodal tools offer to young children. Chapters contain examples of ‘doing’ the arts in the early years, new ways of teaching, and how to use emerging technologies to develop multiliteracies, equity, agency, social and cultural capital, and enhance the learning and engagement of marginalized children."--publisher website

Review of refugee mental health interventions following resettlement : best practice and recommendations

There are increasing numbers of refugees worldwide, with approximately 16 million refugees in 2007 and over 2.5 million refugees resettled in the United States since the start of its humanitarian program. Psychologists and other health professionals who deliver mental health services for individuals from refugee backgrounds need to have confidence that the therapeutic interventions they employ are appropriate and effective for the clients with whom they work. The current review briefly surveys refugee research, examines empirical evaluations of therapeutic interventions in resettlement contexts, and provides recommendations for best practices and future directions in resettlement countries. The resettlement interventions found to be most effective typically target culturally homogeneous client samples and demonstrate moderate to large outcome effects on aspects of traumatic stress and anxiety reduction. Further evaluations of the array of psychotherapeutic, psychosocial, pharmacological, and other therapeutic approaches, including psychoeducational and community-based interventions that facilitate personal and community growth and change, are encouraged. There is a need for increased awareness, training and funding to implement longitudinal interventions that work collaboratively with clients from refugee backgrounds through the stages of resettlement.