Evaluating the success of large-scale, integrated information systems through the lens of IS-impact and IS-support

This study proceeds from a central interest in the importance of systematically evaluating operational large-scale integrated information systems (IS) in organisations. The study is conducted within the IS-Impact Research Track at Queensland University of Technology (QUT). The goal of the IS-Impact Track is, "to develop the most widely employed model for benchmarking information systems in organizations for the joint benefit of both research and practice" (Gable et al, 2009). The track espouses programmatic research having the principles of incrementalism, tenacity, holism and generalisability through replication and extension research strategies. Track efforts have yielded the bicameral IS-Impact measurement model; the ‘impact’ half includes Organisational-Impact and Individual-Impact dimensions; the ‘quality’ half includes System-Quality and Information-Quality dimensions. Akin to Gregor’s (2006) analytic theory, the ISImpact model is conceptualised as a formative, multidimensional index and is defined as "a measure at a point in time, of the stream of net benefits from the IS, to date and anticipated, as perceived by all key-user-groups" (Gable et al., 2008, p: 381). The study adopts the IS-Impact model (Gable, et al., 2008) as its core theory base. Prior work within the IS-Impact track has been consciously constrained to Financial IS for their homogeneity. This study adopts a context-extension strategy (Berthon et al., 2002) with the aim "to further validate and extend the IS-Impact measurement model in a new context - i.e. a different IS - Human Resources (HR)". The overarching research question is: "How can the impacts of large-scale integrated HR applications be effectively and efficiently benchmarked?" This managerial question (Cooper & Emory, 1995) decomposes into two more specific research questions – In the new HR context: (RQ1): "Is the IS-Impact model complete?" (RQ2): "Is the ISImpact model valid as a 1st-order formative, 2nd-order formative multidimensional construct?" The study adhered to the two-phase approach of Gable et al. (2008) to hypothesise and validate a measurement model. The initial ‘exploratory phase’ employed a zero base qualitative approach to re-instantiating the IS-Impact model in the HR context. The subsequent ‘confirmatory phase’ sought to validate the resultant hypothesised measurement model against newly gathered quantitative data. The unit of analysis for the study is the application, ‘ALESCO’, an integrated large-scale HR application implemented at Queensland University of Technology (QUT), a large Australian university (with approximately 40,000 students and 5000 staff). Target respondents of both study phases were ALESCO key-user-groups: strategic users, management users, operational users and technical users, who directly use ALESCO or its outputs. An open-ended, qualitative survey was employed in the exploratory phase, with the objective of exploring the completeness and applicability of the IS-Impact model’s dimensions and measures in the new context, and to conceptualise any resultant model changes to be operationalised in the confirmatory phase. Responses from 134 ALESCO users to the main survey question, "What do you consider have been the impacts of the ALESCO (HR) system in your division/department since its implementation?" were decomposed into 425 ‘impact citations.’ Citation mapping using a deductive (top-down) content analysis approach instantiated all dimensions and measures of the IS-Impact model, evidencing its content validity in the new context. Seeking to probe additional (perhaps negative) impacts; the survey included the additional open question "In your opinion, what can be done better to improve the ALESCO (HR) system?" Responses to this question decomposed into a further 107 citations which in the main did not map to IS-Impact, but rather coalesced around the concept of IS-Support. Deductively drawing from relevant literature, and working inductively from the unmapped citations, the new ‘IS-Support’ construct, including the four formative dimensions (i) training, (ii) documentation, (iii) assistance, and (iv) authorisation (each having reflective measures), was defined as: "a measure at a point in time, of the support, the [HR] information system key-user groups receive to increase their capabilities in utilising the system." Thus, a further goal of the study became validation of the IS-Support construct, suggesting the research question (RQ3): "Is IS-Support valid as a 1st-order reflective, 2nd-order formative multidimensional construct?" With the aim of validating IS-Impact within its nomological net (identification through structural relations), as in prior work, Satisfaction was hypothesised as its immediate consequence. The IS-Support construct having derived from a question intended to probe IS-Impacts, too was hypothesised as antecedent to Satisfaction, thereby suggesting the research question (RQ4): "What is the relative contribution of IS-Impact and IS-Support to Satisfaction?" With the goal of testing the above research questions, IS-Impact, IS-Support and Satisfaction were operationalised in a quantitative survey instrument. Partial least squares (PLS) structural equation modelling employing 221 valid responses largely evidenced the validity of the commencing IS-Impact model in the HR context. ISSupport too was validated as operationalised (including 11 reflective measures of its 4 formative dimensions). IS-Support alone explained 36% of Satisfaction; IS-Impact alone 70%; in combination both explaining 71% with virtually all influence of ISSupport subsumed by IS-Impact. Key study contributions to research include: (1) validation of IS-Impact in the HR context, (2) validation of a newly conceptualised IS-Support construct as important antecedent of Satisfaction, and (3) validation of the redundancy of IS-Support when gauging IS-Impact. The study also makes valuable contributions to practice, the research track and the sponsoring organisation.

Producing solidarity : a settlement strategy of the Karen refugee community in Brisbane, Australia

This paper explores the link between experience and context. It places the lived experiences of Karen refugees during settlement in Brisbane, Australia within the socio-political context of Burma, or particularly the historical context of persecution. Two key events – the Wrist-tying Ceremony and the Karen New Year – provide a link between experience and context. The findings of this study show a community strategically at work in a new and ongoing settlement process. This process pays respect to the complexities of cultural integrity whilst also engaging with the challenges of integration. The complexities are local (in terms of cultural, linguistic and religious diversity), national (maintaining a broader sense of community that includes linkages across Australia, as well as an engagement with the Australian socio-political context), and transnational (participating in a global Karen community). This transnational community encompasses Karen settling elsewhere in the world, Karen in refugee camps neighbouring Burma, and Karen living inside Burma. This paper argues that substantial “identity work” is involved in Karen settlement. The two key community events are useful vignettes of this identity work. Both events demonstrate how Karen cultural practices can meaningfully negotiate deeply historical ideas of Karen identity with contemporary challenges of settlement. In addition, they set out a version of settlement that departs from traditional settlement constructs; they show how the lived experience of settlement is messy, complex and dynamic, and not reflective of the neat, idealistic models that immigration policy and settlement theory project.

Identity verification in conveyancing : the failure of current legislative and regulatory measures, and recommendations for change

"Defrauding land titles systems impacts upon us all. Those who deal in land include ordinary citizens, big business, small business, governments, not-for-profit organisation, deceased estates...Fraud here touches almost everybody." the thesis presented in this paper is that the current and disparate steps taken by jurisdictions to alleviate land fraud associated with identity-based crimes are inadequate. The centrepiece of the analysis is the consideration of two scenarios that have recently occurred. One is the typical scenario where a spouse forges the partner's signature to obtain a mortgage from a financial institution. The second is atypical. It involves a sophisticated overseas fraud duping many stakeholders involved in the conveyancing process. After outlining these scenarios, we will examine how identity verification requirements of the United Kingdom, Ontario, the Australian states, and New Zealand would have been applied to these two frauds. Our conclusion is that even though some jurisdictions may have prevented the frauds from occurring, the current requirements are inadequate. We use the lessons learnt to propose what we consider core principles for identity verification in land transactions.

Ecological dynamics as a theoretical framework for development of sustainable behaviours towards the environment

This paper proposes how the theoretical framework of ecological dynamics can provide an influential model of the learner and the learning process to pre-empt effective behaviour changes. Here we argue that ecological dynamics supports a well established model of the learner ideally suited to the environmental education context because of its emphasis on the learner-environment relationship. The model stems from perspectives on behaviour change in ecological psychology and dynamical systems theory. The salient points of the model are highlighted for educators interested in manipulating environmental constraints in the learning process, with the aim of designing effective learning programs in environmental education. We conclude by providing generic principles of application which might define the learning process in environmental education programs.

Welfare-to-work and the experience of single mothers in Australia : where are the benefits?

In July 2006 ‘welfare-to-work’ policies were introduced for single parents in Australia. These policies require most single parents with school aged children to be employed or seeking employment of 15-25 hours per week in return for their income support payment. The changes represented a sharp increase in the obligations applying to single parents on income support. This paper is concerned with how the well-being of single mothers who are combining income support and paid employment is being influenced by these stepped up activity requirements. The paper draws on data from semi-structured interviews with 21 Brisbane single mothers. The analysis explores participants’ experiences in the new policy environment utilizing the theoretical framework of ‘relational autonomy’. Relational approaches to autonomy emphasize the importance of relations of dependency and interdependency to the development of autonomy and well-being. The findings indicate that in their dealings with the welfare bureaucracy participants experienced a lack of recognition of their identities as mothers, paid workers and competent decision makers. These experiences have negative consequences for self worth, relational autonomy and ultimately the well-being of single parent families.

Handover : the collective narrative of nursing practice

This paper examines the practice of handover in a large metropolitan hospital. It shows that the handover is a significant site at which to examine how tensions and imperatives derived from the traditional institutional position and role of the nurse are played out in contradiction with emergent professionalism. It identifies handover dimensions and focuses discussion on how the collective narrative of the handover serves to construct patient identities as well as ensure solidarity and cohesion among nurses.

A taxonomy of model-based testing approaches

Model-based testing (MBT) relies on models of a system under test and/or its environment to derive test cases for the system. This paper discusses the process of MBT and defines a taxonomy that covers the key aspects of MBT approaches. It is intended to help with understanding the characteristics, similarities and differences of those approaches, and with classifying the approach used in a particular MBT tool. To illustrate the taxonomy, a description of how three different examples of MBT tools fit into the taxonomy is provided.

Studying in Cuba, returning home to work : experiences of graduates from the English-speaking Caribbean

Cuba’s higher education scholarship program has received little attention in the literature on education and development. In this chapter, I discuss themes that emerge from my interviews with graduates from English-speaking Caribbean countries who studied in Cuba, as well as Cuban educators, on the nature of their academic programs and their subsequent careers. This facilitates exploration of a number of questions, including the following: 1. How, in the perceptions of scholarship students and graduates, have they experienced the philosophy of combing study, practical work, and research in the tertiary education curriculum in Cuban universities? 2. What impact does studying in Cuba appear to have on graduates after they return to their home countries? 3. How does the experience of the graduates throw light on the relationship between tertiary education and national development?

Experiencing and imagining new ways of becoming TESOL teachers

The question has been asked "Can we shape an imaginative teacher identity?" (Garrod 2005). This research explores how participating in an overseas school experience can contribute to developing TESOL teachers' professional identities. The particular context for this research is the experiences of a group of Hong Kong pre-service TESOL teachers attending a short language immersion program at a university in Australia. As part of this program, the teachers are attached to a local school, where they observe and interact with the school community. This research tracks the teachers' perceptions of how this experience has contributed to their understandings of what it means to be a TESOL teacher and to their own developing sense of professional identity. It is suggested that engaging in critical reflection on this intercultural experience can develop teacher knowledge, practice and sense of self. Recent research (Swain, in press) posits that verbal protocols, such as 'stimulated recall' are part of the learning process rather than mere data collection techniques. How can this potential of 'stimulated recall' be realized as part of the learning processes in TESOL teacher education?

Returning to the roots of culture : a review and re-conceptualisation of safety culture

Despite significant research, there is still little agreement over how to define safety culture or of what it is comprised. Due to this lack of agreement, much of the safety culture research has little more than safety management strategies in common. There is, however, a degree of acceptance of the close relationship between safety culture and organisational culture. Organisational culture can be described using traditional views of culture drawn from the anthropology and cultural psychology literature. However, the safety culture literature rarely ventures beyond organisational culture into discussions of these more traditional concepts of culture. There is a need to discuss how these concepts of culture can be applied to safety culture to provide greater understanding of safety culture and additional means by which to approach safety in the workplace. This review explores how three traditional conceptualisations of culture; the normative, anthropological and pragmatist conceptualisations, can and have been be applied to safety culture. Finally the review proposes a synthesised conceptualisation of safety culture which can be used to provide greater depth and practical applicability of safety culture, by increasing our understanding of the interactions between cultural and contextual variables in a given workplace and the effect they have on safety.

A comparison study on hydrogen sensing performance of Pt/MoO3 nanoplatelets coated with a thin layer of Ta2O5 or La2O3

In this work, we investigate how hydrogen sensing performance of thermally evaporated MoO3 nanoplatelets can be further improved by RF sputtering a thin layer of tantalum oxide (Ta2O5) or lanthanum oxide (La2O3). We show that dissociated hydrogen atoms cause the thin film layer to be polarised, inducing a measurable potential difference greater than that as reported previously. We attribute these observations to the presence of numerous traps in the thin layer; their states allow a stronger trapping of charge at the Pt-thin film oxide interface as compared to the MoO3 sensors without the coating. Under exposure to H2 (10 000 ppm) the maximum change in dielectric constant of 45.6 (at 260 °C) for the Ta2O5/MoO3 nanoplatelets and 31.6 (at 220 °C) for La2O3/MoO3 nanoplatelets. Subsequently, the maximum sensitivity for the Ta2O5/MoO3 is 16.87 (at 260 °C) and La2O3/MoO3 is 7.52 (at 300 °C).

‘Working with the team’ : an exploratory study of improved type 2 diabetes management in a new model of integrated primary/secondary care

This study aimed to explore how a new model of integrated primary/secondary care for type 2 diabetes management, the Brisbane South Complex Diabetes Service (BSCDS), related to improved diabetes management in a selected group of patients. We used a qualitative research design to obtain detailed accounts from the BSCDS via semi-structured interviews with 10 patients. The interviews were fully transcribed and systematically coded using a form of thematic analysis. Participants’ responses were grouped in relation to: (1) Patient-centred care; (2) Effective multiprofessional teamwork; and (3) Empowering patients. The key features of this integrated primary/secondary care model were accessibility and its delivery within a positive health care environment, clear and supportive interpersonal communication between patients and health care providers, and patients seeing themselves as being part of the team-based care. The BSCDS delivered patient-centred care and achieved patient engagement in ways that may have contributed to improved type 2 diabetes management in these participants.

Identification and evaluation of service bundles for governmental one-stop portals

Recent advances in the area of ‘Transformational Government’ position the citizen at the centre of focus. This paradigm shift from a department-centric to a citizen-centric focus requires governments to re-think their approach to service delivery, thereby decreasing costs and increasing citizen satisfaction. The introduction of franchises as a virtual business layer between the departments and their citizens is intended to provide a solution. Franchises are structured to address the needs of citizens independent of internal departmental structures. For delivering services online, governments pursue the development of a One-Stop Portal, which structures information and services through those franchises. Thus, each franchise can be mapped to a specific service bundle, which groups together services that are deemed to be of relevance to a specific citizen need. This study focuses on the development and evaluation of these service bundles. In particular, two research questions guide the line of investigation of this study: Research Question 1): What methods can be used by governments to identify service bundles as part of governmental One-Stop Portals? Research Question 2): How can the quality of service bundles in governmental One-Stop Portals be evaluated? The first research question asks about the identification of suitable service bundle identification methods. A literature review was conducted, to, initially, conceptualise the service bundling task, in general. As a consequence, a 4-layer model of service bundling and a morphological box were created, detailing characteristics that are of relevance when identifying service bundles. Furthermore, a literature review of Decision-Support Systems was conducted to identify approaches of relevance in different bundling scenarios. These initial findings were complemented by targeted studies of multiple leading governments in the e-government domain, as well as with a local expert in the field. Here, the aim was to identify the current status of online service delivery and service bundling in practice. These findings led to the conceptualising of two service bundle identification methods, applicable in the context of Queensland Government: On the one hand, a provider-driven approach, based on service description languages, attributes, and relationships between services was conceptualised. As well, a citizen-driven approach, based on analysing the outcomes from content identification and grouping workshops with citizens, was also conceptualised. Both methods were then applied and evaluated in practice. The conceptualisation of the provider-driven method for service bundling required the initial specification of relevant attributes that could be used to identify similarities between services called relationships; these relationships then formed the basis for the identification of service bundles. This study conceptualised and defined seven relationships, namely ‘Co-location’, ‘Resource’, ‘Co-occurrence’, ‘Event’, ‘Consumer’, ‘Provider’, and ‘Type’. The relationships, and the bundling method itself, were applied and refined as part of six Action Research cycles in collaboration with the Queensland Government. The findings show that attributes and relationships can be used effectively as a means for bundle identification, if distinct decision rules are in place to prescribe how services are to be identified. For the conceptualisation of the citizen-driven method, insights from the case studies led to the decision to involve citizens, through card sorting activities. Based on an initial list of services, relevant for a certain franchise, participating citizens grouped services according to their liking. The card sorting activity, as well as the required analysis and aggregation of the individual card sorting results, was analysed in depth as part of this study. A framework was developed that can be used as a decision-support tool to assist with the decision of what card sorting analysis method should be utilised in a given scenario. The characteristic features associated with card sorting in a government context led to the decision to utilise statistical analysis approaches, such as cluster analysis and factor analysis, to aggregate card sorting results. The second research question asks how the quality of service bundles can be assessed. An extensive literature review was conducted focussing on bundle, portal, and e-service quality. It was found that different studies use different constructs, terminology, and units of analysis, which makes comparing these models a difficult task. As a direct result, a framework was conceptualised, that can be used to position past and future studies in this research domain. Complementing the literature review, interviews conducted as part of the case studies with leaders in e-government, indicated that, typically, satisfaction is evaluated for the overall portal once the portal is online, but quality tests are not conducted during the development phase. Consequently, a research model which appropriately defines perceived service bundle quality would need to be developed from scratch. Based on existing theory, such as Theory of Reasoned Action, Expectation Confirmation Theory, and Theory of Affordances, perceived service bundle quality was defined as an inferential belief. Perceived service bundle quality was positioned within the nomological net of services. Based on the literature analysis on quality, and on the subsequent work of a focus group, the hypothesised antecedents (descriptive beliefs) of the construct and the associated question items were defined and the research model conceptualised. The model was then tested, refined, and finally validated during six Action Research cycles. Results show no significant difference in higher quality or higher satisfaction among users for either the provider-driven method or for the citizen-driven method. The decision on which method to choose, it was found, should be based on contextual factors, such as objectives, resources, and the need for visibility. The constructs of the bundle quality model were examined. While the quality of bundles identified through the citizen-centric approach could be explained through the constructs ‘Navigation’, ‘Ease of Understanding’, and ‘Organisation’, bundles identified through the provider-driven approach could be explained solely through the constructs ‘Navigation’ and ‘Ease of Understanding’. An active labelling style for bundles, as part of the provider-driven Information Architecture, had a larger impact on ‘Quality’ than the topical labelling style used in the citizen-centric Information Architecture. However, ‘Organisation’, reflecting the internal, logical structure of the Information Architecture, was a significant factor impacting on ‘Quality’ only in the citizen-driven Information Architecture. Hence, it was concluded that active labelling can compensate for a lack of logical structure. Further studies are needed to further test this conjecture. Such studies may involve building alternative models and conducting additional empirical research (e.g. use of an active labelling style for the citizen-driven Information Architecture). This thesis contributes to the body of knowledge in several ways. Firstly, it presents an empirically validated model of the factors explaining and predicting a citizen’s perception of service bundle quality. Secondly, it provides two alternative methods that can be used by governments to identify service bundles in structuring the content of a One-Stop Portal. Thirdly, this thesis provides a detailed narrative to suggest how the recent paradigm shift in the public domain, towards a citizen-centric focus, can be pursued by governments; the research methodology followed by this study can serve as an exemplar for governments seeking to achieve a citizen-centric approach to service delivery.

Introducing Masculinity Studies to Information Systems research : the case of Gaydar

I believe that studies of men's gendered experiences of information systems are needed. In order to support this claim, I introduce the area of Masculinity Studies to Information Systems research and, using this, present an exploratory analysis of an internet dating website for gay men – Gaydar. The information system, which forms part of the Gaydar community, is shown to shape, and be shaped by the members as they accept and challenge aspects of it as related to their identities. In doing this, I show how the intertwined processes of information systems development and use contribute to the creation of diverse interpretations of masculinity within a group of men. In sum, my analysis highlights different kinds of men and different versions of masculinity that can sometimes be associated with different experiences of information systems. The implications of this work centre on the need to expand our knowledge of men's gendered experiences with information systems, to reflect upon processes of technology facilitated categorisation and to consider the influences that contribute to the roll out of particular software features along with the underlying rationales for market segmentation in the software and software-based services industries.

Supporting transition to law school and student well-being : the role of professional legal identity

The empirically established decline in law student well being during the first year of law school is a red-flagged imprimatur for first year curriculum change. This article suggests that by engaging law students with the concept of a positive professional identity, student engagement and intrinsic motivation will increase because they are working towards a career goal that has meaning and purpose. Law school is a time of professional transformation and the legal academy can take steps to ensure that this transformation is inculcated with positive messages. Literature from the fields of law and psychology is analysed in this article, to explain how a positive conception of the legal profession (and a student’s future role within it) can increase a student’s psychological well-being – at law school and beyond.