Evaluating the success of large-scale, integrated information systems through the lens of IS-impact and IS-support

This study proceeds from a central interest in the importance of systematically evaluating operational large-scale integrated information systems (IS) in organisations. The study is conducted within the IS-Impact Research Track at Queensland University of Technology (QUT). The goal of the IS-Impact Track is, "to develop the most widely employed model for benchmarking information systems in organizations for the joint benefit of both research and practice" (Gable et al, 2009). The track espouses programmatic research having the principles of incrementalism, tenacity, holism and generalisability through replication and extension research strategies. Track efforts have yielded the bicameral IS-Impact measurement model; the ‘impact’ half includes Organisational-Impact and Individual-Impact dimensions; the ‘quality’ half includes System-Quality and Information-Quality dimensions. Akin to Gregor’s (2006) analytic theory, the ISImpact model is conceptualised as a formative, multidimensional index and is defined as "a measure at a point in time, of the stream of net benefits from the IS, to date and anticipated, as perceived by all key-user-groups" (Gable et al., 2008, p: 381). The study adopts the IS-Impact model (Gable, et al., 2008) as its core theory base. Prior work within the IS-Impact track has been consciously constrained to Financial IS for their homogeneity. This study adopts a context-extension strategy (Berthon et al., 2002) with the aim "to further validate and extend the IS-Impact measurement model in a new context - i.e. a different IS - Human Resources (HR)". The overarching research question is: "How can the impacts of large-scale integrated HR applications be effectively and efficiently benchmarked?" This managerial question (Cooper & Emory, 1995) decomposes into two more specific research questions – In the new HR context: (RQ1): "Is the IS-Impact model complete?" (RQ2): "Is the ISImpact model valid as a 1st-order formative, 2nd-order formative multidimensional construct?" The study adhered to the two-phase approach of Gable et al. (2008) to hypothesise and validate a measurement model. The initial ‘exploratory phase’ employed a zero base qualitative approach to re-instantiating the IS-Impact model in the HR context. The subsequent ‘confirmatory phase’ sought to validate the resultant hypothesised measurement model against newly gathered quantitative data. The unit of analysis for the study is the application, ‘ALESCO’, an integrated large-scale HR application implemented at Queensland University of Technology (QUT), a large Australian university (with approximately 40,000 students and 5000 staff). Target respondents of both study phases were ALESCO key-user-groups: strategic users, management users, operational users and technical users, who directly use ALESCO or its outputs. An open-ended, qualitative survey was employed in the exploratory phase, with the objective of exploring the completeness and applicability of the IS-Impact model’s dimensions and measures in the new context, and to conceptualise any resultant model changes to be operationalised in the confirmatory phase. Responses from 134 ALESCO users to the main survey question, "What do you consider have been the impacts of the ALESCO (HR) system in your division/department since its implementation?" were decomposed into 425 ‘impact citations.’ Citation mapping using a deductive (top-down) content analysis approach instantiated all dimensions and measures of the IS-Impact model, evidencing its content validity in the new context. Seeking to probe additional (perhaps negative) impacts; the survey included the additional open question "In your opinion, what can be done better to improve the ALESCO (HR) system?" Responses to this question decomposed into a further 107 citations which in the main did not map to IS-Impact, but rather coalesced around the concept of IS-Support. Deductively drawing from relevant literature, and working inductively from the unmapped citations, the new ‘IS-Support’ construct, including the four formative dimensions (i) training, (ii) documentation, (iii) assistance, and (iv) authorisation (each having reflective measures), was defined as: "a measure at a point in time, of the support, the [HR] information system key-user groups receive to increase their capabilities in utilising the system." Thus, a further goal of the study became validation of the IS-Support construct, suggesting the research question (RQ3): "Is IS-Support valid as a 1st-order reflective, 2nd-order formative multidimensional construct?" With the aim of validating IS-Impact within its nomological net (identification through structural relations), as in prior work, Satisfaction was hypothesised as its immediate consequence. The IS-Support construct having derived from a question intended to probe IS-Impacts, too was hypothesised as antecedent to Satisfaction, thereby suggesting the research question (RQ4): "What is the relative contribution of IS-Impact and IS-Support to Satisfaction?" With the goal of testing the above research questions, IS-Impact, IS-Support and Satisfaction were operationalised in a quantitative survey instrument. Partial least squares (PLS) structural equation modelling employing 221 valid responses largely evidenced the validity of the commencing IS-Impact model in the HR context. ISSupport too was validated as operationalised (including 11 reflective measures of its 4 formative dimensions). IS-Support alone explained 36% of Satisfaction; IS-Impact alone 70%; in combination both explaining 71% with virtually all influence of ISSupport subsumed by IS-Impact. Key study contributions to research include: (1) validation of IS-Impact in the HR context, (2) validation of a newly conceptualised IS-Support construct as important antecedent of Satisfaction, and (3) validation of the redundancy of IS-Support when gauging IS-Impact. The study also makes valuable contributions to practice, the research track and the sponsoring organisation.

Measuring literalism and symbolism in advertisements : scale development and validation

A basic element in advertising strategy is the choice of an appeal. Many researchers have studied communication message form and specifically forms of literalism and symbolism, or some variation. The motives for such study are grounded in increasing the effectiveness of commercial communication messages, especially advertising messages. Advertising research studies typically use forms of literalism (e.g. informativeness) or symbolism (e.g. metaphoric, tropes, schemes figures of speech, and rhetorical figures) as independent variables and compare these against one or more of the traditional advertising effectiveness measures as dependent variable(s). The main challenge in assessing the effectiveness of literalism or symbolism in message content is the discreet identification of the construct. However, no standard, empirically-tested measure was located in the literature.

Exploratory factor analysis and psychometric evaluation of the Teachers Reporting Attitude Scale for Child Sexual Abuse

This paper presents an evaluation of an instrument to measure teachers’ attitudes towards reporting child sexual abuse and discusses the instrument’s merit for research into reporting practice. Based on responses from 444 Australian teachers, the Teachers’ Reporting Attitude Scale for Child Sexual Abuse (TRAS - CSA) was evaluated using exploratory factor analysis. The scale isolated three dimensions: commitment to the reporting role; confidence in the system’s response to reports; and concerns about reporting. These three factors accounted for 37.5% of the variance in the 14-item measure. Alpha coefficients for the subscales were 0.769 (commitment), 0.617 (confidence), and 0.661 (concerns). The findings provide insights into the complexity of studying teachers’ attitudes towards reporting of child sexual abuse, and have implications for future research.

A dual-scale modelling approach for drying hygroscopic porous media

A new dualscale modelling approach is presented for simulating the drying of a wet hygroscopic porous material that couples the porous medium (macroscale) with the underlying pore structure (microscale). The proposed model is applied to the convective drying of wood at low temperatures and is valid in the so-called hygroscopic range, where hygroscopically held liquid water is present in the solid phase and water exits only as vapour in the pores. Coupling between scales is achieved by imposing the macroscopic gradients of moisture content and temperature on the microscopic field using suitably-defined periodic boundary conditions, which allows the macroscopic mass and thermal fluxes to be defined as averages of the microscopic fluxes over the unit cell. This novel formulation accounts for the intricate coupling of heat and mass transfer at the microscopic scale but reduces to a classical homogenisation approach if a linear relationship is assumed between the microscopic gradient and flux. Simulation results for a sample of spruce wood highlight the potential and flexibility of the new dual-scale approach. In particular, for a given unit cell configuration it is not necessary to propose the form of the macroscopic fluxes prior to the simulations because these are determined as a direct result of the dual-scale formulation.

Multicultural mental health awareness scale

Australia is one of the most culturally and linguistically diverse (CALD) society in the world. There are individuals from all over the globe settled in Australia. They enter Australia as migrants or refugees. Although, the process of migration differs from individual to individual, it can be an uprooting experience and can bring with it many mental health challenges which need professional attention. Mainstream allied and mental health professionals need to be prepared for this diverse population and their mental health issues and concerns. These professionals may have to offer multicultural counselling to clients from an ethnic and cultural background, which is very different from their own. It is therefore essential for them to demonstrate multicultural counselling competencies (MCC)...

Role of kilometer-scale weak circular heterogeneities on upper crustal deformation patterns: Evidence from scaled analogue modeling and the Sudbury Basin, Canada

The Sudbury Basin is a non-cylindrical fold basin occupying the central portion of the Sudbury Impact Structure. The impact structure lends itself excellently to explore the structural evolution of continental crust containing a circular region of long-term weakness. In a series of scaled analogue experiments various model crustal configurations were shortened horizontally at a constant rate. In mechanically weakened crust, model basins formed that mimic several first-order structural characteristics of the Sudbury Basin: (1) asymmetric, non-cylindrical folding of the Basin, (2) structures indicating concentric shortening around lateral basin termini and (3) the presence of a zone of strain concentration near the hinge zones of model basins. Geometrically and kinematically this zone corresponds to the South Range Shear Zone of the Sudbury Basin. According to our experiments, this shear zone is a direct mechanical consequence of basin formation, rather than the result of thrusting following folding. Overall, the models highlight the structurally anomalous character of the Sudbury Basin within the Paleoproterozoic Eastern Penokean Orogen. In particular, our models suggest that the Basin formed by pure shear thickening of crust, whereas transpressive deformation prevailed elsewhere in the orogen. The model basin is deformed by thickening and non-cylindrical synformal buckling, while conjugate transpressive shear zones propagated away from its lateral tips. This is consistent with pure shear deformation of a weak circular inclusion in a strong matrix. The models suggest that the Sudbury Basin formed as a consequence of long-term weakening of the upper crust by meteorite impact.

The causes of sinuous crustal-scale deformation patterns in hot orogens: Evidence from scaled analogue experiments and the southern Central Andes

The cause of upper-crustal segmentation into rhomb-shaped, shear zone-bound domains associated with contractional sedimentary basins in hot, wide orogens is not well understood. Here we use scaled multilayered analogue experiments to investigate the role of an orogen-parallel crustal-strength gradient on the formation of such structures. We show that the aspect ratio and size of domains, the sinuous character and abundance of transpressional shear zones vary with the integrated mechanical strength of crust. Upper-crustal deformation patterns and the degree of strain localization in the experiments are controlled by the ratio between the brittle and ductile strength in the model crust as well as gradients in tectonic and buoyancy forces. The experimental results match the first-order kinematic and structural characteristics of the southern Central Andes and provide insight on the dynamics of underlying deformation patterns in hot, wide orogens.

The Multidimensional Loss Scale : validating a cross cultural instrument for measuring loss in Burmese refugees

The Multidimensional Loss Scale: Initial Development and Psychometric Evaluation The Multidimensional Loss Scale (MLS) represents the first instrument designed specifically to measure loss in refugee populations. Researchers developed initial items of the Multidimensional Loss Scale to assess Experience of Loss Events and Loss Distress in a culturally sensitive manner across multiple domains (social, material, intra-personal and cultural). A sample of 70 recently settled Burmese adult refugees completed a battery of questionnaires, including new scale items. Analyses explored the scale’s factor structure, internal consistency, convergent validity and divergent validity. Principal Axis Factoring supported a five-factor model: Loss of Symbolic Self, Loss of Interdependence, Loss of Home, Interpersonal Loss, and Loss of Intrapersonal Integrity. Chronbach’s Alphas indicated satisfactory internal consistency for Experience of Loss Events (.85) and Loss Distress (.92). Convergent and divergent validity of Loss Distress were supported by moderate correlations with interpersonal grief and trauma symptoms and weak correlations with depression and anxiety. The new scale was well received by people from refugee backgrounds and shows promise for application in future research and practice

Development and validation of the consumer disillusionment toward marketing activity scale

This study examines disillusioned consumers. The theory proposes that this is a group learning to lower their expectations of firm integrity and who, to avoid being let down, ignore marketing activity directly from the firm. This kind of exchange orientation develops as a response to consistent failure in perceptions of firm integrity. The research includes six studies, including over 600 adult consumers, to outline the development and validation of a measure of consumer disillusionment toward marketing activity. Completing the process provides a valid and reliable four-item measure. In addition, the study includes the assessment of the nomological validity of the construct. The nomological validation includes using cue utilization theory to predict that disillusioned consumers favor advertising that provides evidence of verifiable integrity. The validation experiment uses print advertising containing high and low verifiable integrity stimuli. Results confirm the theory with disillusioned consumers focusing less on the firm as source of information. Further, these consumers respond more favorably than non-disillusioned consumers to third party endorsers who serve to verify the firm's attempts to show integrity.

Confronting the shortage of skilled and professional workers : A large scale industry-school partnership initiative

In most of the advanced economies, students are losing interest in careers especially in engineering and related industries. Hence, western economies are confronting a critical skilled labour shortage in areas of technology, science and engineering. The aim of this paper is to document how the organisational and institutional elements of one industry-school partnerships initiative – The Gateway Schools Program - contribute to productive knowledge sharing and networking. In particular this paper focuses on an initiative of an Australian State government in response to a perceived crisis around the skills shortage in an economy transitioning from a localised to a global knowledge production economy. The Gateway Schools initiative signals the first sustained attempt in Australia to incorporate schools into production networks through strategic partnerships linking them to partner organisations at the industry level. We provide case examples of how four schools operationalise the partnerships with the mining and energy industries and how these partnerships as knowledge assets impact the delivery of curriculum and capacity building among teachers. A program theory approach to analysis, informed by theoretical perspectives of Bailey (1994), Bagnall (2007) and Walsh (2004) was adopted. Each of these theorists provides a related but different perspective on the establishment, purpose, and effectiveness respectively of partnerships. Our ultimate goal is to define those characteristics of successful partnerships that do contribute to enhanced interest and engagement by students in those careers that are currently experiencing critical shortages.

Clinical trial of the Norton Scale in acute care settings

This study investigated the effect of using Norton Scale assessment data in the nursing care of patients at risk of developing pressure ulcers. The results indicated that incorporating the Norton Scale in care planning resulted in benefits to patients through earlier and more effective nursing interventions.

Teacher Reporting Attitudes Scale (TRAS): confirmatory and exploratory factor analyses with a Malaysian sample.

The Teacher Reporting Attitude Scale (TRAS) is a newly developed tool to assess teachers’ attitudes toward reporting child abuse and neglect. This article reports on an investigation of the factor structure and psychometric properties of the short form Malay version of the TRAS. A self-report cross-sectional survey was conducted with 667 teachers in 14 randomly selected schools in Selangor state, Malaysia. Analyses were conducted in a 3-stage process using both confirmatory (stages 1 and 3) and exploratory factor analyses (stage 2) to test, modify, and confirm the underlying factor structure of the TRAS in a non-Western teacher sample. Confirmatory factor analysis did not support a 3-factor model previously reported in the original TRAS study. Exploratory factor analysis revealed an 8-item, 4-factor structure. Further confirmatory factor analysis demonstrated appropriateness of the 4-factor structure. Reliability estimates for the four factors—commitment, value, concern, and confidence—were moderate. The modified short form TRAS (Malay version) has potential to be used as a simple tool for relatively quick assessment of teachers’ attitudes toward reporting child abuse and neglect. Cross-cultural differences in attitudes toward reporting may exist and the transferability of newly developed instruments to other populations should be evaluated.

Utility of the Mild Brain Injury Atypical Symptoms Scale to detect symptom exaggeration : an analogue simulation study

Brief self-report symptom checklists are often used to screen for postconcussional disorder (PCD) and posttraumatic stress disorder (PTSD) and are highly susceptible to symptom exaggeration. This study examined the utility of the five-item Mild Brain Injury Atypical Symptoms Scale (mBIAS) designed for use with the Neurobehavioral Symptom Inventory (NSI) and the PTSD Checklist–Civilian (PCL–C). Participants were 85 Australian undergraduate students who completed a battery of self-report measures under one of three experimental conditions: control (i.e., honest responding, n = 24), feign PCD (n = 29), and feign PTSD (n = 32). Measures were the mBIAS, NSI, PCL–C, Minnesota Multiphasic Personality Inventory–2, Restructured Form (MMPI–2–RF), and the Structured Inventory of Malingered Symptomatology (SIMS). Participants instructed to feign PTSD and PCD had significantly higher scores on the mBIAS, NSI, PCL–C, and MMPI–2–RF than did controls. Few differences were found between the feign PCD and feign PTSD groups, with the exception of scores on the NSI (feign PCD > feign PTSD) and PCL–C (feign PTSD > feign PCD). Optimal cutoff scores on the mBIAS of ≥8 and ≥6 were found to reflect “probable exaggeration” (sensitivity = .34; specificity = 1.0; positive predictive power, PPP = 1.0; negative predictive power, NPP = .74) and “possible exaggeration” (sensitivity = .72; specificity = .88; PPP = .76; NPP = .85), respectively. Findings provide preliminary support for the use of the mBIAS as a tool to detect symptom exaggeration when administering the NSI and PCL–C.

A known-groups evaluation of the Response Bias Scale in a neuropsychological setting

We evaluated the Minnesota Multiphasic Personality Inventory-Second Edition (MMPI-2) Response Bias Scale (RBS). Archival data from 83 individuals who were referred for neuropsychological assessment with no formal diagnosis (n = 10), following a known or suspected traumatic brain injury (n = 36), with a psychiatric diagnosis (n = 20), or with a history of both trauma and a psychiatric condition (n = 17) were retrieved. The criteria for malingered neurocognitive dysfunction (MNCD) were applied, and two groups of participants were formed: poor effort (n = 15) and genuine responders (n = 68). Consistent with previous studies, the difference in scores between groups was greatest for the RBS (d = 2.44), followed by two established MMPI-2 validity scales, F (d = 0.25) and K (d = 0.23), and strong significant correlations were found between RBS and F (rs = .48) and RBS and K (r = −.41). When MNCD group membership was predicted using logistic regression, the RBS failed to add incrementally to F. In a separate regression to predict group membership, K added significantly to the RBS. Receiver-operating curve analysis revealed a nonsignificant area under the curve statistic, and at the ideal cutoff in this sample of >12, specificity was moderate (.79), sensitivity was low (.47), and positive and negative predictive power values at a 13% base rate were .25 and .91, respectively. Although the results of this study require replication because of a number of limitations, this study has made an important first attempt to report RBS classification accuracy statistics for predicting poor effort at a range of base rates.