An evaluation of IS-impact utility and intuitiveness

This study is conducted within the IS-Impact Research Track at Queensland University of Technology (QUT). The goal of the IS-Impact Track is, "to develop the most widely employed model for benchmarking information systems in organizations for the joint benefit of both research and practice" (Gable et al, 2006). IS-Impact is defined as "a measure at a point in time, of the stream of net benefits from the IS [Information System], to date and anticipated, as perceived by all key-user-groups" (Gable Sedera and Chan, 2008). Track efforts have yielded the bicameral IS-Impact measurement model; the "impact" half includes Organizational-Impact and Individual-Impact dimensions; the "quality" half includes System-Quality and Information-Quality dimensions. The IS-Impact model, by design, is intended to be robust, simple and generalisable, to yield results that are comparable across time, stakeholders, different systems and system contexts. The model and measurement approach employs perceptual measures and an instrument that is relevant to key stakeholder groups, thereby enabling the combination or comparison of stakeholder perspectives. Such a validated and widely accepted IS-Impact measurement model has both academic and practical value. It facilitates systematic operationalisation of a main dependent variable in research (IS-Impact), which can also serve as an important independent variable. For IS management practice it provides a means to benchmark and track the performance of information systems in use. From examination of the literature, the study proposes that IS-Impact is an Analytic Theory. Gregor (2006) defines Analytic Theory simply as theory that ‘says what is’, base theory that is foundational to all other types of theory. The overarching research question thus is "Does IS-Impact positively manifest the attributes of Analytic Theory?" In order to address this question, we must first answer the question "What are the attributes of Analytic Theory?" The study identifies the main attributes of analytic theory as: (1) Completeness, (2) Mutual Exclusivity, (3) Parsimony, (4) Appropriate Hierarchy, (5) Utility, and (6) Intuitiveness. The value of empirical research in Information Systems is often assessed along the two main dimensions - rigor and relevance. Those Analytic Theory attributes associated with the ‘rigor’ of the IS-Impact model; namely, completeness, mutual exclusivity, parsimony and appropriate hierarchy, have been addressed in prior research (e.g. Gable et al, 2008). Though common tests of rigor are widely accepted and relatively uniformly applied (particularly in relation to positivist, quantitative research), attention to relevance has seldom been given the same systematic attention. This study assumes a mainly practice perspective, and emphasises the methodical evaluation of the Analytic Theory ‘relevance’ attributes represented by the Utility and Intuitiveness of the IS-Impact model. Thus, related research questions are: "Is the IS-Impact model intuitive to practitioners?" and "Is the IS-Impact model useful to practitioners?" March and Smith (1995), identify four outputs of Design Science: constructs, models, methods and instantiations (Design Science research may involve one or more of these). IS-Impact can be viewed as a design science model, composed of Design Science constructs (the four IS-Impact dimensions and the two model halves), and instantiations in the form of management information (IS-Impact data organised and presented for management decision making). In addition to methodically evaluating the Utility and Intuitiveness of the IS-Impact model and its constituent constructs, the study aims to also evaluate the derived management information. Thus, further research questions are: "Is the IS-Impact derived management information intuitive to practitioners?" and "Is the IS-Impact derived management information useful to practitioners? The study employs a longitudinal design entailing three surveys over 4 years (the 1st involving secondary data) of the Oracle-Financials application at QUT, interspersed with focus groups involving senior financial managers. The study too entails a survey of Financials at four other Australian Universities. The three focus groups respectively emphasise: (1) the IS-Impact model, (2) the 2nd survey at QUT (descriptive), and (3) comparison across surveys within QUT, and between QUT and the group of Universities. Aligned with the track goal of producing IS-Impact scores that are highly comparable, the study also addresses the more specific utility-related questions, "Is IS-Impact derived management information a useful comparator across time?" and "Is IS-Impact derived management information a useful comparator across universities?" The main contribution of the study is evidence of the utility and intuitiveness of IS-Impact to practice, thereby further substantiating the practical value of the IS-Impact approach; and also thereby motivating continuing and further research on the validity of IS-Impact, and research employing the ISImpact constructs in descriptive, predictive and explanatory studies. The study also has value methodologically as an example of relatively rigorous attention to relevance. A further key contribution is the clarification and instantiation of the full set of analytic theory attributes.

Skill development and social inclusion via peer assisted learning in first-year higher education : an evaluation of student experiences across two law units

Because professions seek graduates who can 'collaborate, share skills and knowledge, and communicate' (Kruck and Reif, 2001, p 37), it is important that university graduates are not equipped solely with the content knowledge of their discipline, but also with prospective employment skills. Furthermore, when students 'interact more in positive ways with their teachers and peers, they gain more in terms of essential skills and competencies, such as critical thinking, problem~solving [and] effective communication' (NSSE, 2000, p 2)./n this way, peer assisted fellowing has the potential to enhance students' professional development, and provide the social inclusion and engagement necessary for effective learning. This session describes two peer assisted learning models embedded within first year QUT Faculty of Law units. Through a partnership between teaching staff, student mentors and mentees, the models aim to facilitate student socialisation whilst supplementing understanding of substantive law with the development of academic and work·related skills. Mentor and mentee perceptions, and program implications, are considered.

Social media and its impact on crisis communication: Case studies of Twitter use in emergency management in Australia and New Zealand

There is a growing awareness worldwide of the significance of social media to communication in times of both natural and human-created disasters and crises. While the media have long been used as a means of broadcasting messages to communities in times of crisis – bushfires, floods, earthquakes etc. – the significance of social media in enabling many-to-many communication through ubiquitous networked computing and mobile media devices is becoming increasingly important in the fields of disaster and emergency management. This paper undertakes an analysis of the uses made of social media during two recent natural disasters: the January 2011 floods in Brisbane and South-East Queensland in Australia, and the February 2011 earthquake in Christchurch, New Zealand. It is part of a wider project being undertaken by a research team based at the Queensland University of Technology in Brisbane, Australia, that is working with the Queensland Department of Community Safety (DCS) and the EIDOS Institute, and funded by the Australian Research Council (ARC) through its Linkages program. The project combines large-scale, quantitative social media tracking and analysis techniques with qualitative cultural analysis of communication efforts by citizens and officials, to enable both emergency management authorities and news media organisations to develop, implement, and evaluate new social media strategies for emergency communication.

Study Protocol - Alcohol Management Plans (AMPs) in remote indigenous communities in Queensland: their impacts on injury, violence, health and social indicators and their cost-effectiveness

Background In 2002/03 the Queensland Government responded to high rates of alcohol-related harm in discrete Indigenous communities by implementing alcohol management plans (AMPs), designed to include supply and harm reduction and treatment measures. Tighter alcohol supply and carriage restrictions followed in 2008 following indications of reductions in violence and injury. Despite the plans being in place for over a decade, no comprehensive independent review has assessed to what level the designed aims were achieved and what effect the plans have had on Indigenous community residents and service providers. This study will describe the long-term impacts on important health, economic and social outcomes of Queensland’s AMPs. Methods/Design The project has two main studies, 1) outcome evaluation using de-identified epidemiological data on injury, violence and other health and social indicators for across Queensland, including de-identified databases compiled from relevant routinely-available administrative data sets, and 2) a process evaluation to map the nature, timing and content of intervention components targeting alcohol. Process evaluation will also be used to assess the fidelity with which the designed intervention components have been implemented, their uptake and community responses to them and their perceived impacts on alcohol supply and consumption, injury, violence and community health. Interviews and focus groups with Indigenous residents and service providers will be used. The study will be conducted in all 24 of Queensland’s Indigenous communities affected by alcohol management plans. Discussion This evaluation will report on the impacts of the original aims for AMPs, what impact they have had on Indigenous residents and service providers. A central outcome will be the establishment of relevant databases describing the parameters of the changes seen. This will permit comprehensive and rigorous surveillance systems to be put in place and provided to communities empowering them with the best credible evidence to judge future policy and program requirements for themselves. The project will inform impending alcohol policy and program adjustments in Queensland and other Australian jurisdictions. The project has been approved by the James Cook University Human Research Ethics Committee (approval number H4967 & H5241).

Queensland's budget austerity and its impact on social welfare : is the cure worse than the disease?

While considerable attention has been paid to the austerity experiments in Europe, much less attention has been paid to austerity case studies from other parts of the world. This paper examines the case of Queensland, Australia, where the government has pursued austerity measures, while making dire warnings that unless public debt was slashed and the public service sector downsized,Queensland risked becoming the Spain of Australia. The comparison is incomprehensible, given the very different economic situation in Queensland compared with Spain. This comparison constructed a sense of crisis that helped to mask standard neoliberal economic reform. While pursuing neoliberal economic policies,the Queensland Government has also been introducing draconian laws that limit civil liberties and political freedoms for ordinary citizens. This mix of authoritarianism and austerity has met considerable resistance, and this dynamic is discussed in the paper, along with the predictable and unequal impact that austerity measures have had on the general population and social services.

Illuminative evaluation as a method applied to Australian Government policy borrowing and implementation in higher education

Any government deciding to invoke widespread change in its higher education sector through implementation of new policies impacts on every institution and all staff and students, often in both the time taken up and the heightened emotions caused. The central phenomenon that this study addresses is the process and consequences of policy changes in higher education in Australia. The aim of this article is to record the research design through the perspective (evaluation research), theoretical framework (program evaluation) and methods (content analysis, descriptive statistical analysis and bibliometric analysis) applied to the investigation of the 2003 federal government higher education reform package. This approach allows both the intended and unintended consequences arising from the policy implementation of three national initiatives focused on learning and teaching in higher education in Australia to surface. As a result, this program evaluation, also known in some disciplines as policy implementation analysis, will demonstrate the applicability of illuminative evaluation as a methodology and reinforce how program evaluation will assist and advise future government reform and policy implementation, and will serve as a legacy for future evaluative research.Any government deciding to invoke widespread change in its higher education sector through implementation of new policies impacts on every institution and all staff and students, often in both the time taken up and the heightened emotions caused. The central phenomenon that this study addresses is the process and consequences of policy changes in higher education in Australia. The aim of this article is to record the research design through the perspective (evaluation research), theoretical framework (program evaluation) and methods (content analysis, descriptive statistical analysis and bibliometric analysis) applied to the investigation of the 2003 federal government higher education reform package. This approach allows both the intended and unintended consequences arising from the policy implementation of three national initiatives focused on learning and teaching in higher education in Australia to surface. As a result, this program evaluation, also known in some disciplines as policy implementation analysis, will demonstrate the applicability of illuminative evaluation as a methodology and reinforce how program evaluation will assist and advise future government reform and policy implementation, and will serve as a legacy for future evaluative research.

Multilingualism and speech-language competence in early childhood: Impact on academic and social-emotional outcomes at school

This large-scale longitudinal population study provided a rare opportunity to consider the interface between multilingualism and speech-language competence on children’s academic and social-emotional outcomes and to determine whether differences between groups at 4 to 5 years persist, deepen, or disappear with time and schooling. Four distinct groups were identified from the Kindergarten cohort of the Longitudinal Study of Australian Children (LSAC) (1) English-only + typical speech and language (n = 2,012); (2) multilingual + typical speech and language (n = 476); (3) English-only + speech and language concern (n = 643); and (4) multilingual + speech and language concern (n = 109). Two analytic approaches were used to compare these groups. First, a matched case-control design was used to randomly match multilingual children with speech and language concern (group 4, n = 109) to children in groups 1, 2, and 3 on gender, age, and family socio-economic position in a cross-sectional comparison of vocabulary, school readiness, and behavioral adjustment. Next, analyses were applied to the whole sample to determine longitudinal effects of group membership on teachers’ ratings of literacy, numeracy, and behavioral adjustment at ages 6 to 7 and 8 to 9 years. At 4 to 5 years, multilingual children with speech and language concern did equally well or better than English-only children (with or without speech and language concern) on school readiness tests but performed more poorly on measures of English vocabulary and behavior. At ages 6 to 7 and 8 to 9, the early gap between English-only and multilingual children had closed. Multilingualism was not found to contribute to differences in literacy and numeracy outcomes at school; instead, outcomes were more related to concerns about children’s speech and language in early childhood. There were no group differences for socio-emotional outcomes. Early evidence for the combined risks of multilingualism plus speech and language concern was not upheld into the school years.

A cluster randomised controlled trial evaluation and cost-effectiveness analysis of the Roots of Empathy schools-based programme for improving social and emotional wellbeing outcomes among 8-9 year olds in Northern Ireland

A substantial body of evidence suggest that well designed school based prevention programmes can be effective in improving a variety of social, health and academic outcomes for children and young people. This poster presents the methodology for evaluating the Roots of Empathy (ROE) programme. ROE is a universal programme delivered on a whole-class basis for one academic year. It consists of 27 lessons that run over a school year and is based around a monthly classroom visit by an infant and parent, typically recruited from the local community, whom the class 'adopts' at the start of the school year. The evaluation aims to evaluate the immediate and longer term impact of ROE on social and emotional wellbeing outcomes among 8-9 year old pupils, as well as evaluate the cost-effectiveness of the programme.

Analyzing the learning of the taking personal and social responsibility model within a new physical education undergraduate degree program in El Salvador

EI Salvador presents an unfortunate history that includes a military regime and a civil war that together created a legacy of violence in which the country still struggle nowadays. Salud Escolar Integral (SEI) was created in 2005 as a program to combat youth violence throughout the re-formulation of physical education (PE) classes in public schools, promoting life skills learning that supports the resolution of conflicts with nonviolent ways. In 2007, SEI supported the creation of a physical e~ucation teacher education (PETE) degree at the Universidad Pedag6gica de EI Salvador (UPES), having the goal to assist pre-service teachers with a better understanding of humanistic principles. The present research analyzed if after attending all three years ofUPES PETE program, students presented high self-perception levels of competence and confidence related to attitude, skills and knowledge to teach PE within humanistic principles. Taking Personal and Social Responsibility (TPSR) was the theoretical framework used to analyze the development of humanistic principles. The study had a mixed-method longitudinal design that included questionnaires, reflection templates and interviews. In conclusion, although it is suggested that UPES should provide better support for the development of the teaching principles of empowering students and transfer learning, most of the humanistic principles were highly promoted by the program. At last, it is suggested that future research should track teachers' progress while teaching in schools, in order to analyze if the theory of promoting humanistic principles have also become a daily practice.

The effects of a general excercise program on task self-efficacy and social physique anxiety in older adults

Older adults represent the most sedentary segment of the adult population, and thus it is critical to investigate factors that influence exercise behaviour for this age group. The purpose of this study was to examine the influence of a general exercise program, incorporating cardiovascular, strength, flexibility, and balance components, on task selfefficacy and SPA in older adult men and women. Participants (n=114, Mage = 67 years) were recruited from the Niagara region and randomly assigned to a 12-week supervised exercise program or a wait-list control. Task self-efficacy and SPA measures were taken at baseline and program end. The present study found that task self-efficacy was a significant predictor of leisure time physical activity for older adults. In addition, change in task self-efficacy was a significant predictor of change in SPA. The findings of this study suggest that sources of task self-efficacy should be considered for exercise interventions targeting older adults.

HIDING IN PLAIN SIGHT- Sustainable Physical Activity Program Development and Evaluation for Youth with Special Needs: An Evaluative Case Study

The purpose of my research was to contribute to the improvement and sustainability of the Special Needs Activity Program, and develop program implementation strategies that had practical outcomes. I conducted an evaluative case study of S.N.A.P in order to determine what a quality adapted physical activity (APA) program is, why S.N.A.P is considered a quality APA program, and what institutional policies and practices exist to support it. Data was collected via interviews, questionnaires, and observations. Data analysis involved inductive and deductive methods, and a SWOTAR evaluation. Results indicate that quality APA programs include: ‘people’, ‘environment’, and ‘expectations’; there are benefits of experiential learning; activity stations that promote creativity are valuable; several stakeholders do not know the details about S.N.A.P but recognize its value; the institution values what S.N.A.P provides, yet, there is nothing being done to sustain it. Future research should investigate the feasibility of implementing S.N.A.P in various contexts.

Impact assessment and quality analysis of corporate social responsability (CSR) programs of mining companies and their contribution to sustainable development in the communities they operate: case study Tenke Fungurume Mining SA in the Democratic Republic of Congo (DRC)

Purpose – This case study presents an impact assessment of Corporate Social Responsibility (CSR) programs of the TFM Company in order to understand how they contribute to the sustainable development of communities in areas in which they operate. Design/Methodology/Approach - Data for this study was collected using qualitative data methods that included semi-structured interviews and Focus Group Discussions most of them audio and video recorded. Documentary analysis and a field visit were also undertaken for the purpose of quality analysis of the CSR programs on the terrain. Data collected was analyzed using the Seven Questions to sustainability (7Qs) framework, an evaluation tool developed by the Mining, Minerals and Sustainable Development (MMSD) North America chapter. Content analysis method was on the other hand used to examine the interviews and FGDs of the study participants. Findings - Results shows that CSR programs of TFM SA do contribute to community development, as there have been notable changes in the communities’ living conditions. But whether they have contributed to sustainable development is not yet the case as programs that enhance the capacity of communities and other stakeholders to support these projects development beyond the implementation stage and the mines operation lifetime need to be considered and implemented. Originality/Value – In DRC, there is paucity of information of research studies that focus on impact assessment of CSR programs in general and specifically those of mining companies and their contribution to sustainable development of local communities. Many of the available studies cover issues of minerals and conflict or conflict minerals as mostly referred to. This study addressees this gap.

Skills training and social influences for violence prevention in middle schools: A curriculum evaluation

This pilot study evaluated the effect of skills training and of social influences on self-reported aggressive behavior in a sample of 239 sixth-grade students. The effect of two intervention groups and one control group were compared. In the first intervention group, a 15-session, violence-prevention curriculum was taught by the teacher. In the second intervention group, the same curriculum was taught by the teacher with the assistance of peer leaders trained to modify social norms about violence. The control group was evaluated but did not receive any training. The design included four schools. In two schools, three classes were assigned to one of the two interventions or to the control group. In the other two schools, two classes were assigned to either intervention (teacher only) or control. Students were evaluated before and after the implementation of the curriculum using a standardized questionnaire.^ The primary outcome was the effect of the curriculum and peer leaders on self-reported aggressive behaviors. The secondary outcome was their impact on intervening variables: knowledge about violence, conflict-resolution skills, self-efficacy, and attitudes.^ The intervention had a moderate effect on reducing self-reported aggressive behaviors among boys in two of the six classes that received the curriculum. Both classes with peer leaders reduced their aggressive behavior, but this reduction was significant in only one. A peer leader selection problem could probably explain this lack of effect.^ In three of the four schools, both interventions had an overall significant effect on increasing knowledge about violence and skills to reduce violence. Students also developed a more negative attitude toward violence after the intervention. As hypothesized, attitude change was stronger among students from the teacher plus peer leader group. No intervention effect was observed on self-efficacy nor on attitudes toward skills to reduce violence. Limitations of the study and implications for violence prevention in schools are discussed. ^

Marital split-up and widowhood in old age: Differential impact on psychological and social well-being

Marital split-up and spousal loss are among the most stressful critical life events. Numerous studies have documented their detrimental effects on well-being, yet the large individual differences in psychological adaptation are still not well understood. Whereas in old age bereavement is normative and can be anticipated, divorce is an “off-time” transition for this age group. In contrast to bereavement which has been amply studied, research on later life divorce is still missing despite the increasing relevance of the topic due to the significant increase of divorces in older age. Based on a modified and extended view of Amato’s divorce-stress-adjustment model (2000), the aim of this contribution is to explore the differential impact of marital split-up and widowhood in older age on psychological (life satisfaction) and social well-being (social loneliness), and the adaptation to these critical life events. Our analyses are based on data gathered in a questionnaire study, which is part of the Swiss National Centre of Competence in Research LIVES. In a first step we compared three groups of individuals aged 60 to 75 years: a sample of 251 persons with a marital split-up (127 women; 123 men), a sample of 270 widowed persons (170 women; 100 men), and a group of 221 continuously married people (110 women; 111 men), which served as control group. In a second step, we investigated the role of socio-demographic variables, intrapersonal and interpersonal resources and variables of the context of loss as predictors for the psychological adaptation to a marital break-up and loss in old age. First results by ANCOVA indicate significant differences with regard to life satisfaction among the three groups, with divorced persons with the lowest scores, followed by the bereaved ones, and the married controls with the highest. Regarding social loneliness, divorced individuals report higher social loneliness than the bereaved group and the married controls (no significant difference between widowed and the married). In both loss groups, financial and intrapersonal resources, as well as the emotional valence of the loss are the most important predictors for the psychological and social adaptation. However, happiness in the past relationship is an important resource regarding the indicators for adaptation for the widowers, but not for individuals with a marital dissolution.

Program evaluation for a summer science internship: Short and long term benefits as reported by interns

Undergraduate research programs have been used as a tool to attract and retain student interest in science careers. This study evaluates the short and long-term benefits of a Summer Science Internship (SSI) at the University of Texas Health Science Center at Houston– School of Public Health – in Brownsville, Texas, by analyzing survey data from alumni. Questions assessing short-term program impact were aimed at three main topics, student: satisfaction with program, self-efficacy for science after completing the program, and perceived benefits. Long-term program impact was assessed by looking at student school attendance and college majors along with perceived links between SSI and future college plans. Students reported high program satisfaction, a significant increase in science self-efficacy and high perceived benefits. At the time data were collected for the study, one-hundred percent of alumni were enrolled in school (high school or college). The majority of students indicated they were interested in completing a science major/career, heavily influenced by their participation in the program.^