Formative and reflective measurement and validation mismatch in survey research : an archival analysis of information systems success constructs 1985-2007

The generic IS-success constructs first identified by DeLone and McLean (1992) continue to be widely employed in research. Yet, recent work by Petter et al (2007) has cast doubt on the validity of many mainstream constructs employed in IS research over the past 3 decades; critiquing the almost universal conceptualization and validation of these constructs as reflective when in many studies the measures appear to have been implicitly operationalized as formative. Cited examples of proper specification of the Delone and McLean constructs are few, particularly in light of their extensive employment in IS research. This paper introduces a four-stage formative construct development framework: Conceive > Operationalize > Respond > Validate (CORV). Employing the CORV framework in an archival analysis of research published in top outlets 1985-2007, the paper explores the extent of possible problems with past IS research due to potential misspecification of the four application-related success dimensions: Individual-Impact, Organizational-Impact, System-Quality and Information-Quality. Results suggest major concerns where there is a mismatch of the Respond and Validate stages. A general dearth of attention to the Operationalize and Respond stages in methodological writings is also observed.

Decision support system for improving construction companies’ business performance

As part of a decision making process, the controlling process in construction companies can be supported by computer application that provides faster and reliable decision. This paper discusses the development of a knowledge-based decision support system for controlling construction companies’ business performance. The knowledge-base was developed using questionnaire survey and case studies. A questionnaire survey was conducted to identify potential problems that can occur in construction companies as well as the source of the problems and their impact on companies’ performance. Case studies were used to identify and analyse various corrective actions. The result of the study shows that decision support system using knowledge-based management system improves the effectiveness and the efficiency of decision making process for selecting the most appropriate corrective action that can improve construction companies’ performance. The application, which had been developed in this research, was designed to support the process of controlling construction companies’ business performance and to assist young manager in selecting the most optimum corrective actions for the problems related to achieving companies’ objectives. This computer application can be used as a learning tool for identifying potential problems that a construction company faces and the most optimum corrective action.

Institutional problems of the emerging scientific community in Iran

This article attempts to explore the concept of scientific community at the macro-national level in the context of Iran. Institutionalisation of science and its professional growth has been constrained by several factors. The article first conceptualises the notion of science community as found in the literature in the context of Iran, and attempts to map through some indicators. The main focus, however, lies in mapping some institutional problems through empirical research. This was undertaken in 2002–04 in order to analyse the structure of the scientific community in Iran in the ‘exact sciences’ (mathematics, physics, chemistry, biology and earth sciences). The empirical work was done in two complementary perspectives: through a questionnaire and statistical analysis of it, and through semistructured interviews with the researchers. There are number of problems confronting scientists in Iran. Facilities provided by institutions is one of the major problems of research. Another is the tenuous cooperation among scientists. This is reported by most of the researchers, who deplore the lack of cooperation among their group. Relationships are mostly with the Ph.D. students and only marginally with colleagues. Our research shows that the more brilliant the scientists, the more frustrated they are from scientific institutions in Iran. Medium-range researchers seem to be much happier about the scientific institution to which they belong than the brighter scholars. The scientific institutions in Iran seem to be built for the needs of the former rather than the latter. These institutions seem not to play a positive role in the case of the best scientists. On the whole, many ingredients of the scientific community, at least at its inception, are present among Iranian scientists: the strong desire for scientific achievement in spite of personal, institutional and economic problems.

Knowing a donor and identifying as one : determinants of people's willingness for related and anonymous living donation in Australia

While LRD (living donation to a genetically/emotionally related recipient) is well established in Australia, LAD (living anonymous donation to a stranger) is rare. Given the increasing use of LAD overseas, Australia may likely follow suit. Understanding the determinants of people’s willingness for LAD is essential but infrequently studied in Australia. Consequently, we compared the determinants of people’s LRD and LAD willingness, and assessed whether these determinants differed according to type of living donation. We surveyed 487 health students about their LRD and LAD willingness, attitudes, identity, prior experience with blood and organ donation, deceased donation preference, and demographics. We used Structural Equation Modelling (SEM) to identify the determinants of willingness for LRD and LAD and paired sample t-tests to examine differences in LRD and LAD attitudes, identity, and willingness. Mean differences in willingness (LRD 5.93, LAD 3.92), attitudes (LRD 6.43, LAD 5.53), and identity (LRD 5.69, LAD 3.58) were statistically significant. Revised SEM models provided a good fit to the data (LRD: x2 (41) = 67.67, p = 0.005, CFI = 0.96, RMSEA = 0.04; LAD: x2 (40) = 79.64, p < 0.001, CFI = 0.95, RMSEA = 0.05) and explained 45% and 54% of the variation in LRD and LAD willingness, respectively. Four common determinants of LRD and LAD willingness emerged: identity, attitude, past blood donation, and knowing a deceased donor. Religious affiliation and deceased donation preference predicted LAD willingness also. Identifying similarities and differences in these determinants can inform future efforts aimed at understanding people’s LRD and LAD willingness and the evaluation of potential living donor motives. Notably, this study highlights the importance of people’s identification as a living donor as a motive underlying their willingness to donate their organs while living.

Integrating engineering model eliciting activities in elementary school curricula

This paper argues for a future-oriented, inclusion of Engineering Model Eliciting Activities (EngMEAs) in elementary mathematics curricula. In EngMEAs students work with meaningful engineering problems that capitalise on and extend their existing mathematics and science learning, to develop, revise and document powerful models, while working in groups. The models developed by six groups of 12-year students in solving the Natural Gas activity are presented. Results showed that student models adequately solved the problem, although student models did not take into account all the data provided. Student solutions varied to the extent students employed the engineering context in their models and to their understanding of the mathematical concepts involved in the problem. Finally, recommendations for implementing EngMEAs and for further research are discussed.

Methodologies for investigating relationships between concept development and the development of problem solving abilities

This paper is the second in a pair that Lesh, English, and Fennewald will be presenting at ICME TSG 19 on Problem Solving in Mathematics Education. The first paper describes three shortcomings of past research on mathematical problem solving. The first shortcoming can be seen in the fact that knowledge has not accumulated – in fact it has atrophied significantly during the past decade. Unsuccessful theories continue to be recycled and embellished. One reason for this is that researchers generally have failed to develop research tools needed to reliably observe, document, and assess the development of concepts and abilities that they claim to be important. The second shortcoming is that existing theories and research have failed to make it clear how concept development (or the development of basic skills) is related to the development of problem solving abilities – especially when attention is shifted beyond word problems found in school to the kind of problems found outside of school, where the requisite skills and even the questions to be asked might not be known in advance. The third shortcoming has to do with inherent weaknesses in observational studies and teaching experiments – and the assumption that a single grand theory should be able to describe all of the conceptual systems, instructional systems, and assessment systems that strongly molded and shaped by the same theoretical perspectives that are being used to develop them. Therefore, this paper will describe theoretical perspectives and methodological tools that are proving to be effective to combat the preceding kinds or shortcomings. We refer to our theoretical framework as models & modeling perspectives (MMP) on problem solving (Lesh & Doerr, 2003), learning, and teaching. One of the main methodologies of MMP is called multi-tier design studies (MTD).

An investigation of differences in crash characteristics between males and females involved in a fatigue-related crash or close call event

There is consensus among community and road safety agencies that driver fatigue is a major road safety issue and it is well known that excessive fatigue is linked with an increased risk of a motor vehicle crash. Previous research has implicated a wide variety of factors involved in fatigue-related crashes and the effects of these various factors in regard to crash risk can be interpreted as causal (i.e. alcohol and/or drugs may induce fatigue states) or additive (e.g. where a lack of sleep is combined with alcohol). As such, the purpose of this investigation was to examine self-report data to determine whether there are any differences in the prevalence, crash characteristics, and travel patterns of males and females involved in a fatigue-related crash or close call event. Such research is important to understand how fatigue related incidents occur within the typical driving patterns of men and women and it provides a starting point in order to explore if males and females experience and understand the risk of diving when tired in the same way. A representative sample of (N = 1,600) residents living in the Australian Capital Territory (ACT) and New South Wales (NSW), Australia, were surveyed regarding their experience of fatigue and their involvement in fatigue-related crashes and close call incidents. Results revealed that over 35% of participants reported having had a close call or crash due to driving when tired in the five years prior to the study being conducted. In addition, the results obtained revealed a number of interesting characteristics that provide preliminary evidence that gender differences do exist when examining the prevalence, crash characteristics, and travel patterns of males and females involved in a fatigue-related crash or close call event. It is argued that the results obtained can provide particularly useful information for the refinement and further development of appropriate countermeasures that better target this complex issue.

Interventions for co-occurring addictive and other mental disorders (AMDs)

While research on the management of co-occurring addictive and mental disorders (AMDs) has grown substantially in recent years, we still have little guidance on specific strategies. Consideration of epidemiological research and ethical principles can supplement existing clinical trials in providing a way forward. High frequencies of co-occurring disorders, equity of access for affected individuals and potential clashes between services in priorities and procedures, suggest that a stepped model of care by a single service may often be required. Typically, problems are multiple rather than dual, with potential for mutual influence, suggesting a need for interventions that are sensitive to and encompass complex co-occurring problems. Motivational problems are endemic, initial gains are often partial and unstable, and relapses potentially have serious consequences, suggesting a need for long-term, assertive follow-up. Principles such as these provide a solid framework for designing both services and interventions. However, there is a continuing need for controlled trials that unpack effective components of interventions, and increase their impact.

Problem solving in a middle school robotics design classroom

Little research has been conducted on how students work when they are required to plan, build and evaluate artefacts in technology rich learning environments such as those supported by tools including flow charts, Labview programming and Lego construction. In this study, activity theory was used as an analytic tool to examine the social construction of meaning. There was a focus on the effect of teachers’ goals and the rules they enacted upon student use of the flow chart planning tool, and the tools of the programming language Labview and Lego construction. It was found that the articulation of a teacher’s goals via rules and divisions of labour helped to form distinct communities of learning and influenced the development of different problem solving strategies. The use of the planning tool flow charting was associated with continuity of approach, integration of problem solutions including appreciation of the nexus between construction and programming, and greater educational transformation. Students who flow charted defined problems in a more holistic way and demonstrated more methodical, insightful and integrated approaches to their use of tools. The findings have implications for teaching in design dominated learning environments.

Current evidence on integrated treatment for serious mental disorder and substance misuse

Substance misuse in people with serious mental disorders is common and has a wideranging negative impact. The multiplicity of problems suggests that this comorbidity is better conceptualized as a type of complex disorder than by ‘dual diagnosis’. Problems with sequential and parallel treatments have led to the development of integrated approaches, with one practitioner or team addressing both the substance use and mental disorder. These treatments are typically characterized by motivation enhancement, minimizing treatment-related stress, emphasizing harm reduction as well as abstinence, and assertive outreach. A review of published randomized trials demonstrates that superior effects to controls are rarely consistent across treatment foci and over time. While motivational interventions assist engagement, more intervention is usually required for integrated treatment programs to improve long-term outcomes more than control conditions. More intensive case management does not consistently improve impact, but extended cognitive-behavioral therapies have promise. Suggestions for maximizing treatment effects and improving research evidence are provided.

Beating the urge : implications of research into substance-related desires

Despite the advent of improved pharmacological treatments to alleviate substance-related desires, psychological approaches will continue to be required. However, the current psychological treatment that most specifically focuses on desires and their management—cue exposure (CE)—has not lived up to its original promise. This paper argues that current psychological approaches to desire do not adequately incorporate our knowledge about the factors that trigger, maintain, and terminate episodes of desire. It asserts that the instigation and maintenance of desires involve both associative and elaborative processes. Understanding the processes triggering the initiation of intrusive thoughts may assist in preventing some episodes, but occasional intrusions will be inevitable. A demonstration of the ineffectiveness of thought suppression may discourage its use as a coping strategy for desire-related intrusions, and mindfulness meditation plus cognitive therapy may help in accepting their occurrence and letting them go. Competing tasks may be used to reduce elaboration of desires, and competing sensory images may have particular utility. The application of these procedures during episodes that are elicited in the clinic may allow the acquisition of more effective strategies to address desires in the natural environment.

Levelling expectations across different years in an undergraduate degree to support work-related learning : evidence for a multi-pronged approach.

One of the ways in which university departments and faculties can enhance the quality of learning and assessment is to develop a ‘well thought out criterion‐referenced assessment system’ (Biggs, 2003, p. 271). In designing undergraduate degrees (courses) this entails making decisions about the levelling of expectations across different years through devising objectives and their corresponding criteria and standards: a process of alignment analogous to what happens in unit (subject) design. These decisions about levelling have important repercussions in terms of supporting students’ work‐related learning, especially in relation to their ability to cope with the increasing cognitive and skill demands made on them as they progress through their studies. They also affect the accountability of teacher judgments of students’ responses to assessment tasks, achievement of unit objectives and, ultimately, whether students are awarded their degrees and are sufficiently prepared for the world of work. Research reveals that this decision‐making process is rarely underpinned by an explicit educational rationale (Morgan et al, 2002). The decision to implement criterion referenced assessment in an undergraduate microbiology degree was the impetus for developing such a rationale because of the implications for alignment, and therefore ‘levelling’ of expectations across different years of the degree. This paper provides supporting evidence for a multi‐pronged approach to levelling, through backward mapping of two revised units (foundation and exit year). This approach adheres to the principles of alignment while combining a work‐related approach (via industry input) with the blended disciplinary and learner‐centred approaches proposed by Morgan et al. (2002). It is suggested that this multi‐pronged approach has the potential for making expectations, especially work‐related ones across different year levels of degrees, more explicit to students and future employers.

Mainstreamed students with learning difficulties : failing and underachieving in the secondary school

Despite the rhetoric that students with learning difficulties are adequately supported within schools, the evidence suggests that they continue to experience school failure with devastating consequences. Students with learning difficulties are disproportionately represented as juvenile delinquents, as the unemployed and in mental health statistics. However, the defining of this group remains confused and imprecise and has not been a national priority. This has repercussions for both secondary schools and for the students themselves. This paper highlights research related to teaching practices, policies and school structure and their effects on the academic outcomes and emotional well being of students with learning difficulties. Finally, it makes a number of recommendations to change the status quo for these students.

Strains as Mediators between Job Characteristics and Work-Related Outcomes in Police Officers

The relationship between job characteristics (e.g., job demands, social support) and work-related outcomes (e.g., turnover intentions, job performance) is assumed to be mediated by strains (e.g., work-related well-being, psychological strain). However, evidence suggests this association will be stronger for work-related strains than broader measures of overall psychological well-being. The primary aim of this study was to identify whether work and non-work related strains differ significantly in their ability to mediate between job characteristics and work-related outcomes. Perceptions of job characteristics, strain, turnover intentions and job performance were collected via a self-report survey from 2,588 Australian police officers. All job characteristics (job demands, job control, supervisor support and colleague support) were significant predictors of both job performance and turnover intentions, with the exception of job demands, which was not a significant predictor of turnover intentions. Both work and non-work related strains were significant predictors of turnover intentions and job performance. Strains were collectively significant in mediating between job characteristics and work-related outcomes, except in the case of job demands and job performance. The indirect effects of job characteristics on work-related outcomes were primarily through officers’ work-related enthusiasm. The relative importance of work-related enthusiasm in mediating between job characteristics and work-related outcomes offers some support for previous research suggesting stronger associations between work-related constructs. Future research should examine whether there are substantial differences in the explanatory power of work-related enthusiasm and a popular related construct, work engagement.

Strategic short termism as an issue of top-teams’ temporal orientation

Short-termism among firms, the tendency to excessively discount long-term benefits and favour less valuable short-term benefits, has been a prominent issue in business and public policy debates but research to date has been inconclusive. We study how managers frame, interpret, and resolve problems of intertemporal choice in actual decisions by using computer aided text analysis to measure the frequency of top-team temporal references in 1653 listed Australian firms between 1992-2005. Contrary to short-termism arguments we find evidence of a significant general increase in Future orientation and a significant decrease in Current/Past orientation. We also show top-teams’ temporal orientation is related to their strategic orientation, specifically the extent to which they focus on Innovation-Expansion and Capacity Building.