A critical evaluation and comparison of two formative measures of system quality using criterion variables

Evaluating the validity of formative variables has presented ongoing challenges for researchers. In this paper we use global criterion measures to compare and critically evaluate two alternative formative measures of System Quality. One model is based on the ISO-9126 software quality standard, and the other is based on a leading information systems research model. We find that despite both models having a strong provenance, many of the items appear to be non-significant in our study. We examine the implications of this by evaluating the quality of the criterion variables we used, and the performance of PLS when evaluating formative models with a large number of items. We find that our respondents had difficulty distinguishing between global criterion variables measuring different aspects of overall System Quality. Also, because formative indicators “compete with one another” in PLS, it may be difficult to develop a set of measures which are all significant for a complex formative construct with a broad scope and a large number of items. Overall, we suggest that there is cautious evidence that both sets of measures are valid and largely equivalent, although questions still remain about the measures, the use of criterion variables, and the use of PLS for this type of model evaluation.

Cellular stages of root formation, root system quality and survival of Pinus elliottii var. elliottii x P. caribaea var. hondurensis cuttings in different temperature environments.

Time to first root in cuttings varies under different environmental conditions and understanding these differences is critical for optimizing propagation of commercial forestry species. Temperature environment (15, 25, 30 or 35 +/- A 2A degrees C) had no effect on the cellular stages in root formation of the Slash x Caribbean Pine hybrid over 16 weeks as determined by histology. Initially callus cells formed in the cortex, then tracheids developed and formed primordia leading to external roots. However, speed of development followed a growth curve with the fastest development occurring at 25A degrees C and slowest at 15A degrees C with rooting percentages at week 12 of 80 and 0% respectively. Cutting survival was good in the three cooler temperature regimes (> 80%) but reduced to 59% at 35A degrees C. Root formation appeared to be dependant on the initiation of tracheids because all un-rooted cuttings had callus tissue but no tracheids, irrespective of temperature treatment and clone.

Cellular stages of root formation, root system quality and survival of Pinuselliottii var. elliottii x P. caribaea var. hondurensis cuttings in different temperature environments.

Time to first root in cuttings varies under different environmental conditions and understanding these differences is critical for optimizing propagation of commercial forestry species. Temperature environment (15, 25, 30 or 352C) had no effect on the cellular stages in root formation of the Slash * Caribbean Pine hybrid over 16 weeks as determined by histology. Initially callus cells formed in the cortex, then tracheids developed and formed primordia leading to external roots. However, speed of development followed a growth curve with the fastest development occurring at 25C and slowest at 15C with rooting percentages at week 12 of 80 and 0% respectively. Cutting survival was good in the three cooler temperature regimes (>80%) but reduced to 59% at 35C. Root formation appeared to be dependant on the initiation of tracheids because all un-rooted cuttings had callus tissue but no tracheids, irrespective of temperature treatment and clone.

Food-system quality control and stage of distribution

This article models the interactions between safety and quality control and stage of distribution in the food marketing complex

A critical evaluation and comparison of two formative measures of system quality using criterion variables

Evaluating the validity of formative variables has presented ongoing challenges for researchers. In this paper we use global criterion measures to compare and critically evaluate two alternative formative measures of System Quality. One model is based on the ISO-9126 software quality standard, and the other is based on a leading information systems research model. We find that despite both models having a strong provenance, many of the items appear to be non-significant in our study. We examine the implications of this by evaluating the quality of the criterion variables we used, and the performance of PLS when evaluating formative models with a large number of items. We find that our respondents had difficulty distinguishing between global criterion variables measuring different aspects of overall System Quality. Also, because formative indicators “compete with one another” in PLS, it may be difficult to develop a set of measures which are all significant for a complex formative construct with a broad scope and a large number of items. Overall, we suggest that there is cautious evidence that both sets of measures are valid and largely equivalent, although questions still remain about the measures, the use of criterion variables, and the use of PLS for this type of model evaluation.

Quality Information System: Investigating the conception, role, models and suggesting conceptual and hierarchal models

In the current business world which companies’ competition is very compact in the business arena, quality in manufacturing and providing products and services can be considered as a means of seeking excellence and success of companies in this competition arena. Entering the era of e-commerce and emergence of new production systems and new organizational structures, traditional management and quality assurance systems have been challenged. Consequently, quality information system has been gained a special seat as one of the new tools of quality management. In this paper, quality information system has been studied with a review of the literature of the quality information system, and the role and position of quality Information System (QIS) among other information systems of a organization is investigated. The quality Information system models are analyzed and by analyzing and assessing presented models in quality information system a conceptual and hierarchical model of quality information system is suggested and studied. As a case study the hierarchical model of quality information system is developed by evaluating hierarchical models presented in the field of quality information system based on the Shetabkar Co.

Six sigma approach to improve quality in E-services : an empirical study in Jordan

In the last two decades, Six Sigma approach has found its success in manufacturing sectors. The relevance of Six Sigma methodologies in service sector has been realised more recently. This paper investigates the application of Six Sigma approach to improve quality in electronic services (e-services) as more and more countries are adopting e-services as a means of providing services to their community and people through the Web. In particular, this paper presents a case study about the use of Six Sigma model to measure the customer satisfaction and quality levels achieved in e-services that were recently launched by public sector organisations in a developing country, such as Jordan. An empirical study consisting of 280 participating customers of Jordan‘s e-services is conducted and the problems are identified through the DMAIC phases of Six Sigma. The service quality levels are measured and analysed using six main criteria, namely, Website Design, Reliability, Responsiveness, Personalization, Information Quality, and System Quality. The overall result of the study indicating a 74% customer satisfaction with a Six Sigma level of 2.12 has enabled the Greater Amman Municipality to identify the usability issues associated with their e-services offered by public sector organisations and to take the leads from the results of the study to improve customer satisfaction. The aim of the paper is not only to implement Six Sigma as a measurement-based strategy for improving e-customer service quality in a newly launched e-service programme, but also to help widen its scope in investigating other service dimensions and perform comparative studies in other developing countries as future research.

Identifying the determinants of e-learning service delivery quality

In recent years, many universities and educational institutions have made considerable investments in e-learning systems. These are systems that deliver educational services via electronic channels. Service quality has been studied in previous research as a critical factor for measuring systems success. Modest attention has been paid to factors affecting the service delivery quality in the e-learning arena. The objective of this study is to identify the factors considered to impact the e-learning systems service delivery quality through a survey of stakeholders. The sample was 720 students enrolled in online courses at the University of Southern Queensland (USQ).The main finding of this study is that IT infrastructure, system quality, and information quality significantly affect service delivery quality in the e-learning systems field. IT infrastructure services were found to play a critical role in improving system quality and information quality, and this construct can be considered as a foundation of delivering high quality educational services.

Software architecture for web-based project management system

This article presents software architecture for a web-based system to aid project managing, conceptually founded on guidelines of the Project Management Body of Knowledge (PMBoK) and on ISO/IEC 9126, as well as on the result of an empiric study done in Brazil. Based on these guidelines, this study focused on two different points of view about project management: the view of those who develop software systems to aid management and the view of those who use these systems. The designed software architecture is capable of guiding an incremental development of a quality system that will satisfy today's marketing necessities, principally those of small and medium size enterprises.

Nursery water management on initial development and quality of Piptadenia gonoacantha seedlings

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

THEODORE, a two-step heating system for the EC/OC determination of radiocarbon (14C) in the environment

Measurements of 14C in the organic carbon (OC) and elemental carbon (EC) fractions, respectively, of fine aerosol particles bear the potential to apportion anthropogenic and biogenic emission sources. For this purpose, the system THEODORE (two-step heating system for the EC/OC determination of radiocarbon in the environment) was developed. In this device, OC and EC are transformed into carbon dioxide in a stream of oxygen at 340 and 650 �C, respectively, and reduced to filamentous carbon. This is the target material for subsequent accelerator mass spectrometry (AMS) 14C measurements, which were performed on sub-milligram carbon samples at the PSI/ETH compact 500 kV AMS system. Quality assurance measurements of SRM 1649a, Urban Dust, yielded a fraction of modern fM in total carbon (TC) of 0.522 ±0.018 (n ¼ 5, 95% confidence level) in agreement with reported values. The results for OC and EC are 0.70± 0.05 (n ¼ 3) and 0.066 ± 0.020 (n ¼ 4), respectively.

An integrated framework for ensuring the quality of software design

Software development is an extremely complex process, during which human errors are introduced and result in faulty software systems. It is highly desirable and important that these errors can be prevented and detected as early as possible. Software architecture design is a high-level system description, which embodies many system features and properties that are eventually implemented in the final operational system. Therefore, methods for modeling and analyzing software architecture descriptions can help prevent and reveal human errors and thus improve software quality. Furthermore, if an analyzed software architecture description can be used to derive a partial software implementation, especially when the derivation can be automated, significant benefits can be gained with regard to both the system quality and productivity. This dissertation proposes a framework for an integrated analysis on both of the design and implementation. To ensure the desirable properties of the architecture model, we apply formal verification by using the model checking technique. To ensure the desirable properties of the implementation, we develop a methodology and the associated tool to translate an architecture specification into an implementation written in the combination of Arch-Java/Java/AspectJ programming languages. The translation is semi-automatic so that many manual programming errors can be prevented. Furthermore, the translation inserting monitoring code into the implementation such that runtime verification can be performed, this provides additional assurance for the quality of the implementation. Moreover, validations for the translations from architecture model to program are provided. Finally, several case studies are experimented and presented.

Formative and reflective measurement and validation mismatch in survey research : an archival analysis of information systems success constructs 1985-2007

The generic IS-success constructs first identified by DeLone and McLean (1992) continue to be widely employed in research. Yet, recent work by Petter et al (2007) has cast doubt on the validity of many mainstream constructs employed in IS research over the past 3 decades; critiquing the almost universal conceptualization and validation of these constructs as reflective when in many studies the measures appear to have been implicitly operationalized as formative. Cited examples of proper specification of the Delone and McLean constructs are few, particularly in light of their extensive employment in IS research. This paper introduces a four-stage formative construct development framework: Conceive > Operationalize > Respond > Validate (CORV). Employing the CORV framework in an archival analysis of research published in top outlets 1985-2007, the paper explores the extent of possible problems with past IS research due to potential misspecification of the four application-related success dimensions: Individual-Impact, Organizational-Impact, System-Quality and Information-Quality. Results suggest major concerns where there is a mismatch of the Respond and Validate stages. A general dearth of attention to the Operationalize and Respond stages in methodological writings is also observed.

Evaluating information systems

The book within which this chapter appears is published as a research reference book (not a coursework textbook) on Management Information Systems (MIS) for seniors or graduate students in Chinese universities. It is hoped that this chapter, along with the others, will be helpful to MIS scholars and PhD/Masters research students in China who seek understanding of several central Information Systems (IS) research topics and related issues. The subject of this chapter - ‘Evaluating Information Systems’ - is broad, and cannot be addressed in its entirety in any depth within a single book chapter. The chapter proceeds from the truism that organizations have limited resources and those resources need to be invested in a way that provides greatest benefit to the organization. IT expenditure represents a substantial portion of any organization’s investment budget and IT related innovations have broad organizational impacts. Evaluation of the impact of this major investment is essential to justify this expenditure both pre- and post-investment. Evaluation is also important to prioritize possible improvements. The chapter (and most of the literature reviewed herein) admittedly assumes a blackbox view of IS/IT1, emphasizing measures of its consequences (e.g. for organizational performance or the economy) or perceptions of its quality from a user perspective. This reflects the MIS emphasis – a ‘management’ emphasis rather than a software engineering emphasis2, where a software engineering emphasis might be on the technical characteristics and technical performance. Though a black-box approach limits diagnostic specificity of findings from a technical perspective, it offers many benefits. In addition to superior management information, these benefits may include economy of measurement and comparability of findings (e.g. see Part 4 on Benchmarking IS). The chapter does not purport to be a comprehensive treatment of the relevant literature. It does, however, reflect many of the more influential works, and a representative range of important writings in the area. The author has been somewhat opportunistic in Part 2, employing a single journal – The Journal of Strategic Information Systems – to derive a classification of literature in the broader domain. Nonetheless, the arguments for this approach are believed to be sound, and the value from this exercise real. The chapter drills down from the general to the specific. It commences with a highlevel overview of the general topic area. This is achieved in 2 parts: - Part 1 addressing existing research in the more comprehensive IS research outlets (e.g. MISQ, JAIS, ISR, JMIS, ICIS), and Part 2 addressing existing research in a key specialist outlet (i.e. Journal of Strategic Information Systems). Subsequently, in Part 3, the chapter narrows to focus on the sub-topic ‘Information Systems Success Measurement’; then drilling deeper to become even more focused in Part 4 on ‘Benchmarking Information Systems’. In other words, the chapter drills down from Parts 1&2 Value of IS, to Part 3 Measuring Information Systems Success, to Part 4 Benchmarking IS. While the commencing Parts (1&2) are by definition broadly relevant to the chapter topic, the subsequent, more focused Parts (3 and 4) admittedly reflect the author’s more specific interests. Thus, the three chapter foci – value of IS, measuring IS success, and benchmarking IS - are not mutually exclusive, but, rather, each subsequent focus is in most respects a sub-set of the former. Parts 1&2, ‘the Value of IS’, take a broad view, with much emphasis on ‘the business Value of IS’, or the relationship between information technology and organizational performance. Part 3, ‘Information System Success Measurement’, focuses more specifically on measures and constructs employed in empirical research into the drivers of IS success (ISS). (DeLone and McLean 1992) inventoried and rationalized disparate prior measures of ISS into 6 constructs – System Quality, Information Quality, Individual Impact, Organizational Impact, Satisfaction and Use (later suggesting a 7th construct – Service Quality (DeLone and McLean 2003)). These 6 constructs have been used extensively, individually or in some combination, as the dependent variable in research seeking to better understand the important antecedents or drivers of IS Success. Part 3 reviews this body of work. Part 4, ‘Benchmarking Information Systems’, drills deeper again, focusing more specifically on a measure of the IS that can be used as a ‘benchmark’3. This section consolidates and extends the work of the author and his colleagues4 to derive a robust, validated IS-Impact measurement model for benchmarking contemporary Information Systems (IS). Though IS-Impact, like ISS, has potential value in empirical, causal research, its design and validation has emphasized its role and value as a comparator; a measure that is simple, robust and generalizable and which yields results that are as far as possible comparable across time, across stakeholders, and across differing systems and systems contexts.