764 resultados para external validity
Resumo:
This paper discusses human factors issues of low cost railway level crossings in Australia. Several issues are discussed in this paper including safety at passive level railway crossings, human factors considerations associated with unavailability of a warning device, and a conceptual model for how safety could be compromised at railway level crossings following prolonged or frequent unavailability. The research plans to quantify safety risk to motorists at level crossings using a Human Reliability Assessment (HRA) method, supported by data collected using an advanced driving simulator. This method aims to identify human error within tasks and task units identified as part of the task analysis process. It is anticipated that by modelling driver behaviour the current study will be able to quantify meaningful task variability including temporal parameters, between participants and within participants. The process of complex tasks such as driving through a level crossing is fundamentally context-bound. Therefore this study also aims to quantify those performance-shaping factors that contribute to vehicle train collisions by highlighting changes in the task units and driver physiology. Finally we will also consider a number of variables germane to ensuring external validity of our results. Without this inclusion, such an analysis could seriously underestimate risk.
Resumo:
This research is one of several ongoing studies conducted within the IT Professional Services (ITPS) research programme at Queensland University of Technology (QUT). In 2003, ITPS introduced the IS-Impact model, a measurement model for measuring information systems success from the viewpoint of multiple stakeholders. The model, along with its instrument, is robust, simple, yet generalisable, and yields results that are comparable across time, stakeholders, different systems and system contexts. The IS-Impact model is defined as “a measure at a point in time, of the stream of net benefits from the Information System (IS), to date and anticipated, as perceived by all key-user-groups”. The model represents four dimensions, which are ‘Individual Impact’, ‘Organizational Impact’, ‘Information Quality’ and ‘System Quality’. The two Impact dimensions measure the up-to-date impact of the evaluated system, while the remaining two Quality dimensions act as proxies for probable future impacts (Gable, Sedera & Chan, 2008). To fulfil the goal of ITPS, “to develop the most widely employed model” this research re-validates and extends the IS-Impact model in a new context. This method/context-extension research aims to test the generalisability of the model by addressing known limitations of the model. One of the limitations of the model relates to the extent of external validity of the model. In order to gain wide acceptance, a model should be consistent and work well in different contexts. The IS-Impact model, however, was only validated in the Australian context, and packaged software was chosen as the IS understudy. Thus, this study is concerned with whether the model can be applied in another different context. Aiming for a robust and standardised measurement model that can be used across different contexts, this research re-validates and extends the IS-Impact model and its instrument to public sector organisations in Malaysia. The overarching research question (managerial question) of this research is “How can public sector organisations in Malaysia measure the impact of information systems systematically and effectively?” With two main objectives, the managerial question is broken down into two specific research questions. The first research question addresses the applicability (relevance) of the dimensions and measures of the IS-Impact model in the Malaysian context. Moreover, this research question addresses the completeness of the model in the new context. Initially, this research assumes that the dimensions and measures of the IS-Impact model are sufficient for the new context. However, some IS researchers suggest that the selection of measures needs to be done purposely for different contextual settings (DeLone & McLean, 1992, Rai, Lang & Welker, 2002). Thus, the first research question is as follows, “Is the IS-Impact model complete for measuring the impact of IS in Malaysian public sector organisations?” [RQ1]. The IS-Impact model is a multidimensional model that consists of four dimensions or constructs. Each dimension is represented by formative measures or indicators. Formative measures are known as composite variables because these measures make up or form the construct, or, in this case, the dimension in the IS-Impact model. These formative measures define different aspects of the dimension, thus, a measurement model of this kind needs to be tested not just on the structural relationship between the constructs but also the validity of each measure. In a previous study, the IS-Impact model was validated using formative validation techniques, as proposed in the literature (i.e., Diamantopoulos and Winklhofer, 2001, Diamantopoulos and Siguaw, 2006, Petter, Straub and Rai, 2007). However, there is potential for improving the validation testing of the model by adding more criterion or dependent variables. This includes identifying a consequence of the IS-Impact construct for the purpose of validation. Moreover, a different approach is employed in this research, whereby the validity of the model is tested using the Partial Least Squares (PLS) method, a component-based structural equation modelling (SEM) technique. Thus, the second research question addresses the construct validation of the IS-Impact model; “Is the IS-Impact model valid as a multidimensional formative construct?” [RQ2]. This study employs two rounds of surveys, each having a different and specific aim. The first is qualitative and exploratory, aiming to investigate the applicability and sufficiency of the IS-Impact dimensions and measures in the new context. This survey was conducted in a state government in Malaysia. A total of 77 valid responses were received, yielding 278 impact statements. The results from the qualitative analysis demonstrate the applicability of most of the IS-Impact measures. The analysis also shows a significant new measure having emerged from the context. This new measure was added as one of the System Quality measures. The second survey is a quantitative survey that aims to operationalise the measures identified from the qualitative analysis and rigorously validate the model. This survey was conducted in four state governments (including the state government that was involved in the first survey). A total of 254 valid responses were used in the data analysis. Data was analysed using structural equation modelling techniques, following the guidelines for formative construct validation, to test the validity and reliability of the constructs in the model. This study is the first research that extends the complete IS-Impact model in a new context that is different in terms of nationality, language and the type of information system (IS). The main contribution of this research is to present a comprehensive, up-to-date IS-Impact model, which has been validated in the new context. The study has accomplished its purpose of testing the generalisability of the IS-Impact model and continuing the IS evaluation research by extending it in the Malaysian context. A further contribution is a validated Malaysian language IS-Impact measurement instrument. It is hoped that the validated Malaysian IS-Impact instrument will encourage related IS research in Malaysia, and that the demonstrated model validity and generalisability will encourage a cumulative tradition of research previously not possible. The study entailed several methodological improvements on prior work, including: (1) new criterion measures for the overall IS-Impact construct employed in ‘identification through measurement relations’; (2) a stronger, multi-item ‘Satisfaction’ construct, employed in ‘identification through structural relations’; (3) an alternative version of the main survey instrument in which items are randomized (rather than blocked) for comparison with the main survey data, in attention to possible common method variance (no significant differences between these two survey instruments were observed); (4) demonstrates a validation process of formative indexes of a multidimensional, second-order construct (existing examples mostly involved unidimensional constructs); (5) testing the presence of suppressor effects that influence the significance of some measures and dimensions in the model; and (6) demonstrates the effect of an imbalanced number of measures within a construct to the contribution power of each dimension in a multidimensional model.
Resumo:
Developers and policy makers are consistently at odds over the debate as to whether impact fees increase house prices. This debate continues despite the extensive body of theoretical and empirical international literature that discusses the passing on to home buyers of impact fees, and the corresponding increase to housing prices. In attempting to quantify this impact, over a dozen empirical studies have been carried out in the US and Canada since the 1980’s. However the methodologies used vary greatly, as do the results. Despite similar infrastructure funding policies in numerous developed countries, no such empirical works exist outside of the US/Canada. The purpose of this research is to analyse the existing econometric models in order to identify, compare and contrast the theoretical bases, methodologies, key assumptions and findings of each. This research will assist in identifying if further model development is required and/or whether any of these models have external validity and are readily transferable outside of the US. The findings conclude that there is very little explicit rationale behind the various model selections and that significant model deficiencies appear still to exist.
Resumo:
Organizations from every industry sector seek to enhance their business performance and competitiveness through the deployment of contemporary information systems (IS), such as Enterprise Systems (ERP). Investments in ERP are complex and costly, attracting scrutiny and pressure to justify their cost. Thus, IS researchers highlight the need for systematic evaluation of information system success, or impact, which has resulted in the introduction of varied models for evaluating information systems. One of these systematic measurement approaches is the IS-Impact Model introduced by a team of researchers at Queensland University of technology (QUT) (Gable, Sedera, & Chan, 2008). The IS-Impact Model is conceptualized as a formative, multidimensional index that consists of four dimensions. Gable et al. (2008) define IS-Impact as "a measure at a point in time, of the stream of net benefits from the IS, to date and anticipated, as perceived by all key-user-groups" (p.381). The IT Evaluation Research Program (ITE-Program) at QUT has grown the IS-Impact Research Track with the central goal of conducting further studies to enhance and extend the IS-Impact Model. The overall goal of the IS-Impact research track at QUT is "to develop the most widely employed model for benchmarking information systems in organizations for the joint benefit of both research and practice" (Gable, 2009). In order to achieve that, the IS-Impact research track advocates programmatic research having the principles of tenacity, holism, and generalizability through extension research strategies. This study was conducted within the IS-Impact Research Track, to further generalize the IS-Impact Model by extending it to the Saudi Arabian context. According to Hofsted (2012), the national culture of Saudi Arabia is significantly different from the Australian national culture making the Saudi Arabian culture an interesting context for testing the external validity of the IS-Impact Model. The study re-visits the IS-Impact Model from the ground up. Rather than assume the existing instrument is valid in the new context, or simply assess its validity through quantitative data collection, the study takes a qualitative, inductive approach to re-assessing the necessity and completeness of existing dimensions and measures. This is done in two phases: Exploratory Phase and Confirmatory Phase. The exploratory phase addresses the first research question of the study "Is the IS-Impact Model complete and able to capture the impact of information systems in Saudi Arabian Organization?". The content analysis, used to analyze the Identification Survey data, indicated that 2 of the 37 measures of the IS-Impact Model are not applicable for the Saudi Arabian Context. Moreover, no new measures or dimensions were identified, evidencing the completeness and content validity of the IS-Impact Model. In addition, the Identification Survey data suggested several concepts related to IS-Impact, the most prominent of which was "Computer Network Quality" (CNQ). The literature supported the existence of a theoretical link between IS-Impact and CNQ (CNQ is viewed as an antecedent of IS-Impact). With the primary goal of validating the IS-Impact model within its extended nomological network, CNQ was introduced to the research model. The Confirmatory Phase addresses the second research question of the study "Is the Extended IS-Impact Model Valid as a Hierarchical Multidimensional Formative Measurement Model?". The objective of the Confirmatory Phase was to test the validity of IS-Impact Model and CNQ Model. To achieve that, IS-Impact, CNQ, and IS-Satisfaction were operationalized in a survey instrument, and then the research model was assessed by employing the Partial Least Squares (PLS) approach. The CNQ model was validated as a formative model. Similarly, the IS-Impact Model was validated as a hierarchical multidimensional formative construct. However, the analysis indicated that one of the IS-Impact Model indicators was insignificant and can be removed from the model. Thus, the resulting Extended IS-Impact Model consists of 4 dimensions and 34 measures. Finally, the structural model was also assessed against two aspects: explanatory and predictive power. The analysis revealed that the path coefficient between CNQ and IS-Impact is significant with t-value= (4.826) and relatively strong with â = (0.426) with CNQ explaining 18% of the variance in IS-Impact. These results supported the hypothesis that CNQ is antecedent of IS-Impact. The study demonstrates that the quality of Computer Network affects the quality of the Enterprise System (ERP) and consequently the impacts of the system. Therefore, practitioners should pay attention to the Computer Network quality. Similarly, the path coefficient between IS-Impact and IS-Satisfaction was significant t-value = (17.79) and strong â = (0.744), with IS-Impact alone explaining 55% of the variance in Satisfaction, consistent with results of the original IS-Impact study (Gable et al., 2008). The research contributions include: (a) supporting the completeness and validity of IS-Impact Model as a Hierarchical Multi-dimensional Formative Measurement Model in the Saudi Arabian context, (b) operationalizing Computer Network Quality as conceptualized in the ITU-T Recommendation E.800 (ITU-T, 1993), (c) validating CNQ as a formative measurement model and as an antecedent of IS Impact, and (d) conceptualizing and validating IS-Satisfaction as a reflective measurement model and as an immediate consequence of IS Impact. The CNQ model provides a framework to perceptually measure Computer Network Quality from multiple perspectives. The CNQ model features an easy-to-understand, easy-to-use, and economical survey instrument.
Resumo:
Background The prevalence of type 2 diabetes is rising internationally. Patients with diabetes have a higher risk of cardiovascular events accounting for substantial premature morbidity and mortality, and health care expenditure. Given healthcare workforce limitations, there is a need to improve interventions that promote positive self-management behaviours that enable patients to manage their chronic conditions effectively, across different cultural contexts. Previous studies have evaluated the feasibility of including telephone and Short Message Service (SMS) follow up in chronic disease self-management programs, but only for single diseases or in one specific population. Therefore, the aim of this study is to evaluate the feasibility and short-term efficacy of incorporating telephone and text messaging to support the care of patients with diabetes and cardiac disease, in Australia and in Taiwan. Methods/design A randomised controlled trial design will be used to evaluate a self-management program for people with diabetes and cardiac disease that incorporates the use of simple remote-access communication technologies. A sample size of 180 participants from Australia and Taiwan will be recruited and randomised in a one-to-one ratio to receive either the intervention in addition to usual care (intervention) or usual care alone (control). The intervention will consist of in-hospital education as well as follow up utilising personal telephone calls and SMS reminders. Primary short term outcomes of interest include self-care behaviours and self-efficacy assessed at baseline and four weeks. Discussion If the results of this investigation substantiate the feasibility and efficacy of the telephone and SMS intervention for promoting self management among patients with diabetes and cardiac disease in Australia and Taiwan, it will support the external validity of the intervention. It is anticipated that empirical data from this investigation will provide valuable information to inform future international collaborations, while providing a platform for further enhancements of the program, which has potential to benefit patients internationally.
Resumo:
The use of hedonic models to estimate the effects of various factors on house prices is well established. This paper examines a number of international hedonic house price models that seek to quantify the effect of infrastructure charges on new house prices. This work is an important factor in the housing affordability debate, with many governments in high growth areas having user-pays infrastructure charging policies operating in tandem with housing affordability objectives, with no empirical evidence on the impact of one on the other. This research finds there is little consistency between existing models and the data sets utilised. Specification appears dependent upon data availability rather than sound theoretical grounding. This may lead to a lack of external validity with model specification dependent upon data availability rather than sound theoretical grounding.
Resumo:
The thesis develops a summative evaluation framework of the NOURISH Randomised Controlled Trial, and applies this to a selection of maternal feeding choice outcomes of the programme. The research is based on an ecological model of the complex set of factors that need to be acted upon to address childhood obesity. The novel approach extends the standard RCT effect evaluation, while also conducting an in-depth evaluation of the process of programme development and implementation. Research findings identify adaptations of intervention delivery that could improve its effectiveness and translatability, in a new cycle of the programme.
Resumo:
Purpose A fundamental aspect of hierarchical loyalty programs is that some consumers get rewards that others do not. Despite the widespread use of such programs, academics have long debated whether these benefits are outweighed by the potential negative impact of the differential treatment of customers. This study extends our understanding, examining the impact of message framing on consumers’ reactions to hierarchical loyalty structures. Design/methodology/approach Three online studies were conducted. Study 1 uses advertisements to manipulate the message frame’s emphasis (benefits vs. status). Study 2 manipulates consumers’ frame of thought by directing their attention to either changes in benefits or status. Finally, Study 3 uses the proposed framework to reconcile contradictory findings from past research. Findings Low-frequency customers who do not expect to qualify for a superior customer tier tend to reject hierarchical programs when thinking about status. In contrast, when these customers think about concrete rewards, loyalty program messages produce no negative reactions. High-frequency customers are positively affected by communication regardless of the type of benefits framed. Research limitations/implications All studies were done online potentially limiting the external validity of the results. Nevertheless, the impact of message framing on perceptions about the loyalty program seems to be quite robust across different studies and manipulations. Practical implications When communicating with low-frequency customers managers should avoid promising status; customers should instead be motivated based on concrete rewards. High-frequency customers are indifferent to alternative emphasis of communication frames. Originality/value Marketing academics have acknowledged the importance of being able to reward top customers without demotivating light and moderate users. Our research is the first to provide a solution to this issue.
Resumo:
Purpose - This study investigates the relationship marketing (RM) strategy of a retail bank and examines whether - after its implementation - customer relationships were strengthened through perceived improvements in the banking relationship and consequent loyalty towards the bank. Design/methodology/approach - A survey was conducted on two profitability segments, of which the more profitable segment had been directly exposed to a customer oriented RM strategy, whereas the less profitable segment had been subjected to more sales oriented marketing communications. Findings - No significant differences were found between the segments on customers’ evaluations of the service relationship or their loyalty toward the bank. Furthermore regression analysis revealed that relationship satisfaction was less important as a determinant of loyalty in the more profitable segment. Research limitations/implications - This study was conducted as a case study of one specific branch of a bank group in Finland, which limits the external validity of its results. It was not possible to ascertain if, or to what extent, customers of the more profitable segment had received the intended RM treatment. Other limitations are also discussed. Practical implications - Customer orientation is desirable within retail banking and more studies are needed on the differential drivers of loyalty across customer profitability segments. By identifying the aspects of a banking relationship that are more highly valued among more profitable customers than among less profitable customers, bank managers would be able to more effectively devise appropriate strategies for different segments. Originality/value - The study contributes to the RM literature and marketing of financial services by providing empirical evidence of the effects of RM activities on customer relationship perceptions in different profitability segments.
Resumo:
Resumen: Se analizan las propiedades psicométricas de la escala de creencias post-críticas (PCBS) en una muestra de 410 ciudadanos de 18 a 55 años de Córdoba/Argentina, seleccionados a partir de un muestreo no aleatorio. La escala fue traducida para el contexto local. A partir del uso complementario de Escalamiento Multidimensional y Análisis Factorial de componentes principales, se replican las dos dimensiones constitutivas de la PCBS (inclusión-exclusión en la trascendencia e interpretación literal-simbólica de los contenidos religiosos) y las cuatro sub-escalas propuestas: Crítica Externa, Segunda Ingenuidad, Ortodoxia, y Relativismo. El estudio reporta los índices de fiabilidad y la validez externa para cada una de éstas, y se discuten cuestiones operativas y conceptuales de su adecuación en Argentina.
Resumo:
Trust and cooperation constitute cornerstones of common-pool resource theory, showing that "prosocial" strategies among resource users can overcome collective action problems and lead to sustainable resource governance. Yet, antisocial behavior and especially the coexistence of prosocial and antisocial behaviors have received less attention. We broaden the analysis to include the effects of both "prosocial" and "antisocial" interactions. We do so in the context of marine protected areas (MPAs), the most prominent form of biodiversity conservation intervention worldwide. Our multimethod approach relied on lab-in-the-field economic experiments (n = 127) in two MPA and two non-MPA communities in Baja California, Mexico. In addition, we deployed a standardized fishers' survey (n = 544) to verify the external validity of our findings and expert informant interviews (n = 77) to develop potential explanatory mechanisms. In MPA sites, prosocial and antisocial behavior is significantly higher, and the presence of antisocial behavior does not seem to have a negative effect on prosocial behavior. We suggest that market integration, economic diversification, and strengthened group identity in MPAs are the main potential mechanisms for the simultaneity of prosocial and antisocial behavior we observed. This study constitutes a first step in better understanding the interaction between prosociality and antisociality as related to natural resources governance and conservation science, integrating literatures from social psychology, evolutionary anthropology, behavioral economics, and ecology.
Resumo:
El rol desempeñado por la opinión pública en el desarrollo de la política criminal actual justifica el incremento de investigaciones destinadas a evaluar las actitudes de los ciudadanos hacia el castigo. No obstante, los avances en este ámbito han sido limitados debido a la utilización de rudimentarios instrumentos de medida. Por ello, el presente trabajo tiene como propósito explorar el efecto que generan en la opinión ciudadana ciertas variables referidas al hecho delictivo y al infractor, precisando su contribución relativa y la interacción existente entre ellas. Para satisfacer este objetivo se recurrió a un diseño factorial de la encuesta, creando una población de 256 casos-escenario fruto de la combinación de cuatro factores: la edad del joven, su historial delictivo, el grado de implicación en el hecho y el tipo de delito cometido. Los mismos fueron distribuidos en grupos de ocho casos ordenados aleatoriamente y fueron suministrados a 32 sujetos. Posteriormente se aplicaron análisis de regresión logística binaria. Los resultados obtenidos revelan que la naturaleza violenta de los hechos, la implicación activa de los jóvenes y el historial delictivo son predictores importantes de las condenas punitivas. Sin embargo la edad, una variable fundamental en la configuración de la justicia juvenil, no resulta significativa. De este modo, el trabajo muestra el potencial explicativo de este conjunto de factores y debate sus implicaciones teóricas y metodológicas para la investigación futura en este terreno.
Resumo:
The impetus towards basing practice and policy decisions more explicitly on sound research requires tools to facilitate the systematic appraisal of the quality of research encompassing a diverse range of methods and designs. Five exemplar tools were developed and assessed in terms of their usefulness in selecting studies for inclusion in a systematic review. The widely used ‘hierarchy of evidence’ was adapted and used to appraise internal validity. Four tools were then developed to appraise the external validity dimensions of generalizability (two scales) and methods of data collection (two scales). Methods of combining the scores generated by each tool were explored. Qualitative and quantitative studies were appraised, not separated into two spheres but by using complementary tools developed to appraise different aspects of rigour. There was a high level of agreement between researchers in applying the tools to twenty-two studies on decision making by professionals about the longterm care of older people. The scales for internal validity and generalizability discriminated between the qualities of studies appropriately. The two tools to appraise data collection gave diverse results. Excluding studies that scored in the lowest category on any scale appeared to be the scoring system that was most justifiable. This approach is presented to stimulate debate about the practical application of the evidence-based initiative to social work and social care. This study may assist in developing clearer definitions and common language about appraising rigour that should further the process of selecting robust research for synthesis to inform practice and policy decisions.
Resumo:
This paper estimates the marginal willingness-to-pay for attributes of a hypothetical HIV vaccine using discrete choice modeling. We use primary data from 326 respondents from Bangkok and Chiang Mai, Thailand, in 2008–2009, selected using purposive, venue-based sampling across two strata. Participants completed a structured questionnaire and full rank discrete choice modeling task administered using computer-assisted personal interviewing. The choice experiment was used to rank eight hypothetical HIV vaccine scenarios, with each scenario comprising seven attributes (including cost) each of which had two levels. The data were analyzed in two alternative specifications: (1) best-worst; and (2) full-rank, using logit likelihood functions estimated with custom routines in Gauss matrix programming language. In the full-rank specification, all vaccine attributes are significant predictors of probability of vaccine choice. The biomedical attributes of the hypothetical HIV vaccine (efficacy, absence of VISP, absence of side effects, and duration of effect) are the most important attributes for HIV vaccine choice. On average respondents are more than twice as likely to accept a vaccine with 99% efficacy, than a vaccine with 50% efficacy. This translates to a willingness to pay US$383 more for a high efficacy vaccine compared with the low efficacy vaccine. Knowledge of the relative importance of determinants of HIV vaccine acceptability is important to ensure the success of future vaccination programs. Future acceptability studies of hypothetical HIV vaccines should use more finely grained biomedical attributes, and could also improve the external validity of results by including more levels of the cost attribute.