A critical analysis of e-government evaluation models at national and local municipal levels

Abstract: The importance of e-government models lies in their offering a basis to measure and guide e-government. There is still no agreement on how to assess a government online. Most of the e-government models are not based on research, nor are they validated. In most countries, e-government has not reached higher stages of growth. Several scholars have shown a confusing picture of e-government. What is lacking is an in-depth analysis of e-government models. Responding to the need for such an analysis, this study identifies the strengths and weaknesses of major national and local e-government evaluation models. The common limitations of most models are focusing on the government and not the citizen, missing qualitative measures, constructing the e-equivalent of a bureaucratic administration, and defining general criteria without sufficient validations. In addition, this study has found that the metrics defined for national e-government are not suitable for municipalities, and most of the existing studies have focused on national e-governments even though local ones are closer to citizens. There is a need for developing a good theoretical model for both national and local municipal e-government.

A quantitative and qualitative evaluation of reports of clinical trials published in six Brazilian dental journals indexed in the Scientific Electronic Library Online (SciELO)

INTRODUCTION: Open access publishing is becoming increasingly popular within the biomedical sciences. SciELO, the Scientific Electronic Library Online, is a digital library covering a selected collection of Brazilian scientific journals many of which provide open access to full-text articles.This library includes a number of dental journals some of which may include reports of clinical trials in English, Portuguese and/or Spanish. Thus, SciELO could play an important role as a source of evidence for dental healthcare interventions especially if it yields a sizeable number of high quality reports. OBJECTIVE: The aim of this study was to identify reports of clinical trials by handsearching of dental journals that are accessible through SciELO, and to assess the overall quality of these reports. MATERIAL AND METHODS: Electronic versions of six Brazilian dental Journals indexed in SciELO were handsearched at www.scielo.br in September 2008. Reports of clinical trials were identified and classified as controlled clinical trials (CCTs - prospective, experimental studies comparing 2 or more healthcare interventions in human beings) or randomized controlled trials (RCTs - a random allocation method is clearly reported), according to Cochrane eligibility criteria. CRITERIA TO ASSESS METHODOLOGICAL QUALITY INCLUDED: method of randomization, concealment of treatment allocation, blinded outcome assessment, handling of withdrawals and losses and whether an intention-to-treat analysis had been carried out. RESULTS: The search retrieved 33 CCTs and 43 RCTs. A majority of the reports provided no description of either the method of randomization (75.3%) or concealment of the allocation sequence (84.2%). Participants and outcome assessors were reported as blinded in only 31.2% of the reports. Withdrawals and losses were only clearly described in 6.5% of the reports and none mentioned an intention-to-treat analysis or any similar procedure. CONCLUSIONS: The results of this study indicate that a substantial number of reports of trials and systematic reviews are available in the dental journals listed in SciELO, and that these could provide valuable evidence for clinical decision making. However, it is clear that the quality of a number of these reports is of some concern and that improvement in the conduct and reporting of these trials could be achieved if authors adhered to internationally accepted guidelines, e.g. the CONSORT statement.

Clinical practice guidelines in Portugal : quantitative and qualitative evaluation

RESUMO: Introdução As normas de orientação clínica são ferramentas úteis na translação de conhecimentos desde a investigação para a prática clínica diária. Estratégias ativas de implementação de normas de orientação clínica requerem elevado esforço organizacional e financeiro. Quando os recursos são escassos, as estratégias passivas podem ser a única opção de disseminação. Desde 2011 a Direção Geral da Saúde publicou cento e cinquenta e nove normas de orientação clínica. Nesta Tese é feita uma avaliação do impacto que estratégias de disseminação de normas de orientação clínica têm no padrão de prescrição dos médicos e uma avaliação qualitativa do processo das normas de orientação clínica em Portugal. Métodos: O primeiro artigo é um estudo quasi experimental usando uma série de análises temporais interrompida para comparar os níveis observados e esperados de prescrição de inibidores da ciclooxigenasa-2, antes e depois da publicação da norma de orientação clínica sobre a utilização de anti-inflamatórios não esteroides. O segundo estudo é um artigo de opinião e debate no qual numa primeira parte contextualiza o processo das normas da Direcção Geral da Saúde, na segunda parte aponta virtudes e defeitos no processo e a terceira parte constitui uma contribuição com vista à melhoria do processo. Discussão A produção de normas de orientação clínica requer metodologia rigorosa e complexa. A literatura médica revela que a translação de conhecimento é uma tarefa árdua. Estratégias de implementação ativas requerem recursos financeiros e organizacionais sólidos. Estratégias de implementação passivas podem representar uma solução aceitável se os recursos financeiros e organizacionais escasseiam. Pouco é conhecido sobre a eficácia destas estratégias fora do contexto de investigação. Com esta Tese pretendo contribuir para a clarificação desta resposta, outros países e instituições podem ver utilidade nesta informação, bem como pretendo contribuir para a discussão e melhoria do processo das normas de orientação clínica em Portugal. ------------------ ABSTRACT: Introduction Clinical practice guidelines can help address the failure to translate research findings into clinical practice. Active clinical practice guidelines implementation strategies require active efforts from organizations and are resource and financially demanding. Passive implementation strategies may represent the only option if resources are scarce. Out of research environment, real world efficacy of passive implementation strategies is still undetermined. Since 2011 the Portuguese General Health Directorate published one hundred and fifty nine guidelines. In this Thesis I evaluate the impact of passive dissemination of clinical practice guideline in clinician’s prescription behavior and review, from a qualitative point of view, the Portuguese clinical practice guideline process. Methods The first study is a quasi-experimental study using a retrospective interrupted time-series analysis design to compare the observed and expected prescription of cyclooxygenase-2 before and after the non steroidal antiinflammatory guideline publication. The second study is an opinion and debate article in which I firstly review the General Health Directorate guideline process. The second part states positive and negative aspects in the process and the third part is a contribution aimed at improving the process in the future. Discussion Clinical practice guidelines production demands a rigorous and complex methodology. medical iterature reveals that knowledge translation is a difficult task. Active implementation strategies demand solid financial and organizational resources. Passive implementation strategies may represent an acceptable solution if financial and organizational resources are scarce. Little is known about the efficacy of these strategies out of the research context. With this Thesis I intend to contribute to clarify this question, other countries and institutions with similar conditions may find this information useful, and also to contribute for the discussion and general improvement of national clinical practice guidelines process.

Evaluation qualitative de la compliance médicale [Qualitative evaluation of medical compliance].

OBJECTIVE: The effectiveness of CLP (Consultation and liaison psychiatry) interventions in a general hospital is difficult to evaluate; parameters potentially determinant as to effectiveness are numerous. Effectiveness evaluations are almost exclusively restricted to the duration of hospitalization. Since CLP may and often should be manifest beyond discharge, we intended to determine the agreement between our proposition and its execution as a measure of effectiveness. METHOD: We based our analyses principally on the general practitioner's appreciation of the CLP impact, a measure of effectiveness at distance from the consultation by a judge not directly involved in the consulting process. This qualitative assessment is based on a population of 50 patients. RESULTS: Our results suggest that agreement between our proposal and its complete execution is good concerning medication (90%) and referral rate after the hospitalization (85%), average as to liaison suggestions (65%) and clearly weak as to propositions regarding further investigations (< 30%). CONCLUSION: CLP proposals must be as close as possible to the in-patient physician's preoccupations to enhance the probability that they be executed. The concordance as to the proposal and its execution as well as the CLP impact estimation need be evaluated at distance. This evaluation must imply the general practitioner's assessment.

A quantitative and qualitative evaluation of reports of clinical trials published in six Brazilian dental journals indexed in the Scientific Electronic Library Online (SciELO)

Introduction: Open access publishing is becoming increasingly popular within the biomedical sciences. SciELO, the Scientific Electronic Library Online, is a digital library covering a selected collection of Brazilian scientific journals many of which provide open access to full-text articles. This library includes a number of dental journals some of which may include reports of clinical trials in English, Portuguese and/or Spanish. Thus, SciELO could play an important role as a source of evidence for dental healthcare interventions especially if it yields a sizeable number of high quality reports. Objective: The aim of this study was to identify reports of clinical trials by handsearching of dental journals that are accessible through SciELO, and to assess the overall quality of these reports. Material and methods: Electronic versions of six Brazilian dental Journals indexed in SciELO were handsearched at www.scielo.br in September 2008. Reports of clinical trials were identified and classified as controlled clinical trials (CCTs - prospective, experimental studies comparing 2 or more healthcare interventions in human beings) or randomized controlled trials (RCTs - a random allocation method is clearly reported), according to Cochrane eligibility criteria. Criteria to assess methodological quality included: method of randomization, concealment of treatment allocation, blinded outcome assessment, handling of withdrawals and losses and whether an intention-to-treat analysis had been carried out. Results: The search retrieved 33 CCTs and 43 RCTs. A majority of the reports provided no description of either the method of randomization (75.3%) or concealment of the allocation sequence (84.2%). Participants and outcome assessors were reported as blinded in only 31.2% of the reports. Withdrawals and losses were only clearly described in 6.5% of the reports and none mentioned an intention-to-treat analysis or any similar procedure. Conclusions: The results of this study indicate that a substantial number of reports of trials and systematic reviews are available in the dental journals listed in SciELO, and that these could provide valuable evidence for clinical decision making. However, it is clear that the quality of a number of these reports is of some concern and that improvement in the conduct and reporting of these trials could be achieved if authors adhered to internationally accepted guidelines, e. g. the CONSORT statement.

Qualitative evaluation of active potential barriers in SnO2-based polycrystalline devices by electrostatic force microscopy

This paper discuss the qualitative use of electrostatic force microscopy to study the grain boundary active potential barrier present in dense SnO2-based polycrystalline semiconductors. The effect of heat treatment under rich- and poor-oxygen atmospheres was evaluated while especially considering the number of active barriers at grain boundary regions. The results show that the number of active barriers decrease after heat treatment in an oxygen-poor atmosphere and increase after heat treatment in oxygen-rich atmospheres. The observed effect was explained by considering the presence of oxidized transition metal elements segregated at grain boundary regions which leads to the p-type character of this region, in agreement with the atomic barrier formation mechanism in metal oxide varistor systems.

An investigation of used car safety: final report. Volume II-Qualitative evaluation.

Mode of access: Internet.

Brady et al.'s (2005) service evaluation models: A replication and extension in China

The research described in this study replicates and extends the Brady et al., [Brady, M. K., Knight, G. A., Cronin Jr. J. Toma, G., Hult, M. and Keillor, B. D. (2005), emoving the Contextual Lens: A Multinational, Mult-setting Comparison of Service Evaluation Models, Journal of Retailing, 81(3), pp. 215-230] study suggestion that future research in service evaluations should focus on emerging service economies such as China. The intent of the research was to examine the suitability of the models suggested by Brady and colleagues in the Chinese market. The replication somewhat successfully duplicated their finding as to the superiority of the comprehensive service evaluation model. Additionally, we also sought to examine as to whether the service evaluation model is gender invariant. Our findings indicate that there are significant differences between gender. These findings are discussed relative to the limitations associated with the study.

Brady et al.'s (2005) service evaluation models: A replication and extension in China

The research described in this study replicates and extends the Brady et al., [Brady, M. K., Knight, G. A., Cronin Jr. J. Toma, G., Hult, M. and Keillor, B. D. (2005), emoving the Contextual Lens: A Multinational, Mult-setting Comparison of Service Evaluation Models, Journal of Retailing, 81(3), pp. 215-230] study suggestion that future research in service evaluations should focus on emerging service economies such as China. The intent of the research was to examine the suitability of the models suggested by Brady and colleagues in the Chinese market. The replication somewhat successfully duplicated their finding as to the superiority of the comprehensive service evaluation model. Additionally, we also sought to examine as to whether the service evaluation model is gender invariant. Our findings indicate that there are significant differences between gender. These findings are discussed relative to the limitations associated with the study.

GPs' perspectives on managing the NHS Health Check in primary care:a qualitative evaluation of implementation in one area of England

OBJECTIVES: To evaluate the implementation of the National Health Service (NHS) Health Check programme in one area of England from the perspective of general practitioners (GPs). DESIGN: A qualitative exploratory study was conducted with GPs and other healthcare professionals involved in delivering the NHS Health Check and with patients. This paper reports the experience of GPs and focuses on the management of the Heath Check programme in primary care. SETTING: Primary care surgeries in the Heart of Birmingham region (now under the auspices of the Birmingham Cross City Clinical Commissioning Group) were invited to take part in the larger scale evaluation. This study focuses on a subset of those surgeries whose GPs were willing to participate. PARTICIPANTS: 9 GPs from different practices volunteered. GPs served an ethnically diverse region with areas of socioeconomic deprivation. Ethnicities of participant GPs included South Asian, South Asian British, white, black British and Chinese. METHODS: Individual semistructured interviews were conducted with GPs face to face or via telephone. Thematic analysis was used to analyse verbatim transcripts. RESULTS: Themes were generated which represent GPs' experiences of managing the NHS Health Check: primary care as a commercial enterprise; 'buy in' to concordance in preventive healthcare; following protocol and support provision. These themes represent the key issues raised by GPs. They reveal variability in the implementation of NHS Health Checks. GPs also need support in allocating resources to the Health Check including training on how to conduct checks in a concordant (or collaborative) way. CONCLUSIONS: The variability observed in this small-scale evaluation corroborates existing findings suggesting a need for more standardisation. Further large-scale research is needed to determine how that could be achieved. Work needs to be done to further develop a concordant approach to lifestyle advice which involves tailored individual goal setting rather than a paternalistic advice-giving model.