Diversity of the Quality Criteria in Qualitative Research in the Health Sciences: Lessons from a Lexicometric Analysis Composed of 133 Guidelines

A review of health sciences literature shows a substantial increase in qualitative publications. This work incorporates a certain number of research quality guidelines. We present the results of the Alceste® lexicometric analysis, which includes 133 quality grids for qualitative research covering five disciplinary fields of the health sciences: medicine and epidemiology, public health and health education, nursing, health sociology and anthropology, psychiatry and psychology. This analysis helped to cross-check the disciplinary fields with the various objectives assigned to the different criteria in the grids examined. The results obtained with Alceste® show the variability of the objectives sought by the authors of the guidelines. These discrepancies are not directly associated to disciplinary fields, and appear to be more closely linked to different qualitative research conceptualizations within the disciplines, and with essential qualitative research validation criteria. These conceptualizations must be clarified to help users better understand the objectives targeted by the grids, and promote more appreciation for qualitative research in the health sciences.

Inter-rater Reliability of Criteria-Based Content Analysis of Children's Statements of Abuse.

The evaluation of children's statements of sexual abuse cases in forensic cases is critically important and must and reliable. Criteria-based content analysis (CBCA) is the main component of the statement validity assessment (SVA), which is the most frequently used approach in this setting. This study investigated the inter-rater reliability (IRR) of CBCA in a forensic context. Three independent raters evaluated the transcripts of 95 statements of sexual abuse. IRR was calculated for each criterion, total score, and overall evaluation. The IRR was variable for the criteria, with several being unsatisfactory. But high IRR was found for the total CBCA scores (Kendall's W = 0.84) and for overall evaluation (Kendall's W = 0.65). Despite some shortcomings, SVA remains a robust method to be used in the comprehensive evaluation of children's statements of sexual abuse in the forensic setting. However, the low IRR of some CBCA criteria could justify some technical improvements.

Evaluation and implementation process for commercial elevator landing doors

Tason ovet voivat olla joko itsesuunniteltuja ja -tehtyjä, tai itse malli ja tuote voidaan ostaa myös yrityksen ulkoa. Tätä make-or-buy kysymystä pohdittaessa ilmenee monta tekijää, jotka vaikuttavat päätökseen. Jos yritys käsittää ostamisen parempana vaihtoehtona, tuote tarvitsee myösimplementointisuunnitelman. Tämän työn päätavoite oli luoda arviointi- ja implementointiprosessi kaupallisille hissin tason oville. Muut tavoitteet olivat: selvittää syyt tälle erikoiselle toiminnolle, löytää kaupallisten ovien käyttöön liittyvät edut ja haitat, sekä luoda kriteerit tason ovien arvioinnille. Lopputuloksena saatiin, että tämän prosessin suorittajan pitää sitoutua arviointi- ja implementointiprosessiin,ja että myös virtuaalitehdas tarvitaan täydentämään arviointivaihetta. Mutta tärkein havainto oli, että tulevaisuuden ovistrategia ei ole vielä täysin päätetty ja siitä syystä yrityksen omat ovimallit pitäisi testata ja verrata niitä kaupallisiin ovimalleihin käyttämällä tämän työn arviointiprosessia.

Quality of Qualitative Research in the Health Sciences : Analysis of the Common Criteria Present in 58 Assessment Guidelines by Expert Users

The number of qualitative research methods has grown substantially over the last twenty years, both in social sciences and, more recently, in the health sciences. This growth came with questions on the quality criteria needed to evaluate this work, and numerous guidelines were published. The latters include many discrepancies though, both in their vocabulary and construction. Many expert evaluators decry the absence of consensual and reliable evaluation tools. The authors present the results of an evaluation of 58 existing guidelines in 4 major health science fields (medicine and epidemiology; nursing and health education; social sciences and public health; psychology / psychiatry, research methods and organization) by expert users (article reviewers, experts allocating funds, editors, etc.). The results propose a toolbox containing 12 consensual criteria with the definitions given by expert users. They also indicate in which disciplinary field each type of criteria is known to be more or less essential. Nevertheless, the authors highlight the limitations of the criteria comparability, as soon as one focuses on their specific definitions. They conclude that each criterion in the toolbox must be explained to come to broader consensus and identify definitions that are consensual to all the fields examined and easily operational.

Eosinophilic granulomatosis with polyangiitis (Churg-Strauss) (EGPA) Consensus Task Force recommendations for evaluation and management.

OBJECTIVE: To develop disease-specific recommendations for the diagnosis and management of eosinophilic granulomatosis with polyangiitis (Churg-Strauss syndrome) (EGPA). METHODS: The EGPA Consensus Task Force experts comprised 8 pulmonologists, 6 internists, 4 rheumatologists, 3 nephrologists, 1 pathologist and 1 allergist from 5 European countries and the USA. Using a modified Delphi process, a list of 40 questions was elaborated by 2 members and sent to all participants prior to the meeting. Concurrently, an extensive literature search was undertaken with publications assigned with a level of evidence according to accepted criteria. Drafts of the recommendations were circulated for review to all members until final consensus was reached. RESULTS: Twenty-two recommendations concerning the diagnosis, initial evaluation, treatment and monitoring of EGPA patients were established. The relevant published information on EGPA, antineutrophil-cytoplasm antibody-associated vasculitides, hypereosinophilic syndromes and eosinophilic asthma supporting these recommendations was also reviewed. DISCUSSION: These recommendations aim to give physicians tools for effective and individual management of EGPA patients, and to provide guidance for further targeted research.

Training system for conceptual design and evaluation for wastewater treatment

Rising population, rapid urbanisation and growing industrialisation have severely stressed water quality and its availability in Malawi. In addition, financial and institutional problems and the expanding agro industry have aggravated this problem. The situation is worsened by depleting water resources and pollution from untreated sewage and industrial effluent. The increasing scarcity of clean water calls for the need for appropriate management of available water resources. There is also demand for a training system for conceptual design and evaluation for wastewater treatment in order to build the capacity for technical service providers and environmental practitioners in the country. It is predicted that Malawi will face a water stress situation by 2025. In the city of Blantyre, this situation is aggravated by the serious pollution threat from the grossly inadequate sewage treatment capacity. This capacity is only 23.5% of the wastewater being generated presently. In addition, limited or non-existent industrial effluent treatment has contributed to the severe water quality degradation. This situation poses a threat to the ecologically fragile and sensitive receiving water courses within the city. This water is used for domestic purposes further downstream. This manuscript outlines the legal and policy framework for wastewater treatment in Malawi. The manuscript also evaluates the existing wastewater treatment systems in Blantyre. This evaluation aims at determining if the effluent levels at the municipal plants conform to existing standards and guidelines and other associated policy and regulatory frameworks. The raw material at all the three municipal plants is sewage. The typical wastewater parameters are Biochemical Oxygen Demand (BOD5), Chemical Oxygen Demand (COD), and Total Suspended Solids (TSS). The treatment target is BOD5, COD, and TSS reduction. Typical wastewater parameters at the wastewater treatment plant at MDW&S textile and garments factory are BOD5 and COD. The treatment target is to reduce BOD5 and COD. The manuscript further evaluates a design approach of the three municipal wastewater treatment plants in the city and the wastewater treatment plant at Mapeto David Whitehead & Sons (MDW&S) textile and garments factory. This evaluation utilises case-based design and case-based reasoning principles in the ED-WAVE tool to determine if there is potential for the tool in Blantyre. The manuscript finally evaluates the technology selection process for appropriate wastewater treatment systems for the city of Blantyre. The criteria for selection of appropriate wastewater treatment systems are discussed. Decision support tools and the decision tree making process for technology selection are also discussed. Based on the treatment targets and design criteria at the eight cases evaluated in this manuscript in reference to similar cases in the ED-WAVE tool, this work confirms the practical use of case-based design and case-based reasoning principles in the ED-WAVE tool in the design and evaluation of wastewater treatment 6 systems in sub-Sahara Africa, using Blantyre, Malawi, as the case study area. After encountering a new situation, already collected decision scenarios (cases) are invoked and modified in order to arrive at a particular design alternative. What is necessary, however, is to appropriately modify the case arrived at through the Case Study Manager in order to come up with a design appropriate to the local situation taking into account technical, socio-economic and environmental aspects. This work provides a training system for conceptual design and evaluation for wastewater treatment.

International research partnerships: establishing partner selection criteria in the university-university context

The main objective of the study was to identify and evaluate criteria for international partner selection in university-university context. This study attempted at promoting better understanding of how universities should proceed in selecting partners for producing joint research publications. Thus, the aim of the study was to gain an understanding of how research collaborations can be developed and how partners can be selected. The choice of a right partner has been identified as a precondition for partnership success. In international research collaborations partnering scientists with different skills and backgrounds bring together complementary knowledge into research projects, which in most cases results in a higher quality output. Therefore, prior to selecting a partner, the set of criteria should be established. This research examined twelve Russian universities with the status of national research university as potential partners for Lappeenranta University of Technology, and selected the most appropriate universities based on established set of criteria. Potential partners’ evaluation was done using secondary sources by tracking partners’ academic success during the period 2005 – 2010. Based on established criteria, the study calculated the partnership index for each university. The results of the research reveal that among twelve examined universities there are four potential partners who have been rather active in publishing scientific articles during 2005 – 2010.

Vaccination Competence - The Concept and Evaluation

The purpose of this two-phase study was to define the concept of vaccination competence and assess the vaccination competence of graduating public health nurse students (PHN students) and public health nurses (PHNs) in Finland, with the goal of promoting and maintaining vaccination competence and developing vaccination education. The first phase of the study included semi-structured interviews with vaccination professionals, graduating PHN students and clients (a total of n=40), asking them to describe vaccination competence as well as the factors strengthening and weakening it. The data were analyzed through content analysis. In the second phase of the study, structured instruments were developed, and vaccination competence of PHN students (n=129) in Finland and PHNs (n=405) was assessed using a self-assessment scale (VAS) and taking a knowledge test. PHNs were used as a reference group, enabling us to determine whether a satisfactory level of vaccination competence was achieved by the end of studies, or whether it was gained through work experience vaccinating clients. The data were collected from five polytechnic institutions and seven health centers located in various parts of the country. The data were collected using instruments developed for this study, and were analyzed statistically. In the first phase, based on the results of the interviews, vaccination competence was defined as a large multi-faceted entity, including the concepts of competent vaccinator, competent implementation of the vaccination, and the outcome of the implementation. Semi-structured interviews revealed that factors strengthening and weakening vaccination competence were connected to the vaccinator, the client being vaccinated, the vaccination environment and vaccinator education. On the whole, factors strengthening and weakening vaccination were the opposite of each other. In the second phase, on the self-assessment of vaccination competence, students rated themselves as significantly lower than working professionals. On the knowledge test, the percentage of correct answers was lower for students than PHNs. When all background variables were taken into account in multivariate analysis, there was no longer a significant difference between the students and PHNs on the self-assessment. However, in multivariate analysis, the PHNs still performed better than students on the knowledge test. For this study, a satisfactory level of vaccination competence was defined as a mean of 8.0 on the self-assessment and 80% correct answers on the knowledge test. Based on these criteria, students almost reached the level of satisfactory in their overall self-assessment, and PHNs did. Both groups, however, did rank themselves as satisfactory in some sum variables. On the knowledge test the students did not achieve a level of satisfactory (80%) in their total score, though PHNs did. As before, both groups did achieve a level of satisfactory in several sum variables. Further research and development should focus on vaccination education, the testing of vaccination competence and vaccination practices in clinical practice, as well as on developing the measurement tools.

Evaluation of outpatient discharge in patients with cutaneous melanoma

OBJECTIVE: to evaluate discharge in a group of patients with cutaneous melanoma according to recently established criteria. METHODS: we conducted an observational, cross-sectional study with 32 patients at the Hospital Universitário Clementino Fraga Filho (HUCFF) / Universidade Federal do Rio de Janeiro (UFRJ), between 1995 and 2013, in the following stages: IA (17 cases, 53.12%), IB (4 cases, 12.5%), IIA (3 cases, 9.37%), IIC (1 case, 3.12%), IIIB (1 case, 3.12%), IIIC (3 cases, 9.37%), melanomas in situ (2 cases, 6.25%), Tx (1 case, 3.12%). RESULTS: the follow-up time varied from one to 20 years (stage IA), five to 15 years (stage IB), six to 17 years (stage IIA), 20 years (stage IIC), 23 years (stage IIIB) and 14 to 18 years (stage IIIC). One melanoma in situ (subungueal) was discharged in the fourth year of follow-up and the other was promptly discharged. The Tx melanoma was followed for 12 years. We observed no relapses or recurrences in the period. CONCLUSION: although a controversial issue, it was possible to endorse the discharge of the patients since our follow-up time had already exceeded the one recommended by the other authors.

Evaluation of common mental disorders in women with polycystic ovary syndrome and its relationship with body mass index

PURPOSE: To evaluate the prevalence of common mental disorders in women diagnosed with polycystic ovary syndrome as compared with paired controls without this syndrome. METHODS: Cross-sectional study with a Control Group examining women between the ages of 18 and 30 who did not use antidepressants and who sought the Gynecology Service of the researched sites. For every woman diagnosed with the polycystic ovary syndrome, another with the same age, educational status and presence or absence of sexual partners was sought without this diagnosis. In total, 166 patients agreed to participate, consisting of 95 diagnosed with polycystic ovary syndrome and 71 in the Control Group. The diagnosis of polycystic ovary syndrome was made by the presence of two from three criteria: oligomenorrhea or amenorrhea, clinical or biochemical hyperandrogenism and polycystic ovaries on transvaginal ultrasound, following exclusion of patients with Cushing's syndrome, congenital adrenal hyperplasia, and androgen-secreting tumors. Weight and height were measured to calculate the body mass index. The Self-Reporting Questionnaire, which evaluated 20 items, was used as an indicator of common mental disorders. A χ² analysis stratified by the category of body mass index was used to compare the prevalence of common mental disorders, between the groups of women with and without the polycystic ovary syndrome. RESULTS: There were no significant differences in age, education, presence of sexual partners, ethnicity, socioeconomic status, use of psychiatric medication, and search for consultation in mental health between the studied groups. The prevalence of obese women with indications of common mental disorders was significantly higher in women with polycystic ovary syndrome than in the Control Group. In the group with healthy body mass index, the incidence of common mental disorders was statistically significant different between women with polycystic ovary syndrome and normal controls (p=0.008). CONCLUSIONS: Women with diagnosis of this disease have an almost three-fold increased likelihood of common mental disorders as compared with those without polycystic ovary syndrome. Although obesity is often observed in polycystic ovary syndrome, even women with a healthy body mass index have an increased risk of psychiatric comorbidity.

Anatomical and functional characteristics of the pelvic floor in nulliparous women submitted to three-dimensional endovaginal ultrasonography: case control study and evaluation of interobserver agreement

PURPOSE: To determine anatomical and functional pelvic floor measurements performed with three-dimensional (3-D) endovaginal ultrasonography in asymptomatic nulliparous women without dysfunctions detected in previous dynamic 3-D anorectal ultrasonography (echo defecography) and to demonstrate the interobserver reliability of these measurements. METHODS: Asymptomatic nulliparous volunteers were submitted to echo defecography to identify dynamic dysfunctions, including anatomical (rectocele, intussusceptions, entero/sigmoidocele and perineal descent) and functional changes (non-relaxation or paradoxical contraction of the puborectalis muscle) in the posterior compartment and assessed with regard to the biometric index of levator hiatus, pubovisceral muscle thickness, urethral length, anorectal angle, anorectal junction position and bladder neck position with the 3-D endovaginal ultrasonography. All measurements were compared at rest and during the Valsalva maneuver, and perineal and bladder neck descent was determined. The level of interobserver agreement was evaluated for all measurements. RESULTS: A total of 34 volunteers were assessed by echo defecography and by 3-D endovaginal ultrasonography. Out of these, 20 subjects met the inclusion criteria. The 14 excluded subjects were found to have posterior dynamic dysfunctions. During the Valsalva maneuver, the hiatal area was significantly larger, the urethra was significantly shorter and the anorectal angle was greater. Measurements at rest and during the Valsalva maneuver differed significantly with regard to anorectal junction and bladder neck position. The mean values for normal perineal descent and bladder neck descent were 0.6 cm and 0.5 cm above the symphysis pubis, respectively. The intraclass correlation coefficient ranged from 0.62-0.93. CONCLUSIONS: Functional biometric indexes, normal perineal descent and bladder neck descent values were determined for young asymptomatic nulliparous women with the 3-D endovaginal ultrasonography. The method was found to be reliable to measure pelvic floor structures at rest and during Valsalva, and might therefore be suitable for identifying dysfunctions in symptomatic patients.

Translation into Brazilian Portuguese, cultural adaptation and evaluation of the reliability of the Disabilities of the Arm, Shoulder and Hand Questionnaire

The objective of the present study was to translate, adapt and validate a Brazilian Portuguese version of the Disabilities of the Arm, Shoulder and Hand (DASH) Questionnaire. The study was carried out in two steps. The first was to translate the DASH into Portuguese and to perform cultural adaptation and the second involved the determination of the reliability and validity of the DASH for the Brazilian population. For this purpose, 65 rheumatoid arthritis patients of either sex (according to the classification criteria of the American College of Rheumatology), ranging in age from 18 to 60 years and presenting no other diseases involving the upper limbs, were interviewed. The patients were selected consecutively at the rheumatology outpatient clinic of UNIFESP. The following results were obtained: in the first step (translation and cultural adaptation), all patients answered the questions. In the second step, Spearman's correlation coefficients for interobserver evaluation ranged from 0.762 to 0.995, values considered to be highly reliable. In addition, intraclass correlation coefficients ranged from 0.97 to 0.99, also highly reliable values. Spearman's correlation coefficients and the intraclass correlation coefficients obtained during intra-observer evaluation ranged from 0.731 to 0.937 and from 0.90 to 0.96, respectively, being highly reliable values. The Ritchie Index showed a weak correlation with Brazilian DASH scores, while the visual analog scale of pain showed a good correlation with DASH score. We conclude that the Portuguese version of the DASH is a reliable instrument.

Evaluation of a 1-h 75-g oral glucose tolerance test in the diagnosis of gestational diabetes

In order to evaluate the performance of a 1-h 75-g oral glucose tolerance test (OGTT) for the diagnosis of gestational diabetes mellitus (GDM), a cohort of 4998 women, 20 years or older, without previous diabetes being treated in prenatal care clinics in Brazil answered a questionnaire and performed a 75-g OGTT including fasting, 1-h and 2-h glucose measurements between their 24th and 28th gestational weeks. Pregnancy outcomes were transcribed from medical registries. GDM was defined according to WHO criteria (fasting: ≥126 mg/dL; 2-h value: ≥140 mg/dL) and macrosomia as a birth weight equal to or higher than 4000 g. Areas under the receiver operator characteristic curve (AUC) were compared and diagnostic properties of various cut-off points were evaluated. The AUCs for the prediction of macrosomia were 0.606 (0.572-0.637) for the 1-h and 0.589 (0.557-0.622) for the 2-h plasma glucose test. Similar predictability was demonstrable regarding combined adverse outcomes: 0.582 (0.559-0.604) for the 1-h test and 0.572 (0.549-0.595) for the 2-h test. When the 1-h glucose test was evaluated against a diagnosis of GDM defined by the 2-h glucose test, the AUC was 0.903 (0.886-0.919). The cut-off point that maximized sensitivity (83%) and specificity (83%) was 141 mg/dL, identifying 21% of the women as positive. A cut-off point of 160 mg/dL, with lower sensitivity (62%), had higher specificity (94%), labeling 8.6% as positive. Detection of GDM can be done with a 1-h 75-g OGTT: the value of 160 mg/dL has the same diagnostic performance as the conventional 2-h value (140 mg/dL). The simplification of the test may improve coverage and timing of the diagnosis of GDM.

Evaluation of renal function in sickle cell disease patients in Brazil

The objective of this study was to investigate renal function in a cohort of 98 patients with sickle cell disease (SCD) followed up at a tertiary hospital in Brazil. Clinical and laboratory characteristics at the time of the most recent medical examination were analyzed. Renal function was evaluated by the estimation of glomerular filtration rate (GFR) by the criteria of the Chronic Kidney Disease Epidemiology Collaboration (CKD-EPI). We compared patients with normal GFR to patients with decreased GFR (<60 mL·min-1·(1.73 m²)-1) and hyperfiltration (>120 mL·min-1·(1.73 m²)-1). Comparison between patients according to the use of hydroxyurea and comparison of clinical and laboratory parameters according to GFR were also carried out. Average patient age was 33.8 ± 13.3 years (range 19-67 years), and 57 (58.1%) patients were females. The comparison of patients according to GFR showed that patients with decreased GFR (<60 mL·min-1·(1.73 m²)-1) were older, had lower levels of hematocrit, hemoglobin and platelets and higher levels of urea and creatinine. Independent risk factors for decreased GFR were advanced age (OR = 21.6, P < 0.0001) and anemia (OR = 39.6, P < 0.0001). Patients with glomerular hyperfiltration tended to be younger, had higher levels of hematocrit, hemoglobin and platelets and lower levels of urea and creatinine, with less frequent urinary abnormalities. Hydroxyurea, at the dosage of 500-1000 mg/day, was being administered to 28.5% of the patients, and there was no significant difference regarding renal function between the two groups. Further studies are required to establish the best therapeutic approach to renal abnormalities in SCD.

Safety criteria for the acquisition of meat in Brazilian University restaurants

The present study's objective was to analyze the procedures aimed at guaranteeing sanitary conditions when acquiring meat. The study was conducted with university restaurants of the Federal Institutions of Higher Education (IFES) located in the five regions of Brazil. Data were collected using a questionnaire and an evaluation list, which was available online to restaurant professionals. The results showed that restaurants chose one or two types of meat, the most frequent of which were beef and chicken. In restaurants managed by the IFES, the acquisition of raw material occurred by bidding. For vendor selection, the restaurants required product registration with the Inspection Service and requested regulation of the supplier by the Health Surveillance. Monitoring was carried out through a technical visit to the supplier and a review of the past records of the supplier. A higher percentage of restaurants in the Southeast region met appropriate sanitary and hygienic criteria for the receipt of meat, followed by the South, Midwest, Northeast and North. We conclude that restaurants meet most of the safety criteria set in the legislation. However, some weaknesses are evident in the physical and functional structure, the system of transportation of raw material and the records of control measures at the place of reception.