816 resultados para Methodological validity
Resumo:
Thèse numérisée par la Division de la gestion de documents et des archives de l'Université de Montréal
Resumo:
Durante os meses de julho e agosto de 2005, o Programa de Prevenção e Controle de Enchentes, da Prefeitura da Cidade do Rio de Janeiro, foi objeto de um procedimento de auditoria operacional realizado por uma equipe de técnicos do Tribunal de Contas do Município do Rio de Janeiro - TCMRJ. Esta auditoria teve como objetivo principal a avaliação do processo de implementação e gestão relativo ao programa, durante o quadriênio 2002-2005, segundo critérios de economia, eficiência, eficácia e efetividade na aplicação dos recursos. Os auditores apontaram a existência de falhas no processo de planejamento e implementação, caracterizadas basicamente por problemas relacionados à execução dos contratos e ao cumprimento das metas de aplicação definidas no planejamento do programa. Apesar dos problemas evidenciados e o registro de várias recomendações sobre oportunidades de melhoria de gestão, a conclusão geral trazida pelo relatório foi a de que não foi possível avaliar consistentemente a eficiência e a eficácia do programa. Entretanto, os resultados colhidos pela presente análise revelaram que os problemas apontados pelo tmbalho do TCMRJ disseram respeito a causas mais profundas, relacionadas à dinâmica do processo de formulação e implementação de políticas públicas, a qual, nem sempre apresenta elementos alinhados com as características e os requisitos estruturais exigidos para o correto funcionamento do modelo de gestão de desempenho. Nesta linha de desenvolvimento, este trabalho procurou organizar as evidências coletadas pela auditoria do TCMRJ em meio a uma estrutura de análise capaz de relacionar os problemas apontados aos seus fatores causativos. Não se trata aqui de questionar a validade metodológica do trabalho conduzido pelo TCMRJ, mas sim, de colocá-lo frente a uma perspectiva de análise mais estruturada e em face a seu real objeto de análise: o modelo de gestão orientada para resultados - suas camcterísticas, requisitos e limitações.
Resumo:
The human startle response is a sensitive, noninvasive measure of central nervous system activity that is Currently used in a wide variety of research and clinical settings. In this article, we raise methodological issues and present recommendations for optimal methods of startle blink electromyographic (EMG) response elicitation, recording, quantification, and reporting. It is hoped that this report Will foster more methodological validity and reliability in research using the startle response, Lis well Lis increase the detail with which relevant methodology is reported in publications using this measure.
Resumo:
This paper reports on a process to validate a revised version of a system for coding classroom discourse in foreign language lessons, a context in which the dual role of language (as content and means of communication) and the speakers' specific pedagogical aims lead to a certain degree of ambiguity in language analysis. The language used by teachers and students has been extensively studied, and a framework of concepts concerning classroom discourse well-established. Models for coding classroom language need, however, to be revised when they are applied to specific research contexts. The application and revision of an initial framework can lead to the development of earlier models, and to the re-definition of previously established categories of analysis that have to be validated. The procedures followed to validate a coding system are related here as guidelines for conducting research under similar circumstances. The advantages of using instruments that incorporate two types of data, that is, quantitative measures and qualitative information from raters' metadiscourse, are discussed, and it is suggested that such procedure can contribute to the process of validation itself, towards attaining reliability of research results, as well as indicate some constraints of the adopted research methodology.
Resumo:
There is a growing body of literature that provides evidence for the efficacy of positive youth development programs in general and preliminary empirical support for the efficacy of the Changing Lives Program (CLP) in particular. This dissertation sought to extend previous efforts to develop and preliminarily examine the Transformative Goal Attainment Scale (TGAS) as a measure of participant empowerment in the promotion of positive development. Consistent with recent advances in the use of qualitative research methods, this dissertation sought to further investigate the utility of Relational Data Analysis (RDA) for providing categorizations of qualitative open-ended response data. In particular, a qualitative index of Transformative Goals, TG, was developed to complement the previously developed quantitative index of Transformative Goal Attainment (TGA), and RDA procedures for calculating reliability and content validity were refined. Second, as a Stage I pilot/feasibility study this study preliminarily examined the potentially mediating role of empowerment, as indexed by the TGAS, in the promotion of positive development. ^ Fifty-seven participants took part in this study, forty CLP intervention participants and seventeen control condition participants. All 57 participants were administered the study's measures just prior to and just following the fall 2003 semester. This study thus used a short-term longitudinal quasi-experimental research design with a comparison control group. ^ RDA procedures were refined and applied to the categorization of open-ended response data regarding participants' transformative goals (TG) and future possible selves (PSQ-QE). These analyses revealed relatively strong, indirect evidence for the construct validity of the categories as well as their theoretically meaningful structural organization, thereby providing sufficient support for the utility of RDA procedures in the categorization of qualitative open-ended response data. ^ In addition, transformative goals (TG) and future possible selves (PSQ-QE), and the quantitative index of perceived goal attainment (TGA) were evaluated as potential mediators of positive development by testing their relationships to other indices of positive intervention outcome within a four-step method involving both analysis of variance (ANOVA and RMANOVAs) and regression analysis. Though more limited in scope than the efforts at the development and refinement of the measures of these mediators, the results were also promising. ^
Resumo:
Aims. The aims of this study were to assess the internal reliability (internal consistency), construct validity, sensitivity and ceiling and floor effects of the Brazilian-Portuguese version of the Impact of Event Scale (IES). Design. Methodological research design. Method. The Brazilian-Portuguese version of the IES was applied to a group of 91 burned patients at three times: the first week after the burn injury (time one), between the fourth and the sixth months (time two) and between the ninth and the 12th months (time three). The internal consistency, construct validity (convergent and dimensionality), sensitivity and ceiling and floor effects were tested. Results. Cronbach`s alpha coefficients showed high internal consistency for the total scale (0 center dot 87) and for the domains intrusive thoughts (0 center dot 87) and avoidance responses (0 center dot 76). During the hospitalisation (time one), the scale showed low and positive correlations with pain measures immediately before (r = 0 center dot 22; p < 0 center dot 05) and immediately after baths and dressings (r = 0 center dot 21; p < 0 center dot 05). After the discharge, we found strong and negative correlations with self-esteem (r = -0 center dot 52; p < 0 center dot 01), strong and positive with depression (r = 0 center dot 63; p < 0 center dot 01) and low and negative with the Bodily pain (r = -0 center dot 24; p < 0 center dot 05), Social functioning (r = -0 center dot 34; p < 0 center dot 01) and Mental health (r = -0 center dot 27; p < 0 center dot 05) domains of the SF-36 at time two. Regarding the sensitivity, no statistically significant differences were observed between mean scale scores according to burned body surface (p = 0 center dot 21). The floor effect was observed in most of the IES items. Conclusion. The adapted version of the scale showed to be reliable and valid to assess postburn reactions on the impact of the event in the group of patients under analysis. Relevance to clinical practice. The Impact of Event Scale can be used in research and clinical practice to assess nursing interventions aimed at decreasing stress during rehabilitation.
Resumo:
ABSTRACT OBJECTIVE : To evaluate the validity and reliability of the Questionnaire for Compliance with Standard Precaution for nurses. METHODS : This methodological study was conducted with 121 nurses from health care facilities in Sao Paulo's countryside, who were represented by two high-complexity and by three average-complexity health care facilities. Internal consistency was calculated using Cronbach's alpha and stability was calculated by the intraclass correlation coefficient, through test-retest. Convergent, discriminant, and known-groups construct validity techniques were conducted. RESULTS : The questionnaire was found to be reliable (Cronbach's alpha: 0.80; intraclass correlation coefficient: (0.97) In regards to the convergent and discriminant construct validity, strong correlation was found between compliance to standard precautions, the perception of a safe environment, and the smaller perception of obstacles to follow such precautions (r = 0.614 and r = 0.537, respectively). The nurses who were trained on the standard precautions and worked on the health care facilities of higher complexity were shown to comply more (p = 0.028 and p = 0.006, respectively). CONCLUSIONS : The Brazilian version of the Questionnaire for Compliance with Standard Precaution was shown to be valid and reliable. Further investigation must be conducted with nurse samples that are more representative of the Brazilian reality. The use of the questionnaire may support the creation of educational measures considering the possible gaps that can be identified, focusing on the workers' health and on the patients' safety.
Resumo:
BACKGROUND: Reconstruction of the central aortic pressure wave from the noninvasive recording of the radial pulse with applanation tonometry has become a standard tool in the field of hypertension. It is not presently known whether recording the radial pulse on the dominant or the nondominant side has any effect on such reconstruction. METHOD: We carried out radial applanation tonometry on both forearms in young, healthy, male volunteers, who were either sedentary (n = 11) or high-level tennis players (n = 10). The purpose of including tennis players was to investigate individuals with extreme asymmetry between the dominant and nondominant upper limb. RESULTS: In the sedentary individuals, forearm circumference and handgrip strength were slightly larger on the dominant (mean +/- SD respectively 27.9 +/- 1.5 cm and 53.8 +/- 10 kg) than on nondominant side (27.3 +/- 1.6 cm, P < 0.001 vs. dominant, and 52.1 +/- 11 kg, P = NS). In the tennis players, differences between sides were more conspicuous (forearm circumference: dominant 28.0 +/- 1.7 cm nondominant 26.4 +/- 1.5 cm, P < 0.001; handgrip strength 61.4 +/- 10.8 vs. 53.4 +/- 9.7 kg, P < 0.001). We found that in both sedentary individuals and tennis players, the radial pulse had identical shape on both sides and, consequently, the reconstructed central aortic pressure waveforms, as well as derived indices of central pulsatility, were not dependent on the side where applanation tonometry was carried out. CONCLUSION: Evidence from individuals with maximal asymmetry of dominant vs. nondominant upper limb indicates that laterality of measurement is not a methodological issue for central pulse wave analysis carried out with radial applanation tonometry.
Resumo:
In the last decades; a growing stock of literature has been devoted to the criticism of GDP as an indicator of societal wealth. A relevant question is: what are the perspectives to build, on the existing knowledge and consensus, alternative measures of prosperity? A starting point may be to connect well-being research agenda with the sustainability one. However, there is no doubt that there is a lot of complexity and fuzziness inherent in multidimensional concepts such as sustainability and well-being. This article analyses the theoretical foundations and the empirical validity of some multidimensional technical tools that can be used for well-being evaluation and assessment. Of course one should not forget that policy conclusions derived through any mathematical model depend also on the conceptual framework used, i.e. which representation of reality (and thus which societal values and interests) has been considered.
Resumo:
Background: The COSMIN checklist (COnsensus-based Standards for the selection of health status Measurement INstruments) was developed in an international Delphi study to evaluate the methodological quality of studies on measurement properties of health-related patient reported outcomes (HR-PROs). In this paper, we explain our choices for the design requirements and preferred statistical methods for which no evidence is available in the literature or on which the Delphi panel members had substantial discussion. Methods: The issues described in this paper are a reflection of the Delphi process in which 43 panel members participated. Results: The topics discussed are internal consistency (relevance for reflective and formative models, and distinction with unidimensionality), content validity (judging relevance and comprehensiveness), hypotheses testing as an aspect of construct validity (specificity of hypotheses), criterion validity (relevance for PROs), and responsiveness (concept and relation to validity, and (in) appropriate measures).Conclusions: We expect that this paper will contribute to a better understanding of the rationale behind the items, thereby enhancing the acceptance and use of the COSMIN checklist.
Resumo:
Using a sample of patients with coronary artery disease, this methodological study aimed to conduct a cross-cultural adaptation and validation of a questionnaire on knowledge of cardiovascular risk factors (Q-FARCS), lifestyle changes, and treatment adherence for use in Brazil. The questionnaire has three scales: general knowledge of risk factors (RFs); specific knowledge of these RFs; and lifestyle changes achieved. Cross-cultural adaptation included translation, synthesis, back-translation, expert committee review, and pretesting. Face and content validity, reliability, and construct validity were measured. Cronbach’s alpha for the total sample (n = 240) was 0.75. Assessment of psychometric properties revealed adequate face and content validity, and the construct revealed seven components. It was concluded that the Brazilian version of Q-FARCS had adequate reliability and validity for the assessment of knowledge of cardiovascular RFs.
Resumo:
We present the first steps in the validation of an observational tool for father-mother-infant interactions: the FAAS (Family Alliance Assessment Scales). Family-level variables are acknowledged as unique contributors to the understanding of the socio-affective development of the child, yet producing reliable assessments of family-level interactions poses a methodological challenge. There is, therefore, a clear need for a validated and clinically relevant tool. This validation study has been carried out on three samples: one non-referred sample, of families taking part in a study on the transition to parenthood (normative sample; n = 30), one referred for medically assisted procreation (infertility sample; n = 30) and one referred for a psychiatric condition in one parent (clinical sample; n = 15). Results show that the FAAS scales have (1) good inter-rater reliability and (2) good validity, as assessed through known-group validity by comparing the three samples and through concurrent validity by checking family interactions against parents' self-reported marital satisfaction.
Resumo:
The twenty-second Theoretical Roman Archaeology Conference (TRAC) was held at the Goethe-University Frankfurt am Main in spring 2012. During the three-day conference fifty papers were delivered, discussing issues from a wide range of geographical regions of the Roman Empire, and applying various theoretical and methodological approaches. An equally wide selection of subjects was presented: sessions looked at Greek art and philhellenism in the Roman world, the validity of the concept of 'Romanisation', change and continuity in Roman religion, urban neighbourhood relations in Pompeii and Ostia, the transformation of objects in and from the Roman world, frontier markets and Roman archaeology in the Provinces. In addition, two general sessions covered single topics such as the 'transvestite of Catterick', metal recycling or Egyptian funeral practice in the Roman period. This volume contains a selection of papers from all these sessions.
Resumo:
This paper develops some theoretical and methodological considerations for the development of a critical competence model (CCM). The model is defined as a set of skills and knowledge functionally organized allowing measurable results with positive consequences for the strategic business objectives. The theoretical approaches of classical model of competences, the contemporary model of competencies and human competencies model were revised for the proposal development. implementation of the model includes 5 steps: 1) conducting a job analysis considering which dimensions or facets are subject to revision, 2) identify people with the opposite performance (the higher performance and lower performance); 3) identify critical incidents most relevant to the job position, 4) develop behavioral expectation scales (bes) and 5) validate BES obtained for experts in the field. As a final consideration, is determined that the competence models require accurate measurement. Approaches considering excessive theoreticism may cause the issue of competence become a fashion business with low or minimal impact, affecting its validity, reliability and deployment in organizations.
Resumo:
El objetivo de esta tesis es predecir el rendimiento de los estudiantes de doctorado en la Universidad de Girona según características personales (background), actitudinales y de redes sociales de los estudiantes. La población estudiada son estudiantes de tercer y cuarto curso de doctorado y sus directores de tesis doctoral. Para obtener los datos se ha diseño un cuestionario web especificando sus ventajas y teniendo en cuenta algunos problemas tradicionales de no cobertura o no respuesta. El cuestionario web se hizo debido a la complejidad que comportan de las preguntas de red social. El cuestionario electrónico permite, mediante una serie de instrucciones, reducir el tiempo para responder y hacerlo menos cargado. Este cuestionario web, además es auto administrado, lo cual nos permite, según la literatura, unas respuestas mas honestas que cuestionario con encuestador. Se analiza la calidad de las preguntas de red social en cuestionario web para datos egocéntricos. Para eso se calcula la fiabilidad y la validez de este tipo de preguntas, por primera vez a través del modelo Multirasgo Multimétodo (Multitrait Multimethod). Al ser datos egocéntricos, se pueden considerar jerárquicos, y por primera vez se una un modelo Multirasgo Multimétodo Multinivel (multilevel Multitrait Multimethod). Las la fiabilidad y validez se pueden obtener a nivel individual (within group component) o a nivel de grupo (between group component) y se usan para llevar a cabo un meta-análisis con otras universidades europeas para analizar ciertas características de diseño del cuestionario. Estas características analizan si para preguntas de red social hechas en cuestionarios web son más fiables y validas hechas "by questions" o "by alters", si son presentes todas las etiquetas de frecuencia para los ítems o solo la del inicio y final, o si es mejor que el diseño del cuestionario esté en con color o blanco y negro. También se analiza la calidad de la red social en conjunto, en este caso específico son los grupos de investigación de la universidad. Se tratan los problemas de los datos ausentes en las redes completas. Se propone una nueva alternativa a la solución típica de la red egocéntrica o los respondientes proxies. Esta nueva alternativa la hemos nombrado "Nosduocentered Network" (red Nosduocentrada), se basa en dos actores centrales en una red. Estimando modelos de regresión, esta "Nosduocentered network" tiene mas poder predictivo para el rendimiento de los estudiantes de doctorado que la red egocéntrica. Además se corrigen las correlaciones de las variables actitudinales por atenuación debido al pequeño tamaño muestral. Finalmente, se hacen regresiones de los tres tipos de variables (background, actitudinales y de red social) y luego se combinan para analizar cual para predice mejor el rendimiento (según publicaciones académicas) de los estudiantes de doctorado. Los resultados nos llevan a predecir el rendimiento académico de los estudiantes de doctorado depende de variables personales (background) i actitudinales. Asimismo, se comparan los resultados obtenidos con otros estudios publicados.