919 resultados para Content validity
Resumo:
Malgré la préoccupation croissante des chercheurs et praticiens pour la santé psychologique au travail, le concept de bien-être vécu au travail est encore mal compris de la communauté scientifique. En effet, peu d’efforts ont été consacrés à ce jour pour développer des connaissances sur le bien-être psychologique au travail arrimées à la réalité des employés. Cette thèse a donc pour objectif de développer une conceptualisation du bien-être psychologique au travail et une instrumentation psychométriquement fiable lui étant rattachée. Pour ce faire, deux études ont été réalisées. La première, de nature qualitative et exploratoire, fut menée auprès de 20 travailleurs canadiens francophones afin de répertorier, à partir d’incidents critiques vécus par ceux-ci, des manifestations de bien-être psychologique au travail. Celles-ci ont pu être classifiées selon un modèle en 2 axes, soit la sphère de référence dans laquelle le bien-être psychologique au travail se vit et la directionnalité selon laquelle il se développe. Ce modèle a ensuite été comparé aux conceptualisations génériques du bien-être psychologique existantes, et cette analyse a permis d’étayer la validité convergente et divergente du modèle. Dans un deuxième temps, l’Indice de bien-être psychologique au travail (IBEPT) a été créé sur la base des manifestations relevées lors de l’étude qualitative, afin d’en assurer la validité de contenu. Une version expérimentale de l’instrument a ensuite été soumise à une expérimentation auprès de 1080 travailleurs québécois. Les analyses factorielles exploratoires révèlent une structure interne en 25 items reflétant 5 dimensions, représentant elles-mêmes un construit de second ordre. La validité de construit de cette conceptualisation a ensuite été étudiée par l’analyse des intercorrélations avec une série de mesures du bien-être et de la détresse psychologique génériques. Les résultats appuient la validité convergente de l’instrument, et démontrent également sa validité divergente. Enfin, l’instrument affiche une cohérence interne satisfaisante. Au terme de cette recherche doctorale, les résultats des deux études sont interprétés en fonction de l’état actuel des connaissances sur le bien-être psychologique, les limites des études sont énoncées, et des pistes de recherche future sont avancées.
Resumo:
La complexité du traitement oncologique a amélioré les taux de survie des adolescents ayant le cancer mais a également augmenté leur souffrance. Le but de la présente étude était d'élaborer une échelle pour mesurer la souffrance chez cette population. À partir d’entrevues semi-structurées auprès de 19 adolescents et 16 experts, un pool d’items associés à la souffrance a été créé. Les items ont été présentés à un panel de neuf experts pour déterminer leur validité de contenu. Les analyses ont montré une validité de contenu élevée de l’échelle par l’indice de validité de contenu de 0,98 associé à un accord inter-juges de 0,88. La majorité des items étaient considérés faciles à comprendre et à y répondre. L’Échelle de Souffrance des Adolescents ayant le cancer (ESAC) est de type likert à quatre choix de réponses. Elle comprend 41 items portant sur la souffrance physique, psychologique, sociale, spirituelle, cognitive et globale.
Resumo:
Nurse Managers need today more than ever instruments that can be used to justify the billions of dollars that are invested in the healthcare sector annually. The objective of the study was to establish the validity and reliability of the Nursing Intensity Critical Care Questionnaire (NICCQ) in a cardiac surgery intensive care unit (CSICU) of a tertiary hospital. An expert panel evaluated the questionnaire’s content validity while generalizability theory was used to estimate the G and D coefficients. Decision studies enabled the investigators to determine if the current ward functioning of having one nurse rate one patient is adequate. Also, exploratory factorial analyses (EFA) preceded by principal component analyses (PCA) looked at establishing the factorial structure for the NICCQ. Finally, the NICCQ was correlated with a severity of illness score known as the Acute Physiology And Chronic Health Evaluation II (APACHE II) to estimate the correlation between patient illness and nursing intensity of care. The NICCQ was used by nurses using a sample of patients who had undergone cardiac surgery and were hospitalized on a CSICU of a tertiary teaching hospital. A convenience sample of nurses and patients on the CSICU was used to reflect the procedures and usual functioning of the unit. Each item on the questionnaire measured nursing intensity of care using a three point ordinal scale (Light, Moderate, and Severe) for the first 11 items, and a five point ordinal scale for the global assessment item (including the intermediate categories light/moderate and moderate/severe). The questionnaire proved to be both valid and able to be generalized to all nurses working in the CSICU. Overall results showed that 94.4% of the item generalizability coefficients indicated acceptable to excellent reliability, with most (86.1%) being larger than .90. The EFA established a simple 4 factor structure that explained little of the variance (32%). A correlation coefficient of 0.36 indicated that patient’ severity of illness is somewhat correlated with nursing intensity of care. The study showed that the NICCQ is a valid questionnaire with a generalizability coefficient that is large enough to be used by nurses’ managers for administrative purposes. Further research using larger samples would be needed to further test the factor structure of the NICCQ.
Resumo:
An interdisciplinary team of a pediatric university teaching hospital in the Montreal area, who treats annually a considerable number of child burn victims, developed a behavioral observation scale on the comfort of children of 7 years of age and less during painful procedures «Échelle d’observation comportementale du confort d’enfants brûlés» (OCCEB- BECCO). The goal of this study was to initiate the validation of OCCEB-BECCO, a new tool for evaluation of comfort for child burn victims. With samples of 16 patients and 5 experts, we proceeded to the evaluation of content validity, internal consistency and criterion validity. Results have shown adequate content validity, internal consistency with (T1) r = 0,96 p < 0,0001, (T2) r = 0,95 p < 0,0001, (T3) r = 0,95 p < 0,0001 and criterion validity with Cronbach alpha at 0,82. A future study with a larger sample and on a longer period of time would be required to pursue validation of this new scale.
Resumo:
Introducción: el fotoenvejecimiento cutáneo es causado principalmente por la exposición crónica y acumulativa a los rayos ultravioleta. Las clasificaciones y escalas existentes evalúan el envejecimiento cutáneo de forma global y no existe un instrumento que valore exclusivamente el fotoenvejecimiento cutáneo. Objetivo: Construir y realizar la validación de contenido, de una escala para valoración clínica del fotoenvejecimiento cutáneo en la cara. Materiales y métodos: Estudio de validez de contenido, de una escala para valoración clínica del fotoenvejecimiento cutáneo en cara, construida a partir del marco conceptual, y evaluada por 15 expertos con especialidades médicas que manejan el fotoenvejecimiento. Los datos obtenidos se analizaron así: porcentaje de la pertinencia; la media; coeficiente de variación (CV) e índice de validez de contenido por ítem (CVIi) de cada ítem incluido en la escala. Resultados: Para el grupo de 15 expertos evaluadores, la pertinencia de los 6 ítems incluidos en los criterios clínicos, arrojo una media de 4,2/5 con CVIi entre 73,3% y 100% y con CV por debajo del 20%; el ítem de surcos tuvo un CV de 26,93%; la pertinencia de los 5 ítems incluidos en los antecedentes, arrojo una media de 3,9/5, un CVIi entre 73,3% y 80% y un CV entre 33,67% y 39,84%. Discusión y conclusiones: La validez de contenido de los criterios clínicos de la escala cumplió en un nivel alto con la pertinencia, lo que indica que miden adecuada y exclusivamente las dimensiones del grado clínico de fotoenvejecimiento cutáneo en cara evaluado por los expertos.
Resumo:
Introducción: la osteogénesis es una patología de origen genético caracterizada por fragilidad ósea, en su curso natural los pacientes que la padecen se enfrentan a múltiples fracturas y múltiples intervenciones quirúrgicas, este tipo de pacientes por ser de alto riesgo necesitan técnicas quirúrgicas que aumenten el tiempo entre cada intervención y que demuestren un mayor impacto en el estado funcional. Objetivo: Determinar el impacto en el estado funcional de los pacientes con osteogénesis imperfecta llevados a tratamiento quirúrgico con clavos telescopados tipo Fassier Duval. Diseño: Estudio descriptivo prospectivo en el que se incluyeron 8 pacientes con diagnóstico de osteogénesis imperfecta, llevados a tratamiento quirúrgico con clavos telescopados tipo Fassier Duval desde el 2009 al 2013 a los cuales se les realizó seguimiento menor de 1 año del post operatorio. Resultados: La respuesta encontrada fue satisfactoria en la mayoría de los pacientes analizados 6 de 8, con cercanía a un estado funcional normal; un riesgo de caída bajo, incorporación y deambulación adecuada y una valoración funcional motora gruesa con valores cercanos al 100% identificando un buen nivel de independencia funcional. Se pudo demostrar que existieron cambios en los valores de la escala y que estos fueron estadísticamente significativos con p=0,028 indicando que el aumento dichos valores en el posoperatorio están relacionados con el procedimiento quirúrgico al utilizado en este grupo de pacientes. Conclusión: El tratamiento quirúrgico con el clavo telescopado de Fassier Duval en nuestra experiencia demostró tener una mejoría en el estado funcional de los pacientes del presente estudio, por lo tanto se sugiere la posibilidad de implementar su uso según este indicado con el fin de obtener un mejor resultado quirúrgico y funcional. Palabras clave: Osteogénesis Imperfecta, Clavo de Fassier Duval, Valoración Funcional Motora
Resumo:
Introducción: La Parálisis Cerebral (PC) es la enfermedad neurológica más incapacitante en niños, su historia natural tiende al deterioro motor y funcional. Con este estudio se busca establecer sí las cirugías múltiples de miembros inferiores, en un tiempo quirúrgico, mantienen el nivel motor y funcional. Material y Método: Estudio analítico de cohortes. Se compara un grupo de pacientes sometidos a cirugías múltiples contra un grupo de pacientes no operados, en el Instituto de Ortopedia Infantil Roosevelt. Se evaluaron los pacientes con dos Laboratorios para el Análisis del Movimiento (LAM) y se midieron los desenlaces mediante el cambio en la puntuación del perfil de marcha (GPS) y el nivel funcional motor grueso (GMFCS). Resultados: 109 pacientes cumplieron con los criterios de selección, 67 pacientes fueron sometidos a cirugía y 42 pacientes no. Los pacientes operados mejoraron el GPS promedio (diferencia -1,94; p=0,002) comparado con los pacientes no operados (diferencia 1,74; p=0,001), indicando una mejoría significativa de la cinemática de la marcha. En un modelo de regresión logística predictivo, el paciente que es operado tiene una probabilidad del 78% de mantener su patrón de marcha, mientras que sí no se opera su probabilidad disminuye al 37%. El nivel funcional motor GMFCS no mostró cambios significativos entre los grupos. Discusión: Las cirugías múltiples de miembros inferiores mantienen de manera significativa el patrón de marcha en pacientes con PC. Se destaca el seguimiento de los pacientes mediante el LAM y se sugiere el uso del GPS para valorar resultados en este tipo de pacientes.
Resumo:
Esta investigación descriptiva, tiene como objetivo presentar el diseño y análisis de la validez de contenido de un instrumento que evalúa el nivel en que se encuentran los elementos modeladores de la percepción de riesgo los cuales se han denominado determinantes. La estrategia metodológica contempló la identificación de estos determinantes, con base en una revisión de estudios y planteamientos realizados por expertos en diferentes campos relacionados con la gestión y percepción del riesgo. Una vez identificados se agruparon en cuatro dimensiones: determinantes vinculados a la persona, los vinculados al entorno, los relacionados con la comprensión del riesgo y los asociados a la organización, a partir de esto se diseñó un instrumento que responde a una serie de ítems sobre cada uno de los cuales se manifiesta el nivel de acuerdo o desacuerdo, utilizando una escala tipo Likert. Se espera que con la información resultado de la aplicación del instrumento se obtenga un perfil de la población analizada, a través de este se podrán definir las áreas foco a intervenir, buscando una percepción de riesgos más adecuada. Finalmente se desarrolló una validación de contenido por expertos, siguiendo el método de validación Delphi.
Resumo:
Objetivos. El Objetivo general de este estudio es determinar si el Instrumento para evaluar las Fallas Cognitivas Ocupacionales (Occupational Cognitive Failures Questionnaire - OCFQ) desarrollado por Allahyari T. et al. (2011) , tiene validez transcultural y podría ser un Instrumento fiable y válido que se puede adaptar al contexto cultural Colombiano para la valoración de las Fallas Cognitivas en el ámbito laboral. Metodología. Se llevó a cabo la traducción, adaptación y validación del Cuestionario de Fallas Cognitivas Ocupacionales (OCFQ) al contexto cultural colombiano, siguiendo las recomendaciones de la Organización Mundial de la Salud (OMS) para el proceso de traducción y adaptación de instrumentos y posteriormente la evaluación de fiabilidad y validez del instrumento adaptado, en cuatro etapas: Etapa 1. Traducción - retro traducción, Etapa 2. “Debriefing” y Análisis de legibilidad, Etapa 3. Validez de contenido, usando el Índice de Validez de Contenido (CVI) y Etapa 4. Evaluación de propiedades métricas. Para la evaluación de Validez de Constructo se aplicó el Análisis Factorial por el Método de Componentes Principales y Rotación Varimax; la consistencia interna y la estabilidad temporal fueron evaluados mediante el Alpha de Cronbach (α) y el test-retest, respectivamente. Resultados. El Cuestionario OCFQ fue adaptado al contexto cultural Colombiano; el análisis de Legibilidad determinó que de acuerdo con el Grado en la escala Inflesz, el Cuestionario es Bastante Fácil de leer. Partiendo de la versión original de 30 ítems se obtuvo una nueva versión de 25 ítems, ya que después de la evaluación de Validez de Contenido se rechazaron 5 ítems. El Índice de Validez de Contenido (CVI) para la versión final del OCFQ adaptado es aceptable (CVI=0,84). Los resultados de las pruebas métricas muestran que la versión final del OCFQ adaptado tiene una buena Consistencia Interna (α=0.90) y el Índice de Correlación Interclases (ICC) fue de 0.91 mostrando una muy buena Estabilidad Temporal. El Análisis Factorial estableció para el Cuestionario OCFQ 4 factores que explican el 47% de la varianza total. Conclusión. La evaluación de las Fallas Cognitivas en el ámbito laboral requiere que se disponga de una herramienta válida y fiable. De acuerdo con los resultados en este estudio se puede establecer que el OCFQ adaptado al Contexto Cultural Colombiano podría ser un instrumento adecuado para medir las Fallas Cognitivas en el ámbito laboral en plantas industriales.
Resumo:
The United Kingdom’s pharmacy regulator contemplated using continuing professional development (CPD) in pharmacy revalidation in 2009, simultaneously asking pharmacy professionals to demonstrate the value of their CPD by showing its relevance and impact. The idea of linking new CPD requirements with revalidation was yet to be explored. Our aim was to develop and validate a framework to guide pharmacy professionals to select CPD activities that are relevant to their work and to produce a score sheet that would make it possible to quantify the impact and relevance of CPD. METHODS: We adapted an existing risk matrix, producing a CPD framework consisting of relevance and impact matrices. Concepts underpinning the framework were refined through feedback from five pharmacist teacher-practitioners. We then asked seven pharmacists to rate the relevance of the framework’s individual elements on a 4-point scale to determine content validity. We explored views about the framework through focus groups with six and interviews with 17 participants who had used it formally in a study. RESULTS: The framework’s content validity index was 0.91. Feedback about the framework related to three themes of penetrability of the framework, usefulness to completion of CPD, and advancement of CPD records for the purpose of revalidation. DISCUSSION: The framework can help professionals better select CPD activities prospectively, and makes assessment of CPD more objective by allowing quantification, which could be helpful for revalidation. We believe the framework could potentially help other health professionals with better management of their CPD irrespective of their field of practice.
Resumo:
Background There is emerging evidence that the physical environment is important for health, quality of life and care, but there is a lack of valid instruments to assess health care environments. The Sheffield Care Environment Assessment Matrix (SCEAM), developed in the United Kingdom, provides a comprehensive assessment of the physical environment of residential care facilities for older people. This paper reports on the translation and adaptation of SCEAM for use in Swedish residential care facilities for older people, including information on its validity and reliability. Methods SCEAM was translated into Swedish and back-translated into English, and assessed for its relevance by experts using content validity index (CVI) together with qualitative data. After modification, the validity assessments were repeated and followed by test-retest and inter-rater reliability tests in six units within a Swedish residential care facility that varied in terms of their environmental characteristics. Results Translation and back translation identified linguistic and semantic related issues. The results of the first content validity analysis showed that more than one third of the items had item-CVI (I-CVI) values less than the critical value of 0.78. After modifying the instrument, the second content validation analysis resulted in I-CVI scores above 0.78, the suggested criteria for excellent content validity. Test-retest reliability showed high stability (96% and 95% for two independent raters respectively), and inter-rater reliability demonstrated high levels of agreement (95% and 94% on two separate rating occasions). Kappa values were very good for test-retest (κ= 0.903 and 0.869) and inter-rater reliability (κ= 0.851 and 0.832). Conclusions Adapting an instrument to a domestic context is a complex and time-consuming process, requiring an understanding of the culture where the instrument was developed and where it is to be used. A team, including the instrument’s developers, translators, and researchers is necessary to ensure a valid translation and adaption. This study showed preliminary validity and reliability evidence for the Swedish version (S-SCEAM) when used in a Swedish context. Further, we believe that the S-SCEAM has improved compared to the original instrument and suggest that it can be used as a foundation for future developments of the SCEAM model.
Resumo:
Background: The gap between what is known and what is practiced results in health service users not benefitting from advances in healthcare, and in unnecessary costs. A supportive context is considered a key element for successful implementation of evidence-based practices (EBP). There were no tools available for the systematic mapping of aspects of organizational context influencing the implementation of EBPs in low- and middle-income countries (LMICs). Thus, this project aimed to develop and psychometrically validate a tool for this purpose. Methods: The development of the Context Assessment for Community Health (COACH) tool was premised on the context dimension in the Promoting Action on Research Implementation in Health Services framework, and is a derivative product of the Alberta Context Tool. Its development was undertaken in Bangladesh, Vietnam, Uganda, South Africa and Nicaragua in six phases: (1) defining dimensions and draft tool development, (2) content validity amongst in-country expert panels, (3) content validity amongst international experts, (4) response process validity, (5) translation and (6) evaluation of psychometric properties amongst 690 health workers in the five countries. Results: The tool was validated for use amongst physicians, nurse/midwives and community health workers. The six phases of development resulted in a good fit between the theoretical dimensions of the COACH tool and its psychometric properties. The tool has 49 items measuring eight aspects of context: Resources, Community engagement, Commitment to work, Informal payment, Leadership, Work culture, Monitoring services for action and Sources of knowledge. Conclusions: Aspects of organizational context that were identified as influencing the implementation of EBPs in high-income settings were also found to be relevant in LMICs. However, there were additional aspects of context of relevance in LMICs specifically Resources, Community engagement, Commitment to work and Informal payment. Use of the COACH tool will allow for systematic description of the local healthcare context prior implementing healthcare interventions to allow for tailoring implementation strategies or as part of the evaluation of implementing healthcare interventions and thus allow for deeper insights into the process of implementing EBPs in LMICs.
Resumo:
Apesar do crescente interesse no conceito de engajamento da marca ainda existe discordância quanto aos seus conceitos fundamentais. Esta tese de doutorado explora a natureza da construção engajamento da marca do consumidor (EMC). No primeiro artigo, EMC é avaliada no âmbito da Teoria da Expectância para explicar e esclarecer como a antecipação de possíveis resultados de se envolver com uma marca, sendo tais resultados classificados como “primeiro nível” (resultante do esforço pessoal alocado para interagir com uma marca) e “segundo nível” (ou nível final, representando a consequência dos resultados de primeiro nível) e uma nova definição de EMC é formulada. Um arcabouço teórico abrangente é proposto para engajamento da marca, usando o Teoria Organizacional de Marketing para Expansão de Fronteiras (TOMEF) como referência para os pontos de contato entre o consumidor e a marca. A partir dos fundamentos teóricos das dimensões cognitivas, emocionais e comportamentais do EMC, quinze proposições teóricas são desenvolvidas para incorporar uma perspectiva multilateral às doutrinas teóricas do construto. No segundo artigo, quatro estudos são usados para desenvolver uma escala de engajamento da marca do consumidor. O Estudo 1 (n = 11) utiliza revisão da literatura e entrevistas em profundidade com os consumidores para gerar os itens da escala. No Estudo 2, oito especialistas avaliam 144 itens quanto a validade de face e validade de conteúdo. No Estudo 3 dados coletados com alunos de graduação (n = 172) é submetida à análise fatorial exploratória (AFE) e confirmatória (AFC) para redução adicional de itens. Trezentos e oitenta e nove respostas de um painel de consumidores são usados no Estudo 4 para avaliar o ajuste do modelo, usando a análise fatorial confirmatória (AFC) e Modelagem por Equações Estruturais (MEE). A escala proposta possui excelentes níveis de validade e confiabilidade. Finalmente, no terceiro papel, uma escala de engajamento do consumidor de Vivek et al. (2014) é replicada (n = 598) junto à consumidores em uma feira automotiva, para estender o debate sobre formas de medição do constructo usando a perspectiva da Teoria de Resposta ao Item (TRI). Embora o modelo desenvolvido com base na teoria clássica de teste (TCT) usando AFC, um modelo de resposta gradual (MRG) identifica cinco itens que têm baixos níveis de poder discriminante e com baixos níveis de informação. A abordagem usando TRI indica um possível caminho para melhorias metodológicas futuras para as escalas desenvolvidas na área de marketing em geral, e para a escala engajamento do consumidor, em particular.
Resumo:
People with venous ulcers constitute as an important public health problem, its treatment is onerous and require assistance provided by trained professionals, systematized through protocols, however what lies in the assistance is that the management of this group of people differs from that preconized in the scientific literature, interfering with wound healing and quality of life of affected. In this sense, the construction of a assistance protocol specific to people with venous ulcers (VU) can help professionals of the Family Health Strategy both in patient assessment as and in establishment of quality assistance. Thus, this study aimed to analyse the validity of a multiprofessional assistance protocol for people with venous ulcers in primary care by health professionals using Delphi technique. This is a quantitative study, the methodological type conducted in two steps: first step related to integrative literature review to subsidize the development of the protocol, then these aspects were organized and proposed to the judges of the study through the Delphi technique. The study was initiated after approval by the Research Ethics Committee. The first step was performed between August and September 2012, in the virtual library of health, in the page of the Coordination of Improvement of Higher Education Personnel, of Municipal Health Secretariat and international guidelines of associations and in the subsequent step carried out between September 2012 to January 2013, was performed search by Lattes platform of the National Council of Technological and Scientific Development, in order to identify health professionals in Brazil who act as judges of the instrument and then, via online, the form was submitted to them.The sample for the second step was 51 judges in the first round and 35 for the second round Delphi. The analysis was done by adopting Kappa index ≥ 0.81 and Content Validity Index (CVI)> 0.80. In the first submission for the judges, items that did not reach Kappa and CVI established were: request / realization / test results, demographic data, medical history, risk factors, verification of pain / vital signs / pulse / infection signs / lesion location/ edema and pain treatment. After removal of items which have not obtained Kappa or CVI index established, it was found achieving optimal levels of these index for the categories. In the next step was the ressubmissão of protocol to judges through the Delphi technique in it was found that, of the 15 categories of the protocol, 12 presented higher scores in Delphi 2 phase and the other three categories remained the same Kappa and IVC of the previous phase. As for the average of evaluation requirements of the protocol was found that the scores assigned by the judges were higher in the second phase in nine of the 10 items, remaining the same in only one of the items indicating validity of the instrument before the consensus of the judges. Thus, we accepted the alternative hypothesis in this study, as they were obtained in the second Delphi phase the validity index greater than or equal to the Delphi 1 phase. The formulation of this assistance protocol valid and reproducible will enable a reorganization and redesign of assistance, with standardization of actions and continuity of care for persons with venous ulcers in primary health care
Resumo:
Venous ulcers are lesions resulting from chronic venous insufficiency, venous valvular abnormalities and venous thrombosis. Its occurrence has been growing with the increase in life expectancy of the world population. Considered as fundamental aspects in the approach to the person with venous ulcer care with the interdisciplinary approach, adoption of protocol-specific knowledge, technical skill, coordination between levels of care complexity of the Health System and active participation of patients and their families, a holistic perspective. The construction of a clinical protocol for people with venous ulcers can help professionals of high complexity services in patient assessment and the establishment of quality care in a systematic way and focused on the factors that interfere with wound healing. Thus, this study aimed to analyze the evidence of validation of a clinical protocol for people with venous ulcers treated at high-complexity services. This is a methodological study with a quantitative approach, developed in three stages: literature review, evidence of content validity and evidence of validation in the clinical context. Approved by the Federal University of Rio Grande do Norte Research Ethics Committee (Opinion: 147.452 and CAAE: 07556312.0.0000.5537). The literature review was conducted in August and September 2012, becoming the basis for the construction of the protocol. Then the evidence of content validity, which included 53 judges (experts) selected by the Lattes platform to evaluate the protocol items was performed. The judges were contacted by e-mail and rated the protocol via Google Docs