749 resultados para construct validity
Resumo:
El objetivo principal de esta Tesis es construir un instrumento de evaluación psicológica válido para examinar las metas de vida de las adolescencias argentinas. Para arribar a su construcción se realizan distintos estudios: un primer Estudio Exploratorio, del que surge evidencia empírica acerca de diferencias en las posibles elecciones de metas según las distintas variables: género, región geográfica y contexto sociocultural de pertenencia. Del mismo estudio provienen las categorías de análisis que se emplean para la selección de ítems a incluir en la versión preliminar del instrumento. A lo largo de la investigación se realizan tres versiones del Inventario Metas Vitales [MV], luego de la aplicación de la prueba correspondiente a cada versión, se hacen los ajustes y se somete a valoración de jueces expertos [validez del constructo]. Finalmente se establece la ESCALA MV defintiva sometida a análisis estadístico confirmatorio. Dado el caudal de datos obtenidos en la muestra definitiva, se decide incluir un análisis complementario de los mismos en función de las variables diferenciales seleccionadas. Para llevar a cabo el objetivo enunciado, se trata de articular una investigación acerca de la población adolescente de nuestro país tomando como referentes a sujetos de entre 17 y 19 años, de ambos sexos, escolarizados en contextos educativos públicos y privados, de distintas provincias del norte, centro y sur de Argentina. Se parte de considerar dos dimensiones conceptuales: la primera refiere a una concepción de Adolescencia no tradicional y desde allí se pone énfasis en la segunda dimensión que comprende una tarea integradora para conocer y comprender las Metas que orientan las vidas de las adolescencias hoy
Resumo:
Teamwork, is one of the abilities that today is highly valued in the professional arena with a great importance for various personal and interpersonal skills associated with it. In this context, the Technical University of Madrid, is developing a coordinated educational innovation project, which main objective is to develop methodological and assessment tools for the acquisition of personal skills necessary to improve the employability of graduates and their skills for project management. Within this context, this paper proposes a methodology composed of various activities and indicators, as well as specific assessment instruments linked to the teamwork competence. Through a series of systematic steps it was allowed the design of an instrument and construction of a scale for measuring the competence of teamwork. The practical application of the methodology has been carried out in Projects lectures from different Schools of Engineering at the Technical University of Madrid, which results are presented in this document as a pilot experience. Results show the various aspects and methods that teachers should consider in evaluating the competence of the work, including analysis of the quality of results, through reliability and construct validity. On the other hand, show the advantages of applying this methodology in the field of project management teaching.
Resumo:
INTRODUCTION: Motion metrics have become an important source of information when addressing the assessment of surgical expertise. However, their direct relationship with the different surgical skills has not been fully explored. The purpose of this study is to investigate the relevance of motion-related metrics in the evaluation processes of basic psychomotor laparoscopic skills, as well as their correlation with the different abilities sought to measure. METHODS: A framework for task definition and metric analysis is proposed. An explorative survey was first conducted with a board of experts to identify metrics to assess basic psychomotor skills. Based on the output of that survey, three novel tasks for surgical assessment were designed. Face and construct validation study was performed, with focus on motion-related metrics. Tasks were performed by 42 participants (16 novices, 22 residents and 4 experts). Movements of the laparoscopic instruments were registered with the TrEndo tracking system and analyzed. RESULTS: Time, path length and depth showed construct validity for all three tasks. Motion smoothness and idle time also showed validity for tasks involving bi-manual coordination and tasks requiring a more tactical approach respectively. Additionally, motion smoothness and average speed showed a high internal consistency, proving them to be the most task-independent of all the metrics analyzed. CONCLUSION: Motion metrics are complementary and valid for assessing basic psychomotor skills, and their relevance depends on the skill being evaluated. A larger clinical implementation, combined with quality performance information, will give more insight on the relevance of the results shown in this study.
Resumo:
Introdução: As precauções-padrão (PP) constituem um conjunto de medidas que têm como finalidade minimizar o risco de transmissão ocupacional de patógenos, sendo indispensável sua utilização por profissionais de saúde, sobretudo pelos enfermeiros. No entanto, a não adesão às PP constitui problemática amplamente discutida em todo o mundo. Embora haja diversos estudos brasileiros que visem avaliar a adesão às PP , ainda tem-se observado grande fragilidade no processo de construção e de validação dos instrumentos utilizados para avaliação deste construto. Objetivo: Realizar a adaptação cultural e validação da Compliance with Standard Precautions Scale (CSPS) para enfermeiros brasileiros. Metodologia: Trata-se de um estudo metodológico para a adaptação e validação da CSPS. Essa escala é composta por 20 itens com quatro opções de respostas, e destina-se a avaliar a adesão às PP. O processo de adaptação consistiu em Tradução, Consenso entre Juízes, Retrotradução e Validação Semântica. A primeira etapa foi a tradução do idioma original para o português do Brasil. Após foi realizado um comitê composto por sete juízes, a versão de consenso obtida na etapa anterior foi traduzida novamente para o idioma de origem. Foram avaliadas as propriedades psicométricas do instrumento, considerando-se as validades de face e de conteúdo, a validade de construto e a confiabilidade. A versão para o Português do Brasil da CSPS (CSPS-PB) foi aplicada em uma amostra de 300 enfermeiros que atuam na assistência a pacientes em um hospital localizado na cidade de São Paulo/SP. A confiabilidade foi avaliada por meio da consistência interna (alfa de Cronbach) e teste reteste (coeficiente de correlação intraclasse - ICC). Para a validação de construto, foi utilizada a comparação entre grupos diferentes, análise fatorial exploratória e análise fatorial confirmatória, segundo o Modelo de Equações Estruturais (SEM). Utilizou-se o software IBM® SPSS, 19.0. Para a análise fatorial confirmatória foi utilizado o módulo específico Analysis of Moment Structures (IBM® SPSS AMOS). Para a análise paralela utilizou-se o programa RanEigen Syntax. O nível de significância adotado foi ? = 0,05. Todos os aspectos éticos foram contemplados. Resultados: A tradução realizada por tradutores juramentados garantiu qualidade a esse processo. A validação de face e de conteúdo possibilitou a realização de modificações pertinentes e imperativas a fim de atender aos critérios de equivalências conceituais, idiomáticas, culturais e semânticas. Obteve-se ?=0,61 na avaliação da consistência interna, indicando confiabilidade satisfatória. O ICC indicou uma correlação de 0,87 quase perfeita para o teste reteste duas semanas após a primeira abordagem, conferindo estabilidade satisfatória. A validade de construto mostrou que a CSPS-PB foi capaz de discriminar as médias de adesão às PP entre grupos distintos referente à idade (F=5,15 p<=0,01), ao tempo de experiência clínica (F = 8,9 p<= 0,000) e a ter recebido treinamento (t = 2,48 p<=0,01). Na análise fatorial confirmatória, o modelo foi subidentificado. A análise fatorial exploratória indicou que todos os itens apresentaram cargas fatoriais adequadas (>=0,30), sendo identificados quatro fatores pela análise paralela. O total de variância explicada foi de 35,48%. Conclusão: A CSPS-PB, trata-se de um instrumento adequado, confiável e válido para medir a adesão às PP entre enfermeiros brasileiros
Resumo:
Este estudo teve por objetivo validar o Protocolo de avaliação do frênulo da língua em bebês. Para isso, a partir do cálculo amostral, foi aplicado o protocolo em 100 bebês saudáveis, nascidos a termo, com 30 dias de vida, em amamentação exclusiva. O processo de validação consistiu da análise da validade de conteúdo, de critério e de construto, bem como da confiabilidade, sensibilidade, especificidade, valor preditivo positivo e negativo. A validade de conteúdo foi realizada por três examinadores, por meio da classificação de cada item quanto à clareza e posterior aplicação do Índice de Validação do Conteúdo. As avaliadoras sugeriram modificações no protocolo, por consenso, possibilitando obter a versão final. Para a validade de critério, comparou-se o Protocolo de avaliação do frênulo da língua em bebês com o instrumento Bristol Tongue Assessment Tool (BTAT). A validade de construto foi analisada a partir da comparação dos escores do protocolo aplicado nos bebês com 30 e 75 dias. As avaliações foram realizadas por duas fonoaudiólogas especialistas em Motricidade Orofacial (denominadas A1 e A2), devidamente treinadas e calibradas, por meio da análise das filmagens realizadas durante a aplicação do protocolo, para verificação da concordância entre examinadores, bem como definição dos valores de sensibilidade, especificidade e valores preditivos. Para a análise da concordância intra-avaliador foi realizado o teste/reteste de 20% da amostra pela A2. Quanto ao tratamento estatístico, para a análise de concordância intra e entre avaliadores, foram utilizados o Coeficiente de Correlação Intraclasse e o cálculo do erro do método. Para análise da validade de construto foram aplicados os testes de Wilcoxon e Mann-Whitney. O nível de significância adotado em todos os testes foi de 5%. Houve 100% de concordância na validação do conteúdo. A validade de critério apresentou correlações fortes dos itens correspondentes do Protocolo de avaliação do frênulo da língua em bebês e do instrumento BTAT, sendo o valor do coeficiente de correlação de Spearman igual a -0,997. Os resultados obtidos evidenciaram uma concordância muito boa intra e entre avaliadores, com valores baixos de erro casual e valores de p>0,05 (evidenciando que não há diferença entre a análise dos avaliadores) e Coeficiente de Correlação Intraclasse maior que 0,75; mostrando ainda, uma capacidade significativa do protocolo em mensurar as mudanças resultantes da frenotomia lingual, pela história clínica, avaliação anatomofuncional e avaliação da sucção não nutritiva e nutritiva (p<0,05). Quando comparados os resultados dos bebês com alteração do frênulo lingual (grupo experimental) e sem alteração (grupo controle), com 30 e 75 dias, houve diferença nos escores parciais e no escore total do exame clínico e do protocolo completo. Os índices de sensibilidade, especificidade e valores preditivos positivo e negativo foram 100%. A ocorrência das alterações do frênulo lingual nesse estudo foi de 21%. Concluiu-se, com este estudo, que o Protocolo de avaliação do frênulo da língua em bebês mostrou ser um instrumento válido e confiável de avaliação, assegurando acurácia em diagnosticar as alterações do frênulo lingual dentro dos parâmetros investigados, podendo ser aplicado por diferentes avaliadores, desde que os mesmos sejam capacitados e treinados para sua aplicação.
Resumo:
Although it may sound reasonable that American education continues to be more effective at sending high school students to college, in a study conducted in 2009, The Council of the Great City Schools states that "slightly more than half of entering ninth grade students arrive performing below grade level in reading and math, while one in five entering ninth grade students is more than two years behind grade level...[and] 25% received support in the form of remedial literacy instruction or interventions" (Council of the Great City Schools, 2009). Students are distracted with technology (Lei & Zhao, 2005), family (Xu & Corno, 2003), medical illnesses (Nielson, 2009), learning disabilities and perhaps the most detrimental to academic success, the very lack of interest in school (Ruch, 1963). In a Johns Hopkins research study, Building a Graduation Nation - Colorado (Balfanz, 2008), warning signs were apparent years before the student dropped out of high school. The ninth grade was often referenced as a critical point that indicated success or failure to graduate high school. The research conducted by Johns Hopkins illustrates the problem: students who become disengaged from school have a much greater chance of dropping out of high school and not graduating. The first purpose of this study was to compare different measurement models of the Student School Engagement (SSE) using Factor Analysis to verify model fit with student engagement. The second purpose was to determine the extent to which the SSE instrument measures student school engagement by investigating convergent validity (via the SSE and Appleton, Christenson, Kim and Reschly's instrument and Fredricks, Blumenfeld, Friedel and Paris's instrument), discriminant validity (via Huebner's Student Life Satisfaction Survey) and criterion-related validity (via the sub-latent variables of Aspirations, Belonging and Productivity and student outcome measures such as achievement, attendance and discipline). Discriminant validity was established between the SSE and the Appleton, Christenson, Kim and Reschly's model and Fredricks, Blumenfeld, Friedel and Paris's (2005) Student Engagement Instruments (SEI). When confirming discriminant validity, the SSE's correlations were weak and statistically not significant, thus establishing discriminant validity with the SLSS. Criterion-related validity was established through structural equation modeling when the SSE was found to be a significant predictor of student outcome measures when both risk score and CSAP scores were used. The third purpose of this study was to assess the factorial invariance of the SSE instrument across gender to ensure the instrument is measuring the intended construct across different groups. Conclusively, configural, weak and metric invariances were established for the SSE as a non-significant change in chi-square indicating that all parameters including the error variances were invariant across groups of gender. Engagement is not a clearly defined psychological construct; it requires more research in order to fully comprehend its complexity. Hopefully, with parental and teacher involvement and a sense of community, student engagement can be nurtured to result in a meaningful attachment to school and academic success.
Resumo:
The purposes of this study were (1) to validate of the item-attribute matrix using two levels of attributes (Level 1 attributes and Level 2 sub-attributes), and (2) through retrofitting the diagnostic models to the mathematics test of the Trends in International Mathematics and Science Study (TIMSS), to evaluate the construct validity of TIMSS mathematics assessment by comparing the results of two assessment booklets. Item data were extracted from Booklets 2 and 3 for the 8th grade in TIMSS 2007, which included a total of 49 mathematics items and every student's response to every item. The study developed three categories of attributes at two levels: content, cognitive process (TIMSS or new), and comprehensive cognitive process (or IT) based on the TIMSS assessment framework, cognitive procedures, and item type. At level one, there were 4 content attributes (number, algebra, geometry, and data and chance), 3 TIMSS process attributes (knowing, applying, and reasoning), and 4 new process attributes (identifying, computing, judging, and reasoning). At level two, the level 1 attributes were further divided into 32 sub-attributes. There was only one level of IT attributes (multiple steps/responses, complexity, and constructed-response). Twelve Q-matrices (4 originally specified, 4 random, and 4 revised) were investigated with eleven Q-matrix models (QM1 ~ QM11) using multiple regression and the least squares distance method (LSDM). Comprehensive analyses indicated that the proposed Q-matrices explained most of the variance in item difficulty (i.e., 64% to 81%). The cognitive process attributes contributed to the item difficulties more than the content attributes, and the IT attributes contributed much more than both the content and process attributes. The new retrofitted process attributes explained the items better than the TIMSS process attributes. Results generated from the level 1 attributes and the level 2 attributes were consistent. Most attributes could be used to recover students' performance, but some attributes' probabilities showed unreasonable patterns. The analysis approaches could not demonstrate if the same construct validity was supported across booklets. The proposed attributes and Q-matrices explained the items of Booklet 2 better than the items of Booklet 3. The specified Q-matrices explained the items better than the random Q-matrices.
Resumo:
More than half of morbidity and mortality in the United States can be attributed to behavior-related disease, such as tobacco use, physical inactivity, poor diet and alcohol consumption. Given the increased prevalence of behaviorally related medical health concerns, physician competence in the implementation of effective behavior change strategies is quickly becoming an essential skill. However, only recently have primary care residency programs begun to systematically teach and evaluate motivational interviewing skills critical to influencing health behavior, and use of standardized, objective assessment tools to assess skillfulness has been largely absent. This paper reports the development of a checklist, the Health Behavior Change Competency Checklist (HBCCC). The instrument captures the theoretical model of behavior change, motivational interviewing, in a practical and versatile manner. Psychometric evaluation demonstrated moderate efficacy. Namely, results indicated the HBCCC possesses good reliability, as evidenced by high internal consistency, and adequate construct validity. It also displayed considerable utility and practical application. While these results provide several reasons for confidence in the HBCCC, item revision and additional testing are required in order to establish it as a meaningful and valuable instrument.
Resumo:
Brain injury is the leading cause of disability and death in children in the United States. Student re-entry into the school setting following a traumatic brain injury is crucial to student success. Multidisciplinary teams within the school district comprised of individuals with expertise in brain injury are ideal in implementing student specific treatment plans given their specialized training and wide range of expertise addressing student needs. Therefore, the purpose of this study is to develop and initially validate a quantitative instrument that school personnel can use to determine if a student, identified as having a traumatic brain injury, will benefit from district-level consultation from a brain injury team. Three studies were designed to investigate the research questions. In study one, the planning and construction of the DORI-TBI was completed. Study two addressed the content validity of the DORI-TBI through a comparison analysis with other referral forms, content review with experts in the field of TBI, and cognitive interviews with professionals to test the usability of the new screening tool. In study three, a field administration was conducted using vignettes to measure construct validity. Results produced a valid and reliable new screening instrument that can aid school-based teams to more efficiently utilize district level consultation with a brain injury support team.
Resumo:
Suspension and expulsion are utilized frequently and disproportionality in schools in the United States. Many schools utilize Positive Behavioral Interventions and Supports (PBIS), a tiered framework to prevent problem behavior and reduce the use of discipline practices (Sugai et al., 2000). Check-In, Check-Out (CICO) is a targeted group behavioral intervention that is utilized within this framework in schools to prevent severe problem behavior in students that are beginning to exhibit externalizing and/or internalizing behavioral needs; thus, preventing the use of exclusionary discipline practices (Crone et al., 2010; Hawken & Horner, 2003). As the use of CICO in schools continues to grow, so too does the need for an instrument measuring its fidelity of implementation. The purpose of this study was to investigate the reliability and validity of the Check-In, Check-Out Fidelity of Implementation Measure (Crone et al., 2010), an instrument created to measure the fidelity of implementation of CICO intervention. This study assessed the psychometric properties of the instrument utilizing an archival data set collected by the statewide PBIS initiative in a western state in the U.S. The results demonstrated promising content validity, construct validity, internal consistency, and interrater reliability. A unidimensional structure was determined to be the best structure for the instrument based on parsimony and the strong results obtained from the item loadings, internal consistency, and interrater reliability. Implications for use and future research are discussed.
Resumo:
Se emplea el diseño de las matrices multirrasgo-multimétodo (MTMM) en la evaluación de la satisfacción del paciente. La muestra, extraída al azar simple, fue de 254 pacientes ingresados en tres hospitales del Servei Valencià de Salut de la provincia de Alicante, mayores de 16 años, conscientes y orientados. Los instrumentos de medida fueron tres escalas de satisfacción, dos de carácter general y una específica con los cuidados de enfermería, todas autoinformes. Los rasgos evaluados fueron varias dimensiones de satisfacción, y los métodos tres tipos de formulación de items y escalas de respuesta. Se ha empleado el análisis factorial confirmatorio, siguiéndose la estrategia de constrastar varios modelos alternativos (Widaman, 1985; Marsh, 1989). Los resulta dos indican que: la varianza de método es elevada, superior a la de rasgos; existe validez convergente; los rasgos están altamente correlacionados, pero hay evidencia de validez discriminante; dos métodos están altamente correlacionados; y no se ha podido estimar el modelo general de matrices MTMM.
Resumo:
Background: The harmonization of European health systems brings with it a need for tools to allow the standardized collection of information about medical care. A common coding system and standards for the description of services are needed to allow local data to be incorporated into evidence-informed policy, and to permit equity and mobility to be assessed. The aim of this project has been to design such a classification and a related tool for the coding of services for Long Term Care (DESDE-LTC), based on the European Service Mapping Schedule (ESMS). Methods: The development of DESDE-LTC followed an iterative process using nominal groups in 6 European countries. 54 researchers and stakeholders in health and social services contributed to this process. In order to classify services, we use the minimal organization unit or “Basic Stable Input of Care” (BSIC), coded by its principal function or “Main Type of Care” (MTC). The evaluation of the tool included an analysis of feasibility, consistency, ontology, inter-rater reliability, Boolean Factor Analysis, and a preliminary impact analysis (screening, scoping and appraisal). Results: DESDE-LTC includes an alpha-numerical coding system, a glossary and an assessment instrument for mapping and counting LTC. It shows high feasibility, consistency, inter-rater reliability and face, content and construct validity. DESDE-LTC is ontologically consistent. It is regarded by experts as useful and relevant for evidence-informed decision making. Conclusion: DESDE-LTC contributes to establishing a common terminology, taxonomy and coding of LTC services in a European context, and a standard procedure for data collection and international comparison.
Resumo:
Background: The assessment of attitudes toward school with the objective of identifying adolescents who may be at risk of underachievement has become an important area of research in educational psychology, although few specific tools for their evaluation have been designed to date. One of the instruments available is the School Attitude Assessment Survey-Revised (SAAS-R). Method: The objective of the current research is to test the construct validity and to analyze the psychometric properties of the Spanish version of the SAAS-R. Data were collected from 1,398 students attending different high schools. Students completed the SAAS-R along with measures of the g factor, and academic achievement was obtained from school records. Results: Confirmatory factor analysis, multivariate analysis of variance and analysis of variance tests supported the validity evidence. Conclusions: The results indicate that the Spanish version of the SAAS-R is a useful measure that contributes to identification of underachieving students. Lastly, the results obtained and their implications for education are discussed.
Resumo:
Background: The Clinical Learning Environment, Supervision and Nurse Teacher scale is a reliable and valid instrument to evaluate the quality of the clinical learning process in international nursing education contexts. Objectives: This paper reports the development and psychometric testing of the Spanish version of the Clinical Learning Environment, Supervision and Nurse Teacher scale. Design: Cross-sectional validation study of the scale. Setting: 10 public and private hospitals in the Alicante area, and the Faculty of Health Sciences (University of Alicante, Spain). Participants: 370 student nurses on clinical placement (January 2011–March 2012). Methods: The Clinical Learning Environment, Supervision and Nurse Teacher scale was translated using the modified direct translation method. Statistical analyses were performed using PASW Statistics 18 and AMOS 18.0.0 software. A multivariate analysis was conducted in order to assess construct validity. Cronbach’s alpha coefficient was used to evaluate instrument reliability. Results: An exploratory factorial analysis identified the five dimensions from the original version, and explained 66.4% of the variance. Confirmatory factor analysis supported the factor structure of the Spanish version of the instrument. Cronbach’s alpha coefficient for the scale was .95, ranging from .80 to .97 for the subscales. Conclusion: This version of the Clinical Learning Environment, Supervision and Nurse Teacher scale instrument showed acceptable psychometric properties for use as an assessment scale in Spanish-speaking countries.
Resumo:
Fundamentos: El Physician Readiness to Manage Intimate Partner Violence Survey (PREMIS) es uno de los cuestionarios más completos en el contexto internacional para la valoración de la capacidad de respuesta frente a la violencia del compañero íntimo por los profesionales de Atención Primaria de Salud. El objetivo de este estudio fue determinar la fiabilidad, consistencia interna y validez de constructo de la versión española de este cuestionario. Métodos: Tras la traducción, retrotraducción y valoración de la validez de contenido del cuestionario, se distribuyeron en una muestra de 200 profesionales de medicina y enfermería de 15 centros de atención primaria de 4 Comunidades Autónomas en 2013 (Comunidad Valenciana, Castilla León, Murcia y Cantabria). Se calcularon los coeficientes alfa de Cronbach, los de correlación intraclase y rho de Spearman (test-retest). Resultados: la versión española del PREMIS incluyó 64 ítems. El coeficiente α de Cronbach fue superior a 0,7 o muy cercano a ese valor en la mayoría de los índices. Se obtuvo un coeficiente de correlación intraclase de 0,87 y un coeficiente de Spearman de 0,67 que muestran una fiabilidad alta. Todas las correlaciones observadas para la escala de opiniones, la única tratada como estructura factorial en el cuestionario PREMIS, fueron superiores a 0,30. Conclusiones: el PREMIS en español obtuvo una buena validez interna, alta fiabilidad y capacidad predictiva de las prácticas auto-referidas por médicos(as) y enfermeros(as) frente a casos de violencia del compañero íntimo en centros de atención primaria.