Tests examining skill outcomes in sport: A systematic review of measurement properties and feasibility

Background
A high level of participant skill is influential in determining the outcome of many sports. Thus, tests assessing skill outcomes in sport are commonly used by coaches and researchers to estimate an athlete’s ability level, to evaluate the effectiveness of interventions or for the purpose of talent identification.

Objective
The objective of this systematic review was to examine the methodological quality, measurement properties and feasibility characteristics of sporting skill outcome tests reported in the peer-reviewed literature.

Data Sources
A search of both SPORTDiscus and MEDLINE databases was undertaken.

Study Selection
Studies that examined tests of sporting skill outcomes were reviewed. Only studies that investigated measurement properties of the test (reliability or validity) were included. A total of 22 studies met the inclusion/exclusion criteria.

Study Appraisal and Synthesis Methods
A customised checklist of assessment criteria, based on previous research, was utilised for the purpose of this review.

Results
A range of sports were the subject of the 22 studies included in this review, with considerations relating to methodological quality being generally well addressed by authors. A range of methods and statistical procedures were used by researchers to determine the measurement properties of their skill outcome tests. The majority (95 %) of the reviewed studies investigated test–retest reliability, and where relevant, inter and intra-rater reliability was also determined. Content validity was examined in 68 % of the studies, with most tests investigating multiple skill domains relevant to the sport. Only 18 % of studies assessed all three reviewed forms of validity (content, construct and criterion), with just 14 % investigating the predictive validity of the test. Test responsiveness was reported in only 9 % of studies, whilst feasibility received varying levels of attention.

Limitations
In organised sport, further tests may exist which have not been investigated in this review. This could be due to such tests firstly not being published in the peer-review literature and secondly, not having their measurement properties (i.e., reliability or validity) examined formally.

Conclusions
Of the 22 studies included in this review, items relating to test methodological quality were, on the whole, well addressed. Test–retest reliability was determined in all but one of the reviewed studies, whilst most studies investigated at least two aspects of validity (i.e., content, construct or criterion-related validity). Few studies examined predictive validity or responsiveness. While feasibility was addressed in over half of the studies, practicality and test limitations were rarely addressed. Consideration of study quality, measurement properties and feasibility components assessed in this review can assist future researchers when developing or modifying tests of sporting skill outcomes.

Examining adverse events after intensive care unit discharge : outcomes from a pilot questionnaire

Adverse events are common in acute clinical settings but little is known about these events occurring after Intensive Care discharge. This study aimed to develop a reliable and valid tool for exploring clinicians’ opinions of factors associated with post-Intensive Care adverse events. A convenience sample of Australian Intensive Care Liaison Nurses was invited to complete and appraise a questionnaire using structured guidelines. Content validity and internal consistency were assessed.

Twelve Intensive Care Liaison Nurses completed the questionnaire. Cronbach?s alpha coefficient showed high internal consistency for the questionnaire; all 24 items on the questionnaire had coefficients greater than 0.852. The content validity index of the questionnaire overall was 0.76.

The post-Intensive Care adverse events questionnaire demonstrated reliability and validity. It is a tool that can be used to explore clinicians? opinions of factors associated with these events. The tool is important as it facilitates further insight into the causes of post-Intensive Care adverse events.

Development and evaluation of a screening tool to identify people with diabetes at increased risk of medication problems relating to hypoglycaemia and medication non-adherence

Abstract Aims: To develop and evaluate a screening tool to identify people with diabetes at increased risk of medication problems relating to hypoglycaemia and medication non-adherence. Methods: A retrospective audit of attendances at a diabetes outpatient clinic at a public, teaching hospital over a 16-month period was conducted. Logistic regression was undertaken to examine risk factors associated with medication problems relating to hypoglycaemia and medication non-adherence and the most predictive set of factors comprise the Diabetes Medication Risk Screening Tool. Evaluating the tool involved assessing sensitivity and specificity, positive and negative predictive values, cut-off scores, inter-rater reliability, and content validity. Results: The Diabetes Medication Risk Screening Tool comprises seven predictive factors: age, living alone, English language, mental and behavioural problems, comorbidity index score, number of medications prescribed, and number of high-risk medications prescribed. The tool has 76.5% sensitivity, 59.5% specificity, and has a 65.1% positive predictive value, and a 71.8% negative predictive value. A score of 27 or more out of 62 was associated with high-risk of a medication problem. The inter-rater reliability of the tool was high (κ = 0.79, 95% CI 0.75 - 0.84) and the content validity index was 99.4%. Conclusion: The Diabetes Medication Risk Screening Tool has good psychometric properties and can proactively identify people with diabetes at greatest risk of medication problems relating to hypoglycaemia and medication non-adherence.

A new computerized adaptive test advancing the measurement of health-related quality of life (HRQoL) in children: the Kids-CAT

Purpose: Assessing health-related quality of life (HRQoL) via Computerized Adaptive Tests (CAT) provides greater measurement precision coupled with a lower test burden compared to conventional tests. Currently, there are no European pediatric HRQoL CATs available. This manuscript aims at describing the development of a HRQoL CAT for children and adolescents: the Kids-CAT, which was developed based on the established KIDSCREEN-27 HRQoL domain structure. Methods: The Kids-CAT was developed combining classical test theory and item response theory methods and using large archival data of European KIDSCREEN norm studies (n = 10,577–19,580). Methods were applied in line with the US PROMIS project. Item bank development included the investigation of unidimensionality, local independence, exploration of Differential Item Functioning (DIF), evaluation of Item Response Curves (IRCs), estimation and norming of item parameters as well as first CAT simulations. Results: The Kids-CAT was successfully built covering five item banks (with 26–46 items each) to measure physical well-being, psychological well-being, parent relations, social support and peers, and school well-being. The Kids-CAT item banks proved excellent psychometric properties: high content validity, unidimensionality, local independence, low DIF, and model conform IRCs. In CAT simulations, seven items were needed to achieve a measurement precision between.8 and.9 (reliability). It has a child-friendly design, is easy accessible online and gives immediate feedback reports of scores. Conclusions: The Kids-CAT has the potential to advance pediatric HRQoL measurement by making it less burdensome and enhancing the patient–doctor communication.

Erratum to: A new computerized adaptive test advancing the measurement of health-related quality of life (HRQoL) in children: the Kids-CAT

Abstract
Purpose
Assessing health-related quality of life (HRQoL) via Computerized Adaptive Tests (CAT) provides greater measurement precision coupled with a lower test burden compared to conventional tests. Currently, there are no European pediatric HRQoL CATs available. This manuscript aims at describing the development of a HRQoL CAT for children and adolescents: the Kids-CAT, which was developed based on the established KIDSCREEN-27 HRQoL domain structure.
Methods
The Kids-CAT was developed combining classical test theory and item response theory methods and using large archival data of European KIDSCREEN norm studies (n=10,577–19,580). Methods were applied in line with the US PROMIS project. Item bank development included the investigation of unidimensionality, local independence, exploration of Differential Item Functioning (DIF), evaluation of Item Response Curves (IRCs), estimation and norming of item parameters as well as first CAT simulations.
Results
The Kids-CAT was successfully built covering five item banks (with 26–46 items each) to measure physical well-being, psychological well-being, parent relations, social support and peers, and school well-being. The Kids-CAT item banks proved excellent psychometric properties: high content validity, unidimensionality, local independence, low DIF, and model conform IRCs. In CAT simulations, seven items were needed to achieve a measurement precision between .8 and .9 (reliability). It has a child-friendly design, is easy accessible online and gives immediate feedback reports of scores.
Conclusions
The Kids-CAT has the potential to advance pediatric HRQoL measurement by making it less burdensome and enhancing the patient–doctor communication.

Characterizing problematic hypoglycaemia: iterative design and preliminary psychometric validation of the Hypoglycaemia Awareness Questionnaire (HypoA-Q)

AIMS: To design and conduct preliminary validation of a measure of hypoglycaemia awareness and problematic hypoglycaemia, the Hypoglycaemia Awareness Questionnaire.

METHODS: Exploratory and cognitive debriefing interviews were conducted with 17 adults (nine of whom were women) with Type 1 diabetes (mean ± sd age 48±10 years). Questionnaire items were modified in consultation with diabetologists/psychologists. Psychometric validation was undertaken using data from 120 adults (53 women) with Type 1 diabetes (mean ± sd age 44±16 years; 50% with clinically diagnosed impaired awareness of hypoglycaemia), who completed the following questionnaires: the Hypoglycaemia Awareness Questionnaire, the Gold score, the Clarke questionnaire and the Problem Areas in Diabetes questionnaire.

RESULTS: Iterative design resulted in 33 items eliciting answers on awareness of hypoglycaemia when awake/asleep and hypoglycaemia frequency, severity and impact (healthcare utilization). Psychometric analysis identified three subscales reflecting 'impaired awareness', 'symptom level' and 'symptom frequency'. Convergent validity was indicated by strong correlations between the impaired awareness subscale and existing measures of awareness: (Gold: rs =0.75, P<0.01; Clarke: rs =0.76, P<0.01). Divergent validity was indicated by weaker correlations with diabetes-related distress (Problem Areas in Diabetes: rs =0.25, P<0.01) and HbA1c (rs =-0.05, non-significant). The impaired awareness subscale and other items discriminated between those with impaired and intact awareness (Gold score). The impaired awareness subscale and other items contributed significantly to models explaining the occurrence of severe hypoglycaemia and hypoglycaemia when asleep.

CONCLUSIONS: This preliminary validation shows the Hypoglycaemia Awareness Questionnaire has robust face and content validity; satisfactory structure; internal reliability; convergent, divergent and known groups validity. The impaired awareness subscale and other items contribute significantly to models explaining recall of severe and nocturnal hypoglycaemia. Prospective validation, including determination of a threshold to identify impaired awareness, is now warranted.

Fundamental movement skills are more than run, throw and catch: the role of stability skills

INTRODUCTION: In motor development literature fundamental movement skills are divided into three constructs: locomotive, object control and stability skills. Most fundamental movement skills research has focused on children's competency in locomotor and object control skills. The first aim of this study was to validate a test battery to assess the construct of stability skills, in children aged 6 to 10 (M age = 8.2, SD = 1.2). Secondly we assessed how the stability skills construct fitted into a model of fundamental movement skill. METHOD: The Delphi method was used to select the stability skill battery. Confirmatory factor analysis (CFA) was used to assess if the skills loaded onto the same construct and a new model of FMS was developed using structural equation modelling. RESULTS: Three postural control tasks were selected (the log roll, rock and back support) because they had good face and content validity. These skills also demonstrated good predictive validity with gymnasts scoring significantly better than children without gymnastic training and children from a high SES school performing better than those from a mid and low SES schools and the mid SES children scored better than the low SES children (all p < .05). Inter rater reliability tests were excellent for all three skills (ICC = 0.81, 0.87, 0.87) as was test re-test reliability (ICC 0.87-0.95). CFA provided good construct validity, and structural equation modelling revealed stability skills to be an independent factor in an overall FMS model which included locomotor (r = .88), object control (r = .76) and stability skills (r = .81). DISCUSSION: This study provides a rationale for the inclusion of stability skills in FMS assessment. The stability skills could be used alongside other FMS assessment tools to provide a holistic assessment of children's fundamental movement skills.

A compilation of consumers' stories: the development of a video to enhance medication adherence in newly transplanted kidney recipients

AIM: To describe the design, development and evaluation of a consumer-centred video, which was underpinned by the Theory of Planned Behaviour and it was created to educate newly transplanted kidney recipients about the importance of medication adherence. BACKGROUND: Kidney transplantation is a treatment whereby medication adherence is critical to ensure long-term kidney graft success. To date, many interventions aimed to improve medication adherence in kidney transplantation have been conducted but consumers remain largely uninvolved in the interventional design. DESIGN: Qualitative sequential design. METHODS: Twenty-two participants who had maintained their kidney transplant for at least 8 months and three participants who had experienced a kidney graft loss due to non-adherence were interviewed from March-May 2014 in Victoria, Australia. These interviews were independently reviewed by two researchers and were used to guide the design of the story plot and to identify storytellers for the video. The first draft of the video was evaluated by a panel of seven experts in the field, one independent educational expert and two consumers using Lynn's content validity questionnaire. The content of the video was regarded as highly relevant and comprehensive, which achieved a score of >3·7 out of a possible 4. RESULTS/FINDINGS: The final 18-minute video comprised 15 sections. Topics included medication management, the factors affecting medication adherence and the absolute necessity of adherence to immunosuppressive medications for graft survival. CONCLUSION: This paper has demonstrated the feasibility of creating a consumer-driven video that supports medication adherence in an engaging way.

Essays on consumer brand engagement

Apesar do crescente interesse no conceito de engajamento da marca ainda existe discordância quanto aos seus conceitos fundamentais. Esta tese de doutorado explora a natureza da construção engajamento da marca do consumidor (EMC). No primeiro artigo, EMC é avaliada no âmbito da Teoria da Expectância para explicar e esclarecer como a antecipação de possíveis resultados de se envolver com uma marca, sendo tais resultados classificados como “primeiro nível” (resultante do esforço pessoal alocado para interagir com uma marca) e “segundo nível” (ou nível final, representando a consequência dos resultados de primeiro nível) e uma nova definição de EMC é formulada. Um arcabouço teórico abrangente é proposto para engajamento da marca, usando o Teoria Organizacional de Marketing para Expansão de Fronteiras (TOMEF) como referência para os pontos de contato entre o consumidor e a marca. A partir dos fundamentos teóricos das dimensões cognitivas, emocionais e comportamentais do EMC, quinze proposições teóricas são desenvolvidas para incorporar uma perspectiva multilateral às doutrinas teóricas do construto. No segundo artigo, quatro estudos são usados para desenvolver uma escala de engajamento da marca do consumidor. O Estudo 1 (n = 11) utiliza revisão da literatura e entrevistas em profundidade com os consumidores para gerar os itens da escala. No Estudo 2, oito especialistas avaliam 144 itens quanto a validade de face e validade de conteúdo. No Estudo 3 dados coletados com alunos de graduação (n = 172) é submetida à análise fatorial exploratória (AFE) e confirmatória (AFC) para redução adicional de itens. Trezentos e oitenta e nove respostas de um painel de consumidores são usados no Estudo 4 para avaliar o ajuste do modelo, usando a análise fatorial confirmatória (AFC) e Modelagem por Equações Estruturais (MEE). A escala proposta possui excelentes níveis de validade e confiabilidade. Finalmente, no terceiro papel, uma escala de engajamento do consumidor de Vivek et al. (2014) é replicada (n = 598) junto à consumidores em uma feira automotiva, para estender o debate sobre formas de medição do constructo usando a perspectiva da Teoria de Resposta ao Item (TRI). Embora o modelo desenvolvido com base na teoria clássica de teste (TCT) usando AFC, um modelo de resposta gradual (MRG) identifica cinco itens que têm baixos níveis de poder discriminante e com baixos níveis de informação. A abordagem usando TRI indica um possível caminho para melhorias metodológicas futuras para as escalas desenvolvidas na área de marketing em geral, e para a escala engajamento do consumidor, em particular.

Validação de protocolo de assistência para pessoas com úlcera venosa na atenção primária

People with venous ulcers constitute as an important public health problem, its treatment is onerous and require assistance provided by trained professionals, systematized through protocols, however what lies in the assistance is that the management of this group of people differs from that preconized in the scientific literature, interfering with wound healing and quality of life of affected. In this sense, the construction of a assistance protocol specific to people with venous ulcers (VU) can help professionals of the Family Health Strategy both in patient assessment as and in establishment of quality assistance. Thus, this study aimed to analyse the validity of a multiprofessional assistance protocol for people with venous ulcers in primary care by health professionals using Delphi technique. This is a quantitative study, the methodological type conducted in two steps: first step related to integrative literature review to subsidize the development of the protocol, then these aspects were organized and proposed to the judges of the study through the Delphi technique. The study was initiated after approval by the Research Ethics Committee. The first step was performed between August and September 2012, in the virtual library of health, in the page of the Coordination of Improvement of Higher Education Personnel, of Municipal Health Secretariat and international guidelines of associations and in the subsequent step carried out between September 2012 to January 2013, was performed search by Lattes platform of the National Council of Technological and Scientific Development, in order to identify health professionals in Brazil who act as judges of the instrument and then, via online, the form was submitted to them.The sample for the second step was 51 judges in the first round and 35 for the second round Delphi. The analysis was done by adopting Kappa index ≥ 0.81 and Content Validity Index (CVI)> 0.80. In the first submission for the judges, items that did not reach Kappa and CVI established were: request / realization / test results, demographic data, medical history, risk factors, verification of pain / vital signs / pulse / infection signs / lesion location/ edema and pain treatment. After removal of items which have not obtained Kappa or CVI index established, it was found achieving optimal levels of these index for the categories. In the next step was the ressubmissão of protocol to judges through the Delphi technique in it was found that, of the 15 categories of the protocol, 12 presented higher scores in Delphi 2 phase and the other three categories remained the same Kappa and IVC of the previous phase. As for the average of evaluation requirements of the protocol was found that the scores assigned by the judges were higher in the second phase in nine of the 10 items, remaining the same in only one of the items indicating validity of the instrument before the consensus of the judges. Thus, we accepted the alternative hypothesis in this study, as they were obtained in the second Delphi phase the validity index greater than or equal to the Delphi 1 phase. The formulation of this assistance protocol valid and reproducible will enable a reorganization and redesign of assistance, with standardization of actions and continuity of care for persons with venous ulcers in primary health care

Evidências de validação de um protocolo para assistência às pessoas com úlceras venosas em serviços de alta complexidade

Venous ulcers are lesions resulting from chronic venous insufficiency, venous valvular abnormalities and venous thrombosis. Its occurrence has been growing with the increase in life expectancy of the world population. Considered as fundamental aspects in the approach to the person with venous ulcer care with the interdisciplinary approach, adoption of protocol-specific knowledge, technical skill, coordination between levels of care complexity of the Health System and active participation of patients and their families, a holistic perspective. The construction of a clinical protocol for people with venous ulcers can help professionals of high complexity services in patient assessment and the establishment of quality care in a systematic way and focused on the factors that interfere with wound healing. Thus, this study aimed to analyze the evidence of validation of a clinical protocol for people with venous ulcers treated at high-complexity services. This is a methodological study with a quantitative approach, developed in three stages: literature review, evidence of content validity and evidence of validation in the clinical context. Approved by the Federal University of Rio Grande do Norte Research Ethics Committee (Opinion: 147.452 and CAAE: 07556312.0.0000.5537). The literature review was conducted in August and September 2012, becoming the basis for the construction of the protocol. Then the evidence of content validity, which included 53 judges (experts) selected by the Lattes platform to evaluate the protocol items was performed. The judges were contacted by e-mail and rated the protocol via Google Docs . After analyzing the ratios obtained in this step, which reported kappa between 0.75 and 0.96 and between 0.80 and 0.98 IVC, and the suggestions of the judges, the protocol was adjusted and subjected to empirical evidence to validate the clinical setting at the University Hospital Onofre Lopes in Natal / RN. Evidence of validation in the clinical setting involved 4 judges who acted in pairs (paired) evaluated 32 patients with venous ulcers in the clinical context of high complexity. In both stages, we used the Kappa Index and Content Validity Index to analyze the responses of the judges. The parameters set as acceptable for these indices were: Kappa ≥ 0.61 and Content Validity Index > 0.80. Any evidence of content validity, as evidence of validation in the clinical context, the protocol items that have not reached Kappa and Content Validity Index established indices were excluded and some items were modified or added after suggestions. The process of content validation evidence and evidence of validation in the clinical setting allowed the improvement of the protocol for the care of people with venous ulcers initially proposed. The initial version of the protocol, built from the literature, contained 15 categories and 108 items; after evidence of content validity, remained the reduction to 15 categories with 91 items; the final version, clinically validated, is composed of the same 15 categories, 76 items. The protocol was validated in its content and in the clinical aspect, so we accepted the alternative hypothesis in the study. This protocol may contribute to the care system, allowing tailor behaviors and promote greater resolution in the treatment of people with venous ulcers in health services of high complexity

Validação de instrumentos para avaliação da habilidade e do conhecimento acerca da medida da pressão arterial

This study aimed to validate tools for evaluating the ability and knowledge about blood pressure (BP) among nursing students. It is a cross-sectional, descriptive, quantitative and methodological study accomplished at the Universidade Federal do Rio Grande do Norte (UFRN), Universidade do Estado do Rio Grande do Norte (UERN) and a private university of the state. The sample consisted of 27 judges of research selected from the inclusion criteria: nursing, teachers of the semiology and/or semiotics discipline, with at least 1 year of experience, being from UFRN, EEN, UERN and private university of the state and and agree to participate voluntarily with the signing of the consent form. The research was development in three stages: construction of two instruments based on the scientific literature, resulting in a structured checklist consists of 28 items and a knowledge questionnaire with 12 questions; submission of the instruments to the judges, in the period from June to September 2012, which should evaluate each item in appropriate , appropriate with changes and inappropriate , addition to making an overall assessment of each instrument based on 10 requirements; validation and verification to the level of agreement among the judges, through the application of Kappa and Content Validity Index (CVI). Was used the consensus level greater than 0.61 (good) to the Kappa index and greater than 0.75 for CVI. Was approved by the Ethics in Research / HUOL. After being coded and tabulated, the data were analyzed using descriptive statistics. Of the 27 judges who evaluated the instrument, 77.8% are female, with a mean age of 36.6 (± 9.0) years, 63.0% worked in UFRN, 74.1% had academic master and 63.0% worked exclusively on teaching. Average length of teaching experience was 7.9 (± 8.0) years and in the semiology and/or semiotics discipline of 5.5 (± 6.7) years. In the judgment of structured checklist and questionnaire of knowledge about blood pressure mensurement any item/question was considered inappropriate since all obtained level of agreement within the indices established (CVI> 0,75 E Kappa> 0.61). In relation to structured checklist, of those 28 items present, 9 showed perfect concordance index (CVI = 1.00, Kappa = 1.00) and another 19 were considered appropriate with changes, especially with regard to clarity and vocabulary. In the questionnaire of knowledge, among the 12 questions that comprised, 7 had perfect concordance index and the others were considered appropriate with changes as requirements as clarity, vocabulary, and feasible sequence of instructional topics. In terms of a overall evaluating of instruments, the structured checklist got CVI of 0.94 and Kappa of 0.89 and the knowledge questionnaire, CVI of 0.97 and a kappa of 0.94. Both instruments proved to be valid as to their content, configuring it as clear and objective tools of assessment of knowledge and ability on blood pressure, being of nursing students as well as others students and health professionals, since the use of valid measures seeking to reduce the risk of distorting the results

Validação de instrumentos para avaliação do conhecimento e da habilidade acerca da sondagem vesical de demora

That study had the aim to validate an instrument to evaluate the knowledge about the Urinary Catheterization (UC) in males. Cross-sectional, descriptive, quantitative and methodological study, accomplished in Universidade Federal do Rio Grande do Norte (UFRN), Universidade do Estado do Rio Grande do Norte (UERN) and a private university from Rio Grande do Norte. Sample of 27 judges selected from the inclusion criteria: registered nurses, discipline of semiology and/or semiotics teachers, with at least 1 year of experience in the disciplines, to work at UFRN, UERN or in private university and agree to participate voluntarily with the signing of the Consent Form. Study developed in three stages: a) elaboration of twos instruments based on the scientific literature, resulting in a structured observation script type checklist consisting of 36 items and a knowledge questionnaire with 12 questions; b) submission of instruments to judges from June to September 2012, which should evaluate each item in "adequate," "adequate with changes" and "inappropriate", and make an overall evaluation of each instrument based on 10 requirements; c) and validation with a verification of the agreement level among the judges, through the application of Kappa Index (K) and Content Validity Index (CVI). It was used the consensus level higher than 0.60 (good) for Kappa Index and higher than 0.70 for CVI. The research project had favorable opinion from the Ethics in Research/HUOL (CAAE n. 0002.0.294.000-10). After being coded and tabulated, the data were analyzed using descriptive statistics. Of the 27 judges who evaluated the instrument, 77.8% are female, with a mean age of 36.6 (± 9.0) years, 63.0% worked in UFRN, 74.1% had master degree and 63.0% worked exclusively on teaching. The experience time mean in teaching was 7.9 (± 8.0) years and in the disciplines of semiology and/or semiotics in nursing was 5.5 (± 6.7) years. In judgment of the checklist and knowledge questionnaire, no step/question was considered inappropriate, since all achieved level of agreement within the established values. All the checklist steps obtained good to excellent K (between 0.60 and 1.00). Of the 36 items, 25 had excellent K (0.75 ≤ K <1.00) and excellent total K (K = 0.83). Regarding the IVC, all steps reached levels above 0.70 (between 0.74 and 1.00) and CVI total was 0.90. All questionnaire questions evaluated separately (K from 0.60 to 0.93 and CVI from 0.74 to 0.96) and generally (K from 0.79 to 1.00 and CVI from 0.89 to 1.00) had evaluation levels of content validity within the established values. The instruments were reformulated based on the agreement levels between judges and international guidelines, dissertations and scientific articles. Both instruments proved to be valid regarding to their content, allowing a clear and objective evaluation of knowledge and skills about UC, both nursing students as well as other students and health professionals, since the use of valid measures seeking the reduction of the risk of the results distorted

Protocolo de avaliação do cuidado de enfermagem e da segurança do paciente em unidades de terapia intensiva

The reports of adverse events date from 1990 up to the present day. Conceptually, these adverse events are unintentional injuries unrelated to the underlying disease, causing measurable lesions in patients, extending the period of hospitalization, or leading to death. These issues require discussions with regard to patient safety, improved quality of service, and preventing medical errors. In the Intensive Care Units, this concern is greater because these are sectors of intensive care to individuals with hemodynamic changes and imminent risk of death. Therefore, it is essential to conduct evaluation processes to investigate aspects of quality of nursing care and patient safety in these spaces. For that reason, we aimed to propose the Evaluation protocol of nursing care and patient safety in Intensive Care Units. For its achievement, we needed to: 1) analyze the evolution of the patient safety concept used in scientific productions, under Rodgers evolutionary concept; 2) identify the necessary items to build the evaluation protocol of nursing care and patient safety in the Intensive Care Unit, from the available evidence in literature; 3) construct an instrument for content validation of the evaluation protocol of nursing care and patient safety in the Intensive Care Unit; and 4) describe and evaluate the appropriateness of the content for an evaluation protocol of nursing care and patient safety in the Intensive Care Unit. This is a methodological study for the content validation of the abovementioned protocol. To meet the first three specific objectives, we used the integrative literature review in Theses Database of the Coordination for the Improvement of Higher Education Personnel and the portal of the Collaborating Centre for Quality of Care and Patient Safety. The fourth specific objective happened through the participation of judges, located from the Lattes curricula, in the content validation process developed in two stages: Delphi 1 and Delphi 2. As instrument, we used the electronic form of Google docs. We present in tables the answers from the evaluation instruments by Delphi consensus and Content Validity Index (CVI) of the entire protocol. We summarized the results in articles entitled Analysis of the patient safety concept: Rodgers evolutionary concept ; Scientific evidence regarding patient safety in the Intensive Care Unit ; Technological device for the content validation process: experience report ; and Evaluation protocol of nursing care and patient safety in Intensive Care Units. The Embodied Opinion of the Research Ethics Committee of the Universidade Federal do Rio Grande do Norte, No. 461,246, under CAAE 19586813.2.0000.5537, approved the study. Thus, we conclude the protocol valid in its content, constituting an important tool for evaluating the quality of nursing care and patient safety in Intensive Care Units

A new short and simple health-related quality of life measurement for paediatric rheumatic diseases: initial validation in juvenile idiopathic arthritis

Objective. To develop and validate a new short and simple measure of health-related quality of life (HRQL) in children with juvenile idiopathic arthritis (JIA).Methods. The Paediatric Rheumatology Quality of Life Scale (PRQL) is a 10-item questionnaire that explores HRQL in two domains: physical health (PhH) and psychosocial health (PsH). Validation of the parent proxy report and child self-report versions of the instrument was accomplished by evaluating 472 JIA patients and similar to 800 healthy children. Validation analyses included assessment of feasibility, face and content validity; construct and discriminative ability; internal structure and consistency; test-retest reliability; responsiveness to clinical change; and minimal clinically important difference.Results. The PRQL was found to be feasible and to possess both face and content validity. The PRQL score correlated in the predicted range with most of the other JIA outcome measures, thereby demonstrating good construct validity, and discriminated well between different levels of disease severity. Assessment of internal structure (factor analysis) revealed that the PhH and PsH subscales identify two unambiguously separated domains. The internal consistency (Cronbach's alpha) was 0.86. The intraclass correlation coefficient for test-retest reliability was 0.91. The PRQL revealed fair responsiveness, with a standardized response mean of 0.67 in improved patients. Overall, the PRQL appeared to be more able to capture physical HRQL than psychosocial HRQL.Conclusion. The PRQL was found to possess good measurement properties and is, therefore, a valid instrument for the assessment of HRQL in children with JIA. This tool is primarily proposed for use in standard clinical care.