A nursing interface terminology: evaluation of face validity

A range of different language systems for nursing diagnosis, interventions and outcomes are currently available. Nursing terminologies are intended to support nursing practice but they have to be evaluated. This study aims to assess the results of an expert survey to establish the face validity of a nursing interface terminology. The study applied a descriptive design with a cross-sectional survey strategy using a written questionnaire administered to expert nurses working in hospitals. Sample size was estimated at 35 participants. The questionnaire included topics related to validity and reliability criteria for nursing controlled vocabularies described in the literature. Mean global score and criteria scoring at least 7 were considered main outcome measures. The analysis included descriptive statistics with a confidence level of 95%. The mean global score was 8.1. The mean score for the validity criteria was 8.4 and 7.8 for reliability and applicability criteria. Two of the criteria for reliability and applicability evaluation did not achieve minimum scores. According to the experts" responses, this terminology meets face validity, but that improvements are required in some criteria and further research is needed to completely demonstrate its metric properties.

Face and content validity of smoking-related and matched control pictures

Smoking-related pictures and matched controls are useful tools in experimental tasks of attentional bias. Noteworthy the procedures used to produce and validate these pairs of pictures are poorly reported. This study aimed to describe the production and evidence of validity of a set of smoking-related pictures and their matched controls. Two studies were conducted to assess validity. An online internet-based survey was used to assess face validity of 12 pictures related to smoking behavior and 12 matched controls. All pictures were colored and were 95mm length x 130mm width. Participants were asked if the pictures were related or not to the smoking behavior and also rated how much each picture was related to smoking behavior. The second study investigated attentional bias in smokers (n = 47) and non-smokers (n = 50), and examined how they assessed all pictures in terms of pleasantness and the 12 smoking-related pictures in terms of relevance to their own smoking behavior. Craving was assessed before and after the experiment. Results indicate that this set of pictures are valid since smoking-related pictures were considered more related to smoking behavior compared to their matched controls. Moreover, smokers showed greater attentional bias for smoking-related pictures than non-smokers. Craving and relevance of the smoking-related pictures were higher in smokers than in non-smokers. Smokers considered smoking-related pictures them less unpleasant than non-smokers. These findings provide evidence of face and content validity of this set of pictures, which will be available to researchers, contributing to maximize the standardization of future investigations.

Portuguese version of the Delirium Rating Scale-Revised-98: reliability and validity

Objective To assess the validity and the reliability of the Portuguese version of the Delirium Rating Scale-Revised-98 (DRS-R-98). Methods The scale was translated into Portuguese and back-translated into English. After assessing its face validity, five diagnostic groups (n = 64; delirium, depression, dementia, schizophrenia and others) were evaluated by two independent researchers blinded to the diagnosis. Diagnosis and severity of delirium as measured by the DRS-R-98 were compared to clinical diagnosis, Mini-Mental State Exam, Confusion Assessment Method, and Clinical Global Impressions scale (CGI). Results Mean and rnedian DRS-R-98 total scores significantly distinguished delirium from the other groups (p < 0.001). Inter-rater reliability (ICC between 0.9 and 1) and internal consistency (alpha = 0.91) were very high. DRS-R-98 severity scores correlated highly with the CGI. Mean DRS-R-98 severity scores during delirium differed significantly (p < 0.01) from the post-treatment values. The area under the curve established by ROC analysis was 0.99 and using the cut-off Value of 20 the scale showed sensitivity and specificity of 92.6% and 94.6%, respectively. Conclusion The Portuguese version of the DRS-R-98 is a valid and reliable measure of delirium that distinguishes delirium from other disorders and is sensitive to change in delirium severity, which may be of great value for longitudinal studies. Copyright (c) 2007 John Wiley & Sons, Ltd.

Detecting and measuring deprivation in primary care: development, validity and reliability of a self-reported questionnaire - the DiPCare-Q

Background: General practitioners play a central role in taking deprivation into consideration when caring for patients in primary care. Validated questions to identify deprivation in primary-care practices are still lacking. For both clinical and research purposes, this study therefore aims to develop and validate a standardized instrument measuring both material and social deprivation at an individual level. Methods: The Deprivation in Primary Care Questionnaire (DiPCare-Q) was developed using qualitative and quantitative approaches between 2008 and 2011. A systematic review identified 199 questions related to deprivation. Using judgmental item quality, these were reduced to 38 questions. Two focus groups (primary-care physicians, and primary-care researchers), structured interviews (10 laymen), and think aloud interviews (eight cleaning staff) assured face validity. Item response theory analysis was then used to derive the DiPCare-Q index using data obtained from a random sample of 200 patients who were to complete the questionnaire a second time over the phone. For construct and criterion validity, the final 16 questions were administered to a random sample of 1,898 patients attending one of 47 different private primary-care practices in western Switzerland (validation set) along with questions on subjective social status (subjective SES ladder), education, source of income, welfare status, and subjective poverty. Results: Deprivation was defined in three distinct dimensions (table); material deprivation (eight items), social deprivation (five items) and health deprivation (three items). Item consistency was high in both the derivation (KR20 = 0.827) and the validation set (KR20 = 0.778). The DiPCare-Q index was reliable (ICC = 0.847). For construct validity, we showed the DiPCare-Q index to be correlated to patients' estimation of their position on the subjective SES ladder (rs = 0.539). This position was correlated to both material and social deprivation independently suggesting two separate mechanisms enhancing the feeling of deprivation. Conclusion: The DiPCare-Q is a rapid, reliable and validated instrument useful for measuring both material and social deprivation in primary care. Questions from the DiPCare-Q are easy to use when investigating patients' social history and could improve clinicians' ability to detect underlying social distress related to deprivation.

The Neuropsychiatric Inventory-Clinician rating scale (NPI-C): Reliability and validity of a revised assessment of neuropsychiatric symptoms in dementia

Background: Neuropsychiatric symptoms (NPS) affect almost all patients with dementia and are a major focus of study and treatment. Accurate assessment of NPS through valid, sensitive and reliable measures is crucial. Although current NPS measures have many strengths, they also have some limitations (e.g. acquisition of data is limited to informants or caregivers as respondents, limited depth of items specific to moderate dementia). Therefore, we developed a revised version of the NPI, known as the NPI-C. The NPI-C includes expanded domains and items, and a clinician-rating methodology. This study evaluated the reliability and convergent validity of the NPI-C at ten international sites (seven languages). Methods: Face validity for 78 new items was obtained through a Delphi panel. A total of 128 dyads (caregivers/patients) from three severity categories of dementia (mild = 58, moderate = 49, severe = 21) were interviewed separately by two trained raters using two rating methods: the original NPI interview and a clinician-rated method. Rater 1 also administered four additional, established measures: the Apathy Evaluation Scale, the Brief Psychiatric Rating Scale, the Cohen-Mansfield Agitation Index, and the Cornell Scale for Depression in Dementia. Intraclass correlations were used to determine inter-rater reliability. Pearson correlations between the four relevant NPI-C domains and their corresponding outside measures were used for convergent validity. Results: Inter-rater reliability was strong for most items. Convergent validity was moderate (apathy and agitation) to strong (hallucinations and delusions; agitation and aberrant vocalization; and depression) for clinician ratings in NPI-C domains. Conclusion: Overall, the NPI-C shows promise as a versatile tool which can accurately measure NPS and which uses a uniform scale system to facilitate data comparisons across studies. Copyright © 2010 International Psychogeriatric Association.

Validity and reliability of a pictorial instrument for assessing perceived motor competence in Portuguese children

It is important to assess young children's perceived Fundamental Movement Skill (FMS) competence in order to examine the role of perceived FMS competence in motivation toward physical activity. Children's perceptions of motor competence may vary according to the culture/country of origin; therefore, it is also important to measure perceptions in different cultural contexts. The purpose was to assess the face validity, internal consistency, test–retest reliability and construct validity of the 12 FMS items in the Pictorial Scale for Perceived Movement Skill Competence for Young Children (PMSC) in a Portuguese sample. Methods Two hundred one Portuguese children (girls, n = 112), 5 to 10 years of age (7.6 ± 1.4), participated. All children completed the PMSC once. Ordinal alpha assessed internal consistency. A random subsamples (n = 47) were reassessed one week later to determine test–retest reliability with Bland–Altman method. Children were asked questions after the second administration to determine face validity. Construct validity was assessed on the whole sample with a Bayesian Structural Equation Modelling (BSEM) approach. The hypothesized theoretical model used the 12 items and two hypothesized factors: object control and locomotor skills. Results The majority of children correctly identified the skills and could understand most of the pictures. Test–retest reliability analysis was good, with an agreement ration between 0.99 and 1.02. Ordinal alpha values ranged from acceptable (object control 0.73, locomotor 0.68) to good (all FMS 0.81). The hypothesized BSEM model had an adequate fit. Conclusions The PMSC can be used to investigate perceptions of children's FMS competence. This instrument can also be satisfactorily used among Portuguese children.

Screening for vulnerability to abuse among older women: Women's health Australia study

The validity of a brief self-report screening measure for elder abuse was examined on a nationally representative sample of more than 12,000 older women it? the baseline survey of the Australian Longitudinal Study on Women's Health. The screening instrument was a modification Of the Hwalek-Sengstock Elder Abuse Screening Test. Construct validity was examined using factor analysis and correlation with a wide range of sociodemographic, psychological. and health-related variables. Four factors, each of three items, were identified representing the following domains: Vulnerability, Dependence, Dejection, and Coercion. The Vulnerability and Coercion factors had the highest face validity for abuse and demonstrated moderate to good construct validity. The six items comprising these factors may provide a simple screening tool for elder abuse The identified correlates of abuse indicators have the potential to enhance policy development, screening, intervention, and carer support programs.

Adaptation of AHRQ patient safety indicators for use in ICD-10 administrative data by an international consortium.

Objective: The Agency for Healthcare Research and Quality (AHRQ) developed Patient Safety Indicators (PSIs) for use with ICD-9-CM data. Many countries have adopted ICD-10 for coding hospital diagnoses. We conducted this study to develop an internationally harmonized ICD-10 coding algorithm for the AHRQ PSIs. Methods: The AHRQ PSI Version 2.1 has been translated into ICD-10-AM (Australian Modification), and PSI Version 3.0a has been independently translated into ICD-10-GM (German Modification). We converted these two country-specific coding algorithms into ICD-10-WHO (World Health Organization version) and combined them to form one master list. Members of an international expert panel-including physicians, professional medical coders, disease classification specialists, health services researchers, epidemiologists, and users of the PSI-independently evaluated this master list and rated each code as either "include," "exclude," or "uncertain," following the AHRQ PSI definitions. After summarizing the independent rating results, we held a face-to-face meeting to discuss codes for which there was no unanimous consensus and newly proposed codes. A modified Delphi method was employed to generate a final ICD-10 WHO coding list. Results: Of 20 PSIs, 15 that were based mainly on diagnosis codes were selected for translation. At the meeting, panelists discussed 794 codes for which consensus had not been achieved and 2,541 additional codes that were proposed by individual panelists for consideration prior to the meeting. Three documents were generated: a PSI ICD-10-WHO version-coding list, a list of issues for consideration on certain AHRQ PSIs and ICD-9-CM codes, and a recommendation to WHO to improve specification of some disease classifications. Conclusion: An ICD-10-WHO PSI coding list has been developed and structured in a manner similar to the AHRQ manual. Although face validity of the list has been ensured through a rigorous expert panel assessment, its true validity and applicability should be assessed internationally.

The Paediatric Rheumatology International Trials Organisation provisional criteria for the evaluation of response to therapy in juvenile dermatomyositis.

OBJECTIVE: To develop a provisional definition for the evaluation of response to therapy in juvenile dermatomyositis (DM) based on the Paediatric Rheumatology International Trials Organisation juvenile DM core set of variables. METHODS: Thirty-seven experienced pediatric rheumatologists from 27 countries achieved consensus on 128 difficult patient profiles as clinically improved or not improved using a stepwise approach (patient's rating, statistical analysis, definition selection). Using the physicians' consensus ratings as the "gold standard measure," chi-square, sensitivity, specificity, false-positive and-negative rates, area under the receiver operating characteristic curve, and kappa agreement for candidate definitions of improvement were calculated. Definitions with kappa values >0.8 were multiplied by the face validity score to select the top definitions. RESULTS: The top definition of improvement was at least 20% improvement from baseline in 3 of 6 core set variables with no more than 1 of the remaining worsening by more than 30%, which cannot be muscle strength. The second-highest scoring definition was at least 20% improvement from baseline in 3 of 6 core set variables with no more than 2 of the remaining worsening by more than 25%, which cannot be muscle strength (definition P1 selected by the International Myositis Assessment and Clinical Studies group). The third is similar to the second with the maximum amount of worsening set to 30%. This indicates convergent validity of the process. CONCLUSION: We propose a provisional data-driven definition of improvement that reflects well the consensus rating of experienced clinicians, which incorporates clinically meaningful change in core set variables in a composite end point for the evaluation of global response to therapy in juvenile DM.

Evaluation of professional knowledge and attitudes on dementia patient care: a trans-cultural adaptation of an evaluation instrument

Objective To describe the trans-cultural adaptation of the evaluation instrument entitled Atenció Sanitària de Les Demències: la visió de L' Atenció Primarià from Catalan into versions in Portuguese for doctors and nurses. This study evaluates the knowledge and perspectives of these professionals in their treatment of patients diagnosed with dementia in cases of primary care. Method The adaptation followed internationally accepted rules, which include the following steps: translation, synthesis, back-translation, revision by a committee of specialists, and a test run with 35 practicing doctors and 35 practicing nurses in Brazil's Family Health Strategy (Estratégia Saúde da Família, or ESF in Portuguese). Results The translation, synthesis, and back-translation steps were performed satisfactorily; only small adjustments were required. The committee of specialists verified the face validity in the version translated into Portuguese, and all of the items that received an agreement score lower than 80% during the initial evaluation were revised. In the test run, the difficulties presented by the health care professionals did not reach 15% of the sample, and therefore, no changes were made. Conclusion The Portuguese translation of the instrument can be considered semantically, idiomatically, culturally, and conceptually equivalent to the original Catalan version and is, therefore, appropriate for use in Brazil.

Development of appropriateness criteria for the surgical treatment of symptomatic lumbar degenerative spondylolisthesis (LDS).

PURPOSE: Spine surgery rates are increasing worldwide. Treatment failures are often attributed to poor patient selection and inappropriate treatment, but for many spinal disorders there is little consensus on the precise indications for surgery. With an aging population, more patients with lumbar degenerative spondylolisthesis (LDS) will present for surgery. The aim of this study was to develop criteria for the appropriateness of surgery in symptomatic LDS. METHODS: A systematic review was carried out to summarize the current level of evidence for the treatment of LDS. Clinical scenarios were generated comprising combinations of signs and symptoms in LDS and other relevant variables. Based on the systematic review and their own clinical experience, twelve multidisciplinary international experts rated each scenario on a 9-point scale (1 highly inappropriate, 9 highly appropriate) with respect to performing decompression only, fusion, and instrumented fusion. Surgery for each theoretical scenario was classified as appropriate, inappropriate, or uncertain based on the median ratings and disagreement in the ratings. RESULTS: 744 hypothetical scenarios were generated; overall, surgery (of some type) was rated appropriate in 27 %, uncertain in 41 % and inappropriate in 31 %. Frank panel disagreement was low (7 % scenarios). Face validity was shown by the logical relationship between each variable's subcategories and the appropriateness ratings, e.g., no/mild disability had a mean appropriateness rating of 2.3 ± 1.5, whereas the rating for moderate disability was 5.0 ± 1.6 and for severe disability, 6.6 ± 1.6. Similarly, the average rating for no/minimal neurological abnormality was 2.3 ± 1.5, increasing to 4.3 ± 2.4 for moderate and 5.9 ± 1.7 for severe abnormality. The three variables most likely (p < 0.0001) to be components of scenarios rated "appropriate" were: severe disability, no yellow flags, and severe neurological deficit. CONCLUSION: This is the first study to report criteria for determining candidacy for surgery in LDS developed by a multidisciplinary international panel using a validated method (RAM). The panel ratings followed logical clinical rationale, indicating good face validity. The work refines clinical classification and the phenotype of degenerative spondylolisthesis. The predictive validity of the criteria should be evaluated prospectively to examine whether patients treated "appropriately" have better clinical outcomes.

The spiritual distress assessment tool: an instrument to assess spiritual distress in hospitalised elderly persons.

BACKGROUND: Although spirituality is usually considered a positive resource for coping with illness, spiritual distress may have a negative influence on health outcomes. Tools are needed to identify spiritual distress in clinical practice and subsequently address identified needs. This study describes the first steps in the development of a clinically acceptable instrument to assess spiritual distress in hospitalized elderly patients. METHODS: A three-step process was used to develop the Spiritual Distress Assessment Tool (SDAT): 1) Conceptualisation by a multidisciplinary group of a model (Spiritual Needs Model) to define the different dimensions characterizing a patient's spirituality and their corresponding needs; 2) Operationalisation of the Spiritual Needs Model within geriatric hospital care leading to a set of questions (SDAT) investigating needs related to each of the defined dimensions; 3) Qualitative assessment of the instrument's acceptability and face validity in hospital chaplains. RESULTS: Four dimensions of spirituality (Meaning, Transcendence, Values, and Psychosocial Identity) and their corresponding needs were defined. A formalised assessment procedure to both identify and subsequently score unmet spiritual needs and spiritual distress was developed. Face validity and acceptability in clinical practice were confirmed by chaplains involved in the focus groups. CONCLUSIONS: The SDAT appears to be a clinically acceptable instrument to assess spiritual distress in elderly hospitalised persons. Studies are ongoing to investigate the psychometric properties of the instrument and to assess its potential to serve as a basis for integrating the spiritual dimension in the patient's plan of care.

A study compared nine patient-specific indices for musculoskeletal disorders.

BACKGROUND AND OBJECTIVE: Patient-specific quality of life indices show great potential, but certain conceptual and methodological concerns have yet to be fully addressed. The present study reviewed nine patient-specific instruments used in musculoskeletal disorders: the Canadian Occupational Performance Measure (COPM), Juvenile Arthritis Quality of life Questionnaire (JAQQ), McMaster-Toronto Arthritis questionnaire (MACTAR), Measure Yourself Medical Outcome Profile (MYMOP), Patient-Specific Index (PASI) for total hip arthroplasty, Problem Elicitation Technique (PET), Patient Generated Index (PGI) of quality of life, Patient-Specific Functional Scale (PSFS), and Schedule for the Evaluation of Individual Quality of Life (SEIQoL). STUDY DESIGN AND SETTING: Each tool was evaluated for purpose, content validity, face validity, feasibility, psychometric properties, and responsiveness. RESULTS: This critical appraisal revealed important differences in terms of the concept underlying these indices, the domains covered, the item-generation techniques and the scoring (response scale, methods) in each scale. The nine indices would generate different responses and likely scores for the same patient, despite the fact that they all include patient-generated items. CONCLUSION: Although the value of these indices in treatment planning and monitoring at an individual level is strong, more studies are needed to improve our understanding of how to interpret the numeric scores of patient-specific indices at both an individual and a group level.