Psychometric analysis of the Brisbane Practice Environment Measure (B-PEM)

Purpose: To undertake rigorous psychometric testing of the newly developed contemporary work environment measure (the Brisbane Practice Environment Measure [B-PEM]) using exploratory factor analysis and confirmatory factor analysis. Methods: Content validity of the 33-item measure was established by a panel of experts. Initial testing involved 195 nursing staff using principal component factor analysis with varimax rotation (orthogonal) and Cronbach's alpha coefficients. Confirmatory factor analysis was conducted using data from a further 983 nursing staff. Results: Principal component factor analysis yielded a four-factor solution with eigenvalues greater than 1 that explained 52.53% of the variance. These factors were then verified using confirmatory factor analysis. Goodness-of-fit indices showed an acceptable fit overall with the full model, explaining 21% to 73% of the variance. Deletion of items took place throughout the evolution of the instrument, resulting in a 26-item, four-factor measure called the Brisbane Practice Environment Measure-Tested. Conclusions: The B-PEM has undergone rigorous psychometric testing, providing evidence of internal consistency and goodness-of-fit indices within acceptable ranges. The measure can be utilised as a subscale or total score reflective of a contemporary nursing work environment. Clinical Relevance: An up-to-date instrument to measure practice environment may be useful for nursing leaders to monitor the workplace and to assist in identifying areas for improvement, facilitating greater job satisfaction and retention.

A psychometric analysis of reliability and validity of the index of learning styles (ILS)

Prior literature showed that Felder and Silverman learning styles model (FSLSM) was widely adopted to cater to individual styles of learners whether in traditional or Technology Enhanced Learning (TEL). In order to infer this model, the Index of Learning Styles (ILS) instrument was proposed. This research aims to analyse the soundness of this instrument in an Arabic sample. Data were integrated from different courses and years. A total of 259 engineering students participated voluntarily in the study. The reliability was analysed by applying internal construct reliability, inter-scale correlation, and total item correlation. The construct validity was also considered by running factor analysis. The overall results indicated that the reliability and validity of perception and input dimensions were moderately supported, whereas processing and understanding dimensions showed low internal-construct consistency and their items were weakly loaded in the associated constructs. Generally, the instrument needs further effort to improve its soundness. However, considering the consistency of the produced results of engineering students irrespective of cross-cultural differences, it can be adopted to diagnose learning styles.

The measurement properties of the menorrhagia multi-attribute quality-of-life scale:a psychometric analysis

Menorrhagia, or heavy menstrual bleeding (HMB), is a common gynaecological condition. As the aim of treatment is to improve women's wellbeing and quality of life (QoL), it is necessary to have effective ways to measure this. This study investigated the reliability and validity of the menorrhagia multi-attribute scale (MMAS), a menorrhagia-specific QoL instrument. Participants (n = 431) completed the MMAS and a battery of other tests as part of the baseline assessment of the ECLIPSE (Effectiveness and Cost-effectiveness of Levonorgestrel-containing Intrauterine system in Primary care against Standard trEatment for menorrhagia) trial. Analyses of their responses suggest that the MMAS has good measurement properties and is therefore an appropriate condition-specific instrument to measure the outcome of treatment for HMB. © 2011 The Authors BJOG An International Journal of Obstetrics and Gynaecology © 2011 RCOG.

Psychometric properties of the Spanish version of the mindful attention awareness scale (MAAS) in patients with fibromyalgia

Background Mindful-based interventions improve functioning and quality of life in fibromyalgia (FM) patients. The aim of the study is to perform a psychometric analysis of the Spanish version of the Mindful Attention Awareness Scale (MAAS) in a sample of patients diagnosed with FM. Methods The following measures were administered to 251 Spanish patients with FM: the Spanish version of MAAS, the Chronic Pain Acceptance Questionnaire, the Pain Catastrophising Scale, the Injustice Experience Questionnaire, the Psychological Inflexibility in Pain Scale, the Fibromyalgia Impact Questionnaire and the Euroqol. Factorial structure was analysed using Confirmatory Factor Analyses (CFA). Cronbach's α coefficient was calculated to examine internal consistency, and the intraclass correlation coefficient (ICC) was calculated to assess the test-retest reliability of the measures. Pearson’s correlation tests were run to evaluate univariate relationships between scores on the MAAS and criterion variables. Results The MAAS scores in our sample were low (M = 56.7; SD = 17.5). CFA confirmed a two-factor structure, with the following fit indices [sbX2 = 172.34 (p < 0.001), CFI = 0.95, GFI = 0.90, SRMR = 0.05, RMSEA = 0.06. MAAS was found to have high internal consistency (Cronbach’s α = 0.90) and adequate test-retest reliability at a 1–2 week interval (ICC = 0.90). It showed significant and expected correlations with the criterion measures with the exception of the Euroqol (Pearson = 0.15). Conclusion Psychometric properties of the Spanish version of the MAAS in patients with FM are adequate. The dimensionality of the MAAS found in this sample and directions for future research are discussed.

Psychometric properties of the MacNew heart disease health-related quality of life instrument in patients with heart failure

RATIONALE, AIMS AND OBJECTIVES: Heart failure (HF) is a severe chronic disease and impairs health-related quality of life (HRQL). While validated specific HRQL instruments are required for evaluation of treatment and rehabilitation in patients with HF, a single validated measure to document changes in HRQL for patients with different heart disease diagnoses would be invaluable. The purpose of this analysis was the psychometric analysis of the German MacNew Heart Disease Questionnaire (MacNew) in HF patients, which has previously been shown to be reliable and valid in patients with myocardial infarction, angina pectoris and arrhythmia. METHODS: We recruited 89 patients (61.7+/-11.5 years; 84.3% male) in two Austrian and one Swiss cardiology department with documented HF (effect sizes 28.9+/-10.1%). The self-administered MacNew, the Short Form-36 (SF-36) and the Hospital Anxiety and Depression Scale were completed. Internal consistency reliability (Cronbach's alpha), discriminative and evaluative validity were assessed. RESULTS: Cronbach's alpha exceeded 0.80. Each MacNew scale differentiated between patients with and without anxiety (3.9+/-1.0 vs. 5.3+/-0.8, all P<0.001), with and without depression (4.2+/-1.2 vs. 5.2+/-0.9 all P<0.03) and by the SF-36 health transition item (deteriorate=4.39, no change=4.95, improve=5.45, all P<0.02). Evaluative validity was demonstrated with effect sizes >0.70 for a subsample attending a 12-week outpatient rehabilitation programme. CONCLUSIONS: The German language version of the MacNew demonstrates consistently acceptable psychometric properties of reliability, validity and responsiveness in patients with documented HF. Together with previous documentation of reliability, validity and responsive, these findings strengthen the argument for the MacNew as a potential 'core' HRQL measure, at least in the German language.

Test of Emotion Comprehension: Exploring the underlying structure through Confirmatory Factor Analysis and Similarity Structure Analysis

Some decades of research on emotional development have underlined the contribution of several domains to emotional understanding in childhood. Based on this research, Pons and colleagues (Pons & Harris, 2002; Pons, Harris & Rosnay, 2004) have proposed the Test of Emotion Comprehension (TEC) which assesses nine domains of emotional understanding, namely the recognition of emotions, based on facial expressions; the comprehension of external emotional causes; impact of desire on emotions; emotions based on beliefs; memory influence on emotions; possibility of emotional regulation; possibility of hiding an emotional state; having mixed emotions; contribution of morality to emotional experiences. This instrument was administered individually to 182 Portuguese children aged between 8 and 11 years, of 3rd and 4th grades, in public schools. Additionally, we used the Socially in Action-Peers (SAp) (Rocha, Candeias & Lopes da Silva, 2012) to assess TEC’s criterion-related validity. Mean differences results in TEC by gender and by socio-economic status (SES) were analyzed. The results of the TEC’s psychometric analysis were performed in terms of items’ sensitivity and reliability (stability, test-retest). Finally, in order to explore the theoretical structure underlying TEC a Confirmatory Factor Analysis and a Similarity Structure Analysis were computed. Implications of these findings for emotional understanding assessment and intervention in childhood are discussed.

Development of a Systematic Approach to Assessing Quality within Australian Residential Aged Care Facilities: The Clinical Care Indicators Tool

Recent years have seen the introduction of formalised accreditation processes in both community and residential aged care, but these only partially address quality assessment within this sector. Residential aged care in Australia does not yet have a standardised system of resident assessment related to clinical, rather than administrative, outcomes. This paper describes the development of a quality assessment tool aimed at addressing this gap. Utilising previous research and the results of nominal groups with experts in the field, the 21-item Clinical Care Indicators (CCI) Tool for residential aged care was developed and trialled nationally. The CCI Tool was found to be simple to use and an effective means of collecting data on the state of resident health and care, with potential benefits for resident care planning and continuous quality improvement within facilities and organisations. The CCI Tool was further refined through a small intervention study to assess its utility as a quality improvement instrument and to investigate its relationship with resident quality of life. The current version covers 23 clinical indicators, takes about 30 minutes to complete and is viewed favourably by nursing staff who use it. Current work focuses on psychometric analysis and benchmarking, which should enable the CCI Tool to make a positive contribution to the measurement of quality in aged care in Australia.

Nurse-administered procedural sedation and analgesia in the cardiac catheterisation laboratory : a mixed methods study

The cardiac catheterisation laboratory (CCL) is a specialised medical radiology facility where both chronic-stable and life-threatening cardiovascular illness is evaluated and treated. Although there are many potential sources of discomfort and distress associated with procedures performed in the CCL, a general anaesthetic is not usually required. For this reason, an anaesthetist is not routinely assigned to the CCL. Instead, to manage pain, discomfort and anxiety during the procedure, nurses administer a combination of sedative and analgesic medications according to direction from the cardiologist performing the procedure. This practice is referred to as nurse-administered procedural sedation and analgesia (PSA). While anecdotal evidence suggested that nurse-administered PSA was commonly used in the CCL, it was clear from the limited information available that current nurse-led PSA administration and monitoring practices varied and that there was contention around some aspects of practice including the type of medications that were suitable to be used and the depth of sedation that could be safely induced without an anaesthetist present. The overall aim of the program of research presented in this thesis was to establish an evidence base for nurse-led sedation practices in the CCL context. A sequential mixed methods design was used over three phases. The objective of the first phase was to appraise the existing evidence for nurse-administered PSA in the CCL. Two studies were conducted. The first study was an integrative review of empirical research studies and clinical practice guidelines focused on nurse-administered PSA in the CCL as well as in other similar procedural settings. This was the first review to systematically appraise the available evidence supporting the use of nurse-administered PSA in the CCL. A major finding was that, overall, nurse-administered PSA in the CCL was generally deemed to be safe. However, it was concluded from the analysis of the studies and the guidelines that were included in the review, that the management of sedation in the CCL was impacted by a variety of contextual factors including local hospital policy, workforce constraints and cardiologists’ preferences for the type of sedation used. The second study in the first phase was conducted to identify a sedation scale that could be used to monitor level of sedation during nurse-administered PSA in the CCL. It involved a structured literature review and psychometric analysis of scale properties. However, only one scale was found that was developed specifically for the CCL, which had not undergone psychometric testing. Several weaknesses were identified in its item structure. Other sedation scales that were identified were developed for the ICU. Although these scales have demonstrated validity and reliability in the ICU, weaknesses in their item structure precluded their use in the CCL. As findings indicated that no existing sedation scale should be applied to practice in the CCL, recommendations for the development and psychometric testing of a new sedation scale were developed. The objective of the second phase of the program of research was to explore current practice. Three studies were conducted in this phase using both quantitative and qualitative research methods. The first was a qualitative explorative study of nurses’ perceptions of the issues and challenges associated with nurse-administered PSA in the CCL. Major themes emerged from analysis of the qualitative data regarding the lack of access to anaesthetists, the limitations of sedative medications, the barriers to effective patient monitoring and the impact that the increasing complexity of procedures has on patients' sedation requirements. The second study in Phase Two was a cross-sectional survey of nurse-administered PSA practice in Australian and New Zealand CCLs. This was the first study to quantify the frequency that nurse-administered PSA was used in the CCL setting and to characterise associated nursing practices. It was found that nearly all CCLs utilise nurse-administered PSA (94%). Of note, by characterising nurse-administered PSA in Australian and New Zealand CCLs, several strategies to improve practice, such as setting up protocols for patient monitoring and establishing comprehensive PSA education for CCL nurses, were identified. The third study in Phase Two was a matched case-control study of risk factors for impaired respiratory function during nurse-administered PSA in the CCL setting. Patients with acute illness were found to be nearly twice as likely to experience impaired respiratory function during nurse-administered PSA (OR=1.78; 95%CI=1.19-2.67; p=0.005). These significant findings can now be used to inform prospective studies investigating the effectiveness of interventions for impaired respiratory function during nurse-administered PSA in the CCL. The objective of the third and final phase of the program of research was to develop recommendations for practice. To achieve this objective, a synthesis of findings from the previous phases of the program of research informed a modified Delphi study, which was conducted to develop a set of clinical practice guidelines for nurse-administered PSA in the CCL. The clinical practice guidelines that were developed set current best practice standards for pre-procedural patient assessment and risk screening practices as well as the intra and post-procedural patient monitoring practices that nurses who administer PSA in the CCL should undertake in order to deliver safe, evidence-based and consistent care to the many patients who undergo procedures in this setting. In summary, the mixed methods approach that was used clearly enabled the research objectives to be comprehensively addressed in an informed sequential manner, and, as a consequence, this thesis has generated a substantial amount of new knowledge to inform and support nurse-led sedation practice in the CCL context. However, a limitation of the research to note is that the comprehensive appraisal of the evidence conducted, combined with the guideline development process, highlighted that there were numerous deficiencies in the evidence base. As such, rather than being based on high-level evidence, many of the recommendations for practice were produced by consensus. For this reason, further research is required in order to ascertain which specific practices result in the most optimal patient and health service outcomes. Therefore, along with necessary guideline implementation and evaluation projects, post-doctoral research is planned to follow up on the research gaps identified, which are planned to form part of a continuing program of research in this field.

What factors influence nurses’ assessment practices? Development of the Barriers to Nurses’ use of Physical Assessment Scale

Aim To develop and psychometrically test the Barriers to Nurses’ use of Physical Assessment Scale. Background There is growing evidence of failure to recognise hospitalised patients at risk of clinical deterioration, in part due to inadequate physical assessment by nurses. Yet, little is known about the barriers to nurses’ use of physical assessment in the acute hospital setting and no validated scales have been published. Design Instrument development study. Method Scale development was based on a comprehensive literature review, focus groups, expert review and psychometric evaluation. The scale was administered to 434 acute care registered nurses working at a large Australian teaching hospital between June and July 2013. Psychometric analysis included factor analysis, model fit statistics and reliability testing. Results The final scale was reduced to 38 items representing seven factors, together accounting for 57.7% of the variance: (1) reliance on others and technology, (2) lack of time and interruptions, (3) ward culture, (4) lack of confidence, (5) lack of nursing role models, (6) lack of influence on patient care, and; (7) specialty area. Internal reliability ranged from .70 to .86. Conclusion Findings provide initial evidence for the validity and reliability of the Barriers to Nurses’ use of Physical Assessment Scale and point to the importance of understanding the organisational determinants of nurses’ assessment practices. The new scale has potential clinical and research applications to support nursing assessment in acute care settings.

Assessing the needs of informal caregivers to cancer survivors: a review of the instruments

Objective: Cancer may impact negatively on an informal caregiver's health long after treatment has ended. This review identifies the self-report measures currently in use to measure caregivers need for support and determines their scientific soundness and clinical utility.

Method: A systematic electronic database search of Medline, CINAHL, PsychINFO, BNI ProQuest was conducted. The psychometric properties and clinical utility of needs assessment tools for caregivers of cancer survivors (excluding advanced disease) were extracted and summarised.

Results: Seven cancer survivor caregiver needs assessment tools were identified. Data on instrument development was well reported, although variability was noted in their structure and content. The majority demonstrated some degree of reliability and validity; only two were evaluated for test–retest reliability (CaSPUN and SPUNS) with only the SPUNS showing a high degree of reliability over time. The Health Care Needs Survey (HCNS), Needs Assessment of Family Caregivers-Cancer (NAFC-C) and Cancer Caregiving Tasks Consequences and Needs Questionnaire (CaTCoN) have been validated at various stages of the cancer continuum. Minimal data was available on responsiveness.

Conclusion: All assessment tools identified require further psychometric analysis. For research purposes, the use of the SPUNS (with its acceptable test–retest reliability) appears most appropriate; although its length may be of concern for clinical use; therefore, the shorter SCNS-P&C is likely to be more suitable for use clinically. At present, the NAFC-C demonstrates a great potential in both the research and clinical environments; however, it requires further psychometric testing before it can be fully recommended. Further analysis is necessary on ideal response formats and the meaning of a total needs score.

Evaluación de la validez de la escala llanto para el dolor en neonatos y menores de cinco años

Introducción: La escala LLANTO para dolor es una escala que hasta la fecha ha sido solo validada en población infantil española, actualmente no se conocen datos en población colombiana. Se pretende validar la escala de dolor LLANTO en pacientes neonatos y menores de 5 años, a través de su aplicación en pacientes atendidos en una de tres instituciones, además comparándola con las escalas FLACC y PIPP dependiendo de edad del paciente. Metodología: Se incluyeron niños con cualquier tipo de dolor, clasificándolos en dos grupos por edad: 1) neonatos y 2) niños entre 1 mes y 5 años de edad, que asistieron a la Fundación Cardioinfantil, Clínica Infantil Colsubsidio o al Hospital Universitario Mayor. Las escalas fueron aplicadas por dos residentes de pediatría y una enfermera especializada en el cuidado de población infantil. Para la prueba piloto se diseñó un cuestionario determinar dificultades en la aplicación de la escala LLANTO. Una vez corregidos los problemas identificados se procederá a la validación de la escala. Resultados: Se presentan los datos de la prueba piloto. Se incluyeron 8 neonatos y 8 niños entre 1 mes y 5 años, esta muestra fue obtenida en un periodo de un mes, con la encuesta se evaluó la aceptación y entendimiento de la escala LLANTO por parte de los evaluadores. La prueba piloto mostró resultados favorables en el 100% de los encuestados. Discusión: Se considera que la escala LLANTO no requiere cambios para continuar con su validación.

Elaboração de instrumento para rastreio do risco de disfagia orofaríngea infantil

Pós-graduação em Fonoaudiologia - FFC

Expectativas de estudiantes universitarios frente a sus capacidades y competencias para participar en cursos abiertos y en línea

La educación virtual ha instalado una manera diferente de comprender la enseñanza y el aprendizaje. Asimismo, ha venido a modificar los roles de profesores y estudiantes y las formas de acceder al conocimiento. En este contexto, el estudio tiene como objetivo analizar las expectativas de estudiantes universitarios en torno a sus propias capacidades y competencias para participar en cursos abiertos y en línea. Nos aproximamos a estas cuestiones a través de un diseño descriptivo y correlacional con la participación de 115 estudiantes chilenos y 75 españoles. Los análisis psicométricos evidencian una buena consistencia del instrumento confirmando las dimensiones teóricas del instrumento, además de la correlación entre algunos factores y las variables demográficas de los grupos estudiados.

Propriedades psicométricas da versão Torga do Teste Stroop

RESUMO Objetivos: Uma nova versão portuguesa do teste Stroop é fundamental para a avaliação neuropsicológica. A versão portuguesa prévia incluía cores que muitas pessoas não conseguiam distinguir. Assim, é objetivo descrever as propriedades psicométricas de uma nova versão, designada versão Torga do Teste Stroop, numa amostra da população portuguesa. Métodos: Inserida no projeto Estudos Normativos de Instrumentos Neuropsicológicos, esta investigação conta com uma amostra global constituída por 544 participantes (241 homens e 303 mulheres) com idades compreendidas entre os 18 e os 97 anos. A avaliação foi realizada com recurso à versão Torga do Teste Stroop, à Figura Complexa de Rey-Osterrieth e à Bateria de Avaliação Frontal enquanto instrumentos de avaliação das funções executivas. Resultados: A versão Torga do Teste Stroop revelou uma consistência interna muito boa (α de Cronbach = 0,99). Revelou também adequada estabilidade temporal e validade convergente. Conclusão: A versão Torga do Teste Stroop aparenta ser um instrumento apropriado à avaliação neuropsicológica de adultos portugueses. Considerando a importância deste teste no contexto da avaliação neuropsicológica, incentivam-se estudos com novas amostras, incluindo amostras clínicas. ABSTRACT Goals: A new Portuguese version of the Stroop Test is essential for the neuropsychological assessment. The previous Portuguese version included colors that many people could not distinguish. Thus, it is aimed to describe the psychometric properties of a new version, called the Torga version of the Stroop Test in a sample of the Portuguese population. Methods: Being part of the Estudos Normativos de Instrumentos Neuropsicológicos/ Normative Studies of Neuropsychological Instruments, this research has a global sample of 544 subjects (241 men and 303 women) aged from 18 to 97 years. The assessment included the Torga version of the Stroop Test, the Rey-Osterrieth Complex Figure and the Frontal Battey Assessment, used as measures of executive functions. Results: The Torga version of the Stroop Test showed a very good internal consistency (Cronbach's α = 0.99). It also revealed an adequate temporal stability and convergent validity. Conclusion: The Torga version of the Stroop Test appears to be an adequate instrument for the neuropsychological assessment of Portuguese adults. Considering the importance of this test in the context of neuropsychological assessment, more studies with new samples, including clinical samples are encouraged.