The many uses of regulatory impact assessment: A meta-analysis of EU and UK cases

Research on regulation has crossed paths with the literature on policy instruments, showing that regulatory policy instruments contain cognitive and normative beliefs about policy. Thus, their usage stacks the deck in favor of one type of actor or one type of regulatory solution. In this article, we challenge the assumption that there is a predetermined relationship between ideas, regulatory policy instruments, and outcomes. We argue that different combinations of conditions lead to different outcomes, depending on how actors use the instrument. Empirically, we analyze 31 EU and UK case studies of regulatory impact assessment (RIA) - a regulatory policy instrument that has been pivotal in the so-called better regulation movement. We distinguish four main usages of RIA, that is, political, instrumental, communicative, and perfunctory. We find that in our sample instrumental usage is not so rare and that the contrast between communicative and political usages is less stark than is commonly thought. In terms of policy recommendations, our analysis suggests that there may be different paths to desirable outcomes. Policymakers should therefore explore different combinations of conditions leading to the usages they deem desirable rather than arguing for a fixed menu of variables.

Non-contact assessment of waist circumference: will tape measurements become progressively obsolete?

Waist circumference (WC) is a key variable to assess in health management as it is a proxy of abdominal fat mass and a surrogate marker of cardiometabolic disease risk, including the metabolic syndrome. Recently, a portable non-contact device calculating WC (ViScan) has been developed, which hence allows the tracking of WC independently of the inter-investigators error. We compared WC values obtained with this device with WC measured by simple non-stretchable tape in 74 adults of varying body mass indices (range 17-39 kg/m(2)). The correlation between the two methods was very high (r=0.97, P<0.0001) and the reproducibility (precision) assessed with a rigid phantom was excellent (<1 cm, coefficient of variability<1%). The instrument constitutes a potentially valuable tool for longitudinal surveys and comparative international studies, which require simple but precise measurements of WC in order to track the effect of subtle changes on various health outcomes.

Assessment of the COOP charts with and without pictures in a Swiss population.

OBJECTIVES: This study aimed to assess the validity of COOP charts in a general population sample, to examine whether illustrations contribute to instrument validity, and to establish general population norms. METHODS: A general population mail survey was conducted among 20-79 years old residents of the Swiss canton of Vaud. Participants were invited to complete COOP charts, the SF-36 Health Survey; they also provided data on health service use in the previous month. Two thirds of the respondents received standard COOP charts, the rest received charts without illustrations. RESULTS: Overall 1250 persons responded (54%). The presence of illustrations did not affect score distributions, except that the illustrated 'physical fitness' chart drew greater non-response (10 vs. 3%, p < 0.001). Validity tests were similar for illustrated and picture-less charts. Factor analysis yielded two principal components, corresponding to physical and mental health. Six COOP charts showed strong and nearly linear relationships with corresponding SF36 scores (all p < 0.001), demonstrating concurrent validity. Similarly, most COOP charts were associated with the use of medical services in the past month. Only the chart on 'social support' partly deviated from construct validity hypotheses. Population norms revealed a generally lower health status in women and an age-related decline in physical health. CONCLUSIONS: COOP charts can be used to assess the health status of a general population. Their validity is good, with the possible exception of the 'social support' chart. The illustrations do not affect the properties of this instrument.

Human Capital Questionnaire (PHCQ): Assessment of European nurses' perception as indicators of human capital quality

Healthcare accreditation models generally include indicators related to healthcare employees' perceptions (e.g. satisfaction, career development, and health safety). During the accreditation process, organizations are asked to demonstrate the methods with which assessments are made. However, none of the models provide standardized systems for the assessment of employees. In this study, we analyzed the psychometric properties of an instrument for the assessment of nurses' perceptions as indicators of human capital quality in healthcare organizations. The Human Capital Questionnaire was applied to a sample of 902 nurses in four European countries (Spain, Portugal, Poland, and the UK). Exploratory factor analysis identified six factors: satisfaction with leadership, identification and commitment, satisfaction with participation, staff well-being, career development opportunities, and motivation. The results showed the validity and reliability of the questionnaire, which when applied to healthcare organizations, provide a better understanding of nurses' perceptions, and is a parsimonious instrument for assessment and organizational accreditation. From a practical point of view, improving the quality of human capital, by analyzing nurses and other healthcare employees' perceptions, is related to workforce empowerment.

Children's experience regarding the quality of their hospital stay: the development of an assessment questionnaire for children

A questionnaire assessing the satisfaction of children with their hospital stay has been developed and tested with 136 children (aged 6-12 years) at 2 Swiss hospital sites. Three out of 4 children were satisfied overall with their hospital stay. Their relationships with the professional medical staff, explanations they received, games they played, and environment, all received positive evaluations. The most critical points were pain, fear, and the absence of relatives. Ninety percent of the children appreciated that their opinions were sought. These results reinforce the importance of having questionnaires available for the children to consider their opinions to enhance the quality of care.

Validation of the spiritual distress assessment tool in older hospitalized patients.

ABSTRACT:¦BACKGROUND: The Spiritual Distress Assessment Tool (SDAT) is a 5-item instrument developed to assess unmet spiritual needs in hospitalized elderly patients and to determine the presence of spiritual distress. The objective of this study was to investigate the SDAT psychometric properties.¦METHODS: This cross-sectional study was performed in a Geriatric Rehabilitation Unit. Patients (N = 203), aged 65 years and over with Mini Mental State Exam score ≥ 20, were consecutively enrolled over a 6-month period. Data on health, functional, cognitive, affective and spiritual status were collected upon admission. Interviews using the SDAT (score from 0 to 15, higher scores indicating higher distress) were conducted by a trained chaplain. Factor analysis, measures of internal consistency (inter-item and item-to-total correlations, Cronbach α), and reliability (intra-rater and inter-rater) were performed. Criterion-related validity was assessed using the Functional Assessment of Chronic Illness Therapy-Spiritual well-being (FACIT-Sp) and the question "Are you at peace?" as criterion-standard. Concurrent and predictive validity were assessed using the Geriatric Depression Scale (GDS), occurrence of a family meeting, hospital length of stay (LOS) and destination at discharge.¦RESULTS: SDAT scores ranged from 1 to 11 (mean 5.6 ± 2.4). Overall, 65.0% (132/203) of the patients reported some spiritual distress on SDAT total score and 22.2% (45/203) reported at least one severe unmet spiritual need. A two-factor solution explained 60% of the variance. Inter-item correlations ranged from 0.11 to 0.41 (eight out of ten with P < 0.05). Item-to-total correlations ranged from 0.57 to 0.66 (all P < 0.001). Cronbach α was acceptable (0.60). Intra-rater and inter-rater reliabilities were high (Intraclass Correlation Coefficients ranging from 0.87 to 0.96). SDAT correlated significantly with the FACIT-Sp, "Are you at peace?", GDS (Rho -0.45, -0.33, and 0.43, respectively, all P < .001), and LOS (Rho 0.15, P = .03). Compared with patients showing no severely unmet spiritual need, patients with at least one severe unmet spiritual need had higher odds of occurrence of a family meeting (adjOR 4.7, 95%CI 1.4-16.3, P = .02) and were more often discharged to a nursing home (13.3% vs 3.8%; P = .027).¦CONCLUSIONS: SDAT has acceptable psychometrics properties and appears to be a valid and reliable instrument to assess spiritual distress in elderly hospitalized patients.

Human Capital Questionnaire (PHCQ): Assessment of European nurses' perception as indicators of human capital quality

Healthcare accreditation models generally include indicators related to healthcare employees' perceptions (e.g. satisfaction, career development, and health safety). During the accreditation process, organizations are asked to demonstrate the methods with which assessments are made. However, none of the models provide standardized systems for the assessment of employees. In this study, we analyzed the psychometric properties of an instrument for the assessment of nurses' perceptions as indicators of human capital quality in healthcare organizations. The Human Capital Questionnaire was applied to a sample of 902 nurses in four European countries (Spain, Portugal, Poland, and the UK). Exploratory factor analysis identified six factors: satisfaction with leadership, identification and commitment, satisfaction with participation, staff well-being, career development opportunities, and motivation. The results showed the validity and reliability of the questionnaire, which when applied to healthcare organizations, provide a better understanding of nurses' perceptions, and is a parsimonious instrument for assessment and organizational accreditation. From a practical point of view, improving the quality of human capital, by analyzing nurses and other healthcare employees' perceptions, is related to workforce empowerment.

Development of an instrument to measure the degree of critical patient's satisfaction with nursing care: research protocol

Aim: To investigate and understand patient's satisfaction with nursing care in the intensive care unit to identify the dimensions of the concept of"satisfaction" from the patient's point of view. To design and validate a questionnaire that measures satisfaction levels in critical patients. Background: There are many instruments capable of measuring satisfaction with nursing care; however, they do not address the reality for critical patients nor are they applicable in our context. Design: A dual approach study comprising: a qualitative phase employing Grounded Theory and a quantitative and descriptive phase to prepare and validate the questionnaire. Methods: Data collection in the qualitative phase will consist of: in-depth interview after theoretical sampling, on-site diary and expert discussion group. The sample size will depend on the expected theoretical saturation n = 27-36. Analysis will be based on Grounded Theory. For the quantitative phase, the sampling will be based on convenience (n = 200). A questionnaire will be designed on the basis of qualitative data. Descriptive and inferential statistics will be used. The validation will be developed on the basis of the validity of the content, the criteria of the construct and reliability of the instrument by the Cronbach's alpha and test-retest approach. Approval date for this protocol was November 2010. Discussion: Self-perceptions, beliefs, experiences, demographic, socio-cultural epistemological and political factors are determinants for satisfaction, and these should be taken into account when compiling a questionnaire on satisfaction with nursing care among critical patients.

Construction and validation of a surgical skills assessment tool for general surgery residency program

Objective: To develop and validate an instrument for measuring the acquisition of technical skills in conducting operations of increasing difficulty for use in General Surgery Residency (GSR) programs. Methods: we built a surgical skills assessment tool containing 11 operations in increasing levels of difficulty. For instrument validation we used the face validaity method. Through an electronic survey tool (Survey MonKey(r)) we sent a questionnaire to Full and Emeritus members of the Brazilian College of Surgeons - CBC - all bearers of the CBC Specialist Title. Results: Of the 307 questionnaires sent we received 100 responses. For the analysis of the data collected we used the Cronbach's alpha test. We observed that, in general, the overall alpha presented with values near or greater than 0.70, meaning good consistency to assess their points of interest. Conclusion: The evaluation instrument built was validated and can be used as a method of assessment of technical skill acquisition in the General Surgery Residency programs in Brazil.

Developmental norms for eight instruments used in the neuropsychological assessment of children: studies in Brazil

Norms for a battery of instruments, including Denckla's and Garfield's tests of Motor Persistence, Benton's Right-Left Discrimination, two recall modalities (Immediate and Delayed) of the Bender Test, Wechsler's Digit Span, the Color Span Test and the Human Figure Drawing Test, were developed for the neuropsychological assessment of children in the greater Rio de Janeiro area. Additionally, the behavior of each child was assessed with the Composite Teacher Rating Scale (Brito GNO and Pinto RCA (1991) Journal of Clinical and Experimental Neuropsychology, 13: 417-418). A total of 398 children (199 boys and 199 girls balanced for age) with a mean age of 9.3 years (SD = 2.8), who were attending a public school in Niterói, were the subjects of this study. Gender and age had significant effects on performance which depended on the instrument. Nonachievers performed worse than achievers in most neuropsychological tests. Comparison of our data to the available counterparts in the United States revealed that American children outperformed Brazilian children on the Right-Left Discrimination, Forward Digit Span, Color Span and Human Figure Drawing Tests. Further analysis showed that the neurobehavioral data consist of different factorial dimensions, including Human Body Representation, Motor Persistence of the Legs, Orbito-Orobuccal Motor Persistence, Attention-Memory, Visuospatial Memory, Neuropsychomotor Speed, Hyperactivity-Inattention, and Anxiety-Negative Socialization. We conclude that gender and age should be taken into account when using the normative data for most of the instruments studied in the present report. Furthermore, we stress the need for major changes in the Brazilian public school system in order to foster the development of secondary cognitive abilities in our children

Bioelectrical impedance spectroscopy for the assessment of body fluid volumes of term neonates

The assessment of fluid volume in neonates by a noninvasive, inexpensive, and fast method can contribute significantly to increase the quality of neonatal care. The objective of the present study was to calibrate an acquisition system and software to estimate the bioelectrical impedance parameters obtained by a method of bioelectrical impedance spectroscopy based on step response and to develop specific equations for the neonatal population to determine body fluid compartments. Bioelectric impedance measurements were performed by a laboratory homemade instrument. The volumes were estimated in a clinical study on 30 full-term neonates at four different times during the first month of life. During the first 24 hours of life the total body water, extracellular water and intracellular water were 2.09 ± 0.25, 1.20 ± 0.19, and 0.90 ± 0.25 liters, respectively. By the 48th hour they were 1.87 ± 0.27, 1.08 ± 0.17, and 0.79 ± 0.21 liters, respectively. On the 10th day they were 2.02 ± 0.25, 1.29 ± 0.21, and 0.72 ± 0.14 liters, respectively, and after 1 month they were 2.34 ± 0.27, 1.62 ± 0.20, and 0.72 ± 0.13 liters, respectively. The behavior of the estimated volume was correlated with neonatal body weight changes, leading to a better interpretation of such changes. In conclusion, this study indicates the feasibility of bioelectrical impedance spectroscopy as a method to help fluid administration in intensive care neonatal units, and also contribute to the development of new equations to estimate neonatal body fluid contents.

Performance assessment of the single photon emission microscope: high spatial resolution SPECT imaging of small animal organs

The single photon emission microscope (SPEM) is an instrument developed to obtain high spatial resolution single photon emission computed tomography (SPECT) images of small structures inside the mouse brain. SPEM consists of two independent imaging devices, which combine a multipinhole collimator, a high-resolution, thallium-doped cesium iodide [CsI(Tl)] columnar scintillator, a demagnifying/intensifier tube, and an electron-multiplying charge-coupling device (CCD). Collimators have 300- and 450-µm diameter pinholes on tungsten slabs, in hexagonal arrays of 19 and 7 holes. Projection data are acquired in a photon-counting strategy, where CCD frames are stored at 50 frames per second, with a radius of rotation of 35 mm and magnification factor of one. The image reconstruction software tool is based on the maximum likelihood algorithm. Our aim was to evaluate the spatial resolution and sensitivity attainable with the seven-pinhole imaging device, together with the linearity for quantification on the tomographic images, and to test the instrument in obtaining tomographic images of different mouse organs. A spatial resolution better than 500 µm and a sensitivity of 21.6 counts·s-1·MBq-1 were reached, as well as a correlation coefficient between activity and intensity better than 0.99, when imaging 99mTc sources. Images of the thyroid, heart, lungs, and bones of mice were registered using 99mTc-labeled radiopharmaceuticals in times appropriate for routine preclinical experimentation of <1 h per projection data set. Detailed experimental protocols and images of the aforementioned organs are shown. We plan to extend the instrument's field of view to fix larger animals and to combine data from both detectors to reduce the acquisition time or applied activity.

Designing and validating the methodology for the Internet assessment of fish consumption at a university setting

Assessing fish consumption is complex and involves several factors; however, the use of questionnaires in surveys and the use of the Internet as tool to collect data have been considered promising approaches. Therefore, the objective of this research was to design a data collection technique using a questionnaire to assess fish consumption by making it available on a specific home page on the Internet. A bibliographical survey or review was carried out to identify the features of the instrument, and therefore pre-tests were conducted with previous instruments, followed by the Focus Group technique. Specialists then performed an analysis and conducted an online pre-test. Multivariate data analysis was applied using the SmartPLS software. The results indicate that 1.966 participants belonging to the University of São Paulo (USP) community participated in the test, and after the exclusion of some variables, a statistically significant results were obtained. The final constructs comprised consumption, quality, and general characteristics. The instrument consisted of behavioral statements in a 5-point Likert scale and multiple-choice questions. The Cronbach's alpha reliability coefficient was 0.66 for general characteristics, 0.98 for quality, and 0.91 for consumption, which indicate good reliability of the instrument. In conclusion, the results proved that the Internet assessment is efficient. The instrument of analysis allowed us to better understand the process of buying and consuming fish in the country, and it can be used as base for further research.

The development, assessment, and implementation of an evaluation of the EMPOWER Program at shelters for abused women /

The development, assessment, and implementation of a program evaluation instrument was carried out to evaluate the impact and efficacy of the EMPOWER Program. This intervention was created to educate residents at a shelter for abused women with an anticipated outcome of prevention. Participants included the staff and residents at 2 shelters in Southern Ontario. Client pre, post and follow-up measures were obtained and analyzed statistically and using keyword content analysis. A single staff measure was obtained and summarized using keyword content analysis. Qualitative results were suggestive of important change in participants. All women in the post and follow-up measures believed their participation in the EMPOWER Program provided them with the knowledge, skills, and confidence to avoid abusive relationships in the fliture. This transformational impact was repeatedly expressed in both resident and staff feedback. Limitations of this research, as well as suggestions for future study were discussed.

Développement d’un instrument d’évaluation des besoins de réadaptation des personnes atteintes de maladies respiratoires chroniques

La réadaptation pulmonaire est une intervention dont l’efficacité est largement reconnue. Cette efficacité a été établie grâce à l’utilisation d’instruments de mesure d’impact global. Les patients bénéficiant des programmes de réadaptation pulmonaire possèdent des caractéristiques variées et souffrent généralement de maladie pulmonaire obstructive chronique à différents degrés. En fonction de leurs différents besoins, les patients répondent de façon variable aux composantes d’un programme de réadaptation pulmonaire. Il est recommandé d’individualiser les programmes en fonction des besoins des patients afin d’en optimiser les effets. À cette fin, l’évaluation des besoins de réadaptation des patients est nécessaire. Comme il n’existe actuellement aucun instrument standardisé pour procéder à cette évaluation, nous avons entrepris d’en développer un à l’aide de méthodes qualitatives et quantitatives de recherche. Un modèle conceptuel d’évaluation des besoins de réadaptation des patients a été élaboré suite aux résultats tirés de groupes de discussion, de la consultation de dossiers médicaux et d’une recension des écrits. À partir de ce modèle, des items devant être sélectionnés de façon individualisée parmi cinq domaines (reconnaissance des besoins, connaissance, motivation, attentes et buts) ont été pré-testés. Les tendances générales concernant la validité des items contenus dans le prototype d’instrument ont été vérifiées lors d’une étude pilote auprès de 50 répondants en réadaptation. Les pistes d’investigation dégagées dans ce mémoire serviront aux études de validation plus approfondies dont devrait faire l’objet ce prototype d’instrument dans le futur.