Evaluation of outpatient child-adolescent mental health services (CAMHS) in Attica-Greece

ABSTRACT: Background: Childhood is a critical time for social and emotional development, educational progress and mental health prevention. Mental health for children and adolescents is defined by the achievement of expected developmental, cognitive, social and emotional skills. The development of child-adolescent mental health services (CAMHS) is a necessity for each country, not only as a prevention measure for the wellbeing of people, but also as an investment to the future of countries. Qualitative evaluation of services is the only way to ensure whether services function under quality standards and increase the possibility of better outcomes for their patients. This study examines the greek outpatient CAMHS against the British Standards of National Institute of Excellence for community CAMHS. The Standards assessed refer to the areas of Assessment, Care and Intervention. Objectives: The main objectives of the study are 1) to evaluate Greek outpatient CAMHS in the Attica region 2) to promote the evaluation process for mental health services in Greece. Methods: Due to the fact that Greek services are based on the British model, the tool used was the British self-review questionnaire of Quality Network for Community CAMHS(QNCC).The tool was translated, adapted and posted to services. Twelve out of twenty outpatient CAMHS of Attica (including Athens) responded. Data was collected and performed by the Statistical Package for Social Sciences SPSS. Results: The study resulted that the CAMHS examined, meet moderately the British Standards of 1) Referral and Access, 2) Assessment & Care planning, 3) Care & Intervention. Two out of twelve services examined, meet the standards of "Assessment and Care" in a higher percentage between 75% and 100%. Conclusions: The paper describes a satisfactory function of CAMHS in Attica prefecture taking into consideration the extremely difficult political situation of Greece at the time of the research. Strong and weak domains are identified. Also the translation and adaptation of British tools promote the evaluation process and quality assurance of Greek CAMHS.

Health services performance for TB treatment in Brazil: a cross-sectional study

Background: Researches to evaluate Primary Health Care performance in TB control in Brazil show that different cities aggregate local specificities in the dynamics of coping with the disease. This study aims to evaluate health services' performance in TB treatment in cities across different Brazilian regions. Methods: This cross-sectional study was conducted in five cities that are considered priorities for TB control in Brazil: Itaborai (ITA), Ribeirao Preto (RP) and Sao Jose do Rio Preto (SJRP) in the Southeast; Campina Grande (CG) and Feira de Santana (FS) in the Northeast. Data were collected through interviews with 514 TB patients under treatment in 2007, using the Primary Care Assessment Tool adapted for TB care in Brazil. Indicators were constructed based on the mean response scores (Likert scale) and compared among the study sites. Results: ""Access to treatment"" was evaluated as satisfactory in the Southeast and regular in the Northeast, which displayed poor results on 'home visits' and 'distance between treatment site and patient's house'. ""Bond"" was assessed as satisfactory in all cities, with a slightly better performance in RP and SJRP. ""Range of services"" was rated as regular, with better performance of southeastern cities. 'Health education', 'DOT' and 'food vouchers' were less offered in the Northeast. ""Coordination"" was evaluated as satisfactory in all cities. ""Family focus"" was evaluated as satisfactory in RP and SJRP, and regular in the others. 'Professional asking patient's family about other health problems' was evaluated as unsatisfactory, except in RP. Conclusions: Two types of obstacles are faced for health service performance in TB treatment in the cities under analysis, mainly in the Northeast. The first is structural and derives from difficulties to access health services and actions. The second is organizational and derives from the way health technologies and services are distributed and integrated. Incentives to improve care organization and management practices, aimed at the integration of primary, secondary and tertiary services, can contribute towards a better performance of health services in TB treatment.

The use of the quality model of Parasuraman, Zeithaml and Berry in health services

This is an article about the theoretical model for assessing quality in health services proposed by Parasuraman, Zheitaml and Berry, in order to measure the degree of satisfaction of users. This model is based on the analysis of expectations and perceptions of users of health services, by means of five dimensions: tangibility, reliability, responsiveness, assurance and empathy. From the difference between what is expected by the user and the service offered, gaps or shortcomings are derived that may be the main obstacle for users to perceive the provision of such services with quality. It was observed that the use of the psychometric scale called Service Quality (SERVQUAL) in some studies about satisfaction, obtained very favorable results in the institutions in which it was employed. The analysis revealed the need to improve the existing models of evaluation, as well as the importance of measuring user satisfaction in health institutions.

Model for the evaluation of drug-dispensing services in primary health care

OBJECTIVE To develop a model for evaluating the efficacy of drug-dispensing service in primary health care. METHODS An efficacy criterion was adopted to determine the level of achievement of the service objectives. The evaluation model was developed on the basis of a literature search and discussions with experts. The applicability test of the model was conducted in 15 primary health care units in the city of Florianópolis, state of Santa Catarina, in 2010, and data were recorded in structured and pretested questionnaires. RESULTS The model developed was evaluated using five dimensions of analysis for analysis. The model was suitable for evaluating service efficacy and helped to identify the critical points of each service dimension. CONCLUSIONS Adaptations to the data collection technique may be required to adjust for the reality and needs of each situation. The evaluation of the drug-dispensing service should promote adequate access to medications supplied through the public health system.

The role of evaluation in decision-making in the management of health services

The management of health services is a complex administrative practice due to the breadth of the field of health and the need to reconcile individual, corporate and collective interests that are not always convergent. In this context, the evaluation needs to have specific characteristics in order to fulfill its role. The scope of this study was to establish the characteristics that the evaluation for the management of health services should have to contribute to decision-making. Usefulness, opportunity, feasibility, reliability, objectivity and directionality represent the set of principles upon which the evaluation should be based. Evaluations should lead to decisions that guarantee not only their efficiency and effectiveness but also their implementation. The evaluation process should ensure that decisions involve all stakeholders in order to render the implementation of decisions feasible, and take into account the health needs of the population and the goals set for the services. The scope of this article is to elicit a debate among different stakeholders in the evaluation in the hope that it can contribute to the reflection on the real usefulness of evaluations in which the political component in management has been increasingly prevalent.

Health services research using linked records: who consents and what is the gain?

Objective: To assess consent to record linkage, describe the characteristics of consenters and compare self-report versus Medicare records of general practitioner use. Method. Almost 40,000 women in the Australian Longitudinal Study on Women's Health were sent a request by mail for permission to link their Medicare records and survey data. Results: 19,700 women consented: 37% of young (18-23 years), 59% of mid-age (4550 years) and 53% of older women (70-75 years). Consenters tended to have higher levels of education and, among the older cohort, were in better health than nonconsenters. Women tended to under-report the number of visits to general practitioners. Conclusions: Record linkage of survey and Medicare data on a large scale is feasible. The linked data provide information on health and socio-economic status which are valuable for understanding health service utilisation. Implications: Linked records provide a powerful tool for health care research, particularly in longitudinal studies.

Validity and reliability of a health care service evaluation instrument for tuberculosis

OBJECTIVE To evaluate the validity and reliability of an instrument that evaluates the structure of primary health care units for the treatment of tuberculosis.METHODS This cross-sectional study used simple random sampling and evaluated 1,037 health care professionals from five Brazilian municipalities (Natal, state of Rio Grande do Norte; Cabedelo, state of Paraíba; Foz do Iguaçu, state of Parana; Sao José do Rio Preto, state of Sao Paulo, and Uberaba, state of Minas Gerais) in 2011. Structural indicators were identified and validated, considering different methods of organization of the health care system in the municipalities of different population sizes. Each structure represented the organization of health care services and contained the resources available for the execution of health care services: physical resources (equipment, consumables, and facilities); human resources (number and qualification); and resources for maintenance of the existing infrastructure and technology (deemed as the organization of health care services). The statistical analyses used in the validation process included reliability analysis, exploratory factor analysis, and confirmatory factor analysis.RESULTS The validation process indicated the retention of five factors, with 85.9% of the total variance explained, internal consistency between 0.6460 and 0.7802, and quality of fit of the confirmatory factor analysis of 0.995 using the goodness-of-fit index. The retained factors comprised five structural indicators: professionals involved in the care of tuberculosis patients, training, access to recording instruments, availability of supplies, and coordination of health care services with other levels of care. Availability of supplies had the best performance and the lowest coefficient of variation among the services evaluated. The indicators of assessment of human resources and coordination with other levels of care had satisfactory performance, but the latter showed the highest coefficient of variation. The performance of the indicators “training” and “access to recording instruments” was inferior to that of other indicators.CONCLUSIONS The instrument showed feasibility of application and potential to assess the structure of primary health care units for the treatment of tuberculosis.

Performance evaluation of hospitals that provide care in the public health system, Brazil

OBJECTIVE To analyze if size, administrative level, legal status, type of unit and educational activity influence the hospital network performance in providing services to the Brazilian Unified Health System.METHODS This cross-sectional study evaluated data from the Hospital Information System and the Cadastro Nacional de Estabelecimentos de Saúde (National Registry of Health Facilities), 2012, in Sao Paulo, Southeastern Brazil. We calculated performance indicators, such as: the ratio of hospital employees per bed; mean amount paid for admission; bed occupancy rate; average length of stay; bed turnover index and hospital mortality rate. Data were expressed as mean and standard deviation. The groups were compared using analysis of variance (ANOVA) and Bonferroni correction.RESULTS The hospital occupancy rate in small hospitals was lower than in medium, big and special-sized hospitals. Higher hospital occupancy rate and bed turnover index were observed in hospitals that include education in their activities. The hospital mortality rate was lower in specialized hospitals compared to general ones, despite their higher proportion of highly complex admissions. We found no differences between hospitals in the direct and indirect administration for most of the indicators analyzed.CONCLUSIONS The study indicated the importance of the scale effect on efficiency, and larger hospitals had a higher performance. Hospitals that include education in their activities had a higher operating performance, albeit with associated importance of using human resources and highly complex structures. Specialized hospitals had a significantly lower rate of mortality than general hospitals, indicating the positive effect of the volume of procedures and technology used on clinical outcomes. The analysis related to the administrative level and legal status did not show any significant performance differences between the categories of public hospitals.

Contribution of Mental Health Service User Groups to Mental Health Services and Policy in Ghana : The Case of Mental Health Society of Ghana

RESUMO: Este estudo procurou documentar a perspectiva (s) dos utentes de saúde mental e das associações de prestadores de cuidados sobre a prestação, o papel e a contribuição de serviços de saúde mental da comunidade tal como foram percebidos por um número de informadores-chave, incluindo os utentes do serviço mentais e os próprios prestadores de cuidados. O caso específico da Sociedade Saúde Mental do Gana (MEHSOG) foi o foco deste estudo. O modelo foi o de um estudo de caso, utilizando discussões de grupo e entrevistas com informadores-chave como instrumentos de recolha de dados. Estas ferramentas de colheita de dados foram complementadas por observações dos participantes e pela revisão de documentos da MEHSOG e dos vários grupos de apoio da comunidade de auto-ajuda que compõem a associação nacional. O estudo revelou que os utentes dos serviços de saúde mental e seus prestadores de cuidados constituem um importante grupo de partes interessadas na prestação de serviços de saúde mental da comunidade e no desenvolvimento de políticas que tenham em conta as necessidades e os direitos das pessoas com doença mental ou epilepsia. O envolvimento da MEHSOG promove a mobilização de membros e famílias relacionadas com a doença mental de beneficiar de serviços de tratamento bem organizados com um impacto significativo na melhoria da saúde e da participação dos utentes dos serviços e seus prestadores de cuidados primários em processos de tomada de decisão da família e na comunidade processos de desenvolvimento. Os utentes dos serviços por beneficiarem de tratamento, e os prestadores de cuidados primários, por se tornarem mais livres e menos sobrecarregados com a responsabilidade de cuidar, podem passar a envolver-se mais em atividades que melhoramo seu estado, o de suas famílias e das comunidades. A advocacia dos membros da MEHSOG para conseguir que a “Mental Health Bill” se transforme numa Lei foi também um desenvolvimento significativo resultante da participação ativa dos utentes do serviço em chamar a atenção para uma nova e inclusiva legislação de saúde mental para o Gana. Entre os fatores e oportunidades que permitiram aos utentes dos serviços de saúde mental e aos prestadores de cuidados primários de pessoas com doença mental apoiar activamente a prestação de serviços de saúde mental comunitária e o desenvolvimento de políticas conta-se a contribuição da sociedade civil do Gana, particularmente o movimento da deficiência, e os esforços anteriores de ONGs em saúde mental e dos profissionais de saúde mental para ter uma nova lei em saúde mental. Observámos um certo número de desafios e barreiras que actuam de forma a limitar a influência dos utentes dos serviços de saúde mental na provisão da saúde mental comunitária e no desenvolvimento de políticas. Entre elas o estigma social contra a doença mental e pessoas com doença mental ou epilepsia e seus cuidadores primaries é um factor chave. O estigma tem alterado a percepção e as análises do público em geral, especialmente dos profissionais de saúde e das autoridades políticas afetando a priorização dos problemas de saúde mental nas políticas e programas. Outro desafio foi a deficiente infra-estrutura disponível para apoiar serviços de saúde mentais que assegurem aos utentes permanecerem em bom estado de saúde e bem-estar para serem advogados de si próprios. A recomendação do presente estudo é que os movimentos de utentes dos serviços de saúde mental são importantes e que eles precisam de ser apoiados e encorajados a desempenhar o seu papel como pessoas com experiência vivida para contribuir para a organização e prestação de serviços de saúde mental, bem como para a implementação, monitorização e avaliação de políticas e programas. ------------------------------------ ABSTRACT: This study sought to document the perspective(s) of mental health users and care-givers associations in community mental health service provision and their role and contribution as it was perceived by a number of key informants including the mental service users and care-givers themselves. The specific case of the Mental Health Society of Ghana (MEHSOG) was the focus of this study. A case study approach was used to with Focus Group Discussions and Key Informants Interviews being the data collection tools that were used. These data collection tools were complemented by participant observations and review of documents of the MEHSOG and the various community self-help peer support groups that make up the national association. The study revealed that mental health service users and their care-givers constitute an important stakeholder group in community mental health service provision and development of policies that factor in the needs and rights of persons with mental illness or epilepsy. MEHSOG’s involvement in mobilising members and education families to come forward with the relations with mental illness to benefit from treatment services were well made a significant impact in improving the health and participation of service users and their primary carers in family decision-making processes and in community development processes. Service users, on benefiting from treatment, and primary care-givers, on becoming freer and less burdened with the responsibility of care, move on to engage in secure livelihoods activities, which enhanced their status in their families and communities. The advocacy MEHSOG members undertook in getting the mental health Bill become Law was also noted as significant development that was realised as a result of active involvement of service users in calling for a new and inclusive mental health legislation for Ghana. Enabling factors and opportunities that enabled mental health service users and primary care-givers of people with mental illness to actively support community mental health service provision and policy development is with the vibrant civil society presence in Ghana, particularly the disability movement, and earlier efforts by NGOs in mental health in Ghana long-side mental health professionals to have a new law in mental health. A number of challenges were also noted which were found to limit the extent to which mental health service users can be influential in community mental health service provision and policy development. Key among them was the social stigma against mental illness and people with mental illness or epilepsy and their primary carers. Stigma has affected perceptions, analyses of the general public, especially health practitioners and policy authorities that it has affected their prioritisation of mental health issues in policies and programmes. Another challenge was the poor infrastructure available to support enhanced mental health care services that ensure mental health service users remain in a good state of health and wellbeing to advocate for themselves. The recommendation from the study is that mental health service user movements are important and need to be supported and encouraged to play their role as persons with lived experience to inform organisation and provision of mental health services as well as design and implementation, monitoring and evaluation of policies and programes.

Evaluation of the Irish Pilot Programme for the Education of Health Care Assistants

Click here to download PDF

Factors associated with use of community mental health services by schizophrenia patients using multilevel analysis

BACKGROUND Persons with schizophrenia and related disorders may be particularly sensitive to a number of determinants of service use, including those related with illness, socio-demographic characteristics and organizational factors. The objective of this study is to identify factors associated with outpatient contacts at community mental health services of patients with schizophrenia or related disorders. METHODS This cross-sectional study analyzed 1097 patients. The main outcome measure was the total number of outpatient consultations during one year. Independent variables were related to socio-demographic, clinical and use of service factors. Data were collected from clinical records. RESULTS The multilevel linear regression model explained 46.35% of the variance. Patients with significantly more contacts with ambulatory services were not working and were receiving welfare benefits (p = 0.02), had no formal education (p = 0.02), had a global level of severity of two or three (four being the most severe) (p < 0.001), with one or more inpatient admissions (p < 0.001), and in contact with both types of professional (nurses and psychiatrists) (p < 0.001). The patients with the fewest ambulatory contacts were those with diagnoses of persistent delusional disorders (p = 0.04) and those who were attended by four of the 13 psychiatrists (p < 0.001). CONCLUSIONS As expected, the variables that explained the use of community service could be viewed as proxies for severity of illness. The most surprising finding, however, was that a group of four psychiatrists was also independently associated with use of ambulatory services by patients with schizophrenia or related disorders. More research is needed to carefully examine how professional support networks interact to affect use of mental health.

Setting priorities in clinical and health services research: Properties of an adapted and updated method

Objectives: The objectives of this study is to review the set of criteria of the Institute of Medicine (IOM) for priority-setting in research with addition of new criteria if necessary, and to develop and evaluate the reliability and validity of the final priority score. Methods: Based on the evaluation of 199 research topics, forty-five experts identified additional criteria for priority-setting, rated their relevance, and ranked and weighted them in a three-round modified Delphi technique. A final priority score was developed and evaluated. Internal consistency, test–retest and inter-rater reliability were assessed. Correlation with experts’ overall qualitative topic ratings were assessed as an approximation to validity. Results: All seven original IOM criteria were considered relevant and two new criteria were added (“potential for translation into practice”, and “need for knowledge”). Final ranks and relative weights differed from those of the original IOM criteria: “research impact on health outcomes” was considered the most important criterion (4.23), as opposed to “burden of disease” (3.92). Cronbach’s alpha (0.75) and test–retest stability (interclass correlation coefficient = 0.66) for the final set of criteria were acceptable. The area under the receiver operating characteristic curve for overall assessment of priority was 0.66. Conclusions: A reliable instrument for prioritizing topics in clinical and health services research has been developed. Further evaluation of its validity and impact on selecting research topics is required