Realist Evaluation: a theory driven approach.

Realistic Evaluation assumes that all programmes implemented in practice have an underlying theory to explain how a particular intervention is meant to work. The purpose of realist evaluation is to test the theoretical propositions underpinning the implementation of a programme in order to understand how and why it works, or might not work, in certain circumstances. The first stage of the realist evaluation is to track and articulate the programme theories to determine the evidence on the ‘official conjecture’ (Pawson et al 2004 pg 16) of how the programme is suppose to work in practice. These official conjectures are then tested and refined by gathering empirical evidence to establish causal relationships between a programme and its outcome. Evaluation of the factors and interactions between factors, supporting or hindering the implementation of a programme in practice facilitate theory refinement. Theory refinement is viewed as an iterative and cyclical process undertaken to synthesise the empirical evidence and develop mid-range theories which can be generalised and applied to other programmes to improve implementation and sustainability. In this symposium an example of realist evaluation used to test and refine the theory underpinning the implementation of Early Warning Systems (EWS) is provided to clarify how this theory driven approach can be applied in practice.

Systematic review of the use of behaviour change techniques (BCTs) in home-based cardiac rehabilitation programmes for patients with cardiovascular disease-protocol

BACKGROUND: Cardiovascular diseases (CVDs), including myocardial infarction, heart failure, peripheral arterial disease and strokes, are highly prevalent conditions and are associated with high morbidity and mortality. Cardiac rehabilitation (CR) is an effective form of secondary prevention for CVD but there is a lack of information regarding which specific behaviour change techniques (BCTs) are included in programmes that are associated with improvements in cardiovascular risk factors. This systematic review will describe the BCTs which are utilised within home-based CR programmes that are effective at reducing a spectrum of CVD risk factors.

METHODS/DESIGN: The review will be reported in line with the preferred reporting items for systematic reviews and meta-analyses (PRISMA) guidance. Randomised and quasi-randomised controlled trials of home-based CR initiated following a vascular event (myocardial infarction, heart failure, peripheral arterial disease and stroke patients) will be included. Articles will be identified through a comprehensive search of MEDLINE, Embase, PsycINFO, Web of Science and Cochrane Database guided by a medical librarian. Two review authors will independently screen articles retrieved from the search for eligibility and extract relevant data, identifying which specific BCTs are included in programmes that are associated with improvements in particular modifiable vascular risk factors.

DISCUSSION: This review will be of value to clinicians and healthcare professionals working with cardiovascular patients by identifying specific BCTs which are used within effective home-based CR. It will also inform the future design and evaluation of complex health service interventions aimed at secondary prevention in CVD.

Protocol for a pilot randomised controlled trial of an intervention to increase the use of traffic light food labelling in UK shoppers (the FLICC trial)

Background: Traffic light labelling of foods—a system that incorporates a colour-coded assessment of the level of total fat, saturated fat, sugar and salt on the front of packaged foods—has been recommended by the UK Government and is currently in use or being phased in by many UK manufacturers and retailers. This paper describes a protocol for a pilot randomised controlled trial of an intervention designed to increase the use of traffic light labelling during real-life food purchase decisions.

Methods/design: The objectives of this two-arm randomised controlled pilot trial are to assess recruitment, retention and data completion rates, to generate potential effect size estimates to inform sample size calculations for the main trial and to assess the feasibility of conducting such a trial. Participants will be recruited by email from a loyalty card database of a UK supermarket chain. Eligible participants will be over 18 and regular shoppers who frequently purchase ready meals or pizzas. The intervention is informed by a review of previous interventions encouraging the use of nutrition labelling and the broader behaviour change literature. It is designed to impact on mechanisms affecting belief and behavioural intention formation as well as those associated with planning and goal setting and the adoption and maintenance of the behaviour of interest, namely traffic light label use during purchases of ready meals and pizzas. Data will be collected using electronic sales data via supermarket loyalty cards and web-based questionnaires and will be used to estimate the effect of the intervention on the nutrition profile of purchased ready meals and pizzas and the behavioural mechanisms associated with label use. Data collection will take place over 48 weeks. A process evaluation including semi-structured interviews and web analytics will be conducted to assess feasibility of a full trial.

Discussion: The design of the pilot trial allows for efficient recruitment and data collection. The intervention could be generalised to a wider population if shown to be feasible in the main trial.

Effects of a book gifting programme on literacy outcomes for foster children: A randomised controlled trial evaluation of the Letterbox Club in Northern Ireland

The poor educational outcomes of children in care is a significant concern internationally. Whilst there have been many interventions developed to address this problem, very few of these have been rigorously evaluated. This article presents the findings of a randomised controlled trial that sought to measure the effectiveness of a book gifting programme (the Letterbox Club) that aims to improve literacy skills amongst children aged 7-11 years in foster care. The programme involves children receiving six parcels of books sent through the post over a six-month period. The trial, which ran between April 2013 and June 2014, involved a sample of 116 children in Northern Ireland (56 randomly allocated to the intervention group and 60 to a waiting list control group). Outcome measures focused on reading skills (reading accuracy, comprehension and rate) and attitudes to reading and school. The trial found no evidence that the book-gifting programme had any effect on any of the outcomes measured. Drawing upon some of the emergent themes from the accompanying qualitative process evaluation that sought to determine foster carer/child attitude towards and engagement with the parcels, it is suggested that one plausible reason for the ineffectiveness of the Letterbox Club, as intimated by carers and children (rather than explicitly explored with them), is the lack of support provided to the carers/children in relation to the packs received. Reflective of an ecological model of children’s development, it is recommended that for book-gifting programmes to be effective they need to include a focus on encouraging the direct involvement of foster carers in shared literacy activities with the children using the books that are gifted.

Exploring the Findings from Three Randomised Controlled Trials of Bookgifting Programmes

Aims: This paper explores the effects from three similar bookgifting programmes on improving reading outcomes of early years’ children, their parents and teachers.
Methods: The paper draws on research data produced by the Centre for Effective Education during three randomised controlled trial (RCT) evaluations of bookgifting programmes (N=1694 participant families in total). The three studies used pre and post test measures to identify effects across a total of 15 social, cognitive and behavioural reading outcomes.
Results: The overall average effect across the 15 outcomes from data provided by 1694 participant families, was d=0.07. This is a relatively small overall effect and there was an overall pattern of small positive effects of this scale across the wide range of the reading outcomes assessed. However, only one significant effect was identified in the 15 outcomes assessed across all three studies.
Conclusions: The review of these three studies suggests that the RCTs struggle to identify significant effects in these low exposure and low cost bookgifting interventions. Furthermore, it is recommended that future RCT studies of this type of programme require very large sample sizes in the scale of 1000’s rather than 100’s to generate enough study power. Or alternatively, these programmes could be evaluated as a component part of more intensive reading interventions.

Rastreio do cancro da mama no concelho de Aveiro: do estudo dos fatores determinantes da adesão às propostas educativas emergentes

O cancro da mama feminino pela sua magnitude merece uma especial atenção ao nível das políticas de saúde. Emerge, pois uma visão abrangente que, por um lado, deve atentar para o encargo que esta representa para qualquer sistema de saúde, pelos custos que acarreta, como também, para a qualidade de vida das mulheres portadoras da mesma. Desta forma, a Liga Portuguesa Contra o Cancro (LPCC) tem desenvolvido, em colaboração com as Administrações Regionais de Saúde (ARS), o Programa de Rastreio do Cancro da Mama (PRCM), o qual apresenta, no Concelho de Aveiro, taxas de adesão na ordem dos 50%, ainda distantes dos 70%, objetivo recomendado pelas guidelines da Comissão Europeia. A não adesão tem sido considerada como um dos principais problemas do sistema de saúde, tanto pelas repercussões ao nível de ganhos em saúde, como também na qualidade de vida e na satisfação dos pacientes com os cuidados de saúde, constituindo-se como um fenómeno multifatorial e multidimensional. É neste sentido que o presente trabalho se propõe identificar os fatores, de cariz individual e do meio envolvente, determinantes da adesão ao PRCM, numa amostra de mulheres residentes no Concelho de Aveiro, com idades compreendidas entre os 45 e os 69 anos e, a partir dos resultados emergentes, propor estratégias de educação em saúde. Como procedimentos metodológicos e, numa primeira fase, entre outubro 2009 e maio 2010 foi aplicado um survey, o qual foi complementado com notas de campo dos entrevistadores a uma amostra não aleatória de 805 mulheres, em dois contextos distintos: no centro de saúde às aderentes à mamografia e, no domicílio, às não aderentes. Numa segunda fase, realizamos duas sessões de Focus Group (FG), num total de 12 elementos, um grupo heterogéneo com enfermeiros, médicos e utentes, e um outro grupo homogéneo, apenas com profissionais de saúde. O tratamento dos dados do survey foi efetuado através de procedimentos estatísticos, com utilização do SPSS® versão 17 e realizadas análises bivariadas (qui-quadrado) e multivariadas (discriminação de função e árvore de decisão através do algoritmo Chi-squared Automatic Interaction Detector) com o intuito de determinar as diferenças entre os grupos e predizer as variáveis exógenas. No que diz respeito a indicadores sociodemográficos, os resultados mostram que aderem mais, as mulheres com idades <50 anos e ≥ 56 anos, as que vivem em localidades urbanas, as trabalhadoras não qualificadas e as reformadas. As que aderem menos ao PRCM têm idades compreendidas entre os 50-55 anos, vivem nas zonas periurbanas, são licenciadas, apresentam categoria profissional superior ou estão desempregadas. Em relação às restantes variáveis exógenas, aderem ao PRCM, as mulheres que apresentam um Bom Perfil de Conhecimentos (46.6%), enquanto as não aderentes apresentam um Fraco Perfil de Conhecimentos (50.6%), sendo esta relação estatisticamente significativa (X2= 10.260; p=0.006).Cerca de 59% das mulheres aderentes realiza o seu rastreio de forma concordante com as orientações programáticas presentes no PRCM, comparativamente com 41.1% das mulheres que não o faz, verificando-se uma relação de dependência bastante significativa entre as variáveis Perfil de Comportamentos e adesão(X2= 348.193; p=0.000). Apesar de não existir dependência estatisticamente significativa entre as Motivações e a adesão ao PRCM (X2= 0.199; p=0.656), se analisarmos particularmente, os motivos de adesão, algumas inquiridas demonstram preocupação, tanto na deteção precoce da doença, como na hereditariedade. Por outro lado, os motivos de não adesão, também denotam aspetos de nível pessoal como o desleixo com a saúde, o desconhecimento e o esquecimento da marcação. As mulheres que revelam Boa Acessibilidade aos Cuidados de Saúde Primários e um Bom Atendimento dos Prestadores de Cuidados aderem mais ao PRCM, comparativamente com as inquiridas que relatam Fraca Acessibilidade e Atendimento, não aderindo. A partir dos resultados da análise multivariada podemos inferir que as variáveis exógenas estudadas possuem um poder discriminante significativo, sendo que, o Perfil de Comportamentos é a variável que apresenta maior grau de diferenciação entre os grupos das aderentes e não aderentes. Como variáveis explicativas resultantes da árvore de decisão CHAID, permaneceram, o Perfil de Comportamentos (concordantes e não concordantes com as guidelines), os grupos etários (<50 anos, 50-55anos e ≥56anos) e o Atendimento dos prestadores de cuidados de saúde. As mulheres mais novas (<50 anos) com Perfil de comportamentos «concordantes» com as guidelines são as que aderem mais, comparativamente com os outros grupos etários. Por outro lado, as não aderentes necessitam de um «bom» atendimento dos prestadores de cuidados para se tornarem aderentes ao PRCM. Tanto as notas de campo, como a discussão dos FG foram sujeitas a análise de conteúdo segundo as categorias em estudo obtidas na primeira fase e os relatos mostram a importância de fatores de ordem individual e do meio envolvente. No que se refere a aspetos psicossociais, destaca-se a importância das crenças e como fatores ambientais menos facilitadores para a adesão apontam a falta de transportes, a falta de tempo das pessoas e a oferta de recursos, principalmente se existirem radiologistas privados como alternativa ao PRCM. Tal como na primeira fase do estudo, uma das motivações para a adesão é a recomendação dos profissionais de saúde para o PRCM, bem como a marcação de consultas pela enfermeira, que pode ser uma oportunidade de contacto para a sensibilização. Os hábitos de vigilância de saúde, a perceção positiva acerca dos programas de saúde no geral, o acesso à informação pertinente sobre o PRCM e a operacionalização deste no terreno parecem ser fatores determinantes segundo a opinião dos elementos dos FG. O tipo e a regularidade no atendimento por parte dos profissionais de saúde, a relação entre profissional de saúde/paciente, a personalização das intervenções educativas, a divulgação que estes fazem do PRCM junto das suas pacientes, bem como, a organização do modelos de cuidados de saúde das unidades de saúde e a forma como os profissionais se envolvem e tomam a responsabilização por um programa desta natureza são fatores condicionantes da adesão. Se atendermos aos resultados deste estudo, verificamos um envolvimento de fatores que integram múltiplos níveis de intervenção, sendo um desafio para as equipas de saúde que pretendam intervir no âmbito do programa de rastreio do cancro da mama. Com efeito, os resultados também apontam para a combinação de múltiplas estratégias que são transversais a vários programas de promoção da saúde, assumindo, desta forma, uma perspetiva multidimensional e dinâmica que visa, essencialmente, a construção social da saúde e do bem-estar (i.e. responsabilização do cidadão pela sua própria saúde e o seu empowerment).

Feasibility of Undertaking Off-Site Infant Eye-Tracking Assessments of Neuro-Cognitive Functioning in Early-Intervention Centres

Recent work suggests that differences in functional brain development are already identifiable in 6- to 9-month-old infants from low socio-economic status (SES) backgrounds. Investigation of early SES-related differences in neuro-cognitive functioning requires the recruitment of large and diverse samples of infants, yet it is often difficult to persuade low-SES parents to come to a university setting. One solution is to recruit infants through early intervention children’s centres (CCs). These are often located in areas of high relative deprivation to support young children. Given the increasing portability of eye-tracking equipment, assessment of large clusters of infants could be undertaken in centres by suitably trained early intervention staff. Here, we report on a study involving 174 infants and their parents, carried out in partnership with CCs, exploring the feasibility of this approach. We report the processes of setting up the project and participant recruitment. We report the diversity of sample obtained on the engagement of CC staff in training and the process of assessment itself.We report the quality of the data obtained, and the levels of engagement of parents and infants. We conclude that this approach has great potential for recruiting large and diverse samples worldwide, provides sufficiently reliable data and is engaging to staff, parents and infants.

A Sociology for Other Animals: Analysis, advocacy, intervention

Sociology has come late to the field of Human Animal Studies (HAS), and such scholarship remains peripheral to the discipline. Early sociological interventions in the field were often informed by a critical perspective, in particular feminism but also Marxism and critical race studies. There have also been less critical routes taken, often using approaches such as actor-network theory and symbolic interactionism. These varied initiatives have made important contributions to the project of animalizing sociology and problematizing its legacies of human-exclusivity. As HAS expands and matures however, different kinds of study and different normative orientations have come increasingly into relations of tension in this eclectic field. This is particularly so when it comes to the ideological and ethical debates on appropriate human relations with other species, and on questions of whether and how scholarship might intervene to alter such relations. However, despite questioning contemporary social forms of human-animal relations and suggesting a need for change, the link between analysis and political strategy is uncertain. This paper maps the field of sociological animal studies through some examples of critical and mainstream approaches and considers their relation to advocacy. While those working in critical sociological traditions may appear to have a more certain political agenda, this article suggests that an analysis of 'how things are' does not always lead to a coherent position on 'what is to be done' in terms of social movement agendas or policy intervention. In addition, concepts deployed in advocacy such as rights, liberation and welfare are problematic when applied beyond the human. Even conceptions less entrenched in the liberal humanist tradition such as embodiment, care and vulnerability are difficult to operationalize. Despite complex and contested claims however, this paper suggests that there might also be possibilities for solidarity.

Implementation of a quality system in joint master programmes

Joint master programmes are systems which by default demand a proper quality system in order to sustain and improve. Objective of this thesis is analysing and proposing solutions to difficulties associated with the implementation of a quality management system to joint master programmes, with the focus on international joint master programmes. The application of the analysis to the Erasmus Mundus joint master programme European Master in Quality in Analytical Laboratories (EMQAL) is discussed. QA systems implementation in HEIs in Europe is an ongoing process, and implementation of such systems in JPs is one step further to enhancing quality in higher education in Europe. The issue closely discussed in this thesis is: should QMS be developed independently from the institutions, or should the institutions, when developing their quality management systems, take into account the (future) development of joint courses and prepare their quality procedures accordingly? A quality management system is normally developed for one organization, and different aspects of cooperation are considered within. A joint master programme is a result of successful cooperation of two or more organizations; therefore a development of its quality management system must be approached in a different manner. This thesis proposes a QMS with emphasis both on the HEI and the consortium. Different processes in the QMS can be managed independently at the level of the HEI or at the level of the consortium. Most processes in joint master programmes should be designed in programmes’ and institutions’ QMSs. Quality of a joint master programme cannot be analyzed separately from the higher education institutions which are organizing it. Comparative analysis of organization of one Erasmus Mundus Master programme to the solutions proposed in discussion showed that from all of the aspects considered, processes in EMQAL are organized in harmony with the proposed delegation of processes of the QMS for a joint master programme. The solutions proposed in the discussion are based on theoretical application of the quality principles and concepts. Comparison to the quality processes and procedures in an existing EM programme showed that analysis is applicable in practice.

Os processos de regulação educativa no programa alimentar : um estudo de caso na autarquia de Cascais

Relatório de estágio de mestrado, Educação (Área de especialização Administração Educacional), Universidade de Lisboa, Instituto de Educação, 2015

The Wilderness Expedition: An effective life course intervention to improve young peoples well-being and connectedness to nature

It is well understood that wilderness expeditions improve well-being; however, there is little supporting quantitative data. The aim of this study was to measure the impact of wilderness expeditions on self-esteem (SE) and connectedness to nature (CN) and assess whether benefits varied according to participant and expedition characteristics. SE and CN were assessed pre– and post–wilderness expeditions in 130 adolescents using Rosenberg’s SE scale and the state CN scale. Two-way ANOVA revealed significant increases in SE and CN (p < .001) as a result of single expeditions. There was also an interaction effect of expedition and gender on SE (p < .05). Males had a higher SE at the start but female SE increased most. Linear regression revealed that living environment, gender, and the length and location of the expedition did not contribute to changes in SE and CN. Regular contact with natural environments will improve adolescent well-being, with the largest improvements in females.

Potenciar a consciência fonológica de crianças pré-escolares em contexto naturalístico

Dissertação apresentada à Escola Superior de Educação de Lisboa para obtenção de grau de mestre em Ciências da Educação Especialidade Intervenção Precoce

Phonological and articulation treatment approaches in Portuguese children with speech and language impairments: a randomized controlled intervention study

Background: In Portugal, the routine clinical practice of speech and language therapists (SLTs) in treating children with all types of speech sound disorder (SSD) continues to be articulation therapy (AT). There is limited use of phonological therapy (PT) or phonological awareness training in Portugal. Additionally, at an international level there is a focus on collecting information on and differentiating between the effectiveness of PT and AT for children with different types of phonologically based SSD, as well as on the role of phonological awareness in remediating SSD. It is important to collect more evidence for the most effective and efficient type of intervention approach for different SSDs and for these data to be collected from diverse linguistic and cultural perspectives. Aims: To evaluate the effectiveness of a PT and AT approach for treatment of 14 Portuguese children, aged 4.0–6.7 years, with a phonologically based SSD. Methods & Procedures: The children were randomly assigned to one of the two treatment approaches (seven children in each group). All children were treated by the same SLT, blind to the aims of the study, over three blocks of a total of 25 weekly sessions of intervention. Outcome measures of phonological ability (percentage of consonants correct (PCC), percentage occurrence of different phonological processes and phonetic inventory) were taken before and after intervention. A qualitative assessment of intervention effectiveness from the perspective of the parents of participants was included. Outcomes & Results: Both treatments were effective in improving the participants’ speech, with the children receiving PT showing a more significant improvement in PCC score than those receiving the AT. Children in the PT group also showed greater generalization to untreated words than those receiving AT. Parents reported both intervention approaches to be as effective in improving their children’s speech. Conclusions & Implications: The PT (combination of expressive phonological tasks, phonological awareness, listening and discrimination activities) proved to be an effective integrated method of improving phonological SSD in children. These findings provide some evidence for Portuguese SLTs to employ PT with children with phonologically based SSD

How to improve consumer decision skills in children? A case study of an intervention with institutionalized children

The aim of this study is to assess the institutionalized children’s skills as consumers but also to assess how we can improve their knowledge through an intervention. The sample was composed of two subgroups (38 institutionalized children and 36 non-institutionalized children). In order to assess children’s knowledge, a questionnaire and an interview were used. The method used as intervention was a 30-minute class. Results suggested that institutionalized children have lower levels of knowledge regarding consumption-related practices and lower levels of accuracy at estimating prices than non-institutionalized children. However, results also showed that the attitudes of institutionalized children towards advertising and making decisions based on price/quantity evaluation or based on the use of the same strategy in different situations are not significantly different from the non-institutionalized children. Regarding the intervention, it was possible to conclude that one class is not the best method to improve children’s knowledge. Institutionalized children need a longer and more practical intervention.

Reinvigorating and redesigning early intervention in psychosis services for young people in Auckland

RESUMO: Auckland tem sido pioneira na implementação de modelos de Intervenção Precoce em Psicose. No entanto, esta organização do serviço não mudou nos últimos 19 anos. Segundo os dados obtidos da utilização do serviço, no período de 1996 -2012 foram atendidos 997 doentes, que tinham um número médio de 89 contactos (IQR: 36-184), com uma duração média de 62 horas de contactos (IQR: 24-136). Estes doentes passaram um número médio de 338 dias (IQR: 93-757) em contacto com o programa. 517 doentes (52%) não necessitaram de internamento no hospital, e os que foram internados, ficaram uma mediana de 124 dias no hospital (IQR: 40-380). Os doentes asiáticos tiveram um aumento de 50% de probabilidade de serem internados no hospital. Este relatório inclui 15 recomendações para orientar as reformas para o serviço e, nomeadamente, delinear a importância de uma visão organizacional e dos seus componentes-chave. As recomendações incluem o reforço da gestão e da liderança numa estrutura de equipe mais integrada, com recursos dedicados a melhorar a consciencialização da comunidade, a educação e deteção precoce, bem como a capacidade de receber referenciações diretas. Os Indicadores Chave de Desempenho devem ser estabelecidos, mas os Exames de Estado Mental em risco, devem ser removidos. Auckland deve manter a faixa etária alvo atual. A duração do serviço deve ser aumentada para um mínimo de três anos, com a opção de aumentá-la para cinco anos. A proporção de gestor de cuidados para os doentes deve ser preconizada em 1:15, enquanto o pessoal de apoio não-clínico deve ser aumentado. Os psiquiatras devem ter uma carga de trabalho de cerca de 80 doentes por equivalente de tempo completo. Um serviço local de prestação de cuidados deve ser desenvolvido com, nomeadamente, intervenções culturais para responder às necessidades da população multicultural de Auckland. A capacidade de investigação deve ser incorporada no Serviço de Intervenção Precoce em Psicoses. Qualquer alteração deverá envolver contacto com todas as partes interessadas, e a Administração Regional de Saúde deve comprometer-se em tempo, recursos humanos e políticos para apoiar e facilitar a mudança do sistema, investindo de forma significativa para melhor servir a comunidade Auckland.----------------------------------- ABSTRACT: Auckland has been pioneering in the adoption of Early Intervention in Psychosis models but the design of the service has not changed in 19 years. In service utilisation data from 997 patients seen from 1996 -2012, patients had a median number of 89 contacts (IQR: 36-184), with a median duration of 62 hours of contact (IQR: 24-136). Patients spent a median number of 338 days (IQR: 93-757) in contact with the program. 517 patients (52%) did not require admission to hospital, and those who did spent a median of 124 days in hospital (IQR: 40-380). Asian patients had a 50% increased chance of being admitted to hospital. This report includes 15 recommendations to guide reforms to the service, including outlining the importance of vision and key components. It recommends strengthened managerial leadership and a more integrated team structure with dedicated resources for improved community awareness, education and early detection as well as the capacity to take direct referrals. Key Performance Indicators (KPIs) should be established but At Risk Mental States should be excluded. Auckland should maintain the current target age range. The duration of service should be increased to a minimum of three years, with the option to extend this to five years. The ratio of care co-ordinator to patients should be capped at 1:15 whilst non-clinical supporting staff should be increased. Psychiatrists should have a caseload of about 80 per FTE. A local Service Delivery framework should be developed, as should cultural interventions to meet the needs of the multicultural population of Auckland. Research capacity should be incorporated into the fabric of Early Intervention in Psychosis Services. Any changes should involve consultation with all stakeholders, and the DHB should commit to investing time, human and political resources to support and facilitate meaningful system change to best serve the Auckland community.