Effects of a book gifting programme on literacy outcomes for foster children: A randomised controlled trial evaluation of the Letterbox Club in Northern Ireland

The poor educational outcomes of children in care is a significant concern internationally. Whilst there have been many interventions developed to address this problem, very few of these have been rigorously evaluated. This article presents the findings of a randomised controlled trial that sought to measure the effectiveness of a book gifting programme (the Letterbox Club) that aims to improve literacy skills amongst children aged 7-11 years in foster care. The programme involves children receiving six parcels of books sent through the post over a six-month period. The trial, which ran between April 2013 and June 2014, involved a sample of 116 children in Northern Ireland (56 randomly allocated to the intervention group and 60 to a waiting list control group). Outcome measures focused on reading skills (reading accuracy, comprehension and rate) and attitudes to reading and school. The trial found no evidence that the book-gifting programme had any effect on any of the outcomes measured. Drawing upon some of the emergent themes from the accompanying qualitative process evaluation that sought to determine foster carer/child attitude towards and engagement with the parcels, it is suggested that one plausible reason for the ineffectiveness of the Letterbox Club, as intimated by carers and children (rather than explicitly explored with them), is the lack of support provided to the carers/children in relation to the packs received. Reflective of an ecological model of children’s development, it is recommended that for book-gifting programmes to be effective they need to include a focus on encouraging the direct involvement of foster carers in shared literacy activities with the children using the books that are gifted.

Evaluation of 'Dementia Friends' programme for undergraduate nursing students: Innovative practice.

The ‘dementia friends’ programme was launched by the Alzheimer’s Society in the UK two years ago with the purpose of educating members of the public about the things they can do which can enhance the lives of people living with dementia. The aim of this project was to deliver a two-hour ‘Dementia Friendly Community Workshop’ written by the Alzheimer’s Society, to an entire cohort of first-year undergraduate nursing students in one Higher Education Institutions in Northern Ireland. Following delivery of the programme, students were asked to complete a short questionnaire on their knowledge and confidence in relation to dementia care before and after the Dementia Friendly Community programme. A total of 322 undergraduate first-year nursing students took part in the Dementia Friendly Community programme. Of these, 304 returned questionnaires; 31.25% of students stated their perceived improvement in dementia knowledge was ‘good’ while 49.01% stated their perceived improvement in dementia knowledge was ‘very good’ and 13.49% stated their perceived improvement in dementia knowledge was ‘excellent’. In relation to confidence in engaging with people with dementia, 31.91% stated ‘good’ improvement, 40.79% stated ‘very good’ improvement and 11.84% stated ‘excellent’ improvement. The Dementia Friendly Community programme was positively reviewed by the undergraduate students as it enhanced knowledge and confidence in relation to care of someone living with dementia.

Evaluating the social effects of the EU URBAN Community Initiative Programme

This article explores alternative interpretations of the meaning and method of urban policy evaluation within the European Union (EU) Structural Funds. Using the EU URBAN Community Initiative Programme 1994-1999 it draws a distinction between 'instrumental' techniques that are primarily concerned with performance and efficiency measures and 'interpretative' approaches that stress the need to explore power relationships in the development and delivery of spending programmes. Empirically, it reflects on the interpretation of EU guidance and the MEANS (Means for Evaluating Actions of a Structural Nature) Collection to evaluate the Derry/Londonderry (UK) URBAN Sub-programme 1994-1999. The analysis concludes by emphasizing the need to ensure that urban policy evaluation is consistent with the broader social turn in the scope and content of regeneration programmes.

Targeting social need in a divided society: an evaluation of a community-based adult education initiative

This article examines the impact of a community-based adult education initiative designed to target social need in Northern Ireland. Set against a backdrop of extreme civil unrest and disadvantageous socio-economic conditions a cohort of adults was identified to participate in a personal and social development programme. The initiative was funded from Peace and Reconciliation resources made available to Northern Ireland by the European Union. High levels of unemployment and negativity about previous learning experiences were characteristic features among participants. An evaluation of the effectiveness of the programme was carried out and a follow-up qualitative survey ensued 6 months after the completion of the training. Results indicate that the learner-centred methodology was effective in providing a gateway to further education and training and enhancing participants' self-esteem, confidence, motivation, tolerance, social skills, community involvement and

The effects of a volunteer mentoring programme on reading outcomes among eight- to nine-year-old children: A follow up randomized controlled trial

This article presents the findings of a randomized controlled trial evaluation of the effects of a revised version of the volunteer mentoring programme, Time to Read. Participating children received two 30-minute mentoring sessions per week from volunteer mentors who carried out paired reading activities with the children. The current trial involved 512 children aged eight to nine years from 50 primary schools. The programme was found to be effective in improving decoding skills (d=+.15), reading rate (d=+.22) and reading fluency (d=+.14) and there was some evidence of a positive effect in relation to the children’s aspirations for the future (d=+.11). However, no evidence was found of the programme having an effect on reading comprehension or reading confidence and enjoyment of reading. The article concludes by suggesting that mentoring programmes using non-specialist volunteers can be effective in improving foundational reading skills but would appear to be less effective in terms of improving higher-order skills such as comprehension. The article also suggests that such programmes are likely to be most effective if concentrating on core reading activities rather than attempting to address reading outcomes indirectly through improving children’s confidence or wider enjoyment of reading.

The challenges of joint working: lessons from the Supporting People Health Pilot evaluation

Purpose: This paper reports the findings of the evaluation of the Supporting People Health Pilots programme, which was established to demonstrate the policy links between housing support services and health and social care services by encouraging the development of integrated services. The paper highlights the challenges Method: The evaluation of the six health pilots rested on two main sources of data collection: Quarterly Project Evaluation Reports collected process data as well as reporting progress against aims and objectives. Semi-structured interviews—conducted across all key professional stakeholder groups and agencies and with people who used services—explored their experiences of these new services. Results: The ability of pilots to work across organisational boundaries to achieve their aims and objectives was associated not only with agencies sharing an understanding of the purpose of the joint venture, a history of joint working and clear and efficient governance arrangements but on two other characteristics: the extent and nature of statutory sector participation and, whether or not the service is defined by a history of voluntary sector involvement. In particular the pilots demonstrated how voluntary sector agencies appeared to be less constrained by organisational priorities and professional agenda and more able to respond flexibly to meet the complex needs of individuals. Conclusion and discussion: The pilots demonstrate that integrating services to support people with complex needs works best

Surveillance for ocular hypertension: An evidence synthesis and economic evaluation

OBJECTIVES: To determine effective and efficient monitoring criteria for ocular hypertension [raised intraocular pressure (IOP)] through (i) identification and validation of glaucoma risk prediction models; and (ii) development of models to determine optimal surveillance pathways.

DESIGN: A discrete event simulation economic modelling evaluation. Data from systematic reviews of risk prediction models and agreement between tonometers, secondary analyses of existing datasets (to validate identified risk models and determine optimal monitoring criteria) and public preferences were used to structure and populate the economic model.

SETTING: Primary and secondary care.

PARTICIPANTS: Adults with ocular hypertension (IOP > 21 mmHg) and the public (surveillance preferences).

INTERVENTIONS: We compared five pathways: two based on National Institute for Health and Clinical Excellence (NICE) guidelines with monitoring interval and treatment depending on initial risk stratification, 'NICE intensive' (4-monthly to annual monitoring) and 'NICE conservative' (6-monthly to biennial monitoring); two pathways, differing in location (hospital and community), with monitoring biennially and treatment initiated for a ≥ 6% 5-year glaucoma risk; and a 'treat all' pathway involving treatment with a prostaglandin analogue if IOP > 21 mmHg and IOP measured annually in the community.

MAIN OUTCOME MEASURES: Glaucoma cases detected; tonometer agreement; public preferences; costs; willingness to pay and quality-adjusted life-years (QALYs).

RESULTS: The best available glaucoma risk prediction model estimated the 5-year risk based on age and ocular predictors (IOP, central corneal thickness, optic nerve damage and index of visual field status). Taking the average of two IOP readings, by tonometry, true change was detected at two years. Sizeable measurement variability was noted between tonometers. There was a general public preference for monitoring; good communication and understanding of the process predicted service value. 'Treat all' was the least costly and 'NICE intensive' the most costly pathway. Biennial monitoring reduced the number of cases of glaucoma conversion compared with a 'treat all' pathway and provided more QALYs, but the incremental cost-effectiveness ratio (ICER) was considerably more than £30,000. The 'NICE intensive' pathway also avoided glaucoma conversion, but NICE-based pathways were either dominated (more costly and less effective) by biennial hospital monitoring or had a ICERs > £30,000. Results were not sensitive to the risk threshold for initiating surveillance but were sensitive to the risk threshold for initiating treatment, NHS costs and treatment adherence.

LIMITATIONS: Optimal monitoring intervals were based on IOP data. There were insufficient data to determine the optimal frequency of measurement of the visual field or optic nerve head for identification of glaucoma. The economic modelling took a 20-year time horizon which may be insufficient to capture long-term benefits. Sensitivity analyses may not fully capture the uncertainty surrounding parameter estimates.

CONCLUSIONS: For confirmed ocular hypertension, findings suggest that there is no clear benefit from intensive monitoring. Consideration of the patient experience is important. A cohort study is recommended to provide data to refine the glaucoma risk prediction model, determine the optimum type and frequency of serial glaucoma tests and estimate costs and patient preferences for monitoring and treatment.

FUNDING: The National Institute for Health Research Health Technology Assessment Programme.

The clinical effectiveness and cost-effectiveness of screening for open angle glaucoma:A systematic review and economic evaluation

Objectives: To assess whether open angle glaucoma (OAG) screening meets the UK National Screening Committee criteria, to compare screening strategies with case finding, to estimate test parameters, to model estimates of cost and cost-effectiveness, and to identify areas for future research. Data sources: Major electronic databases were searched up to December 2005. Review methods: Screening strategies were developed by wide consultation. Markov submodels were developed to represent screening strategies. Parameter estimates were determined by systematic reviews of epidemiology, economic evaluations of screening, and effectiveness (test accuracy, screening and treatment). Tailored highly sensitive electronic searches were undertaken. Results: Most potential screening tests reviewed had an estimated specificity of 85% or higher. No test was clearly most accurate, with only a few, heterogeneous studies for each test. No randomised controlled trials (RCTs) of screening were identified. Based on two treatment RCTs, early treatment reduces the risk of progression. Extrapolating from this, and assuming accelerated progression with advancing disease severity, without treatment the mean time to blindness in at least one eye was approximately 23 years, compared to 35 years with treatment. Prevalence would have to be about 3-4% in 40 year olds with a screening interval of 10 years to approach cost-effectiveness. It is predicted that screening might be cost-effective in a 50-year-old cohort at a prevalence of 4% with a 10-year screening interval. General population screening at any age, thus, appears not to be cost-effective. Selective screening of groups with higher prevalence (family history, black ethnicity) might be worthwhile, although this would only cover 6% of the population. Extension to include other at-risk cohorts (e.g. myopia and diabetes) would include 37% of the general population, but the prevalence is then too low for screening to be considered cost-effective. Screening using a test with initial automated classification followed by assessment by a specialised optometrist, for test positives, was more cost-effective than initial specialised optometric assessment. The cost-effectiveness of the screening programme was highly sensitive to the perspective on costs (NHS or societal). In the base-case model, the NHS costs of visual impairment were estimated as £669. If annual societal costs were £8800, then screening might be considered cost-effective for a 40-year-old cohort with 1% OAG prevalence assuming a willingness to pay of £30,000 per quality-adjusted life-year. Of lesser importance were changes to estimates of attendance for sight tests, incidence of OAG, rate of progression and utility values for each stage of OAG severity. Cost-effectiveness was not particularly sensitive to the accuracy of screening tests within the ranges observed. However, a highly specific test is required to reduce large numbers of false-positive referrals. The findings that population screening is unlikely to be cost-effective are based on an economic model whose parameter estimates have considerable uncertainty, in particular, if rate of progression and/or costs of visual impairment are higher than estimated then screening could be cost-effective. Conclusions: While population screening is not cost-effective, the targeted screening of high-risk groups may be. Procedures for identifying those at risk, for quality assuring the programme, as well as adequate service provision for those screened positive would all be needed. Glaucoma detection can be improved by increasing attendance for eye examination, and improving the performance of current testing by either refining practice or adding in a technology-based first assessment, the latter being the more cost-effective option. This has implications for any future organisational changes in community eye-care services. Further research should aim to develop and provide quality data to populate the economic model, by conducting a feasibility study of interventions to improve detection, by obtaining further data on costs of blindness, risk of progression and health outcomes, and by conducting an RCT of interventions to improve the uptake of glaucoma testing. © Queen's Printer and Controller of HMSO 2007. All rights reserved.

Evaluation of a Final Year Work-shadowing Attachment

The transition from medical student to junior doctor is well recognised to be a difficult and stressful period. To ease this transition, most UK universities have a work-shadowing period (WSP), during which students can learn practical skills needed for forthcoming employment. The aim of this study was to evaluate the WSP at Queen's University Belfast, and gain the views of both students and Foundation Programme Supervisors and Directors (FPSDs). The study utilised both qualitative (focus groups) and quantitative (questionnaires) approaches. The FPSDs completed a specific questionnaire designed for this study, while the students completed the university's internal quality assurance questionnaire. Twenty-eight of the 37 (76%) FPSDs and 106 / 196 (54%) students completed the questionnaires. Focus groups were conducted with up to 10 students in each group in both a regional centre and a district general hospital at the start and the end of the WSP as well as 8 weeks into working life. The transcripts of the focus groups were analysed and themes identified. A number of deficiencies with the current WSP were identified, including concerns about the use of log books, the timing of the attachment and relatively low levels of supervision provided by senior hospital staff members. As a result, students felt unprepared for commencing work, with particular mention given to medical emergencies, prescribing, and the emotional aspects of the job. A number of recommendations are made, including the need for more senior input to ensure better student attendance, participation and clinical interaction. Furthermore, students should be offered additional supervised responsibility for delivery of patient care and more experiential learning with respect to drug prescribing and administration. The study also suggests that more needs to be done to help ease the emotional and psychological stresses of the early FY1 period. These issues have been resolved to a large extent with the introduction of the new final year Student Assistantship module in the academic year 2010-2011. © The Ulster Medical Society, 2012.

A cluster randomised controlled trial of “Bookstart+”: a book gifting programme

Purpose – The purpose of this paper is to evaluate the effectiveness of a free book gifting programme, called “Bookstart+”, in improving family reading outcomes.

Design/methodology/approach – Bookstart+ consists of a pack of books and reading materials provided to families at their two-year-old child's statutory health visit. The pack is accompanied by a short priming demonstration, delivered by the health visitor, on shared reading. The evaluation took the form of a randomised controlled trial (RCT) with 460 families from the client lists of 115 health visitors.

Findings – The study found evidence of: a positive significant effect on parents’ attitudes to reading and books (Cohen's d=+0.192, p=0.034); no significant effect on parental attitudes to their child reading (d=+0.085, p=0.279); and a negative effect, approaching significance, on public library usage (d=-0.160, p=0.055).

Research limitations/implications – The attrition rate was high, with only 43.9 per cent of the target families completing all of the research. However, this level of attrition did not lead to any significant differences between the control and intervention groups on their pre-test measures.

Practical implications – The study provides recommendations for free book gifting service provision in relation to pack contents and delivery.

Originality/value – This paper contributes to the limited international RCT evidence on free book gifting programmes.

Optical coherence tomography for the diagnosis, monitoring and guiding of treatment for neovascular age-related macular degeneration:a systematic review and economic evaluation

BACKGROUND: Age-related macular degeneration is the most common cause of sight impairment in the UK. In neovascular age-related macular degeneration (nAMD), vision worsens rapidly (over weeks) due to abnormal blood vessels developing that leak fluid and blood at the macula.

OBJECTIVES: To determine the optimal role of optical coherence tomography (OCT) in diagnosing people newly presenting with suspected nAMD and monitoring those previously diagnosed with the disease.

DATA SOURCES: Databases searched: MEDLINE (1946 to March 2013), MEDLINE In-Process & Other Non-Indexed Citations (March 2013), EMBASE (1988 to March 2013), Biosciences Information Service (1995 to March 2013), Science Citation Index (1995 to March 2013), The Cochrane Library (Issue 2 2013), Database of Abstracts of Reviews of Effects (inception to March 2013), Medion (inception to March 2013), Health Technology Assessment database (inception to March 2013).

REVIEW METHODS: Types of studies: direct/indirect studies reporting diagnostic outcomes.

INDEX TEST: time domain optical coherence tomography (TD-OCT) or spectral domain optical coherence tomography (SD-OCT).

COMPARATORS: clinical evaluation, visual acuity, Amsler grid, colour fundus photographs, infrared reflectance, red-free images/blue reflectance, fundus autofluorescence imaging, indocyanine green angiography, preferential hyperacuity perimetry, microperimetry. Reference standard: fundus fluorescein angiography (FFA). Risk of bias was assessed using quality assessment of diagnostic accuracy studies, version 2. Meta-analysis models were fitted using hierarchical summary receiver operating characteristic curves. A Markov model was developed (65-year-old cohort, nAMD prevalence 70%), with nine strategies for diagnosis and/or monitoring, and cost-utility analysis conducted. NHS and Personal Social Services perspective was adopted. Costs (2011/12 prices) and quality-adjusted life-years (QALYs) were discounted (3.5%). Deterministic and probabilistic sensitivity analyses were performed.

RESULTS: In pooled estimates of diagnostic studies (all TD-OCT), sensitivity and specificity [95% confidence interval (CI)] was 88% (46% to 98%) and 78% (64% to 88%) respectively. For monitoring, the pooled sensitivity and specificity (95% CI) was 85% (72% to 93%) and 48% (30% to 67%) respectively. The FFA for diagnosis and nurse-technician-led monitoring strategy had the lowest cost (£39,769; QALYs 10.473) and dominated all others except FFA for diagnosis and ophthalmologist-led monitoring (£44,649; QALYs 10.575; incremental cost-effectiveness ratio £47,768). The least costly strategy had a 46.4% probability of being cost-effective at £30,000 willingness-to-pay threshold.

LIMITATIONS: Very few studies provided sufficient information for inclusion in meta-analyses. Only a few studies reported other tests; for some tests no studies were identified. The modelling was hampered by a lack of data on the diagnostic accuracy of strategies involving several tests.

CONCLUSIONS: Based on a small body of evidence of variable quality, OCT had high sensitivity and moderate specificity for diagnosis, and relatively high sensitivity but low specificity for monitoring. Strategies involving OCT alone for diagnosis and/or monitoring were unlikely to be cost-effective. Further research is required on (i) the performance of SD-OCT compared with FFA, especially for monitoring but also for diagnosis; (ii) the performance of strategies involving combinations/sequences of tests, for diagnosis and monitoring; (iii) the likelihood of active and inactive nAMD becoming inactive or active respectively; and (iv) assessment of treatment-associated utility weights (e.g. decrements), through a preference-based study.

STUDY REGISTRATION: This study is registered as PROSPERO CRD42012001930.

FUNDING: The National Institute for Health Research Health Technology Assessment programme.

Evaluation of a partnership between primary and secondary care providing an accessible Level 1 sexual health service in the community

Comprehensive testing for asymptomatic sexually transmitted infections in Northern Ireland has traditionally been provided by genitourinary medicine clinics. As patient demand for services has increased while budgets have remained limited, there has been increasing difficulty in accommodating this demand. In May 2013, the newly commissioned specialist Sexual Health service in the South Eastern Trust sought to pilot a new model of care working alongside a GP partnership of 12 practices. A training programme to enable GPs and practice nurses to deliver Level 1 sexual health care to heterosexual patients aged >16 years, in accordance with the standards of BASHH, was developed. A comprehensive care pathway and dedicated community health advisor supported this new model with close liaison between primary and secondary care. Testing for Chlamydia, gonorrhoea, HIV and syphilis was offered. The aims of the pilot were achieved, namely to provide accessible, cost-effective sexual health care within a framework of robust clinical governance. Furthermore, it uncovered a high positivity rate for Chlamydia, especially in young men attending their general practice, and demonstrated a high level of patient satisfaction. Moreover the capacity of secondary care to deliver Levels 2 and 3 services was increased.

An evaluation of Lab Tutor from the Nursing Student’s Perspective

The efficiency of large group teaching (lectures) has long been called into question with much research high lighting low levels of student participation, and poor attention spans leading to a lack of engagement with learning which inhibits deep learning. Small group teaching and Enquiry Based Learning (EBL) are methods of teaching that can help promote deep learning. There is also a growing need and demand for Technology Enhanced Learning to suit changing lifestyles. The Labtutor® System, is one such piece of software that is designed to incorporate EBL and small group teaching quality into the large group setting.

This study provides a descriptive survey of adult nursing student’s perceptions of the Labtutor system following its use in two Life Science modules within an undergraduate nursing programme. A convenience sample of first year adult nursing students (n= 115) were identified to complete a 32 item questionnaire (appendix three).
Participants reported overall that they enjoyed using the system and found it beneficial to their learning specifically:
(a) Increased engagement with material in online learning as a result of using the system.
(b) Increased participation and levels of interactivity in the lecture as a result of using the system.
(c) Increased enhancement of learning as a result of using the system and
(d) Usefulness of the formative assessment facilitated by using the system.

The study concludes that Labtutor® system and other such methods of Technology Enhanced Learning packages if used correctly can enhance learning.