Knowledge engineering for mental-health risk assessment and decision support

Mental-health risk assessment practice in the UK is mainly paper-based, with little standardisation in the tools that are used across the Services. The tools that are available tend to rely on minimal sets of items and unsophisticated scoring methods to identify at-risk individuals. This means the reasoning by which an outcome has been determined remains uncertain. Consequently, there is little provision for: including the patient as an active party in the assessment process, identifying underlying causes of risk, and eecting shared decision-making. This thesis develops a tool-chain for the formulation and deployment of a computerised clinical decision support system for mental-health risk assessment. The resultant tool, GRiST, will be based on consensual domain expert knowledge that will be validated as part of the research, and will incorporate a proven psychological model of classication for risk computation. GRiST will have an ambitious remit of being a platform that can be used over the Internet, by both the clinician and the layperson, in multiple settings, and in the assessment of patients with varying demographics. Flexibility will therefore be a guiding principle in the development of the platform, to the extent that GRiST will present an assessment environment that is tailored to the circumstances in which it nds itself. XML and XSLT will be the key technologies that help deliver this exibility.

A fuzzy levelised energy cost method for renewable energy technology assessment

Renewable energy project development is highly complex and success is by no means guaranteed. Decisions are often made with approximate or uncertain information yet the current methods employed by decision-makers do not necessarily accommodate this. Levelised energy costs (LEC) are one such commonly applied measure utilised within the energy industry to assess the viability of potential projects and inform policy. The research proposes a method for achieving this by enhancing the traditional discounting LEC measure with fuzzy set theory. Furthermore, the research develops the fuzzy LEC (F-LEC) methodology to incorporate the cost of financing a project from debt and equity sources. Applied to an example bioenergy project, the research demonstrates the benefit of incorporating fuzziness for project viability, optimal capital structure and key variable sensitivity analysis decision-making. The proposed method contributes by incorporating uncertain and approximate information to the widely utilised LEC measure and by being applicable to a wide range of energy project viability decisions. © 2013 Elsevier Ltd. All rights reserved.

Investigating mental health risk assessment in primary care and the potential role of a structured decision support tool, GRiST

Aim: To explore current risk assessment processes in general practice and Improving Access to Psychological Therapies (IAPT) services, and to consider whether the Galatean Risk and Safety Tool (GRiST) can help support improved patient care. Background: Much has been written about risk assessment practice in secondary mental health care, but little is known about how it is undertaken at the beginning of patients' care pathways, within general practice and IAPT services. Methods: Interviews with eight general practice and eight IAPT clinicians from two primary care trusts in the West Midlands, UK, and eight service users from the same region. Interviews explored current practice and participants' views and experiences of mental health risk assessment. Two focus groups were also carried out, one with general practice and one with IAPT clinicians, to review interview findings and to elicit views about GRiST from a demonstration of its functionality. Data were analysed using thematic analysis. Findings Variable approaches to mental health risk assessment were observed. Clinicians were anxious that important risk information was being missed, and risk communication was undermined. Patients felt uninvolved in the process, and both clinicians and patients expressed anxiety about risk assessment skills. Clinicians were positive about the potential for GRiST to provide solutions to these problems. Conclusions: A more structured and systematic approach to risk assessment in general practice and IAPT services is needed, to ensure important risk information is captured and communicated across the care pathway. GRiST has the functionality to support this aspect of practice.

Rapid testing for group B streptococcus during labour: a test accuracy study with evaluation of acceptability and cost-effectiveness

OBJECTIVE: To determine the accuracy, acceptability and cost-effectiveness of polymerase chain reaction (PCR) and optical immunoassay (OIA) rapid tests for maternal group B streptococcal (GBS) colonisation at labour. DESIGN: A test accuracy study was used to determine the accuracy of rapid tests for GBS colonisation of women in labour. Acceptability of testing to participants was evaluated through a questionnaire administered after delivery, and acceptability to staff through focus groups. A decision-analytic model was constructed to assess the cost-effectiveness of various screening strategies. SETTING: Two large obstetric units in the UK. PARTICIPANTS: Women booked for delivery at the participating units other than those electing for a Caesarean delivery. INTERVENTIONS: Vaginal and rectal swabs were obtained at the onset of labour and the results of vaginal and rectal PCR and OIA (index) tests were compared with the reference standard of enriched culture of combined vaginal and rectal swabs. MAIN OUTCOME MEASURES: The accuracy of the index tests, the relative accuracies of tests on vaginal and rectal swabs and whether test accuracy varied according to the presence or absence of maternal risk factors. RESULTS: PCR was significantly more accurate than OIA for the detection of maternal GBS colonisation. Combined vaginal or rectal swab index tests were more sensitive than either test considered individually [combined swab sensitivity for PCR 84% (95% CI 79-88%); vaginal swab 58% (52-64%); rectal swab 71% (66-76%)]. The highest sensitivity for PCR came at the cost of lower specificity [combined specificity 87% (95% CI 85-89%); vaginal swab 92% (90-94%); rectal swab 92% (90-93%)]. The sensitivity and specificity of rapid tests varied according to the presence or absence of maternal risk factors, but not consistently. PCR results were determinants of neonatal GBS colonisation, but maternal risk factors were not. Overall levels of acceptability for rapid testing amongst participants were high. Vaginal swabs were more acceptable than rectal swabs. South Asian women were least likely to have participated in the study and were less happy with the sampling procedure and with the prospect of rapid testing as part of routine care. Midwives were generally positive towards rapid testing but had concerns that it might lead to overtreatment and unnecessary interference in births. Modelling analysis revealed that the most cost-effective strategy was to provide routine intravenous antibiotic prophylaxis (IAP) to all women without screening. Removing this strategy, which is unlikely to be acceptable to most women and midwives, resulted in screening, based on a culture test at 35-37 weeks' gestation, with the provision of antibiotics to all women who screened positive being most cost-effective, assuming that all women in premature labour would receive IAP. The results were sensitive to very small increases in costs and changes in other assumptions. Screening using a rapid test was not cost-effective based on its current sensitivity, specificity and cost. CONCLUSIONS: Neither rapid test was sufficiently accurate to recommend it for routine use in clinical practice. IAP directed by screening with enriched culture at 35-37 weeks' gestation is likely to be the most acceptable cost-effective strategy, although it is premature to suggest the implementation of this strategy at present.

Levonorgestrel intrauterine system versus medical therapy for menorrhagia

Background - Menorrhagia is a common problem, yet evidence to inform decisions about therapy is limited. In a pragmatic, multicenter, randomized trial, we compared the levonorgestrel-releasing intrauterine system (levonorgestrel-IUS) with usual medical treatment in women with menorrhagia who presented to their primary care providers. Methods - We randomly assigned 571 women with menorrhagia to treatment with levonorgestrel-IUS or usual medical treatment (tranexamic acid, mefenamic acid, combined estrogen–progestogen, or progesterone alone). The primary outcome was the patient-reported score on the Menorrhagia Multi-Attribute Scale (MMAS) (ranging from 0 to 100, with lower scores indicating greater severity), assessed over a 2-year period. Secondary outcomes included general quality-of-life and sexual-activity scores and surgical intervention. Results - MMAS scores improved from baseline to 6 months in both the levonorgestrel-IUS group and the usual-treatment group (mean increase, 32.7 and 21.4 points, respectively; P<0.001 for both comparisons). The improvements were maintained over a 2-year period but were significantly greater in the levonorgestrel-IUS group than in the usual-treatment group (mean between-group difference, 13.4 points; 95% confidence interval, 9.9 to 16.9; P<0.001). Improvements in all MMAS domains (practical difficulties, social life, family life, work and daily routine, psychological well-being, and physical health) were significantly greater in the levonorgestrel-IUS group than in the usual-treatment group, and this was also true for seven of the eight quality-of-life domains. At 2 years, more of the women were still using the levonorgestrel-IUS than were undergoing the usual medical treatment (64% vs. 38%, P<0.001). There were no significant between-group differences in the rates of surgical intervention or sexual-activity scores. There were no significant differences in serious adverse events between groups. Conclusions - In women with menorrhagia who presented to primary care providers, the levonorgestrel-IUS was more effective than usual medical treatment in reducing the effect of heavy menstrual bleeding on quality of life. (Funded by the National Institute of Health Research Health Technology Assessment Programme; ECLIPSE Controlled-Trials.com number, ISRCTN86566246.)

Improving the economic value of photographic screening for optical coherence tomography-detectable macular oedema:a prospective, multicentre, UK study

Objectives: To determine the best photographic surrogate markers for detecting sight-threatening macular oedema (MO) in people with diabetes attending UK national screening programmes. Design: A multicentre, prospective, observational cohort study of 3170 patients with photographic signs of diabetic retinopathy visible within the macular region [exudates within two disc diameters, microaneurysms/dot haemorrhages (M/DHs) and blot haemorrhages (BHs)] who were recruited from seven study centres. Setting: All patients were recruited and imaged at one of seven study centres in Aberdeen, Birmingham, Dundee, Dunfermline, Edinburgh, Liverpool and Oxford. Participants: Subjects with features of diabetic retinopathy visible within the macular region attending one of seven diabetic retinal screening programmes. Interventions: Alternative referral criteria for suspected MO based on photographic surrogate markers; an optical coherence tomographic examination in addition to the standard digital retinal photograph. Main outcome measures: (1) To determine the best method to detect sight-threatening MO in people with diabetes using photographic surrogate markers. (2) Sensitivity and specificity estimates to assess the costs and consequences of using alternative strategies. (3) Modelled long-term costs and quality-adjusted life-years (QALYs). Results: Prevalence of MO was strongly related to the presence of lesions and was roughly five times higher in subjects with exudates or BHs or more than two M/DHs within one disc diameter. Having worse visual acuity was associated with about a fivefold higher prevalence of MO. Current manual screening grading schemes that ignore visual acuity or the presence of M/DHs could be improved by taking these into account. Health service costs increase substantially with more sensitive/less specific strategies. A fully automated strategy, using the automated detection of patterns of photographic surrogate markers, is superior to all current manual grading schemes for detecting MO in people with diabetes. The addition of optical coherence tomography (OCT) to each strategy, prior to referral, results in a reduction in costs to the health service with no decrement in the number of MO cases detected. Conclusions: Compared with all current manual grading schemes, for the same sensitivity, a fully automated strategy, using the automated detection of patterns of photographic surrogate markers, achieves a higher specificity for detecting MO in people with diabetes, especially if visual acuity is included in the automated strategy. Overall, costs to the health service are likely to increase if more sensitive referral strategies are adopted over more specific screening strategies for MO, for only very small gains in QALYs. The addition of OCT to each screening strategy, prior to referral, results in a reduction in costs to the health service with no decrement in the number of MO cases detected. © Queen's Printer and Controller of HMSO 2013.

A randomised controlled trial of the clinical effectiveness and cost-effectiveness of the levonorgestrel-releasing intrauterine system in primary care against standard treatment for menorrhagia:the ECLIPSE trial

BACKGROUND: Heavy menstrual bleeding (HMB) is a common problem, yet evidence to inform decisions about initial medical treatment is limited. OBJECTIVES: To assess the clinical effectiveness and cost-effectiveness of the levonorgestrel-releasing intrauterine system (LNG-IUS) (Mirena(®), Bayer) compared with usual medical treatment, with exploration of women's perspectives on treatment. DESIGN: A pragmatic, multicentre randomised trial with an economic evaluation and a longitudinal qualitative study. SETTING: Women who presented in primary care. PARTICIPANTS: A total of 571 women with HMB. A purposeful sample of 27 women who were randomised or ineligible owing to treatment preference participated in semistructured face-to-face interviews around 2 and 12 months after commencing treatment. INTERVENTIONS: LNG-IUS or usual medical treatment (tranexamic acid, mefenamic acid, combined oestrogen-progestogen or progesterone alone). Women could subsequently swap or cease their allocated treatment. OUTCOME MEASURES: The primary outcome was the patient-reported score on the Menorrhagia Multi-Attribute Scale (MMAS) assessed over a 2-year period and then again at 5 years. Secondary outcomes included general quality of life (QoL), sexual activity, surgical intervention and safety. Data were analysed using iterative constant comparison. A state transition model-based cost-utility analysis was undertaken alongside the randomised trial. Quality-adjusted life-years (QALYs) were derived from the European Quality of Life-5 Dimensions (EQ-5D) and the Short Form questionnaire-6 Dimensions (SF-6D). The intention-to-treat analyses were reported as cost per QALY gained. Uncertainty was explored by conducting both deterministic and probabilistic sensitivity analyses. RESULTS: The MMAS total scores improved significantly in both groups at all time points, but were significantly greater for the LNG-IUS than for usual treatment [mean difference over 2 years was 13.4 points, 95% confidence interval (CI) 9.9 to 16.9 points; p < 0.001]. However, this difference between groups was reduced and no longer significant by 5 years (mean difference in scores 3.9 points, 95% CI -0.6 to 8.3 points; p = 0.09). By 5 years, only 47% of women had a LNG-IUS in place and 15% were still taking usual medical treatment. Five-year surgery rates were low, at 20%, and were similar, irrespective of initial treatments. There were no significant differences in serious adverse events between groups. Using the EQ-5D, at 2 years, the relative cost-effectiveness of the LNG-IUS compared with usual medical treatment was £1600 per QALY, which by 5 years was reduced to £114 per QALY. Using the SF-6D, usual medical treatment dominates the LNG-IUS. The qualitative findings show that women's experiences and expectations of medical treatments for HMB vary considerably and change over time. Women had high expectations of a prompt effect from medical treatments. CONCLUSIONS: The LNG-IUS, compared with usual medical therapies, resulted in greater improvement over 2 years in women's assessments of the effect of HMB on their daily routine, including work, social and family life, and psychological and physical well-being. At 5 years, the differences were no longer significant. A similar low proportion of women required surgical intervention in both groups. The LNG-IUS is cost-effective in both the short and medium term, using the method generally recommended by the National Institute for Health and Care Excellence. Using the alternative measures to value QoL will have a considerable impact on cost-effectiveness decisions. It will be important to explore the clinical and health-care trajectories of the ECLIPSE (clinical effectiveness and cost-effectiveness of levonorgestrel-releasing intrauterine system in primary care against standard treatment for menorrhagia) trial participants to 10 years, by which time half of the cohort will have reached menopause. TRIAL REGISTRATION: Current Controlled Trials ISRCTN86566246. FUNDING: This project was funded by the NIHR Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 19, No. 88. See the NIHR Journals Library website for further project information.

Randomised trial of levonorgestrel intrauterine system compared to usual medical treatment for heavy menstrual bleeding:the ECLIPSE Trial

Objective: Heavy menstrual bleeding (menorrhagia) is a common problem, yet evidence is limited to inform therapeutic decisions.We compared the levonorgestrel-releasing intrauterine system(LNG-IUS) to usual medical treatment in a pragmatic randomised trial in primary care. Methods: We randomly assigned 571 women consulting their primary care providers with menorrhagia to LNG-IUS or to usual medical treatment as clinically appropriate (tranexamic acid, mefenamic acid, combined estrogen/progestogen or progestogen only). The primary outcome was a patient-reported measure ofimpact of menorrhagia, the validated Menorrhagia Multi-Attribute Scale (MMAS), assessed over 2 years. Secondary measures included generic quality of life (SF-36), sexual activity and surgical intervention.Results MMAS scores improved from baseline in both the LNG-IUS and usual medical treatment groups by 6 months (mean increases 32.7 points versus 21.4 points, respectively; P < 0.001for both) and were maintained over 2 years, but improvements were significantly greater with LNG-IUS (mean between-group difference 13.4 points, 95%CI, 9.9–16.9; P < 0.001).All domains of MMAS (practical difficulties, social life, family life,work/daily routine, psychological well being and physical health)improved significantly more with LNG-IUS, as were seven of the eight domains of SF-36. More women were still using LNG-IUSthan usual medical treatment at 2 years (64% versus 38%,P < 0.001). There were no significant between-group differences in surgical intervention rates or sexual activity scores. There were no serious adverse events in either group.Conclusions Among women presenting to primary care providers with menorrhagia, LNG-IUS was more effective than usual medical treatment at reducing the impact of this problem on their quality of life. In practice therefore, conventional treatments, such as tranexamic and mefenamic acid, remain helpful choices in women for whom LNG-IUS is considered unsuitable, or due to individual preference. For other women, LNG-IUS can be confidently recommended as an effective initial medical therapy for menorrhagia. Funding: This project was funded by the National Institute for Health Research Health Technology Assessment (NIHR HTA) Programme (project number 02/06/02)

Understanding data collection behaviour of mental health practitioners

Failure to detect patients at risk of attempting suicide can result in tragic consequences. Identifying risks earlier and more accurately helps prevent serious incidents occurring and is the objective of the GRiST clinical decision support system (CDSS). One of the problems it faces is high variability in the type and quantity of data submitted for patients, who are assessed in multiple contexts along the care pathway. Although GRiST identifies up to 138 patient cues to collect, only about half of them are relevant for any one patient and their roles may not be for risk evaluation but more for risk management. This paper explores the data collection behaviour of clinicians using GRiST to see whether it can elucidate which variables are important for risk evaluations and when. The GRiST CDSS is based on a cognitive model of human expertise manifested by a sophisticated hierarchical knowledge structure or tree. This structure is used by the GRiST interface to provide top-down controlled access to the patient data. Our research explores relationships between the answers given to these higher-level 'branch' questions to see whether they can help direct assessors to the most important data, depending on the patient profile and assessment context. The outcome is a model for dynamic data collection driven by the knowledge hierarchy. It has potential for improving other clinical decision support systems operating in domains with high dimensional data that are only partially collected and in a variety of combinations.

Development of science and technology policy for Kuwait

The status of Science and Technology in KUWAIT has been analysed in order to assess the extent of the application of Science and Technology needed for the Country's development. The design and implementation of a Science and Technology Policy has been examined to identify the appropriate technology necessary to improve KUWAIT's socio-economic-industrial structures. Following a general and critical review of the role of Science and Technology in the developing countries, the author has reviewed the past and contemporary employment of Science and Technology for development.of various sectors and the existence, if any, of any form (explicit, implicit, or both) of a Science and Technology Policy in KUWAIT. The thesis is structured to evaluate almost all of the sectors in KUWAIT which utilise Science and/or Technology, the effectiveness of such practices, their policymaking process, the channels by which policies were transformed into sources of influence through Governmental action and the impact that various policy instruments at the disposal of the the Government had on the development of S & T capabilities. The author has studied the implications of the absence of a Science and Technology Policy in Kuwait by examining some specific case studies, eg, the absence of a Technology Assessment Process and the negative impacts resulting from this; the ad-hoc allocation of the research and development budget instead of its being based on a percentage of GNP; the limitations imposed on the development of indigenous contracting companies and consultancy and engineering design offices; the impacts of the absence of Technology Transfer Centre, and so forth. As a consequence of the implications of the above studies, together with the negative results from the absence of an explicit Science and Technology Policy, eg, research and development activities do not relate to the national development plans, the author suggests that a Science and Technology Policy-Making Body should be established to formulate, develop, monitor and correlate the Science and Technology Activities in KUWAIT.

Development of a probabilistic graphical structure from a model of mental health clinical expertise

This thesis explores the process of developing a principled approach for translating a model of mental-health risk expertise into a probabilistic graphical structure. Probabilistic graphical structures can be a combination of graph and probability theory that provide numerous advantages when it comes to the representation of domains involving uncertainty, domains such as the mental health domain. In this thesis the advantages that probabilistic graphical structures offer in representing such domains is built on. The Galatean Risk Screening Tool (GRiST) is a psychological model for mental health risk assessment based on fuzzy sets. In this thesis the knowledge encapsulated in the psychological model was used to develop the structure of the probability graph by exploiting the semantics of the clinical expertise. This thesis describes how a chain graph can be developed from the psychological model to provide a probabilistic evaluation of risk that complements the one generated by GRiST’s clinical expertise by the decomposing of the GRiST knowledge structure in component parts, which were in turned mapped into equivalent probabilistic graphical structures such as Bayesian Belief Nets and Markov Random Fields to produce a composite chain graph that provides a probabilistic classification of risk expertise to complement the expert clinical judgements

Pulse oximetry as a screening test for congenital heart defects in newborn infants: a test accuracy study with evaluation of acceptability and cost-effectiveness

Background: Screening for congenital heart defects (CHDs) relies on antenatal ultrasound and postnatal clinical examination; however, life-threatening defects often go undetected. Objective: To determine the accuracy, acceptability and cost-effectiveness of pulse oximetry as a screening test for CHDs in newborn infants. Design: A test accuracy study determined the accuracy of pulse oximetry. Acceptability of testing to parents was evaluated through a questionnaire, and to staff through focus groups. A decision-analytic model was constructed to assess cost-effectiveness. Setting: Six UK maternity units. Participants: These were 20,055 asymptomatic newborns at = 35 weeks’ gestation, their mothers and health-care staff. Interventions: Pulse oximetry was performed prior to discharge from hospital and the results of this index test were compared with a composite reference standard (echocardiography, clinical follow-up and follow-up through interrogation of clinical databases). Main outcome measures: Detection of major CHDs – defined as causing death or requiring invasive intervention up to 12 months of age (subdivided into critical CHDs causing death or intervention before 28 days, and serious CHDs causing death or intervention between 1 and 12 months of age); acceptability of testing to parents and staff; and the cost-effectiveness in terms of cost per timely diagnosis. Results: Fifty-three of the 20,055 babies screened had a major CHD (24 critical and 29 serious), a prevalence of 2.6 per 1000 live births. Pulse oximetry had a sensitivity of 75.0% [95% confidence interval (CI) 53.3% to 90.2%] for critical cases and 49.1% (95% CI 35.1% to 63.2%) for all major CHDs. When 23 cases were excluded, in which a CHD was already suspected following antenatal ultrasound, pulse oximetry had a sensitivity of 58.3% (95% CI 27.7% to 84.8%) for critical cases (12 babies) and 28.6% (95% CI 14.6% to 46.3%) for all major CHDs (35 babies). False-positive (FP) results occurred in 1 in 119 babies (0.84%) without major CHDs (specificity 99.2%, 95% CI 99.0% to 99.3%). However, of the 169 FPs, there were six cases of significant but not major CHDs and 40 cases of respiratory or infective illness requiring medical intervention. The prevalence of major CHDs in babies with normal pulse oximetry was 1.4 (95% CI 0.9 to 2.0) per 1000 live births, as 27 babies with major CHDs (6 critical and 21 serious) were missed. Parent and staff participants were predominantly satisfied with screening, perceiving it as an important test to detect ill babies. There was no evidence that mothers given FP results were more anxious after participating than those given true-negative results, although they were less satisfied with the test. White British/Irish mothers were more likely to participate in the study, and were less anxious and more satisfied than those of other ethnicities. The incremental cost-effectiveness ratio of pulse oximetry plus clinical examination compared with examination alone is approximately £24,900 per timely diagnosis in a population in which antenatal screening for CHDs already exists. Conclusions: Pulse oximetry is a simple, safe, feasible test that is acceptable to parents and staff and adds value to existing screening. It is likely to identify cases of critical CHDs that would otherwise go undetected. It is also likely to be cost-effective given current acceptable thresholds. The detection of other pathologies, such as significant CHDs and respiratory and infective illnesses, is an additional advantage. Other pulse oximetry techniques, such as perfusion index, may enhance detection of aortic obstructive lesions.

Developing a probabilistic graphical structure from a model of mental-health clinical risk expertise

This paper explores the process of developing a principled approach for translating a model of mental-health risk expertise into a probabilistic graphical structure. The Galatean Risk Screening Tool [1] is a psychological model for mental health risk assessment based on fuzzy sets. This paper details how the knowledge encapsulated in the psychological model was used to develop the structure of the probability graph by exploiting the semantics of the clinical expertise. These semantics are formalised by a detailed specification for an XML structure used to represent the expertise. The component parts were then mapped to equivalent probabilistic graphical structures such as Bayesian Belief Nets and Markov Random Fields to produce a composite chain graph that provides a probabilistic classification of risk expertise to complement the expert clinical judgements. © Springer-Verlag 2010.

Defining an OWL ontology that could be used to integrate mental-health risk information within a decision support system

In the field of mental health risk assessment, there is no standardisation between the data used in different systems. As a first step towards the possible interchange of data between assessment tools, an ontology has been constructed for a particular one, GRiST (Galatean Risk Screening Tool). We briefly introduce GRiST and its data structures, then describe the ontology and the benefits that have already been realised from the construction process. For example, the ontology has been used to check the consistency of the various trees used in the model. We then consider potential uses in integration of data from other sources. © 2009 IEEE.