Classification of cancer-related death certificates using machine learning

Background Cancer monitoring and prevention relies on the critical aspect of timely notification of cancer cases. However, the abstraction and classification of cancer from the free-text of pathology reports and other relevant documents, such as death certificates, exist as complex and time-consuming activities. Aims In this paper, approaches for the automatic detection of notifiable cancer cases as the cause of death from free-text death certificates supplied to Cancer Registries are investigated. Method A number of machine learning classifiers were studied. Features were extracted using natural language techniques and the Medtex toolkit. The numerous features encompassed stemmed words, bi-grams, and concepts from the SNOMED CT medical terminology. The baseline consisted of a keyword spotter using keywords extracted from the long description of ICD-10 cancer related codes. Results Death certificates with notifiable cancer listed as the cause of death can be effectively identified with the methods studied in this paper. A Support Vector Machine (SVM) classifier achieved best performance with an overall F-measure of 0.9866 when evaluated on a set of 5,000 free-text death certificates using the token stem feature set. The SNOMED CT concept plus token stem feature set reached the lowest variance (0.0032) and false negative rate (0.0297) while achieving an F-measure of 0.9864. The SVM classifier accounts for the first 18 of the top 40 evaluated runs, and entails the most robust classifier with a variance of 0.001141, half the variance of the other classifiers. Conclusion The selection of features significantly produced the most influences on the performance of the classifiers, although the type of classifier employed also affects performance. In contrast, the feature weighting schema created a negligible effect on performance. Specifically, it is found that stemmed tokens with or without SNOMED CT concepts create the most effective feature when combined with an SVM classifier.

Automatic ICD-10 classification of cancers from free-text death certificates

Objective Death certificates provide an invaluable source for cancer mortality statistics; however, this value can only be realised if accurate, quantitative data can be extracted from certificates – an aim hampered by both the volume and variable nature of certificates written in natural language. This paper proposes an automatic classification system for identifying cancer related causes of death from death certificates. Methods Detailed features, including terms, n-grams and SNOMED CT concepts were extracted from a collection of 447,336 death certificates. These features were used to train Support Vector Machine classifiers (one classifier for each cancer type). The classifiers were deployed in a cascaded architecture: the first level identified the presence of cancer (i.e., binary cancer/nocancer) and the second level identified the type of cancer (according to the ICD-10 classification system). A held-out test set was used to evaluate the effectiveness of the classifiers according to precision, recall and F-measure. In addition, detailed feature analysis was performed to reveal the characteristics of a successful cancer classification model. Results The system was highly effective at identifying cancer as the underlying cause of death (F-measure 0.94). The system was also effective at determining the type of cancer for common cancers (F-measure 0.7). Rare cancers, for which there was little training data, were difficult to classify accurately (F-measure 0.12). Factors influencing performance were the amount of training data and certain ambiguous cancers (e.g., those in the stomach region). The feature analysis revealed a combination of features were important for cancer type classification, with SNOMED CT concept and oncology specific morphology features proving the most valuable. Conclusion The system proposed in this study provides automatic identification and characterisation of cancers from large collections of free-text death certificates. This allows organisations such as Cancer Registries to monitor and report on cancer mortality in a timely and accurate manner. In addition, the methods and findings are generally applicable beyond cancer classification and to other sources of medical text besides death certificates.

Teaching cause-of-death certification : lessons from international experience

The accuracy of cause-of-death statistics substantially depends on the quality of cause-of-death information in death certificates, primarily completed by medical doctors. Deficiencies in cause-of-death certification have been observed across the world, and over time. Despite educational interventions targeting to improve the quality of death certification, their intended impacts are rarely evaluated. This review aims to provide empirical evidence that could guide the modification of existing educational programs, or the development of new interventions, which are necessary to improve the capacity of certifiers as well as the quality of cause-of-death certification, and thereby, the quality of mortality statistics.

An accessible method for teaching doctors about death certification

The World Health Organization recommends that data on mortality in its member countries are collected utilising the Medical Certificate of Cause of Death published in the instruction volume of the ICD-10. However, investment in health information processes necessary to promote the use of this certificate and improve mortality information is lacking in many countries. An appeal for support to make improvements has been launched through the Health Metrics Network’s MOVE-IT strategy (Monitoring of Vital Events – Information Technology) [World Health Organization, 2011]. Despite this international spotlight on the need for capture of mortality data and in the use of the ICD-10 to code the data reported on such certificates, there is little cohesion in the way that certifiers of deaths receive instruction in how to complete the death certificate, which is the main source document for mortality statistics. Complete and accurate documentation of the immediate, underlying and contributory causes of death of the decedent on the death certificate is a requirement to produce standardised statistical information and to the ability to produce cause-specific mortality statistics that can be compared between populations and across time. This paper reports on a research project conducted to determine the efficacy and accessibility of the certification module of the WHO’s newly-developed web based training tool for coders and certifiers of deaths. Involving a population of medical students from the Fiji School of Medicine and a pre and post research design, the study entailed completion of death certificates based on vignettes before and after access to the training tool. The ability of the participants to complete the death certificates and analysis of the completeness and specificity of the ICD-10 coding of the reported causes of death were used to measure the effect of the students’ learning from the training tool. The quality of death certificate completion was assessed using a Quality Index before and after the participants accessed the training tool. In addition, the views of the participants about accessibility and use of the training tool were elicited using a supplementary questionnaire. The results of the study demonstrated improvement in the ability of the participants to complete death certificates completely and accurately according to best practice. The training tool was viewed very positively and its implementation in the curriculum for medical students was encouraged. Participants also recommended that interactive discussions to examine the certification exercises would be an advantage.

Intake rigour : ensuring only “reportable deaths” become coroners’ cases

The failure of medical practitioners to consistently discharge their obligation to report sudden or unnatural deaths to coroners has rightly prompted concern. Following recent public scandals, coroners and health authorities have increasingly developed procedures to ensure that concerning deaths are reported to coroners. However, the negative consequences of deaths being unnecessarily reported have received less attention: unnecessary intrusion into bereavement; a waste of public resources; and added delay and hindrance to the investigation of matters needing a coroner’s attention. Traditionally, coroners have largely, unquestioningly assumed jurisdiction over any deaths for which a medical practitioner has not issued a cause of death certificate. The Office of the State Coroner in Queensland has recently trialled a system to more rigorously assess whether deaths apparently resulting from natural causes, which have been reported to a coroner, should be investigated by the coroner, rather than being finalised by a doctor issuing a cause of death certificate. This article describes that trial and its results.

Gesturing elsewhere: the identity politics of the Balinese death/thrash metal scene

This essay explores the political significance of Balinese death/thrash fandom. In the early 1990s, the emergence of a death/thrash scene in Bali paralleled growing criticism of accelerated tourism development on the island. Specifically, locals protested the increasing ubiquity of Jakarta, 'the centre', cast as threatening to an authentically 'low', peripheral Balinese culture. Similarly, death/thrash enthusiasts also gravitated toward certain fringes, although they rejected dominant notions of Balinese-ness by gesturing elsewhere, toward a global scene. The essay explores the ways in which death/thrash enthusiasts engaged with local discourses by coveting their marginality, and aims to demonstrate how their articulations of 'alien-ness' contributed in important ways to a broader regionalism.

Factors associated with the wish to hasten death : a study of patients with terminal illness

Background. There is considerable debate regarding the clinical issues surrounding the wish to hasten death (WTHD) in the terminally ill. The clinical factors contributing to the WTHD need further investigation among the terminally ill in order to enhance understanding of the clinical assessment and treatment needs that underlie this problem. A more detailed understanding may assist with the development of appropriate therapeutic interventions. Method. A sample of terminally ill cancer patients (N=256) recruited from an in-patient hospice unit, home palliative care service and a general hospital palliative care consulting service from Brisbane Australia between 1998–2001 completed a questionnaire assessing psychological (depression and anxiety), social (family relationship, social support, level of burden on others) and the impact of physical symptoms. The association between these factors and the WTHD was investigated. Results. A high WTHD was reported by 14% of patients. A discriminant function analysis revealed that the following variables were associated with a high WTHD (P<0·001): higher levels of depressive symptoms, being admitted to an in-patient hospice setting, a greater perception of being a burden on others, lower family cohesion, lower levels of social support, higher levels of anxiety and greater impact of physical symptoms. Conclusions. Psychological and social factors are related to a WTHD among terminally ill cancer patients. Greater attention needs to be paid to the assessment of psychological and social issues in order to provide appropriate therapeutic interventions for terminally ill patients.

Doctors and their patients : A context for understanding the wish to hasten death

There is a paucity of research that has directly examined the role of the health professional in dealing with a terminally ill patient's wish to hasten death (WTHD) and the implications of this for the support and services needed in the care for a dying patient. Themes to emerge from a qualitative analysis of interviews conducted on doctors (n=24) involved in the treatment and care of terminally ill patients were (i) the doctors' experiences in caring for their patients (including themes of emotional demands/expectations, the duration of illness, and the availability of palliative care services); (ii) the doctors' perception of the care provided to their respective patients (comprising themes concerning satisfaction with the care for physical symptoms, for emotional symptoms, or overall care); (iii) the doctors' attitudes to euthanasia and (iv) the doctors' perception of their patients' views/beliefs regarding euthanasia and hastened death. When responses were categorised according to the patients' level of a WTHD, the theme concerning the prolonged nature of the patients' illnesses was prominent in the doctor group who had patients with the highest WTHD, whereas there was only a minority of responses concerning support from palliative care services and satisfaction with the level of emotional care in this group. This exploratory study presents a set of descriptive findings identifying themes among a small group of doctors who have been involved in the care of terminally ill cancer patients, to investigate factors that may be associated with the WTHD among these patients. The pattern of findings suggest that research investigating the doctor-patient interaction in this setting may add to our understanding of the problems (for patients and their doctors) that underpins the wish to hasten death in the terminally ill.