Cardiovascular risk prediction model development and assessment

The aim of this article is to review the development and assessment of cardiovascular risk prediction models and to discuss the predictive value of a risk factor as well as to introduce new assessment methods to evaluate a risk prediction model. Many cardiovascular risk prediction models have been developed during the past three decades. However, there has not been consistent agreement regarding how to appropriately assess a risk prediction model, especially when new markers are added to an existing model. The area under the receiver operating characteristic (ROC) curve has traditionally been used to assess the discriminatory ability of a risk prediction model. However, recent studies suggest that this method has its limitations and cannot be the sole approach to evaluate the usefulness of a new marker. New assessment methods are being developed to appropriately assess a risk prediction model and they will be gradually used in clinical and epidemiological studies.

Overview of risk prediction models in cardiovascular disease research

Many risk prediction models have been developed for cardiovascular diseases in different countries during the past three decades. However, there has not been consistent agreement regarding how to appropriately assess a risk prediction model, especially when new markers are added to an established risk prediction model. Researchers often use the area under the receiver operating characteristic curve (ROC) to assess the discriminatory ability of a risk prediction model. However, recent studies suggest that this method has serious limitations and cannot be the sole approach to evaluate the usefulness of a new marker in clinical and epidemiological studies. To overcome the shortcomings of this traditional method, new assessment methods have been proposed. The aim of this article is to overview various risk prediction models for cardiovascular diseases, to describe the receiver operating characteristic curve method and discuss some new assessment methods proposed recently. Some of the methods were illustrated with figures from a cardiovascular disease study in Australia.

Does the polygraph lead to better risk prediction for sexual offenders?

The polygraph is receiving increased attention surrounding its ability to facilitate more honest disclosures from sexual offenders concerning risk-related information (e.g., historical risk factors and acute-dynamic risk factors). In addition, the polygraph has become accepted as a standard containment tool in the US, although UK professionals appear to have taken a more cautionary approach. The aim of this review is to provide a basic overview of current risk assessment procedure in the absence of the polygraph, and then to investigate studies that use the polygraph to enhance sexual offenders' risk assessments. Specifically, studies examining historical risk factors, stable-dynamic risk factors, and acute-dynamic risk factors are examined and evaluated. We conclude that there is reasonable evidence supporting polygraph use in some areas of risk assessment. However, the vast majority of studies suffers from serious confounds that should be taken into account by professionals who use the polygraph as a standard practice in sexual offender risk assessment and management. Finally, the future of the polygraph is discussed in light of the presented empirical evidence.

Framingham risk prediction equations for incidence of cardiovascular disease using detailed measures for smoking

Current prediction models for risk of cardiovascular disease (CVD) incidence incorporate smoking as a dichotomous yes/no measure. However, the risk of CVD associated with smoking also varies with the intensity and duration of smoking and there is a strong association between time since quitting and the risk of disease onset. This study aims to develop improved risk prediction equations for CVD incidence incorporating intensity and duration of smoking and time since quitting. The risk of developing a first CVD event was evaluated using a Cox’s model for participants in the Framingham offspring cohort who attended the fourth examination (1988–92) between the ages of 30 and 74 years and were free of CVD (n=3751). The full models based on the smoking variables and other risk factors, and reduced models based on the smoking variables and non-laboratory risk factors demonstrated good discrimination, calibration and global fit. The incorporation of both time since quitting among past smokers and pack-years among current smokers resulted in better predictive performance as compared to a dichotomous current/non-smoker measure and a current/quitter/never smoker measure. Compared to never smokers, the risk of CVD incidence increased with pack-years. Risk among those quitting more than five years prior to the baseline exam and within five years prior to the baseline exam were similar and twice as high as that of never smokers. A CVD risk equation incorporating the effects of pack-years and time since quitting provides an improved tool to quantify risk and guide preventive care.

An integrated framework for suicide risk prediction

Suicide is a major concern in society. Despite of great attention paid by the community with very substantive medico-legal implications, there has been no satisfying method that can reliably predict the future attempted or completed suicide. We present an integrated machine learning framework to tackle this challenge. Our proposed framework consists of a novel feature extraction scheme, an embedded feature selection process, a set of risk classifiers and finally, a risk calibration procedure. For temporal feature extraction, we cast the patient’s clinical history into a temporal image to which a bank of one-side filters are applied. The responses are then partly transformed into mid-level features and then selected in 1-norm framework under the extreme value theory. A set of probabilistic ordinal risk classifiers are then applied to compute the risk probabilities and further re-rank the features. Finally, the predicted risks are calibrated. Together with our Australian partner, we perform comprehensive study on data collected for the mental health cohort, and the experiments validate that our proposed framework outperforms risk assessment instruments by medical practitioners.

A meta-analysis of trabecular bone score in fracture risk prediction and its relationship to FRAX

Trabecular bone score (TBS) is a grey-level textural index of bone microarchitecture derived from lumbar spine dual-energy X-ray absorptiometry (DXA) images. TBS is a BMD-independent predictor of fracture risk. The objective of this meta-analysis was to determine whether TBS predicted fracture risk independently of FRAX probability and to examine their combined performance by adjusting the FRAX probability for TBS. We utilized individual level data from 17,809 men and women in 14 prospective population-based cohorts. Baseline evaluation included TBS and the FRAX risk variables and outcomes during follow up (mean 6.7 years) comprised major osteoporotic fractures. The association between TBS, FRAX probabilities and the risk of fracture was examined using an extension of the Poisson regression model in each cohort and for each sex and expressed as the gradient of risk (GR; hazard ratio per 1SD change in risk variable in direction of increased risk). FRAX probabilities were adjusted for TBS using an adjustment factor derived from an independent cohort (the Manitoba Bone Density Cohort). Overall, the GR of TBS for major osteoporotic fracture was 1.44 (95% CI: 1.35-1.53) when adjusted for age and time since baseline and was similar in men and women (p > 0.10). When additionally adjusted for FRAX 10-year probability of major osteoporotic fracture, TBS remained a significant, independent predictor for fracture (GR 1.32, 95%CI: 1.24-1.41). The adjustment of FRAX probability for TBS resulted in a small increase in the GR (1.76, 95%CI: 1.65, 1.87 vs. 1.70, 95%CI: 1.60-1.81). A smaller change in GR for hip fracture was observed (FRAX hip fracture probability GR 2.25 vs. 2.22). TBS is a significant predictor of fracture risk independently of FRAX. The findings support the use of TBS as a potential adjustment for FRAX probability, though the impact of the adjustment remains to be determined in the context of clinical assessment guidelines.

Variable definitions: implications for the prediction of pulmonary complications after adult cardiac surgery

Aim: The aim of this paper was to review the implications that variable definitions have for the prediction of post-operative pulmonary complications after cardiac surgery.

Method: A review of the literature from 1980 to 2002. Selected studies demonstrated an original attempt to examine multivariate associations between pre, intra or post-operative antecedents and pulmonary outcomes in patients undergoing coronary artery bypass grafting (CABG). Reports that described the validation of established clinical prediction rules, testing interventions or research conducted in non-human cohorts were excluded from this review.

Results: Consistently, variable factor and outcome definitions are combined for the development of multivariate prediction models that subsequently have limited clinical value. Despite being prevalent there are very few attempts to examine post-operative pulmonary complications (PPC) as endpoints in isolation. The trajectory of pulmonary dysfunction that precedes complications in the post-operative context is not clear. As such there is little knowledge of post-operative antecedents to PPC that are invariably excluded from model development.

Conclusion: Multivariate clinical prediction rules that incorporate antecedent patient and process factors from the continuum of cardiovascular care for specific pulmonary outcomes are recommended. Models such as these would be useful for practice, policy and quality improvement.

Laboratory and non-laboratory-based risk prevention models for secondary prevention of cardiovascular disease : the LIPID study

Aims : The aims of this study were to examine whether risk prediction models for recurrent cardiovascular disease (CVD) events have prognostic value, and to particularly examine the performance of those models based on non-laboratory data. We also aimed to construct a risk chart based on the risk factors that showed the strongest relationship with CVD.

Methods and results : Cox proportional hazards models were used to calculate a risk score for each recurrent event in a CVD patient who was enrolled in a very large randomized controlled clinical trial. Patients were then classified into groups according to quintiles of their risk score. These risk models were validated by calibration and discrimination analyses based on data from patients recruited in New Zealand for the same study. Non-laboratory-based risk factors, such as age, sex, body mass index, smoking status, angina grade, history of myocardial infarction, revascularization, stroke, diabetes or hypertension and treatment with pravastatin, were found to be significantly associated with the risk of developing a recurrent CVD event. Patients who were classified into the medium and high-risk groups had two-fold and four-fold the risk of developing a CVD event compared with those in the low-risk group, respectively. The risk prediction models also fitted New Zealand data well after recalibration.

Conclusion : A simpler non-laboratory-based risk prediction model performed equally as well as the more comprehensive laboratory-based risk prediction models. The risk chart based on the further simplified Score Model may provide a useful tool for clinical cardiologists to assess an individual patient's risk for recurrent CVD events.

Age at quitting smoking as a predictor of risk of cardiovascular disease incidence independent of smoking status, time since quitting and pack-years

Background: Risk prediction for CVD events has been shown to vary according to current smoking status, pack-years smoked over a lifetime, time since quitting and age at quitting. The latter two are closely and inversely related. It is not known whether the age at which one quits smoking is an additional important predictor of CVD events. The aim of this study was to determine whether the risk of CVD events varied according to age at quitting after taking into account current smoking status, lifetime pack-years smoked and time since quitting.
Findings. We used the Cox proportional hazards model to evaluate the risk of developing a first CVD event for a cohort of participants in the Framingham Offspring Heart Study who attended the fourth examination between ages 30 and 74 years and were free of CVD. Those who quit before the median age of 37 years had a risk of CVD incidence similar to those who were never smokers. The incorporation of age at quitting in the smoking variable resulted in better prediction than the model which had a simple current smoker/non-smoker measure and the one that incorporated both time since quitting and pack-years. These models demonstrated good discrimination, calibration and global fit. The risk among those quitting more than 5 years prior to the baseline exam and those whose age at quitting was prior to 44 years was similar to the risk among never smokers. However, the risk among those quitting less than 5 years prior to the baseline exam and those who continued to smoke until 44 years of age (or beyond) was two and a half times higher than that of never smokers.
Conclusions: Age at quitting improves the prediction of risk of CVD incidence even after other smoking measures are taken into account. The clinical benefit of adding age at quitting to the model with other smoking measures may be greater than the associated costs. Thus, age at quitting should be considered in addition to smoking status, time since quitting and pack-years when counselling individuals about their cardiovascular risk.

The effect of modifiable risk factors on geographic mortality differentials : a modelling study

Background Australian mortality rates are higher in regional and remote areas than in major cities. The degree to which this is driven by variation in modifiable risk factors is unknown.

Methods We applied a risk prediction equation incorporating smoking, cholesterol and blood pressure to a national, population based survey to project all-causes mortality risk by geographic region. We then modelled life expectancies at different levels of mortality risk by geographic region using a risk percentiles model. Finally we set high values of each risk factor to a target level and modelled the subsequent shift in the population to lower levels of mortality risk and longer life expectancy.

Results Survival is poorer in both Inner Regional and Outer Regional/Remote areas compared to Major Cities for men and women at both high and low levels of predicted mortality risk. For men smoking, high cholesterol and high systolic blood pressure were each associated with the mortality difference between Major Cities and Outer Regional/Remote areas--accounting for 21.4%, 20.3% and 7.7% of the difference respectively. For women smoking and high cholesterol accounted for 29.4% and 24.0% of the difference respectively but high blood pressure did not contribute to the observed mortality differences. The three risk factors taken together accounted for 45.4% (men) and 35.6% (women) of the mortality difference. The contribution of risk factors to the corresponding differences for inner regional areas was smaller, with only high cholesterol and smoking contributing to the difference in men-- accounting for 8.8% and 6.3% respectively-- and only smoking contributing to the difference in women--accounting for 12.3%.

Conclusions These results suggest that health intervention programs aimed at smoking, blood pressure and total cholesterol could have a substantial impact on mortality inequities for Outer Regional/Remote areas. Background: Australian mortality rates are higher in regional and remote areas than in major cities. The degree to which this is driven by variation in modifiable risk factors is unknown. Methods. We applied a risk prediction equation incorporating smoking, cholesterol and blood pressure to a national, population based survey to project all-causes mortality risk by geographic region. We then modelled life expectancies at different levels of mortality risk by geographic region using a risk percentiles model. Finally we set high values of each risk factor to a target level and modelled the subsequent shift in the population to lower levels of mortality risk and longer life expectancy. Results: Survival is poorer in both Inner Regional and Outer Regional/Remote areas compared to Major Cities for men and women at both high and low levels of predicted mortality risk. For men smoking, high cholesterol and high systolic blood pressure were each associated with the mortality difference between Major Cities and Outer Regional/Remote areas - accounting for 21.4%, 20.3% and 7.7% of the difference respectively. For women smoking and high cholesterol accounted for 29.4% and 24.0% of the difference respectively but high blood pressure did not contribute to the observed mortality differences. The three risk factors taken together accounted for 45.4% (men) and 35.6% (women) of the mortality difference. The contribution of risk factors to the corresponding differences for inner regional areas was smaller, with only high cholesterol and smoking contributing to the difference in men - accounting for 8.8% and 6.3% respectively - and only smoking contributing to the difference in women - accounting for 12.3%. Conclusions: These results suggest that health intervention programs aimed at smoking, blood pressure and total cholesterol could have a substantial impact on mortality inequities for Outer Regional/Remote areas.

A systematic review of the impact of including both waist and hip circumference in risk models for cardiovascular diseases, diabetes and mortality

Both a larger waist and narrow hips are associated with heightened risk of diabetes, cardiovascular diseases and premature mortality. We review the risk of these outcomes for levels of waist and hip circumferences when terms for both anthropometric measures were included in regression models. MEDLINE and EMBASE were searched (last updated July 2012) for studies reporting the association with the outcomes mentioned earlier for both waist and hip circumferences (unadjusted and with both terms included in the model). Ten studies reported the association between hip circumference and death and/or disease outcomes both unadjusted and adjusted for waist circumference. Five studies reported the risk associated with waist circumference both unadjusted and adjusted for hip circumference. With the exception of one study of venous thromboembolism, the full strength of the association between either waist circumference or hip circumference with morbidity and/or mortality was only apparent when terms for both anthropometric measures were included in regression models. Without accounting for the protective effect of hip circumference, the effect of obesity on risk of death and disease may be seriously underestimated. Considered together (but not as a ratio measure), waist and hip circumference may improve risk prediction models for cardiovascular disease and other outcomes.

Assessing risk post intervention for an acute coronary syndrome: a review of the risk assessment tools and their development

Considerable variability in survival rate after an acute myocardial infarction exists and accurate risk stratification is of significant importance. The American College of Cardiology and the American Heart Association has recommended early risk stratification using several clinical risk scoring instruments to identify high risk patients. The aim of this paper is to identify secondary cardiovascular risk scoring instruments that could be utilized at the time of intervention for acute coronary syndromes and compare their psychometric properties as they were developed. A search using Medline, Cumulative Index to Nursing and Allied Health Literature and the Psychology and Behavioral Sciences Collection data-bases identified studies published between January 1990 and January 2010 used to measure risk after intervention for acute coronary syndrome. Four validated secondary risk prediction scoring instruments were identified for comparison.Secondary risk prediction scoring instruments for the acute coronary syndrome patient population are evidence based, valid and reliable. Use of the instruments by cardiac focused clinicians will aid in the determination of treatment strategies, and estimation of short and long term events and mortality.