No surgical innovation without evaluation: the IDEAL recommendations

Surgery and other invasive therapies are complex interventions, the assessment of which is challenged by factors that depend on operator, team, and setting, such as learning curves, quality variations, and perception of equipoise. We propose recommendations for the assessment of surgery based on a five-stage description of the surgical development process. We also encourage the widespread use of prospective databases and registries. Reports of new techniques should be registered as a professional duty, anonymously if necessary when outcomes are adverse. Case series studies should be replaced by prospective development studies for early technical modifications and by prospective research databases for later pre-trial evaluation. Protocols for these studies should be registered publicly. Statistical process control techniques can be useful in both early and late assessment. Randomised trials should be used whenever possible to investigate efficacy, but adequate pre-trial data are essential to allow power calculations, clarify the definition and indications of the intervention, and develop quality measures. Difficulties in doing randomised clinical trials should be addressed by measures to evaluate learning curves and alleviate equipoise problems. Alternative prospective designs, such as interrupted time series studies, should be used when randomised trials are not feasible. Established procedures should be monitored with prospective databases to analyse outcome variations and to identify late and rare events. Achievement of improved design, conduct, and reporting of surgical research will need concerted action by editors, funders of health care and research, regulatory bodies, and professional societies.

Challenges in evaluating surgical innovation

Research on surgical interventions is associated with several methodological and practical challenges of which few, if any, apply only to surgery. However, surgical evaluation is especially demanding because many of these challenges coincide. In this report, the second of three on surgical innovation and evaluation, we discuss obstacles related to the study design of randomised controlled trials and non-randomised studies assessing surgical interventions. We also describe the issues related to the nature of surgical procedures-for example, their complexity, surgeon-related factors, and the range of outcomes. Although difficult, surgical evaluation is achievable and necessary. Solutions tailored to surgical research and a framework for generating evidence on which to base surgical practice are essential.

Evaluation and stages of surgical innovations

Surgical innovation is an important part of surgical practice. Its assessment is complex because of idiosyncrasies related to surgical practice, but necessary so that introduction and adoption of surgical innovations can derive from evidence-based principles rather than trial and error. A regulatory framework is also desirable to protect patients against the potential harms of any novel procedure. In this first of three Series papers on surgical innovation and evaluation, we propose a five-stage paradigm to describe the development of innovative surgical procedures.

The lifestyle of our kids (LOOK) project: outline of methods

This methods paper outlines the overall design of a community-based multidisciplinary longitudinal study with the intent to stimulate interest and communication from scientists and practitioners studying the role of physical activity in preventive medicine. In adults, lack of regular exercise is a major risk factor in the development of chronic degenerative diseases and is a major contributor to obesity, and now we have evidence that many of our children are not sufficiently active to prevent early symptoms of chronic disease. The lifestyle of our kids (LOOK) study investigates how early physical activity contributes to health and development, utilizing a longitudinal design and a cohort of eight hundred and thirty 7-8-year-old (grade 2) school children followed to age 11-12 years (grade 6), their average family income being very close to that of Australia. We will test two hypotheses, that (a) the quantity and quality of physical activity undertaken by primary school children will influence their psychological and physical health and development; (b) compared with existing practices in primary schools, a physical education program administered by visiting specialists will enhance health and development, and lead to a more positive perception of physical activity. To test the first hypothesis we will monitor all children longitudinally over the 4 years. To test the second we will involve an intervention group of 430 children who receive two 50min physical education classes every week from visiting specialists and a control group of 400 who continue with their usual primary school physical education with their class-room teachers. At the end of grades 2, 4, and 6 we will measure several areas of health and development including blood risk factors for chronic disease, cardiovascular structure and function, physical fitness, psychological characteristics and perceptions of physical activity, bone structure and strength, motor control, body composition, nutritional intake, influence of teachers and family, and academic performance.