Survey of new 2007 and 2011 Cochrane reviews found 37% of prespecified outcomes not reported

OBJECTIVES: To survey the outcomes used in Cochrane Reviews, as part of our work within the Core Outcome Measures in Effectiveness Trials Initiative.

STUDY DESIGN AND SETTING: A descriptive survey of Cochrane Reviews, divided by Cochrane Review Group (CRG), published in full for the first time in 2007 and 2011. Outcomes specified in the methods section of each review and outcomes reported in the results section of each review were of interest, in this exploration of the common use of outcomes and core outcome sets (COS).

RESULTS: Seven hundred eighty-eight reviews, specifying 6,127 outcomes, were included. When we excluded specified outcomes from the 86 reviews that did not include any studies, we found that 1,996 (37%) specified outcomes were not reported. Of the 361 new reviews with studies from 2011, 113 (31%) had a "summary of findings" table (SoF). Fifteen broad outcome categories were identified and used to manage the outcome data. We found consistency in the use of these categories across CRGs but inconsistency in outcomes within these categories.

CONCLUSION: COS have been used rarely in Cochrane Reviews, but the introduction of SoF makes the development and application of COS timelier than ever.

Will your article be found? Authors choose a confusing variety of words to describe dental survival analyses

OBJECTIVES: Identify the words and phrases that authors used to describe time-to-event outcomes of dental treatments in patients.

MATERIALS AND METHODS: A systematic handsearch of 50 dental journals with the highest Citation Index for 2008 identified articles reporting dental treatment with time-to-event statistics (included "case" articles, n = 95), without time-to-event statistics (active "control" articles, n = 91), and all other articles (passive "control" articles n = 6796). The included and active controls were read, identifying 43 English words across the title, aim and abstract, indicating that outcomes were studied over time. Once identified, these words were sought within the 6796 passive controls. Words were divided into six groups. Differences in use of words were analyzed with Pearson's chi-square across these six groups, and the three locations (title, aim, and abstract).

RESULTS: In the abstracts, included articles used group 1 (statistical technique) and group 2 (statistical terms) more frequently than the active and passive controls (group 1: 35%, 2%, 0.37%, P < 0.001 and group 2: 31%, 1%, 0.06%, P < 0.001). The included and active controls used group 3 (quasi-statistical) equally, but significantly more often than the passive controls (82%, 78%, 3.21%, P < 0.001). In the aims, use of target words was similar for included and active controls, but less frequent for groups 1-4 in the passive controls (P < 0.001). In the title, group 2 (statistical techniques) and groups 3-5 (outcomes) were similar for included and active controls, but groups 2 and 3 were less frequent in the passive controls (P < 0.001). Significantly more included articles used group 6 words (stating the study duration) (54%, 30%, P = 0.001).

CONCLUSION: All included articles used time-to-event analyses, but two-thirds did not include words to highlight this in the abstract. There is great variation in the words authors used to describe dental time-to-event outcomes. Electronic identification of such articles would be inconsistent, with low sensitivity and specificity. Authors should improve the reporting quality. Journals should allow sufficient space in abstracts to summarize research, and not impose unrealistic word limits. Readers should be mindful of these problems when searching for relevant articles. Additional research is required in this field.

Lost and Found? A Parable of the Architect (Male) and the Academic (Female)

The following text captures an interview, conducted over three evenings, between a practicing architect (male) and an architecture academic (female and feminist). This is a conversation between two long-standing friends who did their Part 3 professional exam together more than twenty-five years ago. Since then, they have taken different career paths and lived lives at different paces and in different places. Every so often they meet over coffee to laugh and argue about architecture, bemoan failures, and share successes.

The academic initiated the interview in order to hear an honest and open account of the career experience of a male architect. She hoped that their longstanding friendship would lead to less guarded responses. The answers to the questions were always going to be personally challenging to the interviewer and possibly to their friendship. The interview is a form of ethnographic study: a structured, qualitative process within a long term, immersed context. But when ‘the immersed context’ is a much-valued friendship, it is a precarious action. Nevertheless, for the future of gendered relationships both protagonists accepted the risks.