Validation of the National Institutes of Health Stroke Scale, Modified Rankin Scale and Barthel Index in Brazil: The Role of Cultural Adaptation and Structured Interviewing

Background: We aimed to validate three widely used scales in stroke research in a multiethnic Brazilian population. Methods: The National Institutes of Health Stroke Scale (NIHSS), modified Rankin Scale (mRS) and Barthel Index (BI) were translated, culturally adapted and applied by two independent investigators. The mRS was applied with or without a previously validated structured interview. Interobserver agreement (kappa statistics) and intraclass correlation coefficients were calculated. Results: 84 patients underwent mRS (56 with and 28 without a structured interview), 57 BI and 62 NIHSS scoring. Intraclass correlation coefficient was 0.902 for NIHSS and 0.967 for BI. For BI, interobserver agreement was good (kappa = 0.70). For mRS, the structured interview improved interobserver agreement (kappa = 0.34 without a structured interview; 0.75 with a structured interview). Conclusion: The NIHSS, BI and mRS show good validity when translated and culturally adapted. Using a structured interview for the mRS improves interobserver concordance rates. Copyright (C) 2008 S. Karger AG, Basel

Validation of the Scandinavian stroke scale in a multicultural population in Brazil

Background: The objective of this study was to evaluate the consistency, coherence, and interobserver reliability of the Portuguese version of the Scandinavian Stroke Scale (SSS) in a multicultural population of stroke. Methods: The SSS was translated, culturally adapted, and applied by two independent investigators. This was a randomized transverse study involving two groups: group 1 included 20 patients in the acute phase and group 2 included 20 patients in the subacute phase after stroke was confirmed by computed tomography with a pre-stroke modified Rankin Scale score of 0. Each patient also underwent National Institutes of Health Stroke Scale (NIHSS) evaluation at hospital entry and at the time of the SSS evaluation for correlation with our current standard hospital practice. Consistency and coherence were analyzed by Cronbach’s α and interobserver reliability by ĸ. Results: Forty patients were evaluated with 0.88 consistency and coherence in both stroke phases. Mean interobserver ĸ was 0.76, with reliability considered excellent and good for most scale items, and moderate for only the facial palsy item. Conclusion: The SSS is adequate and validated to study post-stroke patients in a multicultural Brazilian population and in the Portuguese language.

The Virtual International Stroke Trials Archive

Background and Purpose - Stroke has global importance and it causes an increasing amount of human suffering and economic burden, but its management is far from optimal. The unsuccessful outcome of several research programs highlights the need for reliable data on which to plan future clinical trials. The Virtual International Stroke Trials Archive aims to aid the planning of clinical trials by collating and providing access to a rich resource of patient data to perform exploratory analyses. Methods - Data were contributed by the principal investigators of numerous trials from the past 16 years. These data have been centrally collated and are available for anonymized analysis and hypothesis testing. Results - ”Currently, the Virtual International Stroke Trials Archive contains 21 trials. There are data on 15 000 patients with both ischemic and hemorrhagic stroke. Ages range between 18 and 103 years, with a mean age of 6912 years. Outcome measures include the Barthel Index, Scandinavian Stroke Scale, National Institutes of Health Stroke Scale, Orgogozo Scale, and modified Rankin Scale. Medical history and onset-to-treatment time are readily available, and computed tomography lesion data are available for selected trials. Conclusions - This resource has the potential to influence clinical trial design and implementation through data analyses that inform planning. (Stroke. 2007;38:1905-1910.)

Calculation of sample size for stroke trials assessing functional outcome: comparison of binary and ordinal approaches

Background Many acute stroke trials have given neutral results. Sub-optimal statistical analyses may be failing to detect efficacy. Methods which take account of the ordinal nature of functional outcome data are more efficient. We compare sample size calculations for dichotomous and ordinal outcomes for use in stroke trials. Methods Data from stroke trials studying the effects of interventions known to positively or negatively alter functional outcome – Rankin Scale and Barthel Index – were assessed. Sample size was calculated using comparisons of proportions, means, medians (according to Payne), and ordinal data (according to Whitehead). The sample sizes gained from each method were compared using Friedman 2 way ANOVA. Results Fifty-five comparisons (54 173 patients) of active vs. control treatment were assessed. Estimated sample sizes differed significantly depending on the method of calculation (Po00001). The ordering of the methods showed that the ordinal method of Whitehead and comparison of means produced significantly lower sample sizes than the other methods. The ordinal data method on average reduced sample size by 28% (inter-quartile range 14–53%) compared with the comparison of proportions; however, a 22% increase in sample size was seen with the ordinal method for trials assessing thrombolysis. The comparison of medians method of Payne gave the largest sample sizes. Conclusions Choosing an ordinal rather than binary method of analysis allows most trials to be, on average, smaller by approximately 28% for a given statistical power. Smaller trial sample sizes may help by reducing time to completion, complexity, and financial expense. However, ordinal methods may not be optimal for interventions which both improve functional outcome

Can we improve the statistical analysis of stroke trials? Statistical re-analysis of functional outcomes in stroke trials

Background: Most large acute stroke trials have been neutral. Functional outcome is usually analysed using a yes or no answer, e.g. death or dependency vs. independence. We assessed which statistical approaches are most efficient in analysing outcomes from stroke trials. Methods: Individual patient data from acute, rehabilitation and stroke unit trials studying the effects of interventions which alter functional outcome were assessed. Outcomes included modified Rankin Scale, Barthel Index, and ‘3 questions’. Data were analysed using a variety of approaches which compare two treatment groups. The results for each statistical test for each trial were then compared. Results: Data from 55 datasets were obtained (47 trials, 54,173 patients). The test results differed substantially so that approaches which use the ordered nature of functional outcome data (ordinal logistic regression, t-test, robust ranks test, bootstrapping the difference in mean rank) were more efficient statistically than those which collapse the data into 2 groups (chi square) (ANOVA p<0.001). The findings were consistent across different types and sizes of trial and for the different measures of functional outcome. Conclusions: When analysing functional outcome from stroke trials, statistical tests which use the original ordered data are more efficient and more likely to yield reliable results. Suitable approaches included ordinal logistic regression, t-test, and robust ranks test.

Can we improve the statistical analysis of stroke trials? Statistical reanalysis of functional outcomes in stroke trials

Background and Purpose—Most large acute stroke trials have been neutral. Functional outcome is usually analyzed using a yes or no answer, eg, death or dependency versus independence. We assessed which statistical approaches are most efficient in analyzing outcomes from stroke trials. Methods—Individual patient data from acute, rehabilitation and stroke unit trials studying the effects of interventions which alter functional outcome were assessed. Outcomes included modified Rankin Scale, Barthel Index, and “3 questions”. Data were analyzed using a variety of approaches which compare 2 treatment groups. The results for each statistical test for each trial were then compared. Results—Data from 55 datasets were obtained (47 trials, 54 173 patients). The test results differed substantially so that approaches which use the ordered nature of functional outcome data (ordinal logistic regression, t test, robust ranks test, bootstrapping the difference in mean rank) were more efficient statistically than those which collapse the data into 2 groups (2; ANOVA, P0.001). The findings were consistent across different types and sizes of trial and for the different measures of functional outcome. Conclusions—When analyzing functional outcome from stroke trials, statistical tests which use the original ordered data are more efficient and more likely to yield reliable results. Suitable approaches included ordinal logistic regression, test, and robust ranks test.

Identification of imaging selection patterns in acute ischemic stroke patients and the influence on treatment and clinical trial enrollment decision making.

BACKGROUND AND PURPOSE: For the STroke Imaging Research (STIR) and VISTA-Imaging Investigators The purpose of this study was to collect precise information on the typical imaging decisions given specific clinical acute stroke scenarios. Stroke centers worldwide were surveyed regarding typical imaging used to work up representative acute stroke patients, make treatment decisions, and willingness to enroll in clinical trials. METHODS: STroke Imaging Research and Virtual International Stroke Trials Archive-Imaging circulated an online survey of clinical case vignettes through its website, the websites of national professional societies from multiple countries as well as through email distribution lists from STroke Imaging Research and participating societies. Survey responders were asked to select the typical imaging work-up for each clinical vignette presented. Actual images were not presented to the survey responders. Instead, the survey then displayed several types of imaging findings offered by the imaging strategy, and the responders selected the appropriate therapy and whether to enroll into a clinical trial considering time from onset, clinical presentation, and imaging findings. A follow-up survey focusing on 6 h from onset was conducted after the release of the positive endovascular trials. RESULTS: We received 548 responses from 35 countries including 282 individual centers; 78% of the centers originating from Australia, Brazil, France, Germany, Spain, United Kingdom, and United States. The specific onset windows presented influenced the type of imaging work-up selected more than the clinical scenario. Magnetic Resonance Imaging usage (27-28%) was substantial, in particular for wake-up stroke. Following the release of the positive trials, selection of perfusion imaging significantly increased for imaging strategy. CONCLUSIONS: Usage of vascular or perfusion imaging by Computed Tomography or Magnetic Resonance Imaging beyond just parenchymal imaging was the primary work-up (62-87%) across all clinical vignettes and time windows. Perfusion imaging with Computed Tomography or Magnetic Resonance Imaging was associated with increased probability of enrollment into clinical trials for 0-3 h. Following the release of the positive endovascular trials, selection of endovascular only treatment for 6 h increased across all clinical vignettes.

Feasibility platform for stroke studies: an online tool to improve eligibility criteria for clinical trials

BACKGROUND AND PURPOSE Eligibility criteria are a key factor for the feasibility and validity of clinical trials. We aimed to develop an online tool to assess the potential effect of inclusion and exclusion criteria on the proportion of patients eligible for an acute stroke trial. METHODS We identified relevant inclusion and exclusion criteria of acute stroke trials. Based on these criteria and using a cohort of 1537 consecutive patients with acute ischemic stroke from 3 stroke centers, we developed a web portal feasibility platform for stroke studies (FePASS) to estimate proportions of eligible patients for acute stroke trials. We applied the FePASS resource to calculate the proportion of patients eligible for 4 recent stroke studies. RESULTS Sixty-one eligibility criteria were derived from 30 trials on acute ischemic stroke. FePASS, publicly available at http://fepass.uni-muenster.de, displays the proportion of patients in percent to assess the effect of varying values of relevant eligibility criteria, for example, age, symptom onset time, National Institutes of Health Stroke Scale, and prestroke modified Rankin Scale, on this proportion. The proportion of eligible patients for 4 recent stroke studies ranged from 2.1% to 11.3%. Slight variations of the inclusion criteria could substantially increase the proportion of eligible patients. CONCLUSIONS FePASS is an open access online resource to assess the effect of inclusion and exclusion criteria on the proportion of eligible patients for a stroke trial. FePASS can help to design stroke studies, optimize eligibility criteria, and to estimate the potential recruitment rate.

Sleep-disordered breathing among acute ischemic stroke patients in Brazil.

OBJECTIVES Sleep-disordered breathing (SDB) is very common in acute stroke patients and has been related to poor outcome. However, there is a lack of data about the association between SDB and stroke in developing countries. The study aims to characterize the frequency and severity of SDB in Brazilian patients during the acute phase of ischemic stroke; to identify clinical and laboratorial data related to SDB in those patients; and to assess the relationship between sleep apnea and functional outcome after six months of stroke. METHODS Clinical data and laboratorial tests were collected at hospital admission. The polysomnography was performed on the first night after stroke symptoms onset. Functional outcome was assessed by the modified Rankin Scale (mRS). RESULTS We prospectively evaluated 69 patients with their first-ever acute ischemic stroke. The mean apnea-hypopnea index (AHI) was 37.7 ± 30.2. Fifty-three patients (76.8%) exhibited an AHI ≥ 10 with predominantly obstructive respiratory events (90.6%), and thirty-three (47.8%) had severe sleep apnea. Age (OR: 1.09; 95% CI: 1.03-1.15; p= 0.004) and hematocrit (OR: 1.18; 95% CI: 1.03-1.34; p= 0.01) were independent predictors of sleep apnea. Age (OR: 1.13; 95% CI: 1.03-1.24; p= 0.01), body mass index (OR: 1.54; 95% CI: 1.54-2.18; p= 0.01), and hematocrit (OR: 1.19; 95% CI: 1.01-1.40; p= 0.04) were independent predictors of severe sleep apnea. The National Institutes of Health Stroke Scale (NIHSS; OR: 1.30; 95% CI: 1.1-1.5; p= 0.001) and severe sleep apnea (OR: 9.7; 95% CI: 1.3-73.8; p= 0.03) were independently associated to mRS >2 at six months, after adjusting for confounders. CONCLUSION Patients with acute ischemic stroke in Brazil have a high frequency of SDB. Severe sleep apnea is associated with a poor long-term functional outcome following stroke in that population.

Predicting long-term outcome after acute ischemic stroke: a simple index works in patients from controlled clinical trials

Background and Purpose—An early and reliable prognosis for recovery in stroke patients is important for initiation of individual treatment and for informing patients and relatives. We recently developed and validated models for predicting survival and functional independence within 3 months after acute stroke, based on age and the National Institutes of Health Stroke Scale score assessed within 6 hours after stroke. Herein we demonstrate the applicability of our models in an independent sample of patients from controlled clinical trials. Methods—The prognostic models were used to predict survival and functional recovery in 5419 patients from the Virtual International Stroke Trials Archive (VISTA). Furthermore, we tried to improve the accuracy by adapting intercepts and estimating new model parameters. Results—The original models were able to correctly classify 70.4% (survival) and 72.9% (functional recovery) of patients. Because the prediction was slightly pessimistic for patients in the controlled trials, adapting the intercept improved the accuracy to 74.8% (survival) and 74.0% (functional recovery). Novel estimation of parameters, however, yielded no relevant further improvement. Conclusions—For acute ischemic stroke patients included in controlled trials, our easy-to-apply prognostic models based on age and National Institutes of Health Stroke Scale score correctly predicted survival and functional recovery after 3 months. Furthermore, a simple adaptation helps to adjust for a different prognosis and is recommended if a large data set is available. (Stroke. 2008;39:000-000.)

International survey of acute stroke imaging used to make revascularization treatment decisions.

BACKGROUND: To assess the differences across continental regions in terms of stroke imaging obtained for making acute revascularization therapy decisions, and to identify obstacles to participating in randomized trials involving multimodal imaging. METHODS: STroke Imaging Repository (STIR) and Virtual International Stroke Trials Archive (VISTA)-Imaging circulated an online survey through its website, through the websites of national professional societies from multiple countries as well as through email distribution lists from STIR and the above mentioned societies. RESULTS: We received responses from 223 centers (2 from Africa, 38 from Asia, 10 from Australia, 101 from Europe, 4 from Middle East, 55 from North America, 13 from South America). In combination, the sites surveyed administered acute revascularization therapy to a total of 25,326 acute stroke patients in 2012. Seventy-three percent of these patients received intravenous (i.v.) tissue plasminogen activator (tPA), and 27%, endovascular therapy. Vascular imaging was routinely obtained in 79% (152/193) of sites for endovascular therapy decisions, and also as part of standard IV tPA treatment decisions at 46% (92/198) of sites. Modality, availability and use of acute vascular and perfusion imaging before revascularization varied substantially between geographical areas. The main obstacles to participate in randomized trials involving multimodal imaging included: mainly insufficient research support and staff (50%, 79/158) and infrequent use of multimodal imaging (27%, 43/158) . CONCLUSION: There were significant variations among sites and geographical areas in terms of stroke imaging work-up used tomake decisions both for intravenous and endovascular revascularization. Clinical trials using advanced imaging as a selection tool for acute revascularization therapy should address the need for additional resources and technical support, and take into consideration the lack of routine use of such techniques in trial planning.

How a sequential design would have affected the GAIN international study of Gavestinel in stroke

While planning the GAIN International Study of gavestinel in acute stroke, a sequential triangular test was proposed but not implemented. Before the trial commenced it was agreed to evaluate the sequential design retrospectively to evaluate the differences in the resulting analyses, trial durations and sample sizes in order to assess the potential of sequential procedures for future stroke trials. This paper presents four sequential reconstructions of the GAIN study made under various scenarios. For the data as observed, the sequential design would have reduced the trial sample size by 234 patients and shortened its duration by 3 or 4 months. Had the study not achieved a recruitment rate that far exceeded expectation, the advantages of the sequential design would have been much greater. Sequential designs appear to be an attractive option for trials in stroke. Copyright 2004 S. Karger AG, Basel

Using historical lesion volume data in the design of a new phase II clinical trial in acute stroke

Background and Purpose-Clinical research into the treatment of acute stroke is complicated, is costly, and has often been unsuccessful. Developments in imaging technology based on computed tomography and magnetic resonance imaging scans offer opportunities for screening experimental therapies during phase II testing so as to deliver only the most promising interventions to phase III. We discuss the design and the appropriate sample size for phase II studies in stroke based on lesion volume. Methods-Determination of the relation between analyses of lesion volumes and of neurologic outcomes is illustrated using data from placebo trial patients from the Virtual International Stroke Trials Archive. The size of an effect on lesion volume that would lead to a clinically relevant treatment effect in terms of a measure, such as modified Rankin score (mRS), is found. The sample size to detect that magnitude of effect on lesion volume is then calculated. Simulation is used to evaluate different criteria for proceeding from phase II to phase III. Results-The odds ratios for mRS correspond roughly to the square root of odds ratios for lesion volume, implying that for equivalent power specifications, sample sizes based on lesion volumes should be about one fourth of those based on mRS. Relaxation of power requirements, appropriate for phase II, lead to further sample size reductions. For example, a phase III trial comparing a novel treatment with placebo with a total sample size of 1518 patients might be motivated from a phase II trial of 126 patients comparing the same 2 treatment arms. Discussion-Definitive phase III trials in stroke should aim to demonstrate significant effects of treatment on clinical outcomes. However, more direct outcomes such as lesion volume can be useful in phase II for determining whether such phase III trials should be undertaken in the first place. (Stroke. 2009;40:1347-1352.)