Webinar Training: an acceptable, feasible and effective approach for multi-site medical record abstraction: the BOWII experience

Background Abstractor training is a key element in creating valid and reliable data collection procedures. The choice between in-person vs. remote or simultaneous vs. sequential abstractor training has considerable consequences for time and resource utilization. We conducted a web-based (webinar) abstractor training session to standardize training across six individual Cancer Research Network (CRN) sites for a study of breast cancer treatment effects in older women (BOWII). The goals of this manuscript are to describe the training session, its participants and participants' evaluation of webinar technology for abstraction training. Findings A webinar was held for all six sites with the primary purpose of simultaneously training staff and ensuring consistent abstraction across sites. The training session involved sequential review of over 600 data elements outlined in the coding manual in conjunction with the display of data entry fields in the study's electronic data collection system. Post-training evaluation was conducted via Survey Monkey©. Inter-rater reliability measures for abstractors within each site were conducted three months after the commencement of data collection. Ten of the 16 people who participated in the training completed the online survey. Almost all (90%) of the 10 trainees had previous medical record abstraction experience and nearly two-thirds reported over 10 years of experience. Half of the respondents had previously participated in a webinar, among which three had participated in a webinar for training purposes. All rated the knowledge and information delivered through the webinar as useful and reported it adequately prepared them for data collection. Moreover, all participants would recommend this platform for multi-site abstraction training. Consistent with participant-reported training effectiveness, results of data collection inter-rater agreement within sites ranged from 89 to 98%, with a weighted average of 95% agreement across sites. Conclusions Conducting training via web-based technology was an acceptable and effective approach to standardizing medical record review across multiple sites for this group of experienced abstractors. Given the substantial time and cost savings achieved with the webinar, coupled with participants' positive evaluation of the training session, researchers should consider this instructional method as part of training efforts to ensure high quality data collection in multi-site studies.

Intra-Rater and Inter-Rater Reliability of a Medical Record Abstraction Study on Transition of Care after Childhood Cancer.

BACKGROUND The abstraction of data from medical records is a widespread practice in epidemiological research. However, studies using this means of data collection rarely report reliability. Within the Transition after Childhood Cancer Study (TaCC) which is based on a medical record abstraction, we conducted a second independent abstraction of data with the aim to assess a) intra-rater reliability of one rater at two time points; b) the possible learning effects between these two time points compared to a gold-standard; and c) inter-rater reliability. METHOD Within the TaCC study we conducted a systematic medical record abstraction in the 9 Swiss clinics with pediatric oncology wards. In a second phase we selected a subsample of medical records in 3 clinics to conduct a second independent abstraction. We then assessed intra-rater reliability at two time points, the learning effect over time (comparing each rater at two time-points with a gold-standard) and the inter-rater reliability of a selected number of variables. We calculated percentage agreement and Cohen's kappa. FINDINGS For the assessment of the intra-rater reliability we included 154 records (80 for rater 1; 74 for rater 2). For the inter-rater reliability we could include 70 records. Intra-rater reliability was substantial to excellent (Cohen's kappa 0-6-0.8) with an observed percentage agreement of 75%-95%. In all variables learning effects were observed. Inter-rater reliability was substantial to excellent (Cohen's kappa 0.70-0.83) with high agreement ranging from 86% to 100%. CONCLUSIONS Our study showed that data abstracted from medical records are reliable. Investigating intra-rater and inter-rater reliability can give confidence to draw conclusions from the abstracted data and increase data quality by minimizing systematic errors.

Object-Oriented Legacy System Trace-based Logic Testing

When reengineering legacy systems, it is crucial to assess if the legacy behavior has been preserved or how it changed due to the reengineering effort. Ideally if a legacy system is covered by tests, running the tests on the new version can identify potential differences or discrepancies. However, writing tests for an unknown and large system is difficult due to the lack of internal knowledge. It is especially difficult to bring the system to an appropriate state. Our solution is based on the acknowledgment that one of the few trustable piece of information available when approaching a legacy system is the running system itself. Our approach reifies the execution traces and uses logic programming to express tests on them. Thereby it eliminates the need to programatically bring the system in a particular state, and handles the test-writer a high-level abstraction mechanism to query the trace. The resulting system, called TESTLOG, was used on several real-world case studies to validate our claims.

Capturing How Objects Flow At Runtime

Most of today's dynamic analysis approaches are based on method traces. However, in the case of object-orientation understanding program execution by analyzing method traces is complicated because the behavior of a program depends on the sharing and the transfer of object references (aliasing). We argue that trace-based dynamic analysis is at a too low level of abstraction for object-oriented systems. We propose a new approach that captures the life cycle of objects by explicitly taking into account object aliasing and how aliases propagate during the execution of the program. In this paper, we present in detail our new meta-model and discuss future tracks opened by it.

Survival and failure rates of orthodontic temporary anchorage devices: a systematic review

AIM: The purpose of this study was to systematically review the literature on the survival rates of palatal implants, Onplants((R)), miniplates and mini screws. MATERIAL AND METHODS: An electronic MEDLINE search supplemented by manual searching was conducted to identify randomized clinical trials, prospective and retrospective cohort studies on palatal implants, Onplants((R)), miniplates and miniscrews with a mean follow-up time of at least 12 weeks and of at least 10 units per modality having been examined clinically at a follow-up visit. Assessment of studies and data abstraction was performed independently by two reviewers. Reported failures of used devices were analyzed using random-effects Poisson regression models to obtain summary estimates and 95% confidence intervals (CI) of failure and survival proportions. RESULTS: The search up to January 2009 provided 390 titles and 71 abstracts with full-text analysis of 34 articles, yielding 27 studies that met the inclusion criteria. In meta-analysis, the failure rate for Onplants((R)) was 17.2% (95% CI: 5.9-35.8%), 10.5% for palatal implants (95% CI: 6.1-18.1%), 16.4% for miniscrews (95% CI: 13.4-20.1%) and 7.3% for miniplates (95% CI: 5.4-9.9%). Miniplates and palatal implants, representing torque-resisting temporary anchorage devices (TADs), when grouped together, showed a 1.92-fold (95% CI: 1.06-2.78) lower clinical failure rate than miniscrews. CONCLUSION: Based on the available evidence in the literature, palatal implants and miniplates showed comparable survival rates of >or=90% over a period of at least 12 weeks, and yielded superior survival than miniscrews. Palatal implants and miniplates for temporary anchorage provide reliable absolute orthodontic anchorage. If the intended orthodontic treatment would require multiple miniscrew placement to provide adequate anchorage, the reliability of such systems is questionable. For patients who are undergoing extensive orthodontic treatment, force vectors may need to be varied or the roots of the teeth to be moved may need to slide past the anchors. In this context, palatal implants or miniplates should be the TADs of choice.

A systematic review of the performance of ceramic and metal implant abutments supporting fixed implant reconstructions

OBJECTIVES: The objective of this systematic review was to assess the 5-year survival rates and incidences of complications associated with ceramic abutments and to compare them with those of metal abutments. METHODS: An electronic Medline search complemented by manual searching was conducted to identify randomized-controlled clinical trials, and prospective and retrospective studies providing information on ceramic and metal abutments with a mean follow-up time of at least 3 years. Patients had to have been examined clinically at the follow-up visit. Assessment of the identified studies and data abstraction was performed independently by three reviewers. Failure rates were analyzed using standard and random-effects Poisson regression models to obtain summary estimates of 5-year survival proportions. RESULTS: Twenty-nine clinical and 22 laboratory studies were selected from an initial yield of 7136 titles and data were extracted. The estimated 5-year survival rate of ceramic abutments was 99.1% [95% confidence interval (CI): 93.8-99.9%] and 97.4% (95% CI: 96-98.3%) for metal abutments. The estimated cumulative incidence of technical complications after 5 years was 6.9% (95% CI: 3.5-13.4%) for ceramic abutments and 15.9% (95% CI: 11.6-21.5%) for metal abutments. Abutment screw loosening was the most frequent technical problem, occurring at an estimated cumulative incidence after 5 years of 5.1% (95% CI: 3.3-7.7%). All-ceramic crowns supported by ceramic abutments exhibited similar annual fracture rates as metal-ceramic crowns supported by metal abutments. The cumulative incidence of biological complications after 5 years was estimated at 5.2% (95% CI: 0.4-52%) for ceramic and 7.7% (95% CI: 4.7-12.5%) for metal abutments. Esthetic complications tended to be more frequent at metal abutments. A meta-analysis of the laboratory data was impossible due to the non-standardized test methods of the studies included. CONCLUSION: The 5-year survival rates estimated from annual failure rates appeared to be similar for ceramic and metal abutments. The information included in this review did not provide evidence for differences of the technical and biological outcomes of ceramic and metal abutments. However, the information for ceramic abutments was limited in the number of studies and abutments analyzed as well as the accrued follow-up time. Standardized methods for the analysis of abutment strength are needed.

Model-Centric, Context-Aware Software Adaptation

Software must be constantly adapted to changing requirements. The time scale, abstraction level and granularity of adaptations may vary from short-term, fine-grained adaptation to long-term, coarse-grained evolution. Fine-grained, dynamic and context-dependent adaptations can be particularly difficult to realize in long-lived, large-scale software systems. We argue that, in order to effectively and efficiently deploy such changes, adaptive applications must be built on an infrastructure that is not just model-driven, but is both model-centric and context-aware. Specifically, this means that high-level, causally-connected models of the application and the software infrastructure itself should be available at run-time, and that changes may need to be scoped to the run-time execution context. We first review the dimensions of software adaptation and evolution, and then we show how model-centric design can address the adaptation needs of a variety of applications that span these dimensions. We demonstrate through concrete examples how model-centric and context-aware designs work at the level of application interface, programming language and runtime. We then propose a research agenda for a model-centric development environment that supports dynamic software adaptation and evolution.

Antiretroviral therapy for prevention of HIV transmission in HIV-discordant couples

BACKGROUND Antiretroviral drugs have been shown to reduce risk of mother-to-child transmission of human immunodeficiency virus (HIV) and are also widely used for post-exposure prophylaxis for parenteral and sexual exposures. Sexual transmission may be lower in couples in which one partner is infected with HIV and the other is not and the infected partner is on antiretroviral therapy (ART). OBJECTIVES To determine if ART use in an HIV-infected member of an HIV-discordant couple is associated with lower risk of HIV transmission to the uninfected partner compared to untreated discordant couples. SEARCH METHODS We used standard Cochrane methods to search electronic databases and conference proceedings with relevant search terms without limits to language. SELECTION CRITERIA Randomised controlled trials (RCT), cohort studies and case-control studies of HIV-discordant couples in which the HIV-infected member of the couple was being treated or not treated with ART DATA COLLECTION AND ANALYSIS: Abstracts of all trials identified by electronic or bibliographic scanning were examined independently by two authors. We initially identified 3,833 references and examined 87 in detail for study eligibility. Data were abstracted independently using a standardised abstraction form. MAIN RESULTS One RCT and nine observational studies were included in the review. These ten studies identified 2,112 episodes of HIV transmission, 1,016 among treated couples and 1,096 among untreated couples. The rate ratio for the single randomised controlled trial was 0.04 [95% CI 0.00, 0.27]. All index partners in this study had CD4 cell counts at baseline of 350-550 cells/µL. Similarly, the summary rate ratio for the nine observational studies was 0.58 [95% CI 0.35, 0.96], with substantial heterogeneity (I(2)=64%). After excluding two studies with inadequate person-time data, we estimated a summary rate ratio of 0.36 [95% CI 0.17, 0.75] with substantial heterogeneity (I(2)=62%). We also performed subgroup analyses among the observational studies to see if the effect of ART on prevention of HIV differed by the index partner's CD4 cell count. Among couples in which the infected partner had ≥350 CD4 cells/µL, we estimated a rate ratio of 0.12 [95% CI 0.01, 1.99]. In this subgroup, there were 247 transmissions in untreated couples and 30 in treated couples. AUTHORS' CONCLUSIONS ART is a potent intervention for prevention of HIV in discordant couples in which the index partner has ≤550 CD4 cells/µL. A recent multicentre RCT confirms the suspected benefit seen in earlier observational studies and reported in more recent ones. Questions remain about durability of protection, the balance of benefits and adverse events associated with earlier therapy, long-term adherence and transmission of ART-resistant strains to partners. Resource limitations and implementation challenges must also be addressed.Counselling, support, and follow up, as well as mutual disclosure, may have a role in supporting adherence, so programmes should be designed with these components. In addition to ART provision, the operational aspects of delivering such programmes must be considered.

The SAKK cancer-specific geriatric assessment (C-SGA): a pilot study of a brief tool for clinical decision-making in older cancer patients

BACKGROUND Recommendations from international task forces on geriatric assessment emphasize the need for research including validation of cancer-specific geriatric assessment (C-SGA) tools in oncological settings. The objective of this study was to evaluate the feasibility of the SAKK Cancer-Specific Geriatric Assessment (C-SGA) in clinical practice. METHODS A cross sectional study of cancer patients >=65 years old (N = 51) with pathologically confirmed cancer presenting for initiation of chemotherapy treatment (07/01/2009-03/31/2011) at two oncology departments in Swiss canton hospitals: Kantonsspital Graubunden (KSGR N = 25), Kantonsspital St. Gallen (KSSG N = 26). Data was collected using three instruments, the SAKK C-SGA plus physician and patient evaluation forms. The SAKK C-SGA includes six measures covering five geriatric assessment domains (comorbidity, function, psychosocial, nutrition, cognition) using a mix of medical record abstraction (MRA) and patient interview. Five individual domains and one overall SAKK C-SGA score were calculated and dichotomized as below/above literature-based cut-offs. The SAKK C-SGA was evaluated by: patient and physician estimated time to complete, ease of completing, and difficult or unanswered questions. RESULTS Time to complete the patient questionnaire was considered acceptable by almost all (>=96%) patients and physicians. Patients reported slightly shorter times to complete the questionnaire than physicians (17.33 +/- 7.34 vs. 20.59 +/- 6.53 minutes, p = 0.02). Both groups rated the patient questionnaire as easy/fairly easy to complete (91% vs. 84% respectively, p = 0.14) with few difficult or unanswered questions. The MRA took on average 8.32 +/- 4.72 minutes to complete. Physicians (100%) considered time to complete MRA acceptable, 96% rated it as easy/fairly easy to complete. Individual study site populations differed on health-related characteristics (excellent/good physician-rated general health KSGR 71% vs. KSSG 32%, p = 0.007). The overall mean C-SGA score was 2.4 +/- 1.12. Patients at KSGR had lower C-SGA scores (2.00 +/- 1.19 vs. 2.81 +/- 0.90, p = 0.009) and a smaller proportion (28% vs.65%, p = 0.008) was above the C-SGA cut-off score compared to KSSG. CONCLUSIONS These results suggest the SAKK C-SGA is a feasible practical tool for use in clinical practice. It demonstrated discriminative ability based on objective geriatric assessment measures, but additional investigations on use for clinical decision-making are warranted. The SAKK C-SGA also provides important usable domain information for intervention to optimize outcomes in older cancer patients.