Visually extracting data records from the deep web

Web sites that rely on databases for their content are now ubiquitous. Query result pages are dynamically generated from these databases in response to user-submitted queries. Automatically extracting structured data from query result pages is a challenging problem, as the structure of the data is not explicitly represented. While humans have shown good intuition in visually understanding data records on a query result page as displayed by a web browser, no existing approach to data record extraction has made full use of this intuition. We propose a novel approach, in which we make use of the common sources of evidence that humans use to understand data records on a displayed query result page. These include structural regularity, and visual and content similarity between data records displayed on a query result page. Based on these observations we propose new techniques that can identify each data record individually, while ignoring noise items, such as navigation bars and adverts. We have implemented these techniques in a software prototype, rExtractor, and tested it using two datasets. Our experimental results show that our approach achieves significantly higher accuracy than previous approaches. Furthermore, it establishes the case for use of vision-based algorithms in the context of data extraction from web sites.

A web-based telemedicine system for low-resource settings 13 years on: insights from referrers and specialists

Background: One way to tackle health inequalities in resource-poor settings is to establish links between doctors and health professionals there and specialists elsewhere using web-based telemedicine. One such system run by the Swinfen Charitable Trust has been in existence for 13 years which is an unusually long time for such systems.

Objective: We wanted to gain some insights into whether and how this system might be improved.

Methods: We carried out a survey by questionnaire of referrers and specialists over a six months period.

Results: During the study period, a total of 111 cases were referred from 35 different practitioners, of whom 24% were not doctors. Survey replies were received concerning 67 cases, a response rate of 61 per cent. Eighty-seven per cent of the responding referrers found the telemedicine advice useful, and 78% were able to follow the advice provided. As a result of the advice received, the diagnosis was changed in 22% of all cases and confirmed in a further 18 per cent. Patient management was changed in 33 per cent. There was no substantial difference between doctors and non-doctors. During the study period, the 111 cases were responded to by 148 specialists, from whom 108 replies to the questionnaire were received, a response rate of 73 per cent. About half of the specialists (47%) felt that their advice had improved the management of the patients. There were 62 cases where it was possible to match up the opinions of the referrer and the consultants about the value of a specific teleconsultation. In 34 cases (55%) the referrers and specialists agreed about the value. However, in 28 cases (45%) they did not: specialists markedly underestimated the value of a consultation compared to referrers. Both referrers and specialist were extremely positive about the system which appears to be working well. Minor changes such as a clearer referral template and an improved web interface for specialists may improve it.

Pull-out forces in shear connectors in composite beams with large web openings

Composite beams with large web openings are often used, and their design is controlled by Vierendeel bending at the four corners of each opening, which is assisted by local composite action with the floor slab. Development of this Vierendeel bending resistance may be limited by pull-out failure of the shear connectors. In this paper, a non-linear elasto-plastic finite element model of a composite beam with web openings was used to investigate this mode of pull-out failure. A test was performed on a typical composite slab in which the shear connectors were subject to pure tension and the failure load was 67 kN, which is approximately 70% of the longitudinal shear resistance. The results of the finite element model are compared against those obtained using the established design theory, that does not limit the vertical pull-out resistance of the shear connectors. It is shown that the local bending resistance due to composite action should be reduced when limited by pull-out of the shear connectors. A parametric study investigated the effect of openings of 600 to 1200 mm length. A simple model is developed to establish the Vierendeel bending resistance, when limited by pull-out of the shear connectors.