External knowledge and query strategies in active learning: A study in clinical information extraction

This paper presents a new active learning query strategy for information extraction, called Domain Knowledge Informativeness (DKI). Active learning is often used to reduce the amount of annotation effort required to obtain training data for machine learning algorithms. A key component of an active learning approach is the query strategy, which is used to iteratively select samples for annotation. Knowledge resources have been used in information extraction as a means to derive additional features for sample representation. DKI is, however, the first query strategy that exploits such resources to inform sample selection. To evaluate the merits of DKI, in particular with respect to the reduction in annotation effort that the new query strategy allows to achieve, we conduct a comprehensive empirical comparison of active learning query strategies for information extraction within the clinical domain. The clinical domain was chosen for this work because of the availability of extensive structured knowledge resources which have often been exploited for feature generation. In addition, the clinical domain offers a compelling use case for active learning because of the necessary high costs and hurdles associated with obtaining annotations in this domain. Our experimental findings demonstrated that 1) amongst existing query strategies, the ones based on the classification model’s confidence are a better choice for clinical data as they perform equally well with a much lighter computational load, and 2) significant reductions in annotation effort are achievable by exploiting knowledge resources within active learning query strategies, with up to 14% less tokens and concepts to manually annotate than with state-of-the-art query strategies.

A reproducible method for automated extraction of brain volumes from 3D human head MR images

An automated method for extracting brain volumes from three commonly acquired three-dimensional (3D) MR images (proton density, T1 weighted, and T2-weighted) of the human head is described. The procedure is divided into four levels: preprocessing, segmentation, scalp removal, and postprocessing. A user-provided reference point is the sole operator-dependent input required. The method's parameters were first optimized and then fixed and applied to 30 repeat data sets from 15 normal older adult subjects to investigate its reproducibility. Percent differences between total brain volumes (TBVs) for the subjects' repeated data sets ranged from .5% to 2.2%. We conclude that the method is both robust and reproducible and has the potential for wide application.

Utility of web content blocks in content extraction

Currently we are facing an overburdening growth of the number of reliable information sources on the Internet. The quantity of information available to everyone via Internet is dramatically growing each year [15]. At the same time, temporal and cognitive resources of human users are not changing, therefore causing a phenomenon of information overload. World Wide Web is one of the main sources of information for decision makers (reference to my research). However our studies show that, at least in Poland, the decision makers see some important problems when turning to Internet as a source of decision information. One of the most common obstacles raised is distribution of relevant information among many sources, and therefore need to visit different Web sources in order to collect all important content and analyze it. A few research groups have recently turned to the problem of information extraction from the Web [13]. The most effort so far has been directed toward collecting data from dispersed databases accessible via web pages (related to as data extraction or information extraction from the Web) and towards understanding natural language texts by means of fact, entity, and association recognition (related to as information extraction). Data extraction efforts show some interesting results, however proper integration of web databases is still beyond us. Information extraction field has been recently very successful in retrieving information from natural language texts, however it is still lacking abilities to understand more complex information, requiring use of common sense knowledge, discourse analysis and disambiguation techniques.

Robust Web content extraction

We present an empirical evaluation and comparison of two content extraction methods in HTML: absolute XPath expressions and relative XPath expressions. We argue that the relative XPath expressions, although not widely used, should be used in preference to absolute XPath expressions in extracting content from human-created Web documents. Evaluation of robustness covers four thousand queries executed on several hundred webpages. We show that in referencing parts of real world dynamic HTML documents, relative XPath expressions are on average significantly more robust than absolute XPath ones.

Development of a new design expression for the in-plane shear capacity of the partially grouted concrete masonry walls

Partially grouted masonry walls subjected to in-plane shear exhibit a complex behaviour because of the influence of the aspect ratio, the pre-compression, the grouting pattern, the ratios of the horizontal and the vertical reinforcements, the boundary conditions and the characteristics of the constituent materials. The existing in-plane shear expressions for the partially grouted masonry are formulated as sum of strength of three parameters, namely, the masonry, the reinforcement and the axial force. The parameter ‘masonry’ includes the wall aspect ratio and the masonry compressive strength; the aspect ratio of the unreinforced panel inscribed into the grouted cores and bond beams are not considered, although failure is often dominated by these unreinforced masonry panels. This paper describes the dominance of these panels, particularly those that are squat, to the shear capacity of whole of shear walls. Further, the current design formulae are shown highly un-conservative by many researchers; this paper provides a potential reason for this un-conservativeness. It is shown that by including an additional term of the unreinforced panel aspect ratio a rational design formula could be established. This new expression is validated with independent test results reported in the literature – both Australian and overseas; the predictions are shown to be conservative.

Determination of tricyclazole in water using solid phase extraction and liquid chromatography

A method for determination of tricyclazole in water using solid phase extraction and high performance liquid chromatography (HPLC) with UV detection at 230nm and a mobile phase of acetonitrile:water (20:80, v/v) was developed. A performance comparison between two types of solid phase sorbents, the C18 sorbent of Supelclean ENVI-18 cartridge and the styrene-divinyl benzene copolymer sorbent of Sep-Pak PS2-Plus cartridge was conducted. The Sep-Pak PS2-Plus cartridges were found more suitable for extracting tricyclazole from water samples than the Supelclean ENVI-18 cartridges. For this cartridge, both methanol and ethyl acetate produced good results. The method was validated with good linearity and with a limit of detection of 0.008gL-1 for a 500-fold concentration through the SPE procedure. The recoveries of the method were stable at 80% and the precision was from 1.1-6.0% within the range of fortified concentrations. The validated method was also applied to measure the concentrations of tricyclazole in real paddy water.

Design expressions for the in-plane shear capacity of confined masonry shear walls containing squat panels

In-plane shear capacity formulation of reinforced masonry is commonly conceived as the sum of the capacities of three parameters, viz, the masonry, the reinforcement, and the precompression. The term “masonry” incorporates the aspect ratio of the wall without any regard to the aspect ratio of the panels inscribed (and hence confined) by the vertical and the horizontal reinforced grout cores. This paper proposes design expressions in which the aspect ratio of such panels is explicitly included. For this purpose, the grouted confining cores are regarded as a grid of confining elements within which the panels are positioned. These confined masonry panels are then considered as building blocks for multi-bay, multi-storied confined masonry shear walls and analyzed using an experimentally validated macroscopic finite-element model. Results of the analyzes of 161 confined masonry walls containing panels of height to length ratio less than 1.0 have been regressed to formulate design expressions. These expressions have been first validated using independent test data sets and then compared with the existing equations in some selected international design standards. The concept of including the unreinforced masonry panel aspect ratio as an additional term in the design expression for partially grouted/confined masonry shear walls is recommended based on the conclusions from this paper.

Acoustic feature extraction using perceptual wavelet packet decomposition for frog call classification

Frog protection has become increasingly essential due to the rapid decline of its biodiversity. Therefore, it is valuable to develop new methods for studying this biodiversity. In this paper, a novel feature extraction method is proposed based on perceptual wavelet packet decomposition for classifying frog calls in noisy environments. Pre-processing and syllable segmentation are first applied to the frog call. Then, a spectral peak track is extracted from each syllable if possible. Track duration, dominant frequency and oscillation rate are directly extracted from the track. With k-means clustering algorithm, the calculated dominant frequency of all frog species is clustered into k parts, which produce a frequency scale for wavelet packet decomposition. Based on the adaptive frequency scale, wavelet packet decomposition is applied to the frog calls. Using the wavelet packet decomposition coefficients, a new feature set named perceptual wavelet packet decomposition sub-band cepstral coefficients is extracted. Finally, a k-nearest neighbour (k-NN) classifier is used for the classification. The experiment results show that the proposed features can achieve an average classification accuracy of 97.45% which outperforms syllable features (86.87%) and Mel-frequency cepstral coefficients (MFCCs) feature (90.80%).

Analysis of word embeddings and sequence features for clinical information extraction

This study investigates the use of unsupervised features derived from word embedding approaches and novel sequence representation approaches for improving clinical information extraction systems. Our results corroborate previous findings that indicate that the use of word embeddings significantly improve the effectiveness of concept extraction models; however, we further determine the influence that the corpora used to generate such features have. We also demonstrate the promise of sequence-based unsupervised features for further improving concept extraction.

Out-of-plane deformation and failure of masonry walls with various forms of reinforcement

Out-of-plane behaviour of mortared and mortarless masonry walls with various forms of reinforcement, including unreinforced masonry as a base case is examined using a layered shell element based explicit finite element modelling method. Wall systems containing internal reinforcement, external surface reinforcement and intermittently laced reinforced concrete members and unreinforced masonry panels are considered. Masonry is modelled as a layer with macroscopic orthotropic properties; external reinforcing render, grout and reinforcing bars are modelled as distinct layers of the shell element. Predictions from the layered shell model have been validated using several out-of-plane experimental datasets reported in the literature. The model is used to examine the effectiveness of two retrofitting schemes for an unreinforced masonry wall.

An explicit finite element modelling method for masonry walls under out-of-plane loading

An explicit finite element modelling method is formulated using a layered shell element to examine the behaviour of masonry walls subject to out-of-plane loading. Masonry is modelled as a homogenised material with distinct directional properties that are calibrated from datasets of a “C” shaped wall tested under pressure loading applied to its web. The predictions of the layered shell model have been validated using several out-of-plane experimental datasets reported in the literature. Profound influence of support conditions, aspect ratio, pre-compression and opening to the strength and ductility of masonry walls is exhibited from the sensitivity analyses performed using the model.

Gravity-induced coronal plane joint moments in adolescent idiopathic scoliosis

Background Adolescent Idiopathic Scoliosis is the most common type of spinal deformity, and whilst the risk of progression appears to be biomechanically mediated (larger deformities are more likely to progress), the detailed biomechanical mechanisms driving progression are not well understood. Gravitational forces in the upright position are the primary sustained loads experienced by the spine. In scoliosis they are asymmetrical, generating moments about the spinal joints which may promote asymmetrical growth and deformity progression. Using 3D imaging modalities to estimate segmental torso masses allows the gravitational loading on the scoliotic spine to be determined. The resulting distribution of joint moments aids understanding of the mechanics of scoliosis progression. Methods Existing low-dose CT scans were used to estimate torso segment masses and joint moments for 20 female scoliosis patients. Intervertebral joint moments at each vertebral level were found by summing the moments of each of the torso segment masses above the required joint. Results The patients’ mean age was 15.3 years (SD 2.3; range 11.9 – 22.3 years); mean thoracic major Cobb angle 52° (SD 5.9°; range 42°-63°) and mean weight 57.5 kg (SD 11.5 kg; range 41 – 84.7 kg). Joint moments of up to 7 Nm were estimated at the apical level. No significant correlation was found between the patients’ major Cobb angles and apical joint moments. Conclusions Patients with larger Cobb angles do not necessarily have higher joint moments, and curve shape is an important determinant of joint moment distribution. These findings may help to explain the variations in progression between individual patients. This study suggests that substantial corrective forces are required of either internal instrumentation or orthoses to effectively counter the gravity-induced moments acting to deform the spinal joints of idiopathic scoliosis patients.

Studies on the out-of-plane behaviour of masonry walls

The prime aim of this PhD thesis is to contribute to the current body of knowledge on the out-of-plane performance of masonry walls through systematic investigation of the key parameters and provide insight into the design clauses of Australian Masonry Standard (AS3700-2011). The research work has been carried out through numerical simulation based on a 3D layered shell element model. The model demonstrated capability to simulate various forms of new and existing masonry systems commonly constructed in Australia such as unreinforced, internally and externally reinforced, confined and dry-stack masonry. In addition, the model simultaneously simulates in-plane and out-of-plane responses.

Optimisation of in-cell accelerated solvent extraction technique for the determination of organochlorine pesticides in river sediments

Organochlorine pesticides (OCPs) are ubiquitous environmental contaminants with adverse impacts on aquatic biota, wildlife and human health even at low concentrations. However, conventional methods for their determination in river sediments are resource intensive. This paper presents an approach that is rapid and also reliable for the detection of OCPs. Accelerated Solvent Extraction (ASE) with in-cell silica gel clean-up followed by Triple Quadrupole Gas Chromatograph Mass Spectrometry (GCMS/MS) was used to recover OCPs from sediment samples. Variables such as temperature, solvent ratio, adsorbent mass and extraction cycle were evaluated and optimised for the extraction. With the exception of Aldrin, which was unaffected by any of the variables evaluated, the recovery of OCPs from sediment samples was largely influenced by solvent ratio and adsorbent mass and, to some extent, the number of cycles and temperature. The optimised conditions for OCPs extraction in sediment with good recoveries were determined to be 4 cycles, 4.5 g of silica gel, 105 ᴼC, and 4:3 v/v DCM: hexane mixture. With the exception of two compounds (α-BHC and Aldrin) whose recoveries were low (59.73 and 47.66 % respectively), the recovery of the other pesticides were in the range 85.35 – 117.97% with precision < 10 % RSD. The method developed significantly reduces sample preparation time, the amount of solvent used, matrix interference, and is highly sensitive and selective.

A curve shortening flow rule for closed embedded plane curves with a prescribed rate of change in enclosed area

Motivated by a problem from fluid mechanics, we consider a generalization of the standard curve shortening flow problem for a closed embedded plane curve such that the area enclosed by the curve is forced to decrease at a prescribed rate. Using formal asymptotic and numerical techniques, we derive possible extinction shapes as the curve contracts to a point, dependent on the rate of decreasing area; we find there is a wider class of extinction shapes than for standard curve shortening, for which initially simple closed curves are always asymptotically circular. We also provide numerical evidence that self-intersection is possible for non-convex initial conditions, distinguishing between pinch-off and coalescence of the curve interior.