Parallel streaming signature EM-tree: A clustering algorithm for web scale applications

The proliferation of the web presents an unsolved problem of automatically analyzing billions of pages of natural language. We introduce a scalable algorithm that clusters hundreds of millions of web pages into hundreds of thousands of clusters. It does this on a single mid-range machine using efficient algorithms and compressed document representations. It is applied to two web-scale crawls covering tens of terabytes. ClueWeb09 and ClueWeb12 contain 500 and 733 million web pages and were clustered into 500,000 to 700,000 clusters. To the best of our knowledge, such fine grained clustering has not been previously demonstrated. Previous approaches clustered a sample that limits the maximum number of discoverable clusters. The proposed EM-tree algorithm uses the entire collection in clustering and produces several orders of magnitude more clusters than the existing algorithms. Fine grained clustering is necessary for meaningful clustering in massive collections where the number of distinct topics grows linearly with collection size. These fine-grained clusters show an improved cluster quality when assessed with two novel evaluations using ad hoc search relevance judgments and spam classifications for external validation. These evaluations solve the problem of assessing the quality of clusters where categorical labeling is unavailable and unfeasible.

A Monte-Carlo tree search in argumentation

Monte-Carlo Tree Search (MCTS) is a heuristic to search in large trees. We apply it to argumentative puzzles where MCTS pursues the best argumentation with respect to a set of arguments to be argued. To make our ideas as widely applicable as possible, we integrate MCTS to an abstract setting for argumentation where the content of arguments is left unspecified. Experimental results show the pertinence of this integration for learning argumentations by comparing it with a basic reinforcement learning.

Micromorphology and anatomy of leaves of Syzygium floribundum (Myrtaceae: Syzygieae), a rainforest tree endemic to eastern Australia

Although species of Syzygium are abundant components of the rainforests in Queensland and New South Wales, little is known about the anatomy of the Australian taxa. Here we describe the foliar anatomy and micromorphology of Syzygium floribundum (syn: Waterhousea floribunda) using standard protocols for scanning electron microscopy (SEM) and light microscopy. Syzygium floribundum possesses dorsiventral leaves with cyclo-staurocytic stomata, single epidermis, internal phloem, rhombus-shaped calcium oxalate crystals and complex-open midrib. In general, leaf anatomical and micromorphological characters are common with some species of the tribe Syzygieae. However, this particular combination of leaf characters has not been reported in a species of the genus. The anatomy of the species is typical of mesophytic taxa.

Identification of putative regulatory motifs in the upstream regions of co-expressed functional groups of genes in Plasmodium falciparum

Background: Regulation of gene expression in Plasmodium falciparum (Pf) remains poorly understood. While over half the genes are estimated to be regulated at the transcriptional level, few regulatory motifs and transcription regulators have been found. Results: The study seeks to identify putative regulatory motifs in the upstream regions of 13 functional groups of genes expressed in the intraerythrocytic developmental cycle of Pf. Three motif-discovery programs were used for the purpose, and motifs were searched for only on the gene coding strand. Four motifs – the 'G-rich', the 'C-rich', the 'TGTG' and the 'CACA' motifs – were identified, and zero to all four of these occur in the 13 sets of upstream regions. The 'CACA motif' was absent in functional groups expressed during the ring to early trophozoite transition. For functional groups expressed in each transition, the motifs tended to be similar. Upstream motifs in some functional groups showed 'positional conservation' by occurring at similar positions relative to the translational start site (TLS); this increases their significance as regulatory motifs. In the ribonucleotide synthesis, mitochondrial, proteasome and organellar translation machinery genes, G-rich, C-rich, CACA and TGTG motifs, respectively, occur with striking positional conservation. In the organellar translation machinery group, G-rich motifs occur close to the TLS. The same motifs were sometimes identified for multiple functional groups; differences in location and abundance of the motifs appear to ensure different modes of action. Conclusion: The identification of positionally conserved over-represented upstream motifs throws light on putative regulatory elements for transcription in Pf.

A pseudo-dynamical systems approach to a class of inverse problems in engineering

A pseudo-dynamical approach for a class of inverse problems involving static measurements is proposed and explored. Following linearization of the minimizing functional associated with the underlying optimization problem, the new strategy results in a system of linearized ordinary differential equations (ODEs) whose steady-state solutions yield the desired reconstruction. We consider some explicit and implicit schemes for integrating the ODEs and thus establish a deterministic reconstruction strategy without an explicit use of regularization. A stochastic reconstruction strategy is then developed making use of an ensemble Kalman filter wherein these ODEs serve as the measurement model. Finally, we assess the numerical efficacy of the developed tools against a few linear and nonlinear inverse problems of engineering interest.

Secondary attribute retrieval using tree data structures

Several techniques are known for searching an ordered collection of data. The techniques and analyses of retrieval methods based on primary attributes are straightforward. Retrieval using secondary attributes depends on several factors. For secondary attribute retrieval, the linear structures—inverted lists, multilists, doubly linked lists—and the recently proposed nonlinear tree structures—multiple attribute tree (MAT), K-d tree (kdT)—have their individual merits. It is shown in this paper that, of the two tree structures, MAT possesses several features of a systematic data structure for external file organisation which make it superior to kdT. Analytic estimates for the complexity of node searchers, in MAT and kdT for several types of queries, are developed and compared.

A comparative study of multiple attribute tree and inverted file structures for large bibliographic files

A variety of data structures such as inverted file, multi-lists, quad tree, k-d tree, range tree, polygon tree, quintary tree, multidimensional tries, segment tree, doubly chained tree, the grid file, d-fold tree. super B-tree, Multiple Attribute Tree (MAT), etc. have been studied for multidimensional searching and related problems. Physical data base organization, which is an important application of multidimensional searching, is traditionally and mostly handled by employing inverted file. This study proposes MAT data structure for bibliographic file systems, by illustrating the superiority of MAT data structure over inverted file. Both the methods are compared in terms of preprocessing, storage and query costs. Worst-case complexity analysis of both the methods, for a partial match query, is carried out in two cases: (a) when directory resides in main memory, (b) when directory resides in secondary memory. In both cases, MAT data structure is shown to be more efficient than the inverted file method. Arguments are given to illustrate the superiority of MAT data structure in an average case also. An efficient adaptation of MAT data structure, that exploits the special features of MAT structure and bibliographic files, is proposed for bibliographic file systems. In this adaptation, suitable techniques for fixing and ranking of the attributes for MAT data structure are proposed. Conclusions and proposals for future research are presented.

Bayesian and Decision Tree Approaches for Pattern Recognition Including Feature Measurement Costs

The minimum cost classifier when general cost functionsare associated with the tasks of feature measurement and classification is formulated as a decision graph which does not reject class labels at intermediate stages. Noting its complexities, a heuristic procedure to simplify this scheme to a binary decision tree is presented. The optimizationof the binary tree in this context is carried out using ynamicprogramming. This technique is applied to the voiced-unvoiced-silence classification in speech processing.

Hantzsch 1,4-dihydropyridine esters and analogs: candidates for generating reproducible one-dimensional packing motifs

Examination of the symmetric Hantzsch 1,4-dihydropyridine ester derivatives of the prototypical nifedipine molecule indicates the tendency of this class of molecule to form a common packing motif. Crystal structure analysis of 2,6-dimethyl-1,4-dihydropyridine-3,5-dicarboxylic diesters and analogs reveals that they form extended chains, characterized as the C(6) packing motif, via intermolecular (amine) N-H...O=C (C3,C5 carbonyl) hydrogen bonds. In addition, all the prepared derivatives also satisfy the basic structural requirements for their high binding efficiency to the receptor. The reproducible C(6) packing motif observed among these compounds has a use in the design of solid-state materials.

Tree species diversity and ecosystem function: Can tropical multi-species plantations generate greater productivity?

Results from the humid tropics of Australia demonstrate that diverse plantations can achieve greater productivity than monocultures. We found that increases in both the observed species number and the effective species richness were significantly related to increased levels of productivity as measured by stand basal area or mean individual tree basal area. Four of five plantation species were more productive in mixtures with other species than in monocultures, offering on average, a 55% increase in mean tree basal area. A general linear model suggests that species richness had a significant effect on mean individual tree basal area when environmental variables were included in the model. As monoculture plantations are currently the preferred reforestation method throughout the tropics these results suggest that significant productivity and ecological gains could be made if multi-species plantations are more broadly pursued.

The Origin of Regioselectivity in a-Cleavage Reactions of Cyclopropenethiones: Potential Role of Pseudo-Jahn-Teller Effect in Substituted Cyclopropenyl Systems

Arylalkylcyclopropenethiones undergo highly regioselective photochemical a-cleavage via thioketene carbene intermediates, giving rise to products derived from the less stabilized carbene. UHF MIND0/3 calculations provide an insight into this unexpected regioselectivity. The nx* triplet of cyclopropenethione is calculated to have a highly unsymmetrical geometry with an elongated C-C bond, a delocalized thiaaUyl fragment, and a pyramidal radicaloid carbon (which eventually becomes the carbene center). From this molecular electronic structure, aryl group stabilization is expected to be more effective at the thiaallyl group rather than at the pyramidal radical center. Thus, the stability of the substituted triplet thione rather than that of the thioketene carbene determines the preferred regiochemistry of cleavage. The unusual structure of the cyclopropenethione triplet is suggested to be related to one of the Jahn-Teller distorted forms of the cyclopropenyl radical. An alternative symmetrical structure is adopted by the corresponding triplet of cyclopropenone, partly accounting for its differing photobehavior. A similar structural dichotomy is demonstrated for the corresponding radical anions as well.

Achievements in forest tree improvement in Australia and New Zealand 6: Genetic improvement and conservation of Araucaria cunninghamii in Queensland

Araucaria cunninghamii (hoop pine) typically occurs as an emergent tree over subtropical and tropical rainforests, in a discontinuous distribution that extends from West Irian Jaya at about 0°30'S, through the highlands of Indonesian New Guinea and Papua New Guinea, along the east coast of Australia from 11°39'S in Queensland to 30°35'S in northern New South Wales. Plantations established in Queensland since the 1920s now total about 44000 ha, and constitute the primary source for the continuing supply of hoop pine quality timber and pulpwood, with a sustainable harvest exceeding 440 000 m3 y-1. Establishment of these managed plantations allowed logging of all native forests of Araucaria species (hoop pine and bunya pine, A. bidwillii) on state-owned lands to cease in the late 1980s, and the preservation of large areas of araucarian forest types within a system of state-owned and managed reserves. The successful plantation program with this species has been strongly supported by genetic improvement activities since the late 1940s - through knowledge of provenance variation and reproductive biology, the provision of reliable sources of improved seed, and the capture of substantial genetic gains in traits of economic importance (for example growth, stem straightness, internode length and spiral grain). As such, hoop pine is one of the few tropical tree species that, for more than half a century, has been the subject of continuous genetic improvement. The history of commercialisation and genetic improvement of hoop pine provides an excellent example of the dual economic and conservation benefits that may be obtained in tropical tree species through the integration of gene conservation and genetic improvement with commercial plantation development. This paper outlines the natural distribution and reproductive biology of hoop pine, describes the major achievements of the genetic improvement program in Queensland over the past 50+ y, summarises current understanding of the genetic variation and control of key selection traits, and outlines the means by which genetic diversity in the species is being conserved.

Accelerating Pseudo-Marginal MCMC using Gaussian Processes

Pseudo-marginal methods such as the grouped independence Metropolis-Hastings (GIMH) and Markov chain within Metropolis (MCWM) algorithms have been introduced in the literature as an approach to perform Bayesian inference in latent variable models. These methods replace intractable likelihood calculations with unbiased estimates within Markov chain Monte Carlo algorithms. The GIMH method has the posterior of interest as its limiting distribution, but suffers from poor mixing if it is too computationally intensive to obtain high-precision likelihood estimates. The MCWM algorithm has better mixing properties, but less theoretical support. In this paper we propose to use Gaussian processes (GP) to accelerate the GIMH method, whilst using a short pilot run of MCWM to train the GP. Our new method, GP-GIMH, is illustrated on simulated data from a stochastic volatility and a gene network model.