Parallel streaming signature EM-tree: A clustering algorithm for web scale applications

The proliferation of the web presents an unsolved problem of automatically analyzing billions of pages of natural language. We introduce a scalable algorithm that clusters hundreds of millions of web pages into hundreds of thousands of clusters. It does this on a single mid-range machine using efficient algorithms and compressed document representations. It is applied to two web-scale crawls covering tens of terabytes. ClueWeb09 and ClueWeb12 contain 500 and 733 million web pages and were clustered into 500,000 to 700,000 clusters. To the best of our knowledge, such fine grained clustering has not been previously demonstrated. Previous approaches clustered a sample that limits the maximum number of discoverable clusters. The proposed EM-tree algorithm uses the entire collection in clustering and produces several orders of magnitude more clusters than the existing algorithms. Fine grained clustering is necessary for meaningful clustering in massive collections where the number of distinct topics grows linearly with collection size. These fine-grained clusters show an improved cluster quality when assessed with two novel evaluations using ad hoc search relevance judgments and spam classifications for external validation. These evaluations solve the problem of assessing the quality of clusters where categorical labeling is unavailable and unfeasible.

Fuzzy-logic based frequency controller for wind farms augmented with energy storage systems

Displacement of conventional synchronous generators by non-inertial units such as wind or solar generators will result in reduced-system inertia affecting under-frequency response. Frequency control is important to avoid equipment damage, load shedding, and possible blackouts. Wind generators along with energy storage systems can be used to improve the frequency response of low-inertia power system. This paper proposes a fuzzy-logic based frequency controller (FFC) for wind farms augmented with energy storage systems (wind-storage system) to improve the primary frequency response in future low-inertia hybrid power system. The proposed controller provides bidirectional real power injection using system frequency deviations and rate of change of frequency (RoCoF). Moreover, FFC ensures optimal use of energy from wind farms and storage units by eliminating the inflexible de-loading of wind energy and minimizing the required storage capacity. The efficacy of the proposed FFC is verified on the low-inertia hybrid power system.

A Monte-Carlo tree search in argumentation

Monte-Carlo Tree Search (MCTS) is a heuristic to search in large trees. We apply it to argumentative puzzles where MCTS pursues the best argumentation with respect to a set of arguments to be argued. To make our ideas as widely applicable as possible, we integrate MCTS to an abstract setting for argumentation where the content of arguments is left unspecified. Experimental results show the pertinence of this integration for learning argumentations by comparing it with a basic reinforcement learning.

Micromorphology and anatomy of leaves of Syzygium floribundum (Myrtaceae: Syzygieae), a rainforest tree endemic to eastern Australia

Although species of Syzygium are abundant components of the rainforests in Queensland and New South Wales, little is known about the anatomy of the Australian taxa. Here we describe the foliar anatomy and micromorphology of Syzygium floribundum (syn: Waterhousea floribunda) using standard protocols for scanning electron microscopy (SEM) and light microscopy. Syzygium floribundum possesses dorsiventral leaves with cyclo-staurocytic stomata, single epidermis, internal phloem, rhombus-shaped calcium oxalate crystals and complex-open midrib. In general, leaf anatomical and micromorphological characters are common with some species of the tribe Syzygieae. However, this particular combination of leaf characters has not been reported in a species of the genus. The anatomy of the species is typical of mesophytic taxa.

Design and flight testing of an integrated solar powered UAV and WSN for greenhouse gas monitoring emissions in agricultural farms

There is an increased interest in measuring the amount of greenhouse gases produced by farming practices . This paper describes an integrated solar powered Unmanned Air Vehicles (UAV) and Wireless Sensor Network (WSN) gas sensing system for greenhouse gas emissions in agricultural lands. The system uses a generic gas sensing system for CH4 and CO2 concentrations using metal oxide (MoX) and non-dispersive infrared sensors, and a new solar cell encapsulation method to power the unmanned aerial system (UAS)as well as a data management platform to store, analyze and share the information with operators and external users. The system was successfully field tested at ground and low altitudes, collecting, storing and transmitting data in real time to a central node for analysis and 3D mapping. The system can be used in a wide range of outdoor applications at a relatively low operational cost. In particular, agricultural environments are increasingly subject to emissions mitigation policies. Accurate measurements of CH4 and CO2 with its temporal and spatial variability can provide farm managers key information to plan agricultural practices. A video of the bench and flight test performed can be seen in the following link: https://www.youtube.com/watch?v=Bwas7stYIxQ

Secondary attribute retrieval using tree data structures

Several techniques are known for searching an ordered collection of data. The techniques and analyses of retrieval methods based on primary attributes are straightforward. Retrieval using secondary attributes depends on several factors. For secondary attribute retrieval, the linear structures—inverted lists, multilists, doubly linked lists—and the recently proposed nonlinear tree structures—multiple attribute tree (MAT), K-d tree (kdT)—have their individual merits. It is shown in this paper that, of the two tree structures, MAT possesses several features of a systematic data structure for external file organisation which make it superior to kdT. Analytic estimates for the complexity of node searchers, in MAT and kdT for several types of queries, are developed and compared.

A comparative study of multiple attribute tree and inverted file structures for large bibliographic files

A variety of data structures such as inverted file, multi-lists, quad tree, k-d tree, range tree, polygon tree, quintary tree, multidimensional tries, segment tree, doubly chained tree, the grid file, d-fold tree. super B-tree, Multiple Attribute Tree (MAT), etc. have been studied for multidimensional searching and related problems. Physical data base organization, which is an important application of multidimensional searching, is traditionally and mostly handled by employing inverted file. This study proposes MAT data structure for bibliographic file systems, by illustrating the superiority of MAT data structure over inverted file. Both the methods are compared in terms of preprocessing, storage and query costs. Worst-case complexity analysis of both the methods, for a partial match query, is carried out in two cases: (a) when directory resides in main memory, (b) when directory resides in secondary memory. In both cases, MAT data structure is shown to be more efficient than the inverted file method. Arguments are given to illustrate the superiority of MAT data structure in an average case also. An efficient adaptation of MAT data structure, that exploits the special features of MAT structure and bibliographic files, is proposed for bibliographic file systems. In this adaptation, suitable techniques for fixing and ranking of the attributes for MAT data structure are proposed. Conclusions and proposals for future research are presented.

Bayesian and Decision Tree Approaches for Pattern Recognition Including Feature Measurement Costs

The minimum cost classifier when general cost functionsare associated with the tasks of feature measurement and classification is formulated as a decision graph which does not reject class labels at intermediate stages. Noting its complexities, a heuristic procedure to simplify this scheme to a binary decision tree is presented. The optimizationof the binary tree in this context is carried out using ynamicprogramming. This technique is applied to the voiced-unvoiced-silence classification in speech processing.

Milk Production Responses to Oversowing a Portion of Tropical Grass Pasture with Summer Crop Legumes on Sub-tropical Dairy Farms

Northern Australian dairy farms have a large area of tropical dryland grass pasture available for use as summer pastures. Late summer-autumn in sub-tropical Australia is traditionally a difficult period in which to produce milk because of the decline in both quality and quantity of tropical grasses (Ehrlich et al. 1994). Options to improve autumn feed on dairy farms include introducing forage crops and conservation, increasing concentrate feeding and introducing legumes. Perennial tropical legumes have not been successful at this time of year because of their inability to sustain stocking rates above one cow/ha. This experiment, conducted on farms, was designed to test if annual crop legumes could be successfully oversown into tropical grass areas using minimal till methods to measure the subsequent impact on milk production on farms. Previous experiments using annual legumes in plots at Mutdapilly Research Station had demonstrated yields up to 10 t/ha can be achieved using annual tropical legumes with protein levels as high as 20% in the whole legume plant. Animal production for a consuming world : proceedings of 9th Congress of the Asian-Australasian Association of Animal Production Societies [AAAP] and 23rd Biennial Conference of the Australian Society of Animal Production [ASAP] and 17th Annual Symposium of the University of Sydney, Dairy Research Foundation, [DRF]. 2-7 July 2000, Sydney, Australia.

Tree species diversity and ecosystem function: Can tropical multi-species plantations generate greater productivity?

Results from the humid tropics of Australia demonstrate that diverse plantations can achieve greater productivity than monocultures. We found that increases in both the observed species number and the effective species richness were significantly related to increased levels of productivity as measured by stand basal area or mean individual tree basal area. Four of five plantation species were more productive in mixtures with other species than in monocultures, offering on average, a 55% increase in mean tree basal area. A general linear model suggests that species richness had a significant effect on mean individual tree basal area when environmental variables were included in the model. As monoculture plantations are currently the preferred reforestation method throughout the tropics these results suggest that significant productivity and ecological gains could be made if multi-species plantations are more broadly pursued.

Achievements in forest tree improvement in Australia and New Zealand 6: Genetic improvement and conservation of Araucaria cunninghamii in Queensland

Araucaria cunninghamii (hoop pine) typically occurs as an emergent tree over subtropical and tropical rainforests, in a discontinuous distribution that extends from West Irian Jaya at about 0°30'S, through the highlands of Indonesian New Guinea and Papua New Guinea, along the east coast of Australia from 11°39'S in Queensland to 30°35'S in northern New South Wales. Plantations established in Queensland since the 1920s now total about 44000 ha, and constitute the primary source for the continuing supply of hoop pine quality timber and pulpwood, with a sustainable harvest exceeding 440 000 m3 y-1. Establishment of these managed plantations allowed logging of all native forests of Araucaria species (hoop pine and bunya pine, A. bidwillii) on state-owned lands to cease in the late 1980s, and the preservation of large areas of araucarian forest types within a system of state-owned and managed reserves. The successful plantation program with this species has been strongly supported by genetic improvement activities since the late 1940s - through knowledge of provenance variation and reproductive biology, the provision of reliable sources of improved seed, and the capture of substantial genetic gains in traits of economic importance (for example growth, stem straightness, internode length and spiral grain). As such, hoop pine is one of the few tropical tree species that, for more than half a century, has been the subject of continuous genetic improvement. The history of commercialisation and genetic improvement of hoop pine provides an excellent example of the dual economic and conservation benefits that may be obtained in tropical tree species through the integration of gene conservation and genetic improvement with commercial plantation development. This paper outlines the natural distribution and reproductive biology of hoop pine, describes the major achievements of the genetic improvement program in Queensland over the past 50+ y, summarises current understanding of the genetic variation and control of key selection traits, and outlines the means by which genetic diversity in the species is being conserved.

Characterization of tree-to-tree variation in morphological, nutritional and medicinal properties of Canarium indicum nuts

As part of a feasibility study of the commercialization potential of C. indicum nuts as Agroforestry Tree Products in Papua New Guinea, preliminary characterization studies have examined the tree-to-tree variation in morphological traits (nut and kernel mass and kernel:nut ratio), as well as nutritional (carbohydrate, fat, protein, sodium, vitamin E) and medicinal traits (anti-oxidant activity, anti-inflammatory activity and phenolic content) of kernels from 18 to 72 trees in a small number of different villages of Papua New Guinea (East New Britain Province). There was continuous variation in these traits indicating opportunities for multiple trait cultivar development targeted at food and pharmaceutical markets. Certain traits, for example anti-inflammatory activity, in which tree-to-tree variation was highly significant, present greater opportunities than others, such as saturated:unsaturated fatty acid ratio. This intraspecific variation was greater within populations than between populations. The data presented has allowed the development of a strategy to domesticate C. indicum for cultivation in homegardens and cocoa-coconut agroforests, using a participatory approach aimed at the production of agroforestry tree products (AFTPs) to empower small-holders and enhance their livelihoods and income.

Light environment and tree development of young Acacia melanoxylon in mixed-species regrowth forest, Tasmania, Australia

Blackwood (Acacia melanoxylon R. Br.) is a valuable leguminous cabinetwood species which is commonly found as a canopy or subcanopy tree in a broad range of mixed-species moist forests on tablelands and coastal escarpments in eastern Australia. This paper reports on the competitive light environment of a commercially valuable multi-species regrowth forest in NW Tasmania, in order to define some of the functional interactions and competitive dynamics of these stands. Comparative observations were made of the internal forest light environment in response to small-gap silvicultural treatments, in a young regenerative mix of three codominant tree species. Light measurements were made during periods of maximum external irradiance of the regrowth Eucalyptus obliqua/A. melanoxylon forest canopy at age 10.5 years. This was at a time of vigourous stand development, 4.5 years following the application of three experimental silvicultural treatments whose effects were observed in comparison with an untreated canopy sample designed as a control. Minimal irradiance was observed within and beneath the dense subcanopy of the native nurse species (Pomaderris apetala) which closely surrounds young blackwood regeneration. Unlike current plantation nurse systems, the dense foliage of the native broadleaved Pomaderris all but eliminated direct side-light and low-angle illumination of the young blackwood, from the beginning of tree establishment. The results demonstrated that retention of these densely stocked native codominants effectively suppressed both size and frequency of blackwood branches on the lower bole, through effective and persistent interception of sunlight. Vigorous young blackwood crowns later overtopped the codominant nurse species, achieving a predictable height of branch-free bole. This competitive outcome offers a valuable tool for management of blackwood crown dynamics, stem form and branch habit through manipulation of light environment in young native regrowth systems. Results demonstrate that effective self-pruning in the lower bole of blackwood is achieved through a marked reduction in direct and diffuse sunlight incident on the lower crown, notably to less than 10-15% of full sunlight intensity during conditions of maximum insolation. The results also contain insights for the improved design of mixed-species plantation nurse systems using these or functionally similar species' combinations. Based on evidence presented here for native regrowth forest, plantation nurse systems for blackwood will need to achieve 85-90% interception of external side-light during early years of tree development if self-pruning is to emulate the results achieved in the native nurse system.

Between-tree variation in fruit quality and fruit mineral concentrations of Hass avocados

Inconsistent internal fruit quality in Hass avocados affects consumer confidence. To determine the influence of individual trees on fruit quality, Hass avocado fruit were harvested from adjacent trees of similar external appearance in 3 commercial orchards in 1998 and 1 orchard in 1999. The trees in each orchard were grown with similar commercial practices and in similar soil types. Within each location, there were significant (P<0.05) differences in the mean ripe fruit quality between trees with respect to fruit body rot severity (mainly anthracnose) with and without cold storage, internal disorders severity due to diffuse discolouration and vascular browning (after cold storage), days to ripen, percentage dry matter, and the percentage of the skin area with purple-black colour when ripe. These effects were also noted in the same orchard in 1999. There were significant (P<0.05) differences in fruit flesh calcium, magnesium, potassium, boron and zinc concentrations between trees. Significant (P<0.05) correlations were observed between average fruit mineral concentrations in each tree (particularly calcium, magnesium and potassium) and body rot severity, percentage dry matter and fruit mass. There was little conclusive evidence that characteristics such as the growth of the non-suberised roots or the degree of scion under- or overgrowth was involved in these tree effects; however, differences between trees with respect to other rootstock characteristics may be involved. The inconsistency of the correlations across sites and years suggested that other factors apart from tree influences could also affect the relationship between fruit minerals and fruit quality.