Introducing a pilot data collection model for real-time evaluation of data redundancy

In order to reduce serious health incidents, individuals with high risks need to be identified as early as possible so that effective intervention and preventive care can be provided. This requires regular and efficient assessments of risk within communities that are the first point of contacts for individuals. Clinical Decision Support Systems CDSSs have been developed to help with the task of risk assessment, however such systems and their underpinning classification models are tailored towards those with clinical expertise. Communities where regular risk assessments are required lack such expertise. This paper presents the continuation of GRiST research team efforts to disseminate clinical expertise to communities. Based on our earlier published findings, this paper introduces the framework and skeleton for a data collection and risk classification model that evaluates data redundancy in real-time, detects the risk-informative data and guides the risk assessors towards collecting those data. By doing so, it enables non-experts within the communities to conduct reliable Mental Health risk triage.

A multi-filter enhanced genetic ensemble system for gene selection and sample classification of microarray data

Background: Feature selection techniques are critical to the analysis of high dimensional datasets. This is especially true in gene selection from microarray data which are commonly with extremely high feature-to-sample ratio. In addition to the essential objectives such as to reduce data noise, to reduce data redundancy, to improve sample classification accuracy, and to improve model generalization property, feature selection also helps biologists to focus on the selected genes to further validate their biological hypotheses.
Results: In this paper we describe an improved hybrid system for gene selection. It is based on a recently proposed genetic ensemble (GE) system. To enhance the generalization property of the selected genes or gene subsets and to overcome the overfitting problem of the GE system, we devised a mapping strategy to fuse the goodness information of each gene provided by multiple filtering algorithms. This information is then used for initialization and mutation operation of the genetic ensemble system.
Conclusion: We used four benchmark microarray datasets (including both binary-class and multi-class classification problems) for concept proving and model evaluation. The experimental results indicate that the proposed multi-filter enhanced genetic ensemble (MF-GE) system is able to improve sample classification accuracy, generate more compact gene subset, and converge to the selection results more quickly. The MF-GE system is very flexible as various combinations of multiple filters and classifiers can be incorporated based on the data characteristics and the user preferences.

A data fusion method in wireless sensor networks

The success of a Wireless Sensor Network (WSN) deployment strongly depends on the quality of service (QoS) it provides regarding issues such as data accuracy, data aggregation delays and network lifetime maximisation. This is especially challenging in data fusion mechanisms, where a small fraction of low quality data in the fusion input may negatively impact the overall fusion result. In this paper, we present a fuzzy-based data fusion approach for WSN with the aim of increasing the QoS whilst reducing the energy consumption of the sensor network. The proposed approach is able to distinguish and aggregate only true values of the collected data as such, thus reducing the burden of processing the entire data at the base station (BS). It is also able to eliminate redundant data and consequently reduce energy consumption thus increasing the network lifetime. We studied the effectiveness of the proposed data fusion approach experimentally and compared it with two baseline approaches in terms of data collection, number of transferred data packets and energy consumption. The results of the experiments show that the proposed approach achieves better results than the baseline approaches.

基于信道估计的RS纠错编码改进算法的设计与实现

提出了一种基于信道估计的RS纠错编码改进算法,该算法可以自适应地根据外界条件和环境对传输信道的干扰变化实时地调节编码系统的数据冗余量。仿真与完整的分析结果证实了该改进算法有效地改善了RS编码算法的传输效率;并且通过实际应用表明:良好的性能,高容错性适应于该通信系统的多种传输信道,具有很强的实用性。

Fuzzy-Rough Attribute Reduction with Application to Web Categorization.

R. Jensen and Q. Shen, 'Fuzzy-Rough Attribute Reduction with Application to Web Categorization,' Fuzzy Sets and Systems, vol. 141, no. 3, pp. 469-485, 2004.

Webpage Classification with ACO-enhanced Fuzzy-Rough Feature Selection.

R. Jensen and Q. Shen, 'Webpage Classification with ACO-enhanced Fuzzy-Rough Feature Selection,' Proceedings of the Fifth International Conference on Rough Sets and Current Trends in Computing (RSCTC 2006), LNAI 4259, pp. 147-156, 2006.

Improving flood models using LiDAR: progress and problems

Airborne scanning laser altimetry (LiDAR) is an important new data source for river flood modelling. LiDAR can give dense and accurate DTMs of floodplains for use as model bathymetry. Spatial resolutions of 0.5m or less are possible, with a height accuracy of 0.15m. LiDAR gives a Digital Surface Model (DSM), so vegetation removal software (e.g. TERRASCAN) must be used to obtain a DTM. An example used to illustrate the current state of the art will be the LiDAR data provided by the EA, which has been processed by their in-house software to convert the raw data to a ground DTM and separate vegetation height map. Their method distinguishes trees from buildings on the basis of object size. EA data products include the DTM with or without buildings removed, a vegetation height map, a DTM with bridges removed, etc. Most vegetation removal software ignores short vegetation less than say 1m high. We have attempted to extend vegetation height measurement to short vegetation using local height texture. Typically most of a floodplain may be covered in such vegetation. The idea is to assign friction coefficients depending on local vegetation height, so that friction is spatially varying. This obviates the need to calibrate a global floodplain friction coefficient. It’s not clear at present if the method is useful, but it’s worth testing further. The LiDAR DTM is usually determined by looking for local minima in the raw data, then interpolating between these to form a space-filling height surface. This is a low pass filtering operation, in which objects of high spatial frequency such as buildings, river embankments and walls may be incorrectly classed as vegetation. The problem is particularly acute in urban areas. A solution may be to apply pattern recognition techniques to LiDAR height data fused with other data types such as LiDAR intensity or multispectral CASI data. We are attempting to use digital map data (Mastermap structured topography data) to help to distinguish buildings from trees, and roads from areas of short vegetation. The problems involved in doing this will be discussed. A related problem of how best to merge historic river cross-section data with a LiDAR DTM will also be considered. LiDAR data may also be used to help generate a finite element mesh. In rural area we have decomposed a floodplain mesh according to taller vegetation features such as hedges and trees, so that e.g. hedge elements can be assigned higher friction coefficients than those in adjacent fields. We are attempting to extend this approach to urban area, so that the mesh is decomposed in the vicinity of buildings, roads, etc as well as trees and hedges. A dominant points algorithm is used to identify points of high curvature on a building or road, which act as initial nodes in the meshing process. A difficulty is that the resulting mesh may contain a very large number of nodes. However, the mesh generated may be useful to allow a high resolution FE model to act as a benchmark for a more practical lower resolution model. A further problem discussed will be how best to exploit data redundancy due to the high resolution of the LiDAR compared to that of a typical flood model. Problems occur if features have dimensions smaller than the model cell size e.g. for a 5m-wide embankment within a raster grid model with 15m cell size, the maximum height of the embankment locally could be assigned to each cell covering the embankment. But how could a 5m-wide ditch be represented? Again, this redundancy has been exploited to improve wetting/drying algorithms using the sub-grid-scale LiDAR heights within finite elements at the waterline.

Balancing guava nutrition with liming and fertilization

A resposta da goiabeira à calagem e à adubação pode ser monitorada por análises de tecido vegetal. O perfil nutricional é definido em relação a padrões de teores de nutrientes. No entanto, os teores de nutrientes-padrão são constantemente criticados por não considerarem as interações que ocorrem entre nutrientes e por gerarem tendências numéricas, decorrentes da redundância dos dados, da dependência de escala e da distribuição não normal. As técnicas de análise composicional de dados podem controlar esses dados tendenciosos, equilibrando os grupos de nutrientes, tais como os envolvidos na calagem e na adubação. A utilização das relações log isométricas (ilr) ortonormais, sequencialmente dispostas, evita tendências numéricas inerentes aos dados de composição. Os objetivos do trabalho foram relacionar o balanço de nutrientes dos tecidos vegetais com a produção de goiabeiras em pomares de 'Paluma' diferentemente corrigidos e adubados, e ajustar os atuais padrões de nutrientes com a faixa de equilíbrio das goiabeiras mais produtivas. Um experimento de calagem de sete anos e três, experimentos de três anos com doses de N, P2O5 e K2O, foram conduzidos em pomares de goiabeiras 'Paluma' em um Latossolo Vermelho-Amarelo. Os teores de N, P, K, Ca e Mg na planta foram monitorados anualmente. Selecionaram-se os balanços [N, P, K | Ca, Mg], [N, P | K], [N | P] e [Ca | Mg] para separar os efeitos da calagem (Ca-Mg) e dos fertilizantes (N-K) nos balanços de macronutrientes. Os balanços foram mais influenciados pela calagem do que pela fertilização. A produtividade das goiabeiras e seu balanço nutricional permitiram a definição de faixas de equilíbrio de nutrientes e sua validação com as faixas de concentrações críticas atualmente utilizadas no Brasil e combinadas em coordenadas ilr.

Diagnose nutricional da goiabeira

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Detecção de outliers espaciais: refinamento de similaridade e desempenho

Pós-graduação em Ciência da Computação - IBILCE

Application of Redundancy Analysis for Aerobiological Data

An aerobiological survey was conducted through five consecutive years (2006–2010) at Worcester (England).The concentration of 20 allergenic fungal spore types was measured using a 7-day volumetric spore trap. The relationship between investigated fungal spore genera and selected meteorological parameters (maximum, minimum, mean and dew point temperatures, rainfall, relative humidity, air pressure,wind direction) was examined using an ordination method(redundancy analysis) to determine which environmental factors favoured their most abundance in the air and whether it would be possible to detect similarities between different genera in their distribution pattern. Redundancy analysis provided additional information about the biology of the studied fungi through the results of the Spearman’s rank correlation. Application of the variance inflation factor in canonical correspondence analysis indicated which explanatory variables were auto-correlated and needed to be excluded from further analyses. Obtained information will be consequently implemented in the selection of factors that will be a foundation for forecasting models for allergenic fungal spores in the future.

Removing redundancy for attribute implications in data with grades

Reasoning with if-then rules –in particular, with those taking from of implications between conjunctions of attributes– is crucial in many disciplines ranging from theoretical computer science to applications. One of the most important problems regarding the rules is to remove redundancies in order to obtain equivalent implicational sets with lower size.

Laser-to-radar sensing redundancy for resilient perception in adverse environmental conditions

This paper presents an approach to promote the integrity of perception systems for outdoor unmanned ground vehicles (UGV) operating in challenging environmental conditions (presence of dust or smoke). The proposed technique automatically evaluates the consistency of the data provided by two sensing modalities: a 2D laser range finder and a millimetre-wave radar, allowing for perceptual failure mitigation. Experimental results, obtained with a UGV operating in rural environments, and an error analysis validate the approach.