Information theory, inference, and learning algorithms

Fun and exciting textbook on the mathematics underpinning the most dynamic areas of modern science and engineering.

Characterising the information requests of aerospace engineering designers

During product development, engineering designers raise several information requests that make them search through human and documentary sources. This paper reports research to characterise, in detail, these requests for designers working in a major aerospace engineering company. The research found that at a high level, a distinction can be made between requests to acquire information and to process information. The former are raised to access design and domain information. The latter, instead, are formed to define designs. For researchers, this study extends existing knowledge of information requests by characterising key differences in their nature and explaining how they are used in the design process. For practitioners, these findings can be used as a basis to understand the diverseness of information requests and how to channel efforts to support designers in information seeking. In particular, the research indicates that a strategy to support designers should enable the development of engineering communities that share information effectively and the introduction of techniques that facilitate the documentation of information. © 2012 Springer-Verlag London Limited.

The cross-entropy method for blind multiuser detection

We consider the problem of blind multiuser detection. We adopt a Bayesian approach where unknown parameters are considered random and integrated out. Computing the maximum a posteriori estimate of the input data sequence requires solving a combinatorial optimization problem. We propose here to apply the Cross-Entropy method recently introduced by Rubinstein. The performance of cross-entropy is compared to Markov chain Monte Carlo. For similar Bit Error Rate performance, we demonstrate that Cross-Entropy outperforms a generic Markov chain Monte Carlo method in terms of operation time.