Design Methodology for Real-Time FPGA-Based Sound Synthesis

Explicit finite difference (FD) schemes can realise highly realistic physical models of musical instruments but are computationally complex. A design methodology is presented for the creation of FPGA-based micro-architectures for FD schemes which can be applied to a range of applications with varying computational requirements, excitation and output patterns and boundary conditions. It has been applied to membrane and plate-based sound producing models, resulting in faster than real-time performance on a Xilinx XC2VP50 device which is 10 to 35 times faster than general purpose and DSP processors. The models have developed in such a way to allow a wide range of interaction (by a musician) thereby leading to the possibility of creating a highly realistic digital musical instrument.

Applying an XC6200 to real-time image processing

This implementation of a two-dimensional discrete cosine transform demonstrates the development of a suitable architectural style for a specific technology-in this case, the Xilinx XC6200 FPGA series. The design exploits distributed arithmetic, parallelism, and pipelining to achieve a high-performance custom-computing implementation.

Deep Corals, Deep Learning: Moving the Deep Net Towards Real-Time Image Annotation

The mismatch between human capacity and the acquisition of Big Data such as Earth imagery undermines commitments to Convention on Biological Diversity (CBD) and Aichi targets. Artificial intelligence (AI) solutions to Big Data issues are urgently needed as these could prove to be faster, more accurate, and cheaper. Reducing costs of managing protected areas in remote deep waters and in the High Seas is of great importance, and this is a realm where autonomous technology will be transformative.

Portfolio of Compositions investigating ensemble improvisation, distributed and real-time scoring, and multi-nodal input and output

This output is a collection of compositions which explore issues of ensemble improvisation, ensemble management and orchestration, real-time and distributed scoring, multi-nodal inputs and outputs, and animated and graphic notation. Compositions include: Activities I; tutti, duet, trio, solo, quartet; Lewitt Notations I; Webwork I; and Sometimes I feel the space between people (voices) in terms of tempos. These compositions are presented in computer animated scores which are synchronized through the network and subject to real-time modification and control. They can be performed by ensembles distributed over large physical spaces connected by the network. The scores for these compositions include software which displays the animations to the performers, software to structure and disseminate score events, and triggering software that allows the control of a performance to be distributed. Scores can also include live electronics which are coordinated with graphic events.

Real time measurement and control of viscosity for extrusion processes using recycled materials

The aim of this paper is to develop a new generation of extruder control system for recycled materials which has ability to automatically maintain constant a polymer melt viscosity of mixed recycled polymers during extrusion, regardless of variations in the Melt Flow Index (MFI) of recycled mixed grade high density polyethylene (HDPE) feedstock. The variations in MFI are due to differences in the source of the recycled material used. The work describes how melt viscosity for specific extruder/die system is calculated in real time using the rheological properties of the materials, the pressure drop through the extruder die and the actual throughput measurements using a gravimetric loss-in-weight hopper feeder. A closed-loop controller is also developed to automatically regulate screw speed and barrel temperature profile to achieve constant viscosity and enable consistent processing of variable grade recycled HDPE materials. Such a system will improve processability of mixed MFI polymers may also reduce the risk of polymer melt degradation, reduce producing large volumes of scrap/waste and lead to improvement in product quality. The experimental results of real time viscosity measurement and control using a 38 mm single screw extruder with different recycled HDPEs with widely different MFIs are reported in this work.

“Signal, image and video processing” special issue: Semantic representations for social behavior analysis in video surveillance systems

No abstract available

Rapid single-nucleotide polymorphism-based identification of clonal Pseudomonas aeruginosa isolates from patients with cystic fibrosis by the use of real-time PCR and high-resolution melting curve analysis

Pseudomonas aeruginosa genotyping relies mainly upon DNA fingerprinting methods, which can be subjective, expensive and time-consuming. The detection of at least three different clonal P. aeruginosa strains in patients attending two cystic fibrosis (CF) centres in a single Australian city prompted the design of a non-gel-based PCR method to enable clinical microbiology laboratories to readily identify these clonal strains. We designed a detection method utilizing heat-denatured P. aeruginosa isolates and a ten-single-nucleotide polymorphism (SNP) profile. Strain differences were detected by SYBR Green-based real-time PCR and high-resolution melting curve analysis (HRM10SNP assay). Overall, 106 P. aeruginosa sputum isolates collected from 74 patients with CF, as well as five reference strains, were analysed with the HRM10SNP assay, and the results were compared with those obtained by pulsed-field gel electrophoresis (PFGE). The HRM10SNP assay accurately identified all 45 isolates as members of one of the three major clonal strains characterized by PFGE in two Brisbane CF centres (Australian epidemic strain-1, Australian epidemic strain-2 and P42) from 61 other P. aeruginosa strains from Australian CF patients and two representative overseas epidemic strain isolates. The HRM10SNP method is simple, is relatively inexpensive and can be completed in <3 h. In our setting, it could be made easily available for clinical microbiology laboratories to screen for local P. aeruginosa strains and to guide infection control policies. Further studies are needed to determine whether the HRM10SNP assay can also be modified to detect additional clonal strains that are prevalent in other CF centres.

Geotechnical monitoring using a combination of LIDAR, real-time dGPS, and electrical tomography to assess geotechnical risk of a coastal landslide.

The Antrim Coast Road stretching from the seaport of Larne in the East of Northern Ireland has a well-deserved reputation for being one of the most spectacular roads in Europe (Day, 2006). However the problematic geology; Jurassic Lias Clay and Triassic Mudstone overlain by Cretaceous Limestone and Tertiary Basalt, and environmental variables result in frequent instances of slope instability manifested in both shallow debris flows and occasional massive rotational movements, creating a geotechnical risk to this highway. This paper describes how a variety of techniques are being used to both assess instability and monitor movement of these active slopes near one site at Straidkilly Point, Glenarm. An in-depth understanding of the geology was obtained via boreholes, resistivity surveys and laboratory testing. Environmental variables recorded by an on-site weather station were correlated with measured pore water pressure and soil moisture infiltration data. Terrestrial LiDAR (TLS), with surveys carried out on a bi-monthly basis allowed for the generation of Digital Elevation Models (DEMs) of difference, highlighting areas of recent movement, accumulation and depletion. Morphology parameters were generated from the DEMs and include slope, curvature and multiple measures of roughness. Changes in the structure of the slope coupled with morphological parameters were characterised and linked to progressive failures from the temporal monitoring. In addition to TLS monitoring, Aerial LiDAR datasets were used for the spatio-morphological characterisation of the slope on a macro scale. A Differential Global Positioning System (dGPS) was also deployed on site to provide a real-time warning system for gross movements, which were also correlated with environmental conditions. Frequent electrical resistivity tomography (ERT) surveys were also implemented to provide a better understanding of long-term changes in soil moisture and help to define the complex geology. The paper describes how the data obtained via a diverse range of methods has been combined to facilitate a more informed management regime of geotechnical risk by the Northern Ireland Roads Service.

Threat Analysis of BlackEnergy Malware for Synchrophasor based Real-time Control and Monitoring in Smart Grid

The BlackEnergy malware targeting critical infrastructures has a long history. It evolved over time from a simple DDoS platform to a quite sophisticated plug-in based malware. The plug-in architecture has a persistent malware core with easily installable attack specific modules for DDoS, spamming, info-stealing, remote access, boot-sector formatting etc. BlackEnergy has been involved in several high profile cyber physical attacks including the recent Ukraine power grid attack in December 2015. This paper investigates the evolution of BlackEnergy and its cyber attack capabilities. It presents a basic cyber attack model used by BlackEnergy for targeting industrial control systems. In particular, the paper analyzes cyber threats of BlackEnergy for synchrophasor based systems which are used for real-time control and monitoring functionalities in smart grid. Several BlackEnergy based attack scenarios have been investigated by exploiting the vulnerabilities in two widely used synchrophasor communication standards: (i) IEEE C37.118 and (ii) IEC 61850-90-5. Specifically, the paper addresses reconnaissance, DDoS, man-in-the-middle and replay/reflection attacks on IEEE C37.118 and IEC 61850-90-5. Further, the paper also investigates protection strategies for detection and prevention of BlackEnergy based cyber physical attacks.

Real-time GPU color-based segmentation of football players

In this paper, we propose a multi-camera application capable of processing high resolution images and extracting features based on colors patterns over graphic processing units (GPU). The goal is to work in real time under the uncontrolled environment of a sport event like a football match. Since football players are composed for diverse and complex color patterns, a Gaussian Mixture Models (GMM) is applied as segmentation paradigm, in order to analyze sport live images and video. Optimization techniques have also been applied over the C++ implementation using profiling tools focused on high performance. Time consuming tasks were implemented over NVIDIA's CUDA platform, and later restructured and enhanced, speeding up the whole process significantly. Our resulting code is around 4-11 times faster on a low cost GPU than a highly optimized C++ version on a central processing unit (CPU) over the same data. Real time has been obtained processing until 64 frames per second. An important conclusion derived from our study is the scalability of the application to the number of cores on the GPU. © 2011 Springer-Verlag.

Video anomaly detection in real-time on a Power-Aware Heterogeneous Platform

FPGAs and GPUs are often used when real-time performance in video processing is required. An accelerated processor is chosen based on task-specific priorities (power consumption, processing time and detection accuracy), and this decision is normally made once at design time. All three characteristics are important, particularly in battery-powered systems. Here we propose a method for moving selection of processing platform from a single design-time choice to a continuous run time one.We implement Histogram of Oriented Gradients (HOG) detectors for cars and people and Mixture of Gaussians (MoG) motion detectors running across FPGA, GPU and CPU in a heterogeneous system. We use this to detect illegally parked vehicles in urban scenes. Power, time and accuracy information for each detector is characterised. An anomaly measure is assigned to each detected object based on its trajectory and location, when compared to learned contextual movement patterns. This drives processor and implementation selection, so that scenes with high behavioural anomalies are processed with faster but more power hungry implementations, but routine or static time periods are processed with power-optimised, less accurate, slower versions. Real-time performance is evaluated on video datasets including i-LIDS. Compared to power-optimised static selection, automatic dynamic implementation mapping is 10% more accurate but draws 12W extra power in our testbed desktop system.

Image, Video and 3D Data Registration: Medical, Satellite and Video Processing Applications with Quality Metrics

Data registration refers to a series of techniques for matching or bringing similar objects or datasets together into alignment. These techniques enjoy widespread use in a diverse variety of applications, such as video coding, tracking, object and face detection and recognition, surveillance and satellite imaging, medical image analysis and structure from motion. Registration methods are as numerous as their manifold uses, from pixel level and block or feature based methods to Fourier domain methods.

This book is focused on providing algorithms and image and video techniques for registration and quality performance metrics. The authors provide various assessment metrics for measuring registration quality alongside analyses of registration techniques, introducing and explaining both familiar and state-of-the-art registration methodologies used in a variety of targeted applications.

Key features:
- Provides a state-of-the-art review of image and video registration techniques, allowing readers to develop an understanding of how well the techniques perform by using specific quality assessment criteria
- Addresses a range of applications from familiar image and video processing domains to satellite and medical imaging among others, enabling readers to discover novel methodologies with utility in their own research
- Discusses quality evaluation metrics for each application domain with an interdisciplinary approach from different research perspectives