Detection of rain in acoustic recordings of the environment using machine learning techniques

This thesis is concerned with the detection and prediction of rain in environmental recordings using different machine learning algorithms. The results obtained in this research will help ecologists to efficiently analyse environmental data and monitor biodiversity.

Semi-automated annotation of environmental acoustic recordings

Environmental sensors collect massive amounts of audio data. This thesis investigates computational methods to support human analysts in identifying faunal vocalisations from that audio. A series of experiments was conducted to trial the effectiveness of novel user interfaces. This research examines the rapid scanning of spectrograms, decision support tools for users, and cleaning methods for folksonomies. Together, these investigations demonstrate that providing computational support to human analysts increases their efficiency and accuracy; this allows bioacoustics projects to efficiently utilise their valuable human analysts.

Acoustic sensing: Roles and applications in monitoring avian biodiversity

This thesis examined the use of acoustic sensors for monitoring avian biodiversity. Acoustic sensors have the potential to significantly increase the spatial and temporal scale of ecological observations, however acoustic recordings of the environment can be opaque and complex. This thesis developed methods for analysing large volumes of acoustic data to maximise the detection of bird species, and compared the results of acoustic sensor biodiversity surveys with traditional bird survey techniques.

Acoustic adaptation in cross database audio visual SHMM training for phonetic spoken term detection

Visual information in the form of lip movements of the speaker has been shown to improve the performance of speech recognition and search applications. In our previous work, we proposed cross database training of synchronous hidden Markov models (SHMMs) to make use of external large and publicly available audio databases in addition to the relatively small given audio visual database. In this work, the cross database training approach is improved by performing an additional audio adaptation step, which enables audio visual SHMMs to benefit from audio observations of the external audio models before adding visual modality to them. The proposed approach outperforms the baseline cross database training approach in clean and noisy environments in terms of phone recognition accuracy as well as spoken term detection (STD) accuracy.

Connecting soundscape to landscape: Which acoustic index best describes landscape configuration?

Soundscape assessment has been proposed as a remote ecological monitoring tool for measuring biodiversity, but few studies have examined how soundscape patterns vary with landscape configuration and condition. The goal of our study was to examine a suite of published acoustic indices to determine whether they provide comparable results relative to varying levels of landscape fragmentation and ecological condition in nineteen forest sites in eastern Australia. Our comparison of six acoustic indices according to time of day revealed that two indices, the acoustic complexity and the bioacoustic index, presented a similar pattern that was linked to avian song intensity, but was not related to landscape and biodiversity attributes. The diversity indices, acoustic entropy and acoustic diversity, and the normalized difference soundscape index revealed high nighttime sound, as well as a dawn and dusk chorus. These indices appear to be sensitive to nocturnal biodiversity which is abundant at night in warm, subtropical environments. We argue that there is need to better understand temporal partitioning of the soundscape by specific taxonomic groups, and this should involve integrated research on amphibians, insects and birds during a 24 h cycle. The three indices that best connected the soundscape with landscape characteristics, ecological condition and bird species richness were acoustic entropy, acoustic evenness and the normalized difference soundscape index. This study has demonstrated that remote soundscape assessment can be implemented as an ecological monitoring tool in fragmented Australian forest landscapes. However, further investigation should be dedicated to refining and/or combining existing acoustic indices and also to determine if these indices are appropriate in other landscapes and for other survey purposes.

Generalised features for bird vocalisation retrieval in acoustic recordings

Bioacoustic monitoring has become a significant research topic for species diversity conservation. Due to the development of sensing techniques, acoustic sensors are widely deployed in the field to record animal sounds over a large spatial and temporal scale. With large volumes of collected audio data, it is essential to develop semi-automatic or automatic techniques to analyse the data. This can help ecologists make decisions on how to protect and promote the species diversity. This paper presents generic features to characterize a range of bird species for vocalisation retrieval. In the implementation, audio recordings are first converted to spectrograms using short-time Fourier transform, then a ridge detection method is applied to the spectrogram for detecting points of interest. Based on the detected points, a new region representation are explored for describing various bird vocalisations and a local descriptor including temporal entropy, frequency bin entropy and histogram of counts of four ridge directions is calculated for each sub-region. To speed up the retrieval process, indexing is carried out and the retrieved results are ranked according to similarity scores. The experiment results show that our proposed feature set can achieve 0.71 in term of retrieval success rate which outperforms spectral ridge features alone (0.55) and Mel frequency cepstral coefficients (0.36).

Clustering acoustic events in environmental recordings for species richness surveys

Environmental acoustic recordings can be used to perform avian species richness surveys, whereby a trained ornithologist can observe the species present by listening to the recording. This could be made more efficient by using computational methods for iteratively selecting the richest parts of a long recording for the human observer to listen to, a process known as “smart sampling”. This allows scaling up to much larger ecological datasets. In this paper we explore computational approaches based on information and diversity of selected samples. We propose to use an event detection algorithm to estimate the amount of information present in each sample. We further propose to cluster the detected events for a better estimate of this amount of information. Additionally, we present a time dispersal approach to estimating diversity between iteratively selected samples. Combinations of approaches were evaluated on seven 24-hour recordings that have been manually labeled by bird watchers. The results show that on average all the methods we have explored would allow annotators to observe more new species in fewer minutes compared to a baseline of random sampling at dawn.

Birdcall retrieval from environmental acoustic recordings using image processing

Acoustic recordings of the environment provide an effective means to monitor bird species diversity. To facilitate exploration of acoustic recordings, we describe a content-based birdcall retrieval algorithm. A query birdcall is a region of spectrogram bounded by frequency and time. Retrieval depends on a similarity measure derived from the orientation and distribution of spectral ridges. The spectral ridge detection method caters for a broad range of birdcall structures. In this paper, we extend previous work by incorporating a spectrogram scaling step in order to improve the detection of spectral ridges. Compared to an existing approach based on MFCC features, our feature representation achieves better retrieval performance for multiple bird species in noisy recordings.

Impacts of wind power integration on small signal stability and low frequency oscillation characteristics of interconnected power systems

为研究风电并网对互联系统低频振荡的影响,基于完整的双馈风电机组模型,定性分析了两区域互联系统在风电机组并网前后阻尼特性的变化情况.从双馈风电机组并网输送距离、并网容量、互联系统联络线传送功率、是否加装电力系统稳定器等多个方面,多角度分析了风电场并网对互联系统小干扰稳定及低频振荡特性的影响.之后,以两个包括两个区域的电力系统为例,进行了系统的计算分析和比较.结果表明,有双馈风电机组接入的互联电力系统,在不同运行模式下,双馈风电机组的并网输送距离、出力水平、联络线传送功率对低频振荡模式的影响在趋势和程度上均有显著差异,这样在对风电场进行入网规划、设计和运行时就需要综合考虑这些因素的影响.

Visual fingerprints of the acoustic environment: The use of acoustic indices to characterise natural habitats

Acoustic recordings play an increasingly important role in monitoring terrestrial environments. However, due to rapid advances in technology, ecologists are accumulating more audio than they can listen to. Our approach to this big-data challenge is to visualize the content of long-duration audio recordings by calculating acoustic indices. These are statistics which describe the temporal-spectral distribution of acoustic energy and reflect content of ecological interest. We combine spectral indices to produce false-color spectrogram images. These not only reveal acoustic content but also facilitate navigation. An additional analytic challenge is to find appropriate descriptors to summarize the content of 24-hour recordings, so that it becomes possible to monitor long-term changes in the acoustic environment at a single location and to compare the acoustic environments of different locations. We describe a 24-hour ‘acoustic-fingerprint’ which shows some preliminary promise.

Computer-assisted sampling of acoustic data for more efficient determination of bird species richness

Bird species richness survey is one of the most intriguing ecological topics for evaluating environmental health. Here, bird species richness denotes the number of unique bird species in a particular area. Factors affecting the investigation of bird species richness include weather, observation bias, and most importantly, the prohibitive costs of conducting surveys at large spatiotemporal scales. Thanks to advances in recording techniques, these problems have been alleviated by deploying sensors for acoustic data collection. Although automated detection techniques have been introduced to identify various bird species, the innate complexity of bird vocalizations, the background noise present in the recording and the escalating volumes of acoustic data pose a challenging task on determination of bird species richness. In this paper we proposed a two-step computer-assisted sampling approach for determining bird species richness in one-day acoustic data. First, a classification model is built based on acoustic indices for filtering out minutes that contain few bird species. Then the classified bird minutes are ordered by an acoustic index and the redundant temporal minutes are removed from the ranked minute sequence. The experimental results show that our method is more efficient in directing experts for determination of bird species compared with the previous methods.

Acoustic features for multi-level classification of Australian frogs

Over past few decades, frog species have been experiencing dramatic decline around the world. The reason for this decline includes habitat loss, invasive species, climate change and so on. To better know the status of frog species, classifying frogs has become increasingly important. In this study, acoustic features are investigated for multi-level classification of Australian frogs: family, genus and species, including three families, eleven genera and eighty five species which are collected from Queensland, Australia. For each frog species, six instances are selected from which ten acoustic features are calculated. Then, the multicollinearity between ten features are studied for selecting non-correlated features for subsequent analysis. A decision tree (DT) classifier is used to visually and explicitly determine which acoustic features are relatively important for classifying family, which for genus, and which for species. Finally, a weighted support vector machines (SVMs) classifier is used for the multi- level classification with three most important acoustic features respectively. Our experiment results indicate that using different acoustic feature sets can successfully classify frogs at different levels and the average classification accuracy can be up to 85.6%, 86.1% and 56.2% for family, genus and species respectively.

Compact features for birdcall retrieval from environmental acoustic recordings

Bioacoustic data can be used for monitoring animal species diversity. The deployment of acoustic sensors enables acoustic monitoring at large temporal and spatial scales. We describe a content-based birdcall retrieval algorithm for the exploration of large data bases of acoustic recordings. In the algorithm, an event-based searching scheme and compact features are developed. In detail, ridge events are detected from audio files using event detection on spectral ridges. Then event alignment is used to search through audio files to locate candidate instances. A similarity measure is then applied to dimension-reduced spectral ridge feature vectors. The event-based searching method processes a smaller list of instances for faster retrieval. The experimental results demonstrate that our features achieve better success rate than existing methods and the feature dimension is greatly reduced.

Impacts of El Niño southern oscillation and Indian Ocean dipole on dengue incidence in Bangladesh

Dengue dynamics are driven by complex interactions between hosts, vectors and viruses that are influenced by environmental and climatic factors. Several studies examined the role of El Niño Southern Oscillation (ENSO) in dengue incidence. However, the role of Indian Ocean Dipole (IOD), a coupled ocean atmosphere phenomenon in the Indian Ocean, which controls the summer monsoon rainfall in the Indian region, remains unexplored. Here, we examined the effects of ENSO and IOD on dengue incidence in Bangladesh. According to the wavelet coherence analysis, there was a very weak association between ENSO, IOD and dengue incidence, but a highly significant coherence between dengue incidence and local climate variables (temperature and rainfall). However, a distributed lag nonlinear model (DLNM) revealed that the association between dengue incidence and ENSO or IOD were comparatively stronger after adjustment for local climate variables, seasonality and trend. The estimated effects were nonlinear for both ENSO and IOD with higher relative risks at higher ENSO and IOD. The weak association between ENSO, IOD and dengue incidence might be driven by the stronger effects of local climate variables such as temperature and rainfall. Further research is required to disentangle these effects.