Fast scene change detection based histogram

This work presents a new approach to detecting the scene change in the successive capture of photographs of a place within equal time interval. This method is based on a gray level histogram of every image. In this method the histogram of an image is processed to modify it for matching with the processed histogram of a reference image. The coefficient of correlation is taken as the measure of matching. As the method does not do any heavy signal processing, and the images are taken successively with a multi-shot digital still camera, it can be applied for real-time processing of such pictures for detection of a scene change. A multi-camera in multi-position approach is also shown to evaluate the change in scene simultaneously from different angles. Both multi-camera and single-camera approaches are compared in detecting a scene change.

A unified 2D-3D video scene change detection framework for mobile camera platforms

In this paper, we present a novel scene change detection algorithm for mobile camera platforms. Our approach integrates sparse 3D scene background modelling and dense 2D image background modelling into a unified framework. The 3D scene background modelling identifies inconsistent clusters over time in a set of 3D cloud points as the scene changes. The 2D image background modelling further confirms the scene changes by finding inconsistent appearances in a set of aligned images using the classical MRF background subtraction technique. We evaluate the performance of our proposed system on a number of challenging video datasets obtained from a camera placed on a moving vehicle and the experiments show that our proposed method outperforms previous works in scene change detection, which suggested the feasibility of our approach.

Improved fade and dissolve detection for reliable video segmentation

We present improved algorithms for automatic fade and dissolve detection in digital video analysis. We devise new two-step algorithms for fade and dissolve detection and introduce a method for eliminating false positives from a list of detected candidate transitions. In our detailed study of these gradual shot transitions, our objective has been to accurately classify the type of transitions (fade-in, fade-out, and dissolve) and to precisely locate the boundary of the transitions. This distinguishes our work from early work in scene change detection which focuses on identifying the existence of a transition rather than its precise temporal extent. We evaluate our algorithms against two other commonly used methods on a comprehensive data set, and demonstrate the improved performance due to our enhancements.

New enhancements to cut, fade, and dissolve detection processes in video segmentation

We present improved algorithms for cut, fade, and dissolve detection which are fundamental steps in digital video analysis. In particular, we propose a new adaptive threshold determination method that is shown to reduce artifacts created by noise and motion in scene cut detection. We also describe new two-step algorithms for fade and dissolve detection, and introduce a method for eliminating false positives from a list of detected candidate transitions. In our detailed study of these gradual shot transitions, our objective has been to accurately classify the type of transitions (fade-in, fade-out, and dissolve) and to precisely locate the boundary of the transitions. This distinguishes our work from other early work in scene change detection which tends to focus primarily on identifying the existence of a transition rather than its precise temporal extent. We evaluate our improved algorithms against two other commonly used shot detection techniques on a comprehensive data set, and demonstrate the improved performance due to our enhancements.

Corner Inlet and Nooramunga Habitat Mapping Project – Part 2 : High resolution mapping and change detection analysis using 2011 Rapid Eye Satellite Image compared to 2009 ALOS Satellite Image

Building on a habitat mapping project completed in 2011, Deakin University was commissioned by Parks Victoria (PV) to apply the same methodology and ground-truth data to a second, more recent and higher resolution satellite image to create habitat maps for areas within the Corner Inlet and Nooramunga Marine and Coastal Park and Ramsar area. A ground-truth data set using in situ video and still photographs was used to develop and assess predictive models of benthic marine habitat distributions incorporating data from both RapidEye satellite imagery (corrected for atmospheric and water column effects by CSIRO) and LiDAR (Light Detection and Ranging) bathymetry. This report describes the results of the mapping effort as well as the methodology used to produce these habitat maps.

Overall accuracies of habitat classifications were good, with error rates similar to or better than the earlier classification (>73 % and kappa values > 0.58 for both study localities). The RapidEye classification failed to accurately detect Pyura and reef habitat classes at the Corner Inlet locality, possibly due to differences in spectral frequencies. For comparison, these categories were combined into a ‘non-seagrass’ category, similar to the one used at the Nooramunga locality in the original classification. Habitats predicted with highest accuracies differed from the earlier classification and were Posidonia in Corner Inlet (89%), and bare sediment (no-visible seagrass class) in Nooramunga (90%). In the Corner Inlet locality reef and Pyura habitat categories were not distinguishable in the repeated classification and so were combined with bare sediments. The majority of remaining classification errors were due to the misclassification of Zosteraceae as bare sediment and vice versa. Dominant habitats were the same as those from the 2011 classification with some differences in extent. For the Corner Inlet study locality the no-visible seagrass category remained the most extensive (9059 ha), followed by Posidonia (5,513 ha) and Zosteraceae (5,504 ha). In Nooramunga no-visible seagrass (6,294 ha), Zosteraceae (3,122 ha) and wet saltmarsh (1,562 ha) habitat classes were most dominant.

Change detection analyses between the 2009 and 2011 imagery were undertaken as part of this project, following the analyses presented in Monk et al. (2011) and incorporating error estimates from both classifications. These analyses indicated some shifts in classification between Posidonia and Zosteraceae as well as a general reduction in the area of Zosteraceae. Issues with classification of mixed beds were apparent, particularly in the main Posidonia bed at Nooramunga where a mosaic of Zosteraceae and Posidonia was seen that was not evident in the ALOS classification. Results of a reanalysis of the 1998-2009 change detection illustrating effects of binning of mixed beds is also provided as an appendix.

This work has been successful in providing baseline maps at an improved level of detail using a repeatable method meaning that any future changes in intertidal and shallow water marine habitats may be assessed in a consistent way with quantitative error assessments. In wider use, these maps should also allow improved conservation planning, advance fisheries and catchment management, and progress infrastructure planning to limit impacts on the Inlet environment.

Evaluating coverage changes in national parks using a hybrid change detection algorithm and remote sensing

Remote sensing is a useful tool for detecting change over time.We introduce a hybrid change-detection method for forest and protected-area vegetation and demonstrate its use with two satellite images of Golestan National Park in northern Iran (1998 and 2010). We report on the advantages and disadvantages of the hybrid method relative to the standard change-detection method. In the proposed hybrid algorithm, the change vector analysis technique was used to determine changes in vegetation. Following this, we used postclassification comparison to determine the nature of the changes observed and their accuracy and to evaluate the effects of different parameters on the performance of the proposed method. We determined 85% accuracy for the proposed hybrid change-detection method, thus demonstrating a method for discovering and assessing environmental threats to natural treasures. © 2014 Society of Photo-Optical Instrumentation Engineers.

Scene extraction in motion pictures

This paper addresses the challenge of bridging the semantic gap between the rich meaning users desire when they query to locate and browse media and the shallowness of media descriptions that can be computed in today's content management systems. To facilitate high-level semantics-based content annotation and interpretation, we tackle the problem of automatic decomposition of motion pictures into meaningful story units, namely scenes. Since a scene is a complicated and subjective concept, we first propose guidelines from fill production to determine when a scene change occurs. We then investigate different rules and conventions followed as part of Fill Grammar that would guide and shape an algorithmic solution for determining a scene. Two different techniques using intershot analysis are proposed as solutions in this paper. In addition, we present different refinement mechanisms, such as film-punctuation detection founded on Film Grammar, to further improve the results. These refinement techniques demonstrate significant improvements in overall performance. Furthermore, we analyze errors in the context of film-production techniques, which offer useful insights into the limitations of our method.

Neighborhood coherence and edge based approaches to film scene extraction

In order to enable high-level semantics-based video annotation and interpretation, we tackle the problem of automatic decomposition of motion pictures into meaningful story units, namely scenes. Since a scene is a complicated and subjective concept, we first propose guidelines from film production to determine when a scene change occurs in film. We examine different rules and conventions followed as part of Film Grammar to guide and shape our algorithmic solution for determining a scene boundary. Two different techniques are proposed as new solutions in this paper. Our experimental results on 10 full-length movies show that our technique based on shot sequence coherence performs well and reasonably better than the color edges-based approach.

Detecting patterns of change in benthic habitats by acoustic remote sensing

Changes in benthic habitats occur as a result of natural variation or human-induced processes. It is important to understand natural fine-scale inter-annual patterns of change to separate these signals from patterns of long-term change. Describing change from an acoustic remote sensing standpoint has been facilitated by the recent availability of full coverage swath acoustic datasets, but is limited by cost pressures associated with multiple surveys of the same area. We studied the use of landscape transition analysis as a means to differentiate seemingly random patterns of habitat change from systematic signals of habitat transition at a shallow (10 to 50 m depth) 18 km2 site on the temperate Australian continental shelf in 2006 and 2007. Supervised classifications for each year were accomplished using inde pendently collected highresolution swath acoustic and video reference data. Of the 4 representative biotic clas ses considered, signals of directional systematic changes occurred be tween a kelp-dominated class, a sessile invertebrate-dominated class and a mixed class of kelp and sessile invertebrates. We provide a detailed analysis of the components of the traditional change detection cross tabulation matrix, allowing identification of the strongest signals of systematic habitat transitions. Iden tifying patterns of habitat change is an important first step toward understanding the processes that drive them.

Integrating time-series hydroacoustics and video observations for detecting changes in benthic habitats

The ability to quantify change in marine benthic habitats must be considered a key goal of marine habitat mapping activities. Changes in distribution of distinct suites of benthic biological species may occur as a result of natural or human induced processes and these processes may operate at a range of temporal and spatial scales. It is important to understand natural small scale inter-annual patterns of change in order to separate these signals from potential patterns of longer term change. Work to describe these processes of change from an acoustic remote sensing stand point has thus far been limited due to the relatively recent availability of full coverage swath acoustic datasets and cost pressures associated with multiple surveys of the same area. This paper describes the use of landscape transition analysis as a means to differentiate seemingly random patterns of habitat change from systematic signals of habitat transition at a shallow (10–50 m depth) 18 km2 study area on the temperate Australian continental shelf between the years 2006 and 2007. Supervised classifications for each year were accomplished using independently collected high resolution (3 m cell-size) multibeam echosounder (MBES) and video-derived reference data. Of the 4 representative biotic classes considered, signals of directional systematic changes were observed to occur between a shallow kelp dominated class, a deep sessile invertebrate dominated class and a mixed class of kelp and sessile invertebrates. These signals of change are interpreted as inter-annual variation in the density and depth related extent of canopy forming kelp species at the site, a phenomenon reported in smaller scale temporal studies of the same species. The methods applied in this study provide a detailed analysis of the various components of the traditional change detection cross tabulation matrix allowing identification of the strongest signals of systematic habitat transitions across broad geographical regions. Identifying clear patterns of habitat change is an important first step in linking these patterns to the processes that drive them.

Finding the beat : an analysis of the rhythmic elements of motion pictures

This paper presents a new study on the application of the framework of Computational Media Aesthetics to the problem of automated understanding of film. Leveraging Film Grammar as the means to closing the "semantic gap" in media analysis, we examine film rhythm, a powerful narrative concept used to endow structure and form to the film compositionally and enhance its lyrical quality experientially. The novelty of this paper lies in the specification and investigation of the rhythmic elements that are present in two cinematic devices; namely motion and editing patterns, and their potential usefulness to automated content annotation and management systems. In our rhythm model, motion behavior is classified as being either nonexistent, fluid or staccato for a given shot. Shot neighborhoods in movies are then grouped by proportional makeup of these motion behavioral classes to yield seven high-level rhythmic arrangements that prove to be adept at indicating likely scene content (e.g. dialogue or chase sequence) in our experiments. The second part of our investigation presents a computational model to detect editing patterns as either metric, accelerated, decelerated or free. Details of the algorithm for the extraction of these classes are presented, along with experimental results on real movie data. We show with an investigation of combined rhythmic patterns that, while detailed content identification via rhythm types alone is not possible by virtue of the fact that film is not codified to this level in terms of rhythmic elements, analysis of the combined motion/editing rhythms can allow us to determine that the content has changed and hypothesize as to why this is so. We present three such categories of change and demonstrate their efficacy for capturing useful film elements (e.g. scene change precipitated by plot event), by providing data support from five motion pictures.

Finding the beat : an analysis of the rhythmic elements of motion pictures

This paper forms a continuation of our work focused on exploiting film grammar for the task of automated film understanding. We examine film rhythm, a powerful narrative concept used to endow structure and form to the film compositionally and to enhance its lyrical quality experientially. Of the many, often complex, cinematic devices contributing to film rhythm, this paper investigates the rhythmic elements that are present in edited sequences of shots, and presents a novel computational model to detect shot structural rhythm as either metric, accelerated, decelerated, or free. Details of the algorithm for the extraction of these editing rhythm classes are presented, along with experimental results on real movie data. Following this we study the usefulness of combining the rhythmic patterns induced through both motion and editing in film. We show that, whilst detailed content identification via rhythm types alone is not possible by virtue of the fact that film is not codified to this level in terms of rhythmic elements, analysis of the combined motion/shot rhythm can allow us to determine that the content has changed and hypothesize as to why this is so. We present 3 such categories of change and demonstrate their efficacy for capturing useful film elements (e.g., scene change precipitated by plot event), by providing data support from 5 motion pictures.

Corner inlet and Nooramunga habitat mapping project

Deakin University and the University of Tasmania were commissioned by Parks Victoria (PV) to create two updated habitat maps for areas within the Corner Inlet and Nooramunga Marine and Coastal Park and Ramsar area. The team obtained a ground-truth data set using in situ video and still photographs. This dataset was used to develop and assess predictive models of benthic marine habitat distributions incorporating data from both ALOS (Advanced Land Observation Satellite) imagery atmospherically corrected by CSIRO and LiDAR (Light Detection and Ranging) bathymetry. This report describes the results of the mapping effort as well as the methodology used to produce these habitat maps.

Overall accuracies of habitat classifications were good, returning overall accuracies >73 % and kappa values > 0.62 for both study localities. Habitats predicted with highest accuracies included Zosteraceae in Nooramunga (91 %), reef in Corner Inlet (80 %), and bare sediment (no-visible macrobiota/no-visible seagrass classes; both > 76 %). The majority of classification errors were due to the misclassification of areas of sparse seagrass as bare sediment. For the Corner Inlet study locality the no-visible macrobiota (10,698 ha), Posidonia (4,608 ha) and Zosteraceae (4,229 ha) habitat classes covered the most area. In Nooramunga no-visible seagrass (5,538 ha), Zosteraceae (4,060 ha) and wet saltmarsh (1,562 ha) habitat classes were most dominant.

In addition to the commissioned work preliminary change detection analyses were undertaken as part of this project. These analyses indicated shifts in habitat extents in both study localities since the late 1990s/2000. In particular, a post-classification analysis highlighted that there were considerable increases in seagrass habitat (primarily Zosteraceae) throughout the littoral zones and river/creek mouths of both study localities. Further, the numerous channel systems remained stable and were free of seagrass at both times. A substantial net loss of Posidonia in the Corner Inlet locality is likely but requires further investigation due to potential misclassifications between habitats in both the 1998 map (Roob et al. 1998) and the current mapping. While the unsupervised Independent Components Analysis (ICA) change detection technique indicated some changes in habitat extent and distribution, considerable areas of habitat change observed in the post-classification approach are questionable, and may reflect misclassifications rather than real change. A particular example of this is an apparent large decrease in Zosteraceae and increase in Posidonia being related to the classification of Posidonia beds as Zosteraceae in the 1998 mapping. Despite this, we believe that changes indicated by both the ICA and post-classification approaches have a high likelihood of being ‘actual’ change. A pattern of gains and losses of Zosteraceae in the region north of Stockyard channel is an example of this. Further analyses and refinements of approaches in change detection analyses such as would improve confidence in the location and extent of habitat changes over this time period.

This work has been successful in providing new baseline maps using a repeatable method meaning that any future changes in intertidal and shallow water marine habitats may be assessed in a consistent way with quantitative error assessments. In wider use, these maps should also allow improved conservation planning, advance fisheries and catchment management, and progress infrastructure planning to limit impacts on the Inlet environment.

Monitoring protected areas using remote sensing technology

Due to irrational use of natural resources, human society is facing unprecedented threats. Remote sensing is one of the essential tools to determine changes in various forms of biological diversity over time. There are many methods to determine changes in protected areas, using satellite images. In this paper after introducing different change detection methods and their advantages and disadvantages, a hybrid method is used to analyse changes in forests and protected areas in a national park. Two Landsat images of Golestan National Park in Iran (taken in 1998 and 2010) were used. This hybrid approach combines Change Vector Analysis (CVA) for flagging the occurrence of changes, followed by signature extension to assign labels to changedpixels. The main objective of this paper is to propose a method for discovering and assessing environmental threats to natural treasures.