Translating Management Storylines: developing a visual strategy to communicate science to stakeholder community, a case for Mackay, QLD

This project developed a visual strategy and graphic outcomes to communicate the results of a scientific collaborative project to the Mackay community. During 2013 and 2014 a team from CSIRO engaged with the community in Mackay to collaboratively develop a set of strategies to improve the management of the Great Barrier Reef. The result of this work was a 300+ page scientific report that needed to be translated and summarised to the general community. The aim of this project was to strategically synthesise information contained in the report and to design and produce an outcome to be distributed to the participant community. By working with the CISRO researchers, an action toolkit was developed, with twelve cards and a booklet. Each card represented the story behind a certain local management issue and the actions that the participants suggested should be taken in order to improve management of The Reef. During the design synthesis it was identified that for all management issues there was a reference to the need to develop some sort of "educational campaign" to the area. That was then translated as an underlying action to support all other actions proposed in the toolkit.

Visual control of an electrohydraulic manipulator for underground mining applications

A large range of underground mining equipment makes use of compliant hydraulic arms for tasks such as rock-bolting, rock breaking, explosive charging and shotcreting. This paper describes a laboratory model electo-hydraulic manipulator which is used to prototype novel control and sensing techniques. The research is aimed at improving the safety and productivity of these mining tasks through automation, in particular the application of closed-loop visual positioning of the machine's end-effector.

Complete-linkage clustering for voice activity detection in audio and visual speech

We propose a novel technique for conducting robust voice activity detection (VAD) in high-noise recordings. We use Gaussian mixture modeling (GMM) to train two generic models; speech and non-speech. We then score smaller segments of a given (unseen) recording against each of these GMMs to obtain two respective likelihood scores for each segment. These scores are used to compute a dissimilarity measure between pairs of segments and to carry out complete-linkage clustering of the segments into speech and non-speech clusters. We compare the accuracy of our method against state-of-the-art and standardised VAD techniques to demonstrate an absolute improvement of 15% in half-total error rate (HTER) over the best performing baseline system and across the QUT-NOISE-TIMIT database. We then apply our approach to the Audio-Visual Database of American English (AVDBAE) to demonstrate the performance of our algorithm in using visual, audio-visual or a proposed fusion of these features.

Putting an "end" to the motor cortex representations of action words

Language processing is an example of implicit learning of multiple statistical cues that provide probabilistic information regarding word structure and use. Much of the current debate about language embodiment is devoted to how action words are represented in the brain, with motor cortex activity evoked by these words assumed to selectively reflect conceptual content and/or its simulation. We investigated whether motor cortex activity evoked by manual action words (e.g., caress) might reflect sensitivity to probabilistic orthographic-phonological cues to grammatical category embedded within individual words. We first review neuroimaging data demonstrating that nonwords evoke activity much more reliably than action words along the entire motor strip, encompassing regions proposed to be action category specific. Using fMRI, we found that disyllabic words denoting manual actions evoked increased motor cortex activity compared with non-body-part-related words (e.g., canyon), activity which overlaps that evoked by observing and executing hand movements. This result is typically interpreted in support of language embodiment. Crucially, we also found that disyllabic nonwords containing endings with probabilistic cues predictive of verb status (e.g., -eve) evoked increased activity compared with nonwords with endings predictive of noun status (e.g., -age) in the identical motor area. Thus, motor cortex responses to action words cannot be assumed to selectively reflect conceptual content and/or its simulation. Our results clearly demonstrate motor cortex activity reflects implicit processing of ortho-phonological statistical regularities that help to distinguish a word's grammatical class.

Classic identity negative priming involves accessing semantic representations in the left anterior temporal cortex

Classic identity negative priming (NP) refers to the finding that when an object is ignored, subsequent naming responses to it are slower than when it has not been previously ignored (Tipper, S.P., 1985. The negative priming effect: inhibitory priming by ignored objects. Q. J. Exp. Psychol. 37A, 571-590). It is unclear whether this phenomenon arises due to the involvement of abstract semantic representations that the ignored object accesses automatically. Contemporary connectionist models propose a key role for the anterior temporal cortex in the representation of abstract semantic knowledge (e.g., McClelland, J.L., Rogers, T.T., 2003. The parallel distributed processing approach to semantic cognition. Nat. Rev. Neurosci. 4, 310-322), suggesting that this region should be involved during performance of the classic identity NP task if it involves semantic access. Using high-field (4 T) event-related functional magnetic resonance imaging, we observed increased BOLD responses in the left anterolateral temporal cortex including the temporal pole that was directly related to the magnitude of each individual's NP effect, supporting a semantic locus. Additional signal increases were observed in the supplementary eye fields (SEF) and left inferior parietal lobule (IPL).

Motor response suppression and the prepotent tendency to respond: A parametric fMRI study

In the present study we utilised functional magnetic resonance imaging (fMRI) to examine cerebral activation during performance of a classic motor task in which response suppression load was parametrically varied. Linear increases in activity were observed in a distributed network of regions across both cerebral hemispheres, although with more extensive involvement of the right prefrontal cortex. Activated regions included prefrontal, parietal and occipitotemporal cortices. Decreasing activation was similarly observed in a distributed network of regions. These response forms are discussed in terms of an increasing requirement for visual cue discrimination and suppression/selection of motor responses, and a decreasing probability of the occurrence of non-target stimuli and attenuation of a prepotent tendency to respond. The results support recent proposals for a dominant role for the right-hemisphere in performance of motor response suppression tasks that emphasise the importance of the right prefrontal cortex.

Brain activity during the encoding, retention, and retrieval of stimulus representations

Studies of delayed nonmatching-to-sample (DNMS) performance following lesions of the monkey cortex have revealed a critical circuit of brain regions involved in forming memories and retaining and retrieving stimulus representations. Using event-related functional magnetic resonance imaging (fMRI), we measured brain activity in 10 healthy human participants during performance of a trial-unique visual DNMS task using novel barcode stimuli. The event-related design enabled the identification of activity during the different phases of the task (encoding, retention, and retrieval). Several brain regions identified by monkey studies as being important for successful DNMS performance showed selective activity during the different phases, including the mediodorsal thalamic nucleus (encoding), ventrolateral prefrontal cortex (retention), and perirhinal cortex (retrieval). Regions showing sustained activity within trials included the ventromedial and dorsal prefrontal cortices and occipital cortex. The present study shows the utility of investigating performance on tasks derived from animal models to assist in the identification of brain regions involved in human recognition memory.

Prefrontal cortex involvement in selective letter generation: A functional magnetic resonance imaging study

Cerebral responses to alternating periods of a control task and a selective letter generation paradigm were investigated with functional Magnetic Resonance Imaging (fMRI). Subjects selectively generated letters from four designated sets of six letters from the English language alphabet, with the instruction that they were not to produce letters in alphabetical order either forward or backward, repeat or alternate letters. Performance during this condition was compared with that of a control condition in which subjects recited the same letters in alphabetical order. Analyses revealed significant and extensive foci of activation in a number of cerebral regions including mid-dorsolateral frontal cortex, inferior frontal gyrus, precuneus, supramarginal gyrus, and cerebellum during the selective letter generation condition. These findings are discussed with respect to recent positron emission tomography (PET) and fMRI studies of verbal working memory and encoding/retrieval in episodic memory.

Cerebral regions associated with verbal response initiation, suppression and strategy use

Cerebral activation associated with performance on a novel task involving two conditions was investigated with functional magnetic resonance imaging (fMRI). In the response initiation condition, subjects nominated the general superordinate category to which each of a series of exemplars (concrete nouns) belonged. In the response suppression condition, subjects were required to nominate a general superordinate category to which each exemplar did not belong, with the instruction that they were not to nominate the same category response twice in a row. Both conditions produced distinct patterns of activation relative to an articulation control condition employing identical stimuli. When initiation and suppression conditions were directly compared, response suppression produced activation in the right frontal pole, orbital frontal cortex and anterior cingulate, left dorsolateral prefrontal cortex and posterior cingulate, and bilaterally in the precuneus, visual association cortex and cerebellum. Response latencies were significantly longer in the suppression condition. Two broadly-defined strategies associated with the correct production of words during the suppression condition were a self-ordered selection from among the superordinate categories identified during the first section of the task and the generation of novel category responses. The neuroanatomical correlates of response initiation, suppression and strategy use are discussed, as are the respective roles of response suppression and strategy generation.

Identifying rate-limiting nodes in large-scale cortical networks for visuospatial processing: An illustration using fMRI

With the advent of functional neuroimaging techniques, in particular functional magnetic resonance imaging (fMRI), we have gained greater insight into the neural correlates of visuospatial function. However, it may not always be easy to identify the cerebral regions most specifically associated with performance on a given task. One approach is to examine the quantitative relationships between regional activation and behavioral performance measures. In the present study, we investigated the functional neuroanatomy of two different visuospatial processing tasks, judgement of line orientation and mental rotation. Twenty-four normal participants were scanned with fMRI using blocked periodic designs for experimental task presentation. Accuracy and reaction time (RT) to each trial of both activation and baseline conditions in each experiment was recorded. Both experiments activated dorsal and ventral visual cortical areas as well as dorsolateral prefrontal cortex. More regionally specific associations with task performance were identified by estimating the association between (sinusoidal) power of functional response and mean RT to the activation condition; a permutation test based on spatial statistics was used for inference. There was significant behavioral-physiological association in right ventral extrastriate cortex for the line orientation task and in bilateral (predominantly right) superior parietal lobule for the mental rotation task. Comparable associations were not found between power of response and RT to the baseline conditions of the tasks. These data suggest that one region in a neurocognitive network may be most strongly associated with behavioral performance and this may be regarded as the computationally least efficient or rate-limiting node of the network.

Action word meaning representations in cytoarchitectonically defined primary and premotor cortices

Recent models of language comprehension have assumed a tight coupling between the semantic representations of action words and cortical motor areas. We combined functional MRI with cytoarchitectonically defined probabilistic maps of left hemisphere primary and premotor cortices to analyse responses of functionally delineated execution- and observation-related regions during comprehension of action word meanings associated with specific effectors (e.g., punch, bite or stomp) and processing of items with various levels of lexical information (non body part-related meanings, nonwords, and visual character strings). The comprehension of effector specific action word meanings did not elicit preferential activity corresponding to the somatotopic organisation of effectors in either primary or premotor cortex. However, generic action word meanings did show increased BOLD signal responses compared to all other classes of lexical stimuli in the pre-SMA. As expected, the majority of the BOLD responses elicited by the lexical stimuli were in association cortex adjacent to the motor areas. We contrast our results with those of previous studies reporting significant effects for only 1 or 2 effectors outside cytoarchitectonically defined motor regions and discuss the importance of controlling for potentially confounding lexical variables such as imageability. We conclude that there is no strong evidence for a somatotopic organisation of action word meaning representations and argue the pre-SMA might have a role in maintaining abstract representations of action words as instructional cues.

The dynamics of global visual effects and games development industries: lessons for Australia’s creative industries development policy

The paper critiques the focus of creative industries policy on capability development of small and medium sized firms and the provision of regional incentives. It analyses factors affecting the competitiveness and sustainability of the games development industry and visual effects suppliers to feature films. Interviews with participants in these industries highlight the need for policy instruments to take into consideration the structure and organization of global markets and the power of lead multinational corporations. We show that although forms of economic governance in these industries may allow sustainable value capture, they are interrupted by bottlenecks in which ferocious competition among suppliers is confronted by comparatively little competition among the lead firms. We argue that current approaches to creative industries policy aimed at building self-sustaining creative industries are unlikely to be sufficient because of the globalized nature of the industries. Rather, we argue that a more profitable approach is likely to require supporting diversification of the industries as ‘feeders’ into other areas of the economy.

Acoustic adaptation in cross database audio visual SHMM training for phonetic spoken term detection

Visual information in the form of lip movements of the speaker has been shown to improve the performance of speech recognition and search applications. In our previous work, we proposed cross database training of synchronous hidden Markov models (SHMMs) to make use of external large and publicly available audio databases in addition to the relatively small given audio visual database. In this work, the cross database training approach is improved by performing an additional audio adaptation step, which enables audio visual SHMMs to benefit from audio observations of the external audio models before adding visual modality to them. The proposed approach outperforms the baseline cross database training approach in clean and noisy environments in terms of phone recognition accuracy as well as spoken term detection (STD) accuracy.

Incorporating visual information for spoken term detection

Spoken term detection (STD) is the task of looking up a spoken term in a large volume of speech segments. In order to provide fast search, speech segments are first indexed into an intermediate representation using speech recognition engines which provide multiple hypotheses for each speech segment. Approximate matching techniques are usually applied at the search stage to compensate the poor performance of automatic speech recognition engines during indexing. Recently, using visual information in addition to audio information has been shown to improve phone recognition performance, particularly in noisy environments. In this paper, we will make use of visual information in the form of lip movements of the speaker in indexing stage and will investigate its effect on STD performance. Particularly, we will investigate if gains in phone recognition accuracy will carry through the approximate matching stage to provide similar gains in the final audio-visual STD system over a traditional audio only approach. We will also investigate the effect of using visual information on STD performance in different noise environments.