Measuring Visual Consistency in 3D Rendering Systems

One of the major challenges facing a present day game development company is the removal of bugs from such complex virtual environments. This work presents an approach for measuring the correctness of synthetic scenes generated by a rendering system of a 3D application, such as a computer game. Our approach builds a database of labelled point clouds representing the spatiotemporal colour distribution for the objects present in a sequence of bug-free frames. This is done by converting the position that the pixels take over time into the 3D equivalent points with associated colours. Once the space of labelled points is built, each new image produced from the same game by any rendering system can be analysed by measuring its visual inconsistency in terms of distance from the database. Objects within the scene can be relocated (manually or by the application engine); yet the algorithm is able to perform the image analysis in terms of the 3D structure and colour distribution of samples on the surface of the object. We applied our framework to the publicly available game RacingGame developed for Microsoft(R) Xna(R). Preliminary results show how this approach can be used to detect a variety of visual artifacts generated by the rendering system in a professional quality game engine.

Bioengineered 3D platform to explore cell-ECM interactions and drug resistance of epithelial ovarian cancer cells

The behaviour of cells cultured within three-dimensional (3D) structures rather than onto two-dimensional (2D) culture plastic more closely reflects their in vivo responses. Consequently, 3D culture systems are becoming crucial scientific tools in cancer cell research. We used a novel 3D culture concept to assess cell-matrix interactions implicated in carcinogenesis: a synthetic hydrogel matrix equipped with key biomimetic features, namely incorporated cell integrin-binding motifs (e.g. RGD peptides) and the ability of being degraded by cell-secreted proteases (e.g. matrix metalloproteases). As a cell model, we chose epithelial ovarian cancer, an aggressive disease typically diagnosed at an advanced stage when chemoresistance occurs. Both cell lines used (OV-MZ-6, SKOV-3) proliferated similarly in 2D, but not in 3D. Spheroid formation was observed exclusively in 3D when cells were embedded within hydrogels. By exploiting the design flexibility of the hydrogel characteristics, we showed that proliferation in 3D was dependent on cell-integrin engagement and the ability of cells to proteolytically remodel their extracellular microenvironment. Higher survival rates after exposure to the anti-cancer drug paclitaxel were observed in cell spheroids grown in hydrogels (40-60%) compared to cell monolayers in 2D (20%). Thus, 2D evaluation of chemosensitivity may not reflect pathophysiological events seen in patients. Because of the design flexibility of their characteristics and their stability in long-term cultures (28 days), these biomimetic hydrogels represent alternative culture systems for the increasing demand in cancer research for more versatile, physiologically relevant and reproducible 3D matrices.

Finitude (Mallee:Time)

An interactive installation with full body interface, digital projection, multi-touch sensitive screen surfaces, interactive 3D gaming software, motorised dioramas, 4.1 spatial sound & new furniture forms - investigating the cultural dimensions of sustainability through the lens of 'time'. “Time is change, time is finitude. Humans are a finite species. Every decision we make today brings that end closer, or alternatively pushes it further away. Nothing can be neutral”. Tony Fry DETAILS: Finitude (Mallee:Time) is a major new media/sculptural hybrid work premiered in 2011 in version 1 at the Ka-rama Motel for the Mildura Palimpsest #8 ('Collaborators and Saboteurs'). Each participant/viewer lies comfortably on their back on the double bed of Room 22. Directly above them, supported by a wooden structure, not unlike a house frame, is a semi-transparent Perspex screen that displays projected 3D imagery and is simultaneously sensitive to the lightest of finger touches. Depending upon the ever changing qualities of the projected image on this screen the participant can see through its surface to a series of physical dioramas suspended above, lit by subtle LED spotlighting. This diorama consists of a slowly rotating series of physical environments, which also include several animatronic components, allowing the realtime composition of whimsical ‘landscapes’ of both 'real' and 'virtual' media. Through subtle, non-didactic touch-sensitive interactivity the participant then has influence over both the 3D graphic imagery, the physical movements of the diorama and the 4.1 immersive soundscape, creating an uncanny blend of physical and virtual media. Five speakers positioned around the room deliver a rich interactive soundscape that responds both audibly and physically to interactions. VERSION 1, CONTEXT/THEORY: Finitude (Mallee: Time) is Version 1 of a series of presentations during 2012-14. This version has been inspired through a series of recent visits and residencies in the SW Victoria Mallee country. Further drawing on recent writings by post colonial author Paul Carter, the work is envisaged as an evolving ‘personal topography’ of place-discovery. By contrasting and melding readily available generalisations of the Mallee regions’ rational surfaces, climatic maps and ecological systems with what Carter calls “a fine capillary system of interconnected words, places, memories and sensations” generated through my own idiosyncratic research processes, Finitude (Mallee Time) invokes a “dark writing” of place through outside eyes - an approach that avoids concentration upon what 'everyone else knows', to instead imagine and develop a sense how things might be. This basis in re-imagining and re-invention becomes the vehicle for the work’s more fundamental intention - as a meditative re-imagination of 'time' (and region) as finite resources: Towards this end, every object, process and idea in the work is re-thought as having its own ‘time component’ or ‘residue’ that becomes deposited into our 'collective future'. Thought this way Finitude (Mallee Time) suggests the poverty of predominant images of time as ‘mechanism’ to instead envisage time as a plastic cyclical medium that we can each choose to ‘give to’ or ‘take away from’ our future. Put another way - time has become finitude.

3D cultures of prostate cancer cells cultured in a novel high-throughput culture platform are more resistant to chemotherapeutics compared to cells cultured in monolayer

Despite monolayer cultures being widely used for cancer drug development and testing, 2D cultures tend to be hypersensitive to chemotherapy and are relatively poor predictors of whether a drug will provide clinical benefit. Whilst generally more complicated, three dimensional (3D) culture systems often better recapitulate true cancer architecture and provide a more accurate drug response. As a step towards making 3D cancer cultures more accessible, we have developed a microwell platform and surface modification protocol to enable high throughput manufacture of 3D cancer aggregates. Herein we use this novel system to characterize prostate cancer cell microaggregates, including growth kinetics and drug sensitivity. Our results indicate that prostate cancer cells are viable in this system, however some non-cancerous prostate cell lines are not. This system allows us to consistently control for the presence or absence of an apoptotic core in the 3D cancer microaggregates. Similar to tumor tissues, the 3D microaggregates display poor polarity. Critically the response of 3D microaggregates to the chemotherapeutic drug, docetaxel, is more consistent with in vivo results than the equivalent 2D controls. Cumulatively, our results demonstrate that these prostate cancer microaggregates better recapitulate the morphology of prostate tumors compared to 2D and can be used for high-throughput drug testing.

Single molecule microscopy in 3D cell cultures and tissues

From the onset of the first microscopic visualization of single fluorescent molecules in living cells at the beginning of this century, to the present, almost routine application of single molecule microscopy, the method has well-proven its ability to contribute unmatched detailed insight into the heterogeneous and dynamic molecular world life is composed of. Except for investigations on bacteria and yeast, almost the entire story of success is based on studies on adherent mammalian 2D cell cultures. However, despite this continuous progress, the technique was not able to keep pace with the move of the cell biology community to adapt 3D cell culture models for basic research, regenerative medicine, or drug development and screening. In this review, we will summarize the progress, which only recently allowed for the application of single molecule microscopy to 3D cell systems and give an overview of the technical advances that led to it. While initially posing a challenge, we finally conclude that relevant 3D cell models will become an integral part of the on-going success of single molecule microscopy.

Translating tissue engineering technology platforms into cancer research

Technology platforms originally developed for tissue engineering applications produce valuable models that mimic three-dimensional (3D) tissue organization and function to enhance the understanding of cell/tissue function under normal and pathological situations. These models show that when replicating physiological and pathological conditions as closely as possible investigators are allowed to probe the basic mechanisms of morphogenesis, differentiation and cancer. Significant efforts investigating angiogenetic processes and factors in tumorigenesis are currently undertaken to establish ways of targeting angiogenesis in tumours. Anti-angiogenic agents have been accepted for clinical application as attractive targeted therapeutics for the treatment of cancer. Combining the areas of tumour angiogenesis, combination therapies and drug delivery systems is therefore closely related to the understanding of the basic principles that are applied in tissue engineering models. Studies with 3D model systems have repeatedly identified complex interacting roles of matrix stiffness and composition, integrins, growth factor receptors and signalling in development and cancer. These insights suggest that plasticity, regulation and suppression of these processes can provide strategies and therapeutic targets for future cancer therapies. The historical perspective of the fields of tissue engineering and controlled release of therapeutics, including inhibitors of angiogenesis in tumours is becoming clearly evident as a major future advance in merging these fields. New delivery systems are expected to greatly enhance the ability to deliver drugs locally and in therapeutic concentrations to relevant sites in living organisms. Investigating the phenomena of angiogenesis and anti-angiogenesis in 3D in vivo models such as the Arterio-Venous (AV) loop mode in a separated and isolated chamber within a living organism adds another significant horizon to this perspective and opens new modalities for translational research in this field.

Phenotypic Characterization of Prostate Cancer LNCaP Cells Cultured within a Bioengineered Microenvironment

Biophysical and biochemical properties of the microenvironment regulate cellular responses such as growth, differentiation, morphogenesis and migration in normal and cancer cells. Since two-dimensional (2D) cultures lack the essential characteristics of the native cellular microenvironment, three-dimensional (3D) cultures have been developed to better mimic the natural extracellular matrix. To date, 3D culture systems have relied mostly on collagen and Matrigel™ hydrogels, allowing only limited control over matrix stiffness, proteolytic degradability, and ligand density. In contrast, bioengineered hydrogels allow us to independently tune and systematically investigate the influence of these parameters on cell growth and differentiation. In this study, polyethylene glycol (PEG) hydrogels, functionalized with the Arginine-glycine-aspartic acid (RGD) motifs, common cell-binding motifs in extracellular matrix proteins, and matrix metalloproteinase (MMP) cleavage sites, were characterized regarding their stiffness, diffusive properties, and ability to support growth of androgen-dependent LNCaP prostate cancer cells. We found that the mechanical properties modulated the growth kinetics of LNCaP cells in the PEG hydrogel. At culture periods of 28 days, LNCaP cells underwent morphogenic changes, forming tumor-like structures in 3D culture, with hypoxic and apoptotic cores. We further compared protein and gene expression levels between 3D and 2D cultures upon stimulation with the synthetic androgen R1881. Interestingly, the kinetics of R1881 stimulated androgen receptor (AR) nuclear translocation differed between 2D and 3D cultures when observed by immunofluorescent staining. Furthermore, microarray studies revealed that changes in expression levels of androgen responsive genes upon R1881 treatment differed greatly between 2D and 3D cultures. Taken together, culturing LNCaP cells in the tunable PEG hydrogels reveals differences in the cellular responses to androgen stimulation between the 2D and 3D environments. Therefore, we suggest that the presented 3D culture system represents a powerful tool for high throughput prostate cancer drug testing that recapitulates tumor microenvironment. © 2012 Sieh et al.

Finitude (V03)

WHAT: An interactive installation with full body interface, digital projection, multi-touch sensitive screen surfaces, interactive 3D gaming software, motorised dioramas, 4.1 spatial sound & new furniture forms - investigating the cultural dimensions of sustainability through the lens of 'time'. “Time is change, time is finitude. Humans are a finite species. Every decision we make today brings that end closer, or alternatively pushes it further away. Nothing can be neutral”. Tony Fry DETAILS: Each participant/viewer lies comfortably on their back. Directly above them is a semi-transparent Perspex screen that displays projected 3D imagery and is simultaneously sensitive to the lightest of finger touches. Depending upon the ever changing qualities of the projected image on this screen the participant can see through its surface to a series of physical dioramas suspended above, lit by subtle LED spotlighting. This diorama consists of a slowly rotating series of physical environments, which also include several animatronic components, allowing the realtime composition of whimsical ‘landscapes’ of both 'real' and 'virtual' media. Through subtle, non-didactic touch-sensitive interactivity the participant then has influence over both the 3D graphic imagery, the physical movements of the diorama and the 4 channel immersive soundscape, creating an uncanny blend of physical and virtual media. Five speakers positioned around the room deliver a rich interactive soundscape that responds both audibly and physically to interactions.

Drug discovery approaches utilizing three-dimensional cell culture

Historically, two-dimensional (2D) cell culture has been the preferred method of producing disease models in vitro. Recently, there has been a move away from 2D culture in favor of generating three-dimensional (3D) multicellular structures, which are thought to be more representative of the in vivo environment. This transition has brought with it an influx of technologies capable of producing these structures in various ways. However, it is becoming evident that many of these technologies do not perform well in automated in vitro drug discovery units. We believe that this is a result of their incompatibility with high-throughput screening (HTS). In this study, we review a number of technologies, which are currently available for producing in vitro 3D disease models. We assess their amenability with high-content screening and HTS and highlight our own work in attempting to address many of the practical problems that are hampering the successful deployment of 3D cell systems in mainstream research.

3D visualisation of groundwater/surface water systems as a planning and communication tool

Groundwater is increasingly recognised as an important yet vulnerable natural resource, and a key consideration in water cycle management. However, communication of sub-surface water system behaviour, as an important part of encouraging better water management, is visually difficult. Modern 3D visualisation techniques can be used to effectively communicate these complex behaviours to engage and inform community stakeholders. Most software developed for this purpose is expensive and requires specialist skills. The Groundwater Visualisation System (GVS) developed by QUT integrates a wide range of surface and sub-surface data, to produce a 3D visualisation of the behaviour, structure and connectivity of groundwater/surface water systems. Surface data (elevation, surface water, land use, vegetation and geology) and data collected from boreholes (bore locations and subsurface geology) are combined to visualise the nature, structure and connectivity of groundwater/surface water systems. Time-series data (water levels, groundwater quality, rainfall, stream flow and groundwater abstraction) is displayed as an animation within the 3D framework, or graphically, to show water system condition changes over time. GVS delivers an interactive, stand-alone 3D Visualisation product that can be used in a standard PC environment. No specialised training or modelling skills are required. The software has been used extensively in the SEQ region to inform and engage both water managers and the community alike. Examples will be given of GVS visualisations developed in areas where there have been community concerns around groundwater over-use and contamination.

A crash avoidance framework for heavy equipment control systems using 3D imaging sensors

This paper presents a preliminary crash avoidance framework for heavy equipment control systems. Safe equipment operation is a major concern on construction sites since fatal on-site injuries are an industry-wide problem. The proposed framework has potential for effecting active safety for equipment operation. The framework contains algorithms for spatial modeling, object tracking, and path planning. Beyond generating spatial models in fractions of seconds, these algorithms can successfully track objects in an environment and produce a collision-free 3D motion trajectory for equipment.

3D reconfigurable autopilot flight system for both general aviation and unmanned aerial systems

This research project investigated and designed a modular architecture for a 3D Reconfigurable Autopilot Flight System that could be used to control actuators in both manned and unmanned aircraft. The system is based on a CAN Bus interface and allows seamless control of different types of actuators. During the course of the research the differences and similarities of autopilots for fixed-wing general aviation aircraft and unmanned aircraft were analysed focusing on the actuator interfaces. This project suggests that software and hardware used in commercial-of-the-shelf avionics could be used in manned and unmanned aviation.

2D-3D Face Recognition Based on PCA and Feature Modelling

Hybrid face recognition, using image (2D) and structural (3D) information, has explored the fusion of Nearest Neighbour classifiers. This paper examines the effectiveness of feature modelling for each individual modality, 2D and 3D. Furthermore, it is demonstrated that the fusion of feature modelling techniques for the 2D and 3D modalities yields performance improvements over the individual classifiers. By fusing the feature modelling classifiers for each modality with equal weights the average Equal Error Rate improves from 12.60% for the 2D classifier and 12.10% for the 3D classifier to 7.38% for the Hybrid 2D+3D clasiffier.