Increasing Realism and Supporting Content Planning for Dynamic Scenes in a Mixed Reality System incorporating a Time-of-Flight Camera

For broadcasting purposes MIXED REALITY, the combination of real and virtual scene content, has become ubiquitous nowadays. Mixed Reality recording still requires expensive studio setups and is often limited to simple color keying. We present a system for Mixed Reality applications which uses depth keying and provides threedimensional mixing of real and artificial content. It features enhanced realism through automatic shadow computation which we consider a core issue to obtain realism and a convincing visual perception, besides the correct alignment of the two modalities and correct occlusion handling. Furthermore we present a possibility to support placement of virtual content in the scene. Core feature of our system is the incorporation of a TIME-OF-FLIGHT (TOF)-camera device. This device delivers real-time depth images of the environment at a reasonable resolution and quality. This camera is used to build a static environment model and it also allows correct handling of mutual occlusions between real and virtual content, shadow computation and enhanced content planning. The presented system is inexpensive, compact, mobile, flexible and provides convenient calibration procedures. Chroma-keying is replaced by depth-keying which is efficiently performed on the GRAPHICS PROCESSING UNIT (GPU) by the usage of an environment model and the current ToF-camera image. Automatic extraction and tracking of dynamic scene content is herewith performed and this information is used for planning and alignment of virtual content. An additional sustainable feature is that depth maps of the mixed content are available in real-time, which makes the approach suitable for future 3DTV productions. The presented paper gives an overview of the whole system approach including camera calibration, environment model generation, real-time keying and mixing of virtual and real content, shadowing for virtual content and dynamic object tracking for content planning.

View-Dependent Extraction of Contours with Distance Transforms for Adaptive Polygonal for adaptive polygonal Mesh-Simplification

During decades Distance Transforms have proven to be useful for many image processing applications, and more recently, they have started to be used in computer graphics environments. The goal of this paper is to propose a new technique based on Distance Transforms for detecting mesh elements which are close to the objects' external contour (from a given point of view), and using this information for weighting the approximation error which will be tolerated during the mesh simplification process. The obtained results are evaluated in two ways: visually and using an objective metric that measures the geometrical difference between two polygonal meshes.

Head Tracking Based Avatar Control for Virtual Environment Teamwork Training

Virtual environments (VE) are gaining in popularity and are increasingly used for teamwork training purposes, e.g., for medical teams. One shortcoming of modern VEs is that nonverbal communication channels, essential for teamwork, are not supported well. We address this issue by using an inexpensive webcam to track the user's head. This tracking information is used to control the head movement of the user's avatar, thereby conveying head gestures and adding a nonverbal communication channel. We conducted a user study investigating the influence of head tracking based avatar control on the perceived realism of the VE and on the performance of a surgical teamwork training scenario. Our results show that head tracking positively influences the perceived realism of the VE and the communication, but has no major influence on the training outcome.

Dutch boundaries

In many schools of architecture the 1970s have been an important watershed for the way in which architecture was taught. For example, recent studies have stressed the importance of Aldo Rossi for the changes in the teaching of architec-ture at the ETH in Zürich that before was based on orthodox modern principles. A similar struggle between an orthodox conception of modernity and its criticism took place at the architectural faculty of Delft, in the Netherlands. Although Delft is an important European school of architecture, the theoretical work produced during this period is not largely known outside the Netherlands. This is perhaps due to the fact that most studies were published in Dutch. With this article, I intend to make the architectural theory developed during this period known to a larger public. The article describes the intellectual journey made by Dutch stu-dents of architecture in the 1970s and 1980s. This was the quest to receive recognition for the intellectual substance of architecture: the insight architecture could be a discourse and a form of knowledge and not only a method of building. Specifically, the work of the architectural theoretician Wim Nijenhuis is highlight-ed. However, as I point out in this article, the results of this journey also had its problematic sides. This becomes clear from the following sentence taken from the dissertation of Wim Nijenhuis: "The search for metaphysical fiction and the tendency towards a technological informed absolute through fully transparent and simultaneous information, should be contested by a fantasy dimension, that does not wish to 'overcome' a given situation and that does not rely on 'creativi-ty' (that would still be historical and humanistic)." Texts like this have a hermet-ic quality that is not easy to comprehend for an architectural public. Even more, there is an important debate looming behind these sentences. As an important outcome of their quest the architectural students in Delft asked themselves: how do we give form to architectural theory once its claim to truth is exposed as an illusion? For Nijenhuis, the discourse about architecture is a mere 'artful game with words': a fiction, besides other forms of fiction like poetry or literature. The question is then if we have not entered the realm of total subjectivity and relativ-ism with this position. From what can the discourse of architecture derive its authority after the death of God?