Interactive Ray Tracing for Virtual TV Studio Applications

In the last years, the well known ray tracing algorithm gained new popularity with the introduction of interactive ray tracing methods. The high modularity and the ability to produce highly realistic images make ray tracing an attractive alternative to raster graphics hardware. Interactive ray tracing also proved its potential in the field of Mixed Reality rendering and provides novel methods for seamless integration of real and virtual content. Actor insertion methods, a subdomain of Mixed Reality and closely related to virtual television studio techniques, can use ray tracing for achieving high output quality in conjunction with appropriate visual cues like shadows and reflections at interactive frame rates. In this paper, we show how interactive ray tracing techniques can provide new ways of implementing virtual studio applications.

O aprimoramento de um software de estúdio virtual por meio de técnicas de matting digital e registro de objetos virtuais

A virtual studio system can use technologies as augmented reality and digital matting to decrease production costs at the same time it provides the same resources of a conventional studio. With this, it’s possible for the current studios, with low cost and using conventional devices, to create productions with greater image quality and effects. Some difficulties are recurrent in virtual studio applications that use augmented reality and digital matting. The virtual objects registration in augmented reality techniques suffer from problems caused by optical distortions in the camera, errors in the marker tracking system, lack of calibration on the equipments or on the environment (lighting, for example), or even by delays in the virtual objects display. On the other hand, the digital matting’s main problem is the real-time execution to preview the scene, which must have optimized processing speed at the same time while maintain the best image quality possible. Taking the given context into consideration, this work aims to give continuity to a virtual studio system called ARStudio, by enhancing digital matting, virtual objects registration and introducing a segmentation based on depth map, yet adding better control over functionalities previously implemented

ARSTUDIO: estúdio virtual para produção de conteúdos audiovisuais em realidade aumentada para a TV Digital

“Virtual Studio” is a system developed for the creation of virtual sets, as well as any threedimensional virtual objects that can be digitally integrated to the scenes captured on a real television studio. Through techniques such as chroma-key, computer graphics , augmented reality and virtual reality is possible flexibility in producing content for digital TV, reduce cost and meet 12.485/2011 law, the Brazilian “Law of Pay TV”, which has among its objectives “to increase the production and circulation of diverse and quality Brazilian audiovisual content, generating jobs, income, royalties, professionalism and strengthening of national culture” (ANCINE , Brazilian Nacional Cinema Agency ). Based on this background, an overview of the benefits of using the technologies mentioned for the production of content for digital television is presented. This work involves the development of a system of Interactive Virtual Studio called ARSTUDIO per team of researchers from the Posgraduate Program in Digital Television: Information and Knowledge at UNESP, São Paulo State University in Bauru, State of São Paulo, Brazil.

ARSTUDIO: estúdio virtual para produção de conteúdos audiovisuais em realidade aumentada para TV digital

Virtual Studio is a system developed for the creation of virtual sets , as well as any three-dimensional virtual objects that can be digitally integrated to the scenes captured on a real television studio . Through techniques such as chroma-key , computer graphics , augmented reality and virtual reality is possible flexibility in producing content for digital TV , reduce cost and meet 12.485/2011 law , the Brazilian Law of Pay TV , which has among its objectives to increase the production and circulation of diverse and quality Brazilian audiovisual content, generating jobs, income , royalties, professionalism and strengthening of national culture (ANCINE , Brazilian Nacional Cinema Agency ). Based on this background , an overview of the benefits of using the technologies mentioned for the production of content for digital television is presented . This work involves the development of a system of Interactive Virtual Studio called ARSTUDIO per team of researchers from the Posgraduate Program in Digital Television: Information and Knowledge at UNESP , São Paulo State University in Bauru , State of São Paulo, Brazil .

Uma metodologia para a geração de conteúdos digitais baseado na utilização de estudios virtuais com realidade aumentada

Pós-graduação em Televisão Digital: Informação e Conhecimento - FAAC

Interação com objetos digitais 3D em estúdios virtuais

Pós-graduação em Televisão Digital: Informação e Conhecimento - FAAC

Digital Illumination for Augmented Studios

Virtual studio technology plays an important role for modern television productions. Blue-screen matting is a common technique for integrating real actors or moderators into computer generated sceneries. Augmented reality offers the possibility to mix real and virtual in a more general context. This article proposes a new technological approach for combining real studio content with computergenerated information. Digital light projection allows a controlled spatial, temporal, chrominance and luminance modulation of illumination – opening new possibilities for TV studios.

Perceptions of physical versus virtual design studio education

While the studio environment has been promoted as an ideal educational setting for project-based disciplines associated with the art and design, few qualitative studies have been undertaken in a comprehensive way, with even fewer giving emphasis to the teachers and students and how they feel about changing their environment. This situation is problematic given the changes and challenges facing higher education, including those associated with new technologies such as online learning. In response, this paper describes a comparative study employing grounded theory to identify and describe teachers’ and students’ perceptions of the physical design studio (PDS) as well as the virtual design studio (VDS) of architectural students in an Australian university. The findings give significance to aspects of design education activities and their role in the development of integrated hybrid learning environments.

The “virtual” producer in the recording studio : media networks in long distance peripheral performances

The producer has for many years been a central agent in recording studio sessions; the validation of this role was, in many ways, related to the producer’s physical presence in the studio, to a greater or lesser extent. However, improvements in the speed of digital networks have allowed studio sessions to be produced long-distance, in real-time, through communication programs such as Skype or REDIS. How does this impact on the role of the producer, a “nexus between the creative inspiration of the artist, the technology of the recording studio, and the commercial aspirations of the record company” (Howlett 2012)? From observations of a studio recording session in Lisbon produced through Skype from New York, this article focuses on the role of the producer in these relatively new recording contexts involving long distance media networks. Methodology involved participant observation carried out in Estúdios Namouche in Lisbon (where the session took place), as part of doctoral research. This ethnographic approach also included a number of semi-directed ethnographic interviews of the different actors in this scenario—musicians, recording engineers, composers and producers. As a theoretical framework, the research of De Zutter and Sawyer on Distributed Creativity is used, as the recording studio sets an example of “a cognitive system where […] tasks are not accomplished by separate individuals, but rather through the interactions of those individuals” (DeZutter 2009:4). Therefore, creativity often emerges as a result of this interaction.

Web 2.0 virtual design studio : social networking as facilitator of design education

In 2009, Deakin University and the Chinese University of Hong Kong trailed the use of Web 2.0 technologies to enhance learning outcomes in a third-year architectural design studio that was modelled on the virtual design studios (VDSs) of the past decades. The studio developed the VDS further by integrating a social learning environment into the blended learning experience. The Web 2.0 VDS utilized the social networking site Ning.com, YouTube, Skype and various three-dimensional modelling, video and image processing, and chat software to deliver lectures, communicate learning goals, disseminate learning resources, submitting, providing feedback and comments to various design works, and assessing of students’ outcomes. This research centres on issues of learning and teaching associated with the development of a social network VDS.

The social network virtual design studio : integrated design learning using blended learning environments

Online communications, multimedia, mobile computing and face-to-face learning create blended learning environments to which some Virtual Design Studios (VDS) have reacted to. Social Networks (SN), as instruments for communication, have provided a potentially fruitful operative base for VDS. These technologies transfer communication, leadership, democratic interaction, teamwork, social engagement and responsibility away from the design tutors to the participants. The implementation of Social Network VDS (SNVDS) moved the VDS beyond its conventional realm and enabled students to develop architectural design that is embedded into a community of learners and expertise both online and offline. Problem-based learning (PBL) becomes an iterative and reflexive process facilitating deep learning. The paper discusses details of the SNVDS, its pedagogical implications to PBL, and presents how the SNVDS is successful in enabling architectural students to collaborate and communicate design proposals that integrate a variety of skills, deep learning, knowledge and construction with a rich learning experience.

How social is the virtual design studio? A case study of a third year design studio

With the advent of social networks, it became apparent that the social aspect of designing and learning plays a crucial role in students’ education. Technologies and skills are the base on which learners interact. The ease of communication, leadership opportunity, democratic interaction, teamwork, and the sense of community are some of the aspects that are now in the centre of design interaction. The paper examines Virtual Design Studios (VDS) that used media-rich platforms and analyses the influence the social aspect plays in solving all problems on the sample of a design studio at Deakin University. It studies the effectiveness of the generated social intelligence and explores the facilitation of students’ self-directed learning. Hereby the paper studies the construction of knowledge via social interaction and how blended learning environments foster motivation and information exchange. It presents its finding based on VDS that were held over the past three years.

Virtual design studio within a blended social network

Online interactions, multimedia, mobile computing and face-to-face learning create blended learning environments to which some Virtual Design Studios (VDS) have reacted. Social Networks (SN), as instruments for communication, have provided a potentially fruitful operative base for VDS. These technologies transfer communication, leadership, democratic interaction, teamwork, social engagement and responsibility away from the design tutors to the participants. The implementation of a Social Network VDS (SNVDS) moved the VDS beyond its conventional realm and enabled students to develop architectural design that is embedded into a community of learners and their expertise both online and offline. Problem-based learning (PBL) becomes an iterative and reflexive process facilitating deep learning. The paper discusses details of the SNVDS, its pedagogical implications to PBL, and presents how the SNVDS is successful in empowering architectural students to collaborate and communicate design proposals that integrate a variety of skills, deep learning, knowledge and construction with a rich learning experience.

Virtual design studio via social networks

With the advent of social networks, it became apparent that the social aspect of designing and learning plays a crucial role in students’ education. The ease of communication, leadership opportunity, democratic interaction, teamwork, and the sense of community are some of the aspects that are now in the centre of design interaction. Online interactions, multimedia, mobile computing and face-to-face learning create blended learning environments to which some Virtual Design Studios (VDS) have reacted. On the sample of a design studio at Deakin University the paper discusses details of the Social Network VDS, its pedagogical implications to PBL, and presents how it is successful in empowering architectural students to collaborate and communicate design proposals that integrate a variety of skills, deep learning, and construction of knowledge. It studies the effectiveness of the generated social intelligence and explores the facilitation of students’ self-directed learning. Hereby the paper studies the construction of knowledge via social interaction and how blended learning environments foster motivation and information exchange.