Motion capture and the future of virtual production

Motion capture continues to be adopted across a range of creative fields including, animation, games, visual effects, dance, live theatre and the visual arts. This panel will discuss and showcase the use of motion capture across these creative fields and consider the future of virtual production in the creative industries.

Made by motion, Series one

“Made by Motion” is a collaboration between digital artist Paul Van Opdenbosch and performer and choreographer Elise May; a series of studies on captured motion data used to generating experimental visual forms that reverberate in space and time. The project investigates the invisible forces generated by and influencing the movement of a dancer. Along with how the forces can be captured and applied to generating visual outcomes that surpass simple data visualisation, projecting the intent of the performer’s movements. The source or ‘seed’ comes from using an Xsens MVN - Inertial Motion Capture system to capture spontaneous dance movements, with the visual generation conducted through a customised dynamics simulation. In this first series the visual investigation focused on manipulating the movement date at the instance of capture, capture been the recording of three-dimensional movement as ‘seen’ by the hardware and ‘understood’ through the calibration of software. By repositioning the capture hardware on the body we can effectively change how the same sequence of movements is ‘seen’ by the motion capture system thus generating a different visual result from effetely identical movement. The outcomes from the experiments clearly demonstrates the effectiveness of using motion capture hardware as a creative tool to manipulate the perception of the capture subject, in this case been a sequence of dance movements. The creative work exhibited is a cross-section of the experiments conducted in practice with the first animated work (Movement A - Control) using the motion capture hardware in its default ‘normal’ configuration. Following this is the lower body moved to the upper body (Lb-Ub), right arm moved onto the left arm (Ra-La), right leg moved onto the left leg (Rl-Ll) and finally the left leg moved onto a object that is then held in the left hand (Ll-Pf (Lh)).

Experimental arts practice incorporating motion capture

My practice-led research explores and maps workflows for generating experimental creative work involving inertia based motion capture technology. Motion capture has often been used as a way to bridge animation and dance resulting in abstracted visuals outcomes. In early works this process was largely done by rotoscoping, reference footage and mechanical forms of motion capture. With the evolution of technology, optical and inertial forms of motion capture are now more accessible and able to accurately capture a larger range of complex movements. Made by Motion is a collaboration between digital artist Paul Van Opdenbosch and performer and choreographer Elise May; a series of studies on captured motion data used to generate experimental visual forms that reverberate in space and time. The project investigates the invisible forces generated by and influencing the movement of a dancer. Along with how the forces can be captured and applied to generating visual outcomes that surpass simple data visualisation, projecting the intent of the performer’s movements. The source or ‘seed’ comes from using an Xsens MVN – Inertial Motion Capture system to capture spontaneous dance movements, with the visual generation conducted through a customised dynamics simulation. In my presentation I will be displaying and discussing a selected creative works from the project along with the process and considerations behind the work.

The ZomPoc Project. A Large Scale Public ARG Event

An experiment in large scale, live, game design and public performance, bringing together participants from across the creative arts to design, deliver and document a project that was both a cooperative learning experience and an experimental public performance. The four month project, funded by the Edge Digital Centre, culminated into a 24 hour ARG event involving over 100 participants in December 2012. Using the premise of a viral outbreak, young enthusiasts auditioned for the roles of Survivor, Zombie, Medic and Military. The main objective was for the Survivors to complete a series of challenges over 24 hours, while the other characters fulfilled their opposing objectives of interference and sabotage supported by both scripted and free-form scenarios staged in constructed scenes throughout the venues. The event was set in the State Library of Queensland and the Edge Digital Centre who granted the project full access, night and day to all areas including public, office and underground areas. These venues were transformed into cinematic settings full of interactive props and various audio-visual effects. The ZomPoc Project was an innovative experiment in writing and directing a large scale, live, public performance, bringing together participants from across the creative industries. In order to design such an event a number of innovative resources were developed exploiting techniques of game design, theatre, film, television and tangible media production. A series of workshops invited local artists, scientists, technicians and engineers to find new ways of collaborating to create networked artifacts, experimental digital works, robotic props, modular set designs, sound effects and unique costuming guided by an innovative multi-platform script developed by Deb Polson. The result of this collaboration was the creation of innovative game and set props, both atmospheric and interactive. Such works animated the space, presented story clues and facilitated interactions between strangers who found themselves sharing a unique experience in unexpected places.

Contours in Motion

My practice-led research explores and maps workflows for generating experimental creative work involving inertia based motion capture technology. Motion capture has often been used as a way to bridge animation and dance resulting in abstracted visuals outcomes. In early works this process was largely done by rotoscoping, reference footage and mechanical forms of motion capture. With the evolution of technology, optical and inertial forms of motion capture are now more accessible and able to accurately capture a larger range of complex movements. The creative work titled “Contours in Motion” was the first in a series of studies on captured motion data used to generating experimental visual forms that reverberate in space and time. With the source or ‘seed’ comes from using an Xsens MVN - Inertial Motion Capture system to capture spontaneous dance movements, with the visual generation conducted through a customised dynamics simulation. The aim of the creative work was to diverge way from a standard practice of using particle system and/or a simple re-targeting of the motion data to drive a 3d character as a means to produce abstracted visual forms. To facilitate this divergence a virtual dynamic object was tether to a selection of data points from a captured performance. The proprieties of the dynamic object were then adjusted to balance the influences from the human movement data with the influence of computer based randomization. The resulting outcome was a visual form that surpassed simple data visualization to project the intent of the performer’s movements into a visual shape itself. The reported outcomes from this investigation have contributed to a larger study on the use of motion capture in the generative arts, furthering the understanding of and generating theories on practice.

Adopting virtual production for animated filmaking

Virtual Production is a rapidly growing approach to filmmaking that utilises 3D software, virtual camera systems and motion capture technology to visually interact with a real-time virtual environment. The use of these technologies has continued to increase, however, little has been done to document the various approaches for incorporating this new film making technique into a production. This practice-led research project outlines the development of virtual production in the entertainment industry and explores possible strategies for adopting aspects of this new film making technique into the production of short animated films. The outcome is an improved understanding of possible strategies that could be utilised to assist producers and directors with the transition into this new film making technique. - See more at: http://dl4.globalstf.org/?wpsc-product=adopting-virtual-production-for-animated-filmaking#sthash.DLzRph4Z.dpuf

Creativity management : the new challenge for BPM

Besides classical criteria such as cost and overall organizational efficiency, an organization’s ability to being creative and to innovate is of increasing importance in markets that are overwhelmed with commodity products and services. Business Process Management (BPM) as an approach to model, analyze, and improve business processes has been successfully applied not only to enhance performance and reduce cost but also to facilitate business imperatives such as risk management and knowledge management. Can BPM also facilitate the management of creativity? We can find many examples where enterprises unintentionally reduced or even killed creativity and innovation for the sake of control, performance, and cost reduction. Based on the experiences we have made within case studies with organizations from the creative industries (film industry, visual effects production, etc.,) we believe that BPM can be a facilitator providing the glue between creativity management and well-established business principles. In this article we introduce the notions of creativity-intensive processes and pockets of creativity as new BPM concepts. We further propose a set of exemplary strategies that enable process owners and process managers to achieve creativity without sacrificing creativity. Our aim is to set the baseline for further discussions on what we call creativity-oriented BPM.

The passage of indeterminacy in the intensification of being

The passage of indeterminacy in the intensification of being is a digital video projection by Daniel McKewen. The work used digital visual effects and experimentation with time-based video synchronisation to manipulate images of celebrities plundered from the internet and television. The result was a sequence of images that served as both portrait of the constructed nature of screen-based imagery, as well as portrait of the pop culture audience that consumes such constructions.

Precarious Creativity: Global Media, Local Labor

Precarious Creativity examines the seismic changes confronting media workers in an age of globalization and corporate conglomeration. This pathbreaking anthology peeks behind the hype and supposed glamor of screen media industries to reveal the intensifying pressures and challenges confronting actors, editors, electricians, and others. The authors take on pressing conceptual and methodological issues while also providing insightful case studies of workplace dynamics regarding creativity, collaboration, exploitation, and cultural difference. Furthermore, it examines working conditions and organizing efforts on all six continents, offering broad-ranging and comprehensive analysis of contemporary screen media labor in such places as Lagos, Prague, Hollywood, and Hyderabad. The collection also examines labor conditions across a range of job categories that includes, for example, visual effects, production services, and adult entertainment. With contributions from such leading scholars as John Caldwell, Vicki Mayer, Herman Gray, and Tejaswini Ganti, Precarious Creativity offers timely critiques of media globalization while also intervening in broader debates about labor, creativity, and precarity.

Shrinking Violets

Description of the work Shrinking Violets is comprised of two half scale garments in laser cut silk organza, developed with a knotting device to allow for disassembly and reassembly. The first is a jacket in layered red organza including black storm flap details. The second is a vest in jade organza with circles of pink organza attached through a pattern of knots. Research Background This practice-led fashion design research sits within the field of Design for Sustainability (DfS) in fashion that seeks to mitigate the environmental and ethical impacts of fashion consumption and production. The research explores new systems of garment construction for DfS, and examines how these systems may involve ‘designing’ new user interactions with the garments. The garments’ construction system allows them to be disassembled and recycled or reassembled by users to form a new garment. Conventional garment design follows a set process of cutting and construction, with pattern pieces permanently machine-stitched together. Garments typically contain multiple fibre types; for example a jacket may be constructed from a shell of wool/polyester, an acetate lining, fusible interlinings, and plastic buttons. These complex inputs mean that textile recycling is highly labour intensive, first to separate the garment pieces and second to sort the multiple fibre types. This difficulty results in poor quality ‘shoddy’ comprised of many fibre types and unsuitable for new apparel, or in large quantities of recyclable textile waste sent to landfill (Hawley 2011). Design-led approaches that consider the garment’s end of life in the design process are a way of addressing this problem. In Gulich’s (2006) analysis, use of single materials is the most effective way to ensure ease of recycling, with multiple materials that can be detached next in effectiveness. Given the low rate of technological innovation in most apparel manufacturing (Ruiz 2011), a challenge for effective recycling is how to develop new manufacturing methods that allow for garments to be more easily disassembled at end-of-life. Research Contribution This project addresses the research question: How can design for disassembly be considered within the fashion design process? I have employed a practice-led methodology in which my design process leads the research, making use of methods of fashion design practice including garment and construction research, fabric and colour research, textile experimentation, drape, patternmaking, and illustration as well as more recent methods such as laser cutting. Interrogating the traditional approaches to garment construction is necessarily a technical process; however fashion design is as much about the aesthetic and desirability of a garment as it is about the garment’s pragmatics or utility. This requires a balance between the technical demands of designing for disassembly with the aesthetic demands of fashion. This led to the selection of luxurious, semi-transparent fabrics in bold floral colours that could be layered to create multiple visual effects, as well as the experimentation with laser cutting for new forms of finishing and fastening the fabrics together. Shrinking Violets makes two contributions to new knowledge in the area of design for sustainability within fashion. The first is in the technical development of apparel modularity through the system of laser cut holes and knots that also become a patterning device. The second contribution lies in the design of a system for users to engage with the garment through its ability to be easily reconstructed into a new form. Research Significance Shrinking Violets was exhibited at the State Library of Queensland’s Asia Pacific Design Library, 1-5 November 2015, as part of The International Association of Societies of Design Research’s (IASDR) biannual design conference. The work was chosen for display by a panel of experts, based on the criteria of design innovation and contribution to new knowledge in design. References Gulich, B. (2006). Designing textile products that are easy to recycle. In Y. Wang (Ed.), Recycling in Textiles (pp. 25-37). London: Woodhead. Hawley, J. M. (2011). Textile recycling options: exploring what could be. In A. Gwilt & T. Rissanen (Eds.), Shaping Sustainable Fashion: Changing the way we make and use clothes (pp. 143 - 155). London: Earthscan. Ruiz, B. (2014). Global Apparel Manufacturing. Retrieved 10 August 2014, from http://clients1.ibisworld.com/reports/gl/industry/default.aspx?entid=470

IASDR 2015 Interplay Exhibition 2-5 NOV 2015

It has been said that we are living in a golden age of innovation. New products, systems and services aimed to enable a better future, have emerged from novel interconnections between design and design research with science, technology and the arts. These intersections are now, more than ever, catalysts that enrich daily activities for health and safety, education, personal computing, entertainment and sustainability, to name a few. Interactive functions made possible by new materials, technology, and emerging manufacturing solutions demonstrate an ongoing interplay between cross-disciplinary knowledge and research. Such interactive interplay bring up questions concerning: (i) how art and design provide a focus for developing design solutions and research in technology; (ii) how theories emerging from the interactions of cross-disciplinary knowledge inform both the practice and research of design and (iii) how research and design work together in a mutually beneficial way. The IASDR2015 INTERPLAY EXHIBITION provides some examples of these interconnections of design research with science, technology and the arts. This is done through the presentation of objects, artefacts and demonstrations that are contextualised into everyday activities across various areas including health, education, safety, furniture, fashion and wearable design. The exhibits provide a setting to explore the various ways in which design research interacts across discipline knowledge and approaches to stimulate innovation. In education, Designing South African Children’s Health Education as Generative Play (A Bennett, F Cassim, M van der Merwe, K van Zijil, and M Ribbens) presents a set of toolkits that resulted from design research entailing generative play. The toolkits are systems that engender pleasure and responsibility, and are aimed at cultivating South African’s youth awareness of nutrition, hygiene, disease awareness and prevention, and social health. In safety, AVAnav: Avalanche Rescue Helmet (Jason Germany) delivers an interactive system as a tool to contribute to reduce the time to locate buried avalanche victims. Helmet-mounted this system responds to the contextual needs of rescuers and has since led to further design research on the interface design of rescuing devices. In apparel design and manufacturing, Shrinking Violets: Fashion design for disassembly (Alice Payne) proposes a design for disassembly through the use of beautiful reversible mono-material garments that interactively responds to the challenges of garment construction in the fashion industry, capturing the metaphor for the interplay between technology and craft in the fashion manufacturing industry. Harvest: A biotextile future (Dean Brough and Alice Payne), explores the interplay of biotechnology, materiality and textile design in the creation of sustainable, biodegradable vegan textile through the process of a symbiotic culture of bacteria and yeast (SCOBY). SCOBY is a pellicle curd that can be harvested, machine washed, dried and cut into a variety of designs and texture combinations. The exploration of smart materials, wearable design and micro-electronics led to creative and aesthetically coherent stimulus-reactive jewellery; Symbiotic Microcosms: Crafting Digital Interaction (K Vones). This creation aims to bridge the gap between craft practitioner and scientific discovery, proposing a move towards the notion of a post-human body, where wearable design is seen as potential ground for new human-computer interactions, affording the development of visually engaging multifunctional enhancements. In furniture design, Smart Assistive chair for older adults (Chao Zhao) demonstrates how cross-disciplinary knowledge interacting with design strategies provide solution that employed new technological developments in older aged care, and the participation of multiple stakeholders: designers, health care system and community based health systems. In health, Molecular diagnosis system for newborns deafness genetic screening (Chao Zhao) presents an ambitious and complex project that includes a medical device aimed at resolving a number of challenges: technical feasibility for city and rural contexts, compatibility with standard laboratory and hospital systems, access to health system, and support the work of different hospital specialists. The interplay between cross-disciplines is evident in this work, demonstrating how design research moves forward through technology developments. These works exemplify the intersection between domains as a means to innovation. Novel design problems are identified as design intersects with the various areas. Research informs this process, and in different ways. We see the background investigation into the contextualising domain (e.g. on-snow studies, garment recycling, South African health concerns, the post human body) to identify gaps in the area and design criteria; the technologies and materials reviews (e.g. AR, biotextiles) to offer plausible technical means to solve these, as well as design criteria. Theoretical reviews can also inform the design (e.g. play, flow). These work together to equip the design practitioner with a robust set of ‘tools’ for design innovation – tools that are based in research. The process identifies innovative opportunity and criteria for design and this, in turn, provides a means for evaluating the success of the design outcomes. Such an approach has the potential to come full circle between research and design – where the design can function as an exemplar, evidencing how the research-articulated problems can be solved. Core to this, however, is the evaluation of the design outcome itself and identifying knowledge outcomes. In some cases, this is fairly straightforward that is, easily measurable. For example the efficacy of Jason Germany’s helmet can be determined by measuring the reduced response time in the rescuer. Similarly the improved ability to recycle Payne’s panel garments can be clearly determined by comparing it to those recycling processes (and her identified criteria of separating textile elements!); while the sustainability and durability of the Brough & Payne’s biotextile can be assessed by documenting the growth and decay processes, or comparative strength studies. There are however situations where knowledge outcomes and insights are not so easily determined. Many of the works here are open-ended in their nature, as they emphasise the holistic experience of one or more designs, in context: “the end result of the art activity that provides the health benefit or outcome but rather, the value lies in the delivery and experience of the activity” (Bennet et al.) Similarly, reconfiguring layers of laser cut silk in Payne’s Shrinking Violets constitutes a customisable, creative process of clothing oneself since it “could be layered to create multiple visual effects”. Symbiotic Microcosms also has room for facilitating experience, as the work is described to facilitate “serendipitous discovery”. These examples show the diverse emphasis of enquiry as on the experience versus the product. Open-ended experiences are ambiguous, multifaceted and differ from person to person and moment to moment (Eco 1962). Determining the success is not always clear or immediately discernible; it may also not be the most useful question to ask. Rather, research that seeks to understand the nature of the experience afforded by the artefact is most useful in these situations. It can inform the design practitioner by helping them with subsequent re-design as well as potentially being generalizable to other designers and design contexts. Bennett et. al exemplify how this may be approached from a theoretical perspective. This work is concerned with facilitating engaging experiences to educate and, ultimately impact on that community. The research is concerned with the nature of that experience as well, and in order to do so the authors have employed theoretical lenses – here these are of flow, pleasure, play. An alternative or complementary approach to using theory, is using qualitative studies such as interviews with users to ask them about what they experienced? Here the user insights become evidence for generalising across, potentially revealing insight into relevant concerns – such as the range of possible ‘playful’ or experiences that may be afforded, or the situation that preceded a ‘serendipitous discovery’. As shown, IASDR2015 INTERPLAY EXHIBITION provides a platform for exploration, discussion and interrogation around the interplay of design research across diverse domains. We look forward with excitement as IASDR continues to bring research and design together, and as our communities of practitioners continue to push the envelope of what is design and how this can be expanded and better understood with research to foster new work and ultimately, stimulate innovation.

Monumenttikuvista elämyskuviin : Helsinki matkaesitteiden kuvituksessa 1895 - 2005

The purpose of this study is to define how Helsinki has been presented in the pictures of tourist brochures and how their illustration has changed over time. Attention is also paid to the values and meanings that the pictures mediate, as well as their historical and societal connections. The pictures are approached as representations selectively interpreting and illustrating the reality of Helsinki, while constructing mental images of it. An iconological framework structures the study. It proceeds from the description and classification of the physical features towards an analysis of time- and culture-specific meanings. The emergence of meanings and their historical and cultural underpinnings are examined from the perspectives of humanistic geography, semiotics and constructionism. In the analysis attention is paid to the discourses, myths and ideologies that underlie the representations. Information on the physical features of the pictures and their changes is collected with a content analysis. The classified data consists of 1377 photographs. These pictures are collected from 75 tourist brochures of Helsinki that have been published between 1895 and 2005. The deeper meanings of the pictures are studied qualitatively, by paying attention to the mental images that the content elements and visual effects evoke. Research studies, contemporary literature and the texts of the tourist brochures are utilised in the interpretation of the meanings. There has been a permanent core to objects of the pictures during the entire study period. It has consisted mainly of sights that are located close to the Senate and Market Squares. In addition, marine elements have been popular. The area of Helsinki represented in the brochures has extended from the Senate Square towards Töölö Bay. Pictures of monumental buildings and statues have been complemented with snapshots and portraits. In the beginning of the 20th century, brochures were mainly produced for the travelling, educated elite. The style of the pictures was declaratory and educative. They aimed at medating an objective image of the reality that prevailed in Helsinki. In practice, the pictures were connected to a patriotic ideology and the corresponding myth of Finnishness. In the second half of the 20th century the improvement of the standard of living led to a democratisation of consumers and an increase in the tourism demand. Local culture and the everyday life of "ordinary" people became popular themes in the pictures. A new welfare ideology manifested itself in the people of the local residential areas, for instance. The increase in the cultural diversity has led to the recognition of new target groups, expecially since the 1980s. The human figures in the pictures have started to function as objects of identification and a means of constructing mental images. A pronounced emphasis on experience and individuality in the illustration of the tourist brochures mirrors the post-modern change and a new ideology based on consumption. The construction and consumption of the pictures in the tourist brochures is governed by the conventions of representation and interpretaion that are typical of the genre of tourist brochures. The pictures emphasize the perceived positive characteristics of Helsinki and thus construct a skewed view of the reality. However, consumers can knowingly use the pictures as a means of dreaming and detaching themselves from their everyday reality.

The application of STEM and in situ controlled dehydration to bacterial systems using ESEM.

Transmission imaging with an environmental scanning electron microscope (ESEM) (Wet STEM) is a recent development in the field of electron microscopy, combining the simple preparation inherent to ESEM work with an alternate form of contrast available through a STEM detector. Because the technique is relatively new, there is little information available on how best to apply this technique and which samples it is best suited for. This work is a description of the sample preparation and microscopy employed by the authors for imaging bacteria with Wet STEM (scanning transmission electron microscopy). Three different bacterial samples will be presented in this study: first, used as a model system, is Escherichia coli for which the contrast mechanisms of STEM are demonstrated along with the visual effects of a dehydration-induced collapse. This collapse, although clearly in some sense artifactual, is thought to lead to structurally meaningful morphological information. Second, Wet STEM is applied to two distinct bacterial systems to demonstrate the novel types of information accessible by this approach: the plastic-producing Cupriavidus necator along with wild-type and ΔmreC knockout mutants of Salmonella enterica serovar Typhimurium. Cupriavidus necator is shown to exhibit clear internal differences between bacteria with and without plastic granules, while the ΔmreC mutant of S. Typhimurium has an internal morphology distinct from that of the wild type.

The application of STEM and in situ controlled dehydration to bacterial systems using ESEM

Transmission imaging with an environmental scanning electron microscope (ESEM) (Wet STEM) is a recent development in the field of electron microscopy, combining the simple preparation inherent to ESEM work with an alternate form of contrast available through a STEM detector. Because the technique is relatively new, there is little information available on how best to apply this technique and which samples it is best suited for. This work is a description of the sample preparation and microscopy employed by the authors for imaging bacteria with Wet STEM (scanning transmission electron microscopy). Three different bacterial samples will be presented in this study: first, used as a model system, is Escherichia coli for which the contrast mechanisms of STEM are demonstrated along with the visual effects of a dehydration-induced collapse. This collapse, although clearly in some sense artifactual, is thought to lead to structurally meaningful morphological information. Second, Wet STEM is applied to two distinct bacterial systems to demonstrate the novel types of information accessible by this approach: the plastic-producing Cupriavidus necator along with wild-type and δmreC knockout mutants of Salmonella enterica serovar Typhimurium. Cupriavidus necator is shown to exhibit clear internal differences between bacteria with and without plastic granules, while the δmreC mutant of S. Typhimurium has an internal morphology distinct from that of the wild type. © 2012 Wiley Periodicals, Inc.

Flavian laws, the railway, the newspaper and Loring’s breads

It is abound the research on the formation, rise and failure of the financial and industrial network undertaken by the Loring-Heredia-Larios triangle, bourgeois families who introduced the Industrial Revolution in the south of Andalusia. On the contrary, there are almost nonexistent studies from the perspective of the mentality that sustained their business, social and ethical model in the algid decades of their action (1850-1860). In this paper we propose some hypotheses about the ideological structures of bourgeois group and point out some keys, clues and signs for a future reconstruction of this kind, which so far has not been incardinated that early and failed malaguenan industrial revolution in streams thinking of that time.