Semantic and context-based retrieval of digital cultural objects [Published in Chinese]

Cultural objects are increasingly generated and stored in digital form, yet effective methods for their indexing and retrieval still remain an important area of research. The main problem arises from the disconnection between the content-based indexing approach used by computer scientists and the description-based approach used by information scientists. There is also a lack of representational schemes that allow the alignment of the semantics and context with keywords and low-level features that can be automatically extracted from the content of these cultural objects. This paper presents an integrated approach to address these problems, taking advantage of both computer science and information science approaches. We firstly discuss the requirements from a number of perspectives: users, content providers, content managers and technical systems. We then present an overview of our system architecture and describe various techniques which underlie the major components of the system. These include: automatic object category detection; user-driven tagging; metadata transform and augmentation, and an expression language for digital cultural objects. In addition, we discuss our experience on testing and evaluating some existing collections, analyse the difficulties encountered and propose ways to address these problems.

Virtual world cultural probe

We have developed a virtual world environment for eliciting expert information from stakeholders. The intention is that the virtual world prompts the user to remember more about their work processes. Our example shows a sparse visualisation of the University of Vienna Department of Computer Science, our collaborators in this project.

Designing cultural probes for children

This paper reports on the challenges faced during the design and deployment of educationally-focused cultural probes with children. The aim of the project was to use cultural probes to discover insights into children's interests and ideas within an educational context. The deployment of a cultural probe pack with children aged between 11 and 13 has demonstrated the method's effectiveness as a tool for design inspiration. Children's responses to the cultural probe have provided a valuable insight into the attributes of successful probe activities, the nature of contextual information which may be gathered and the limitations of the method.

Decolonizing digital heritage practices for Indigenous literacy: A multimodal analysis of iPad Tellagami videos

Purpose Drawing on multimodal texts produced by an Indigenous school community in Australia, we apply critical race theory and multimodal analysis to decolonize digital heritage practices for Indigenous students. This study focuses on the particular ways in which students’ counter-­‐narratives about race were embedded in multimodal and digital design in the development of a digital cultural heritage (Giaccardi, 2012). Pedagogies that explore counter-­‐narratives of cultural heritage in the official curriculum can encourage students to reframe their own racial identity, while challenging dominant white, historical narratives of colonial conquest, race, and power (Gutierrez, 2008). The children’s digital “Gami” videos, created with the iPad application, Tellagami, enabled the students to imagine hybrid, digital social identities and perspectives of Australian history that were tied to their Indigenous cultural heritage (Kamberelis, 2001).

"Like a monkey with a miniature cymbal": Cultural practices of repetition in visual social media

Looping media are recurring components of online content, from gifs to Vine videos, in addition to the conceptual repetition of memes and related practices. This paper analyses practices around looping visual media as examples of vernacular creativity, social media literacies, and internet culture, especially for irreverent and playful purposes. Focusing on the LGBTQ digital cultural context as a pilot study, this research examines multi-platform uses of looping media, including personal narratives through Vine videos and animated gifs on Tumblr. In addition to textual analysis of LGBTQ looping visual social media content, the study will further explore the platform context as part of the experience of looped media. The research will address how these factors may also contribute to practices of irreverence and play, both within the specific case of LGBTQ culture and internet culture more generally.

It’s not me, it’s you : a participant observation case study of the self-publishing musician in the 21st century

This thesis explores the business environment for self-publishing musicians at the end of the 20th century and the start of the 21st century from theoretical and empirical standpoints. The exploration begins by asking three research questions: what are the factors affecting the sustainability of an Independent music business; how many of those factors can be directly influenced by an Independent musician in the day-to-day operations of their musical enterprise; and how can those factors be best manipulated to maximise the benefit generated from digital music assets? It answers these questions by considering the nature of value in the music business in light of theories of political economy, then quantitative and qualitative examinations of the nature of participation in the music business, and then auto-ethnographic approaches to the application of two technologically enabled tools available to Independent musicians. By analyzing the results of five different examinations of the topic it answers each research question with reference to four sets of recurring issues that affect the operations of a 21st century music business: the musicians’ personal characteristics, their ability to address their business’s informational needs; their ability to manage the relationships upon which their business depends; and their ability to resolve the remaining technological problems that confront them. It discusses ways in which Independent self-publishing musicians can and cannot deal with these four issues on a day-to-day basis and highlights aspects for which technological solutions do not exist as well as ways in which technology is not as effective as has been claimed. It then presents a self-critique and proposes some directions for further study before concluding by suggesting some common features of 21st century Independent music businesses. This thesis makes three contributions to knowledge. First, it provides a new understanding of the sources of musical value, shows how this explains changes in the music industries over the past 30 years, and provides a framework for predicting future developments in those industries. Second, it shows how the technological discontinuity that has occurred around the start of the 21st century has and has not affected the production and distribution of digital cultural artefacts and thus the attitudes, approaches, and business prospects of Independent musicians. Third, it argues for new understandings of two methods by which self-publishing musicians can grow a business using production methods that are only beginning to be more broadly understood: home studio recording and fan-sourced production. Developed from the perspective of working musicians themselves, this thesis identifies four sets of issues that determine the probable success of musicians’ efforts to adopt new technologies to capture the value of the musicians’ creativity and thereby foster growth that will sustain an Independent music business in the 21st century.

Exploring motivations of young adults to participate in physical activities

This paper investigates the motivations of young adults aged 18 to 24 years to participate in physical activities and how technology might best support this motivation. Motivational factors were studied through contextual interviews, an adapted cultural probe activity and a survey with a group of young adults currently active in sports. From our preliminary findings we determine that staying healthy, achieving specific goals and socialising represent key motivational factors for young adults to be active in sports, but also, that exercise is not considered a high priority in their daily lives. A link between the motivation of achieving specific goals and a technology to measure and track activities was established. The study concludes with three implications for the design of technology to motivate young adults to participate in sports.

Reflections and encounters: Exploring awareness in an academic environment

Earlier work within the CSCW community treated the notion of awareness as an important resource for supporting shared work and work-related activities. However, new trends have emerged in recent times that utilize the notion of awareness beyond work-related activities and explore social, emotional and interpersonal aspects of people’s everyday lives. To investigate this broader notion of awareness, we carried out a field study using ethnographic and cultural probe based methods in an academic setting. Our aim was to study staff members’ everyday activities in their natural surroundings; understand how awareness beyond work-related activities plays out and how it is dealt with. Our field study results shed light on two broad and sometimes overlapping themes of interaction between staff members: 1) self-representations and 2) casual encounters. We provide examples from the field illustrating these two themes. In general, our results show how awareness is closely associated with people’s everyday lives, where they creatively and artfully utilize ordinary resources from their environments to carry out their routine activities. Using the results of our field study, we describe the design of a situated display called Panorama that is meant to support non-critical, non-work-related awareness within work environments.

Critically deconstructing race through a multimodal analysis of iPad Tellagami videos

Drawing on multimodal texts produced by an Indigenous school community in Australia, I apply critical race theory and multimodal analysis (Jewitt, 2011) to decolonise digital heritage practices for Indigenous students. This study focuses on the particular ways in which students’ counter-narratives about race were embedded in multimodal and digital design in the development of a digital cultural heritage (Giaccardi, 2012). Data analysis involved applying multimodal analysis to the students’ Gamis, following social semiotic categories and principles theorised by Kress and Bezemer (2008), and Jewitt (2006, 2011). This includes attending to the following semiotic elements: visual design, movement and gesture, gaze, and recorded speech, and their interrelationships. The analysis also draws on critical race theory to interpret the students’ representations of race. In particular, the multimodal texts were analysed as a site for students’ views of Indigenous oppression in relation to the colonial powers and ownership of the land in Australian history (Ladson-Billings, 2009). Pedagogies that explore counter-narratives of cultural heritage in the official curriculum can encourage students to reframe their own racial identity, while challenging dominant white, historical narratives of colonial conquest, race, and power (Gutierrez, 2008). The children’s multimodal “Gami” videos, created with the iPad application, Tellagami, enabled the students to imagine hybrid, digital social identities and perspectives of Australian history that were tied to their Indigenous cultural heritage (Kamberelis, 2001).

Valuing Indigenous heritage through multimodal literacy

The study on which this presentation is based focuses on the particular ways in which students’ counter-narratives about race were embedded in multimodal and digital design in the development of a digital cultural heritage. The multimodal texts were analysed as a site for students’ views of Indigenous oppression in relation to the colonial powers and ownership of the land in Australian history. In this presentation, Kathy will demonstrate how pedagogies that explore counter-narratives of cultural heritage in the official curriculum can encourage students to reframe their own racial identity, while challenging dominant white, historical narratives of colonial conquest, race, and power. In the second part of this session, Indigenous Principal, John Davis and teachers from HymbaYumba Community Hub will provide a school-based, Indigenous panel to inspire educators with authentic ways to embed Indigenous knowledge in the curriculum.

Digital scholarship and pedagogy, the next step : cultural science.

There are two aspects to the problem of digital scholarship and pedagogy. One is to do with scholarship; the other with pedagogy. In scholarship, the association of knowledge with its printed form remains dominant. In pedagogy, the desire to abandon print for ‘new’ media is urgent, at least in some parts of the academy. Film and media studies are thus at the intersection of opposing forces – pulling the field ‘back’ to print and ‘forward’ to digital media. These tensions may be especially painful in a field whose own object of study is another form of communication, neither print nor digital but broadcast. Although print has been overtaken in the popular marketplace by audio-visual forms, this was never achieved in the domain of scholarship. Even when it is digitally distributed, the output of research is still a ‘paper.’ But meanwhile, in the realm of teaching, production- and practice-based pedagogy has become firmly established. Nevertheless a disjunction remains, between high-end scholarship in research universities and vocational training in teaching institutions; but neither is well equipped to deal with the digital challenge.

A story worth telling : putting oral history and digital collections online in cultural institutions

Digital platforms in cultural institutions offer exciting opportunities for oral history and digital storytelling that can augment and enrich traditional collections. The way in which cultural institutions allow access to the public is changing dramatically, prompting substantial expansions of their oral history and digital story holdings. In Queensland, Australia, public libraries and museums are becoming innovative hubs of a wide assortment of collections that represent a cross-section of community groups and organisations through the integration of oral history and digital storytelling. The State Library of Queensland (SLQ) features digital stories online to encourage users to explore what the institution has in the catalogue through their website. Now SLQ also offers oral history interviews online, to introduce users to oral history and other components of their collections,- such as photographs and documents to current, as well as new users. This includes the various departments, Indigenous centres and regional libraries affiliated with SLQ statewide, who are often unable to access the materials held within, or even full information about, the collections available within the institution. There has been a growing demand for resources and services that help to satisfy community enthusiasm and promote engagement. Demand increases as public access to affordable digital media technologies increases, and as community or marginalised groups become interested in do it yourself (DIY) history; and SLQ encourages this. This paper draws on the oral history and digital story-based research undertaken by the Queensland University of Technology (QUT) for the State Library of Queensland including: the Apology Collection: The Prime Minister’s apology to Australia’s Indigenous Stolen Generation; Five Senses: regional Queensland artists; Gay history of Brisbane; and The Queensland Business Leaders Hall of Fame.

A cross-cultural approach towards designing digital noticeboards with a remote aboriginal community

This working paper reflects upon the opportunities and challenges of designing a form of digital noticeboard system with a remote Aboriginal community that supports their aspirations for both internal and external communication. The project itself has evolved from a relationship built through ecological work between scientists and the local community on the Groote Eylandt archipelago to study native populations of animal species over the long term. In the course of this work the aspiration has emerged to explore how digital noticeboards might support communication on the island and externally. This paper introduces the community, the context and the history of the project. We then reflect upon the science project, its outcomes and a framework empowering the Aboriginal viewpoint, in order to draw lessons for extending what we see as a pragmatic and relationship based approach towards cross-cultural design.

Digital futures for cultural and media studies

An ambitious rendering of the digital future from a pioneer of media and cultural studies, a wise and witty take on a changing field, and our orientation to it Investigates the uses of multimedia by creative and productive citizen-consumers to provide new theories of communication that accommodate social media, participatory action, and user-creativity Leads the way for new interdisciplinary engagement with systems thinking, complexity and evolutionary sciences, and the convergence of cultural and economic values Analyzes the historical uses of multimedia from print, through broadcasting to the internet Combines conceptual innovation with historical erudition to present a high-level synthesis of ideas and detailed analysis of emergent forms and practices Features an international focus and global reach to provide a basis for students and researchers seeking broader perspectives