Video interaction using pen-based technology

Dissertação para obtenção do Grau de Doutor em Informática

Construction Automation Using Pen-Based Computers, HR-368, 1996

The Iowa Department of Transportation is committed to improved management systems, which in turn has led to increased automation to record and manage construction data. A possible improvement to the current data management system can be found with pen-based computers. Pen-based computers coupled with user friendly software are now to the point where an individual's handwriting can be captured and converted to typed text to be used for data collection. It would appear pen-based computers are sufficiently advanced to be used by construction inspectors to record daily project data. The objective of this research was to determine: (1) if pen-based computers are durable enough to allow maintenance-free operation for field work during Iowa's construction season; and (2) if pen-based computers can be used effectively by inspectors with little computer experience. The pen-based computer's handwriting recognition was not fast or accurate enough to be successfully utilized. The IBM Thinkpad with the pen pointing device did prove useful for working in Windows' graphical environment. The pen was used for pointing, selecting and scrolling in the Windows applications because of its intuitive nature.

Task-based information interaction

Esitys KDK-käytettävyystyöryhmän järjestämässä seminaarissa: Miten käyttäjien toiveet haastavat metatietokäytäntöjämme? / How users' expectations challenge our metadata practices? 30.9.2014.

Content Based Video Retrieval using SURF Descriptor

This paper presents a Robust Content Based Video Retrieval (CBVR) system. This system retrieves similar videos based on a local feature descriptor called SURF (Speeded Up Robust Feature). The higher dimensionality of SURF like feature descriptors causes huge storage consumption during indexing of video information. To achieve a dimensionality reduction on the SURF feature descriptor, this system employs a stochastic dimensionality reduction method and thus provides a model data for the videos. On retrieval, the model data of the test clip is classified to its similar videos using a minimum distance classifier. The performance of this system is evaluated using two different minimum distance classifiers during the retrieval stage. The experimental analyses performed on the system shows that the system has a retrieval performance of 78%. This system also analyses the performance efficiency of the low dimensional SURF descriptor.

Marker-Based Embodied Interaction for Handheld Augmented Reality Games

This article deals with embodied user interfaces for handheld augmented reality games, which consist of both physical and virtual components. We have developed a number of spatial interaction techniques that optically capture the device's movement and orientation relative to a visual marker. Such physical interactions in 3-D space enable manipulative control of mobile games. In addition to acting as a physical controller that recognizes multiple game-dependent gestures, the mobile device augments the camera view with graphical overlays. We describe three game prototypes that use ubiquitous product packaging and other passive media as backgrounds for handheld augmentation. The prototypes can be realized on widely available off-the-shelf hardware and require only minimal setup and infrastructure support.

Informative State-Based Video Communication

We study state-based video communication where a client simultaneously informs the server about the presence status of various packets in its buffer. In sender-driven transmission, the client periodically sends to the server a single acknowledgement packet that provides information about all packets that have arrived at the client by the time the acknowledgment is sent. In receiver-driven streaming, the client periodically sends to the server a single request packet that comprises a transmission schedule for sending missing data to the client over a horizon of time. We develop a comprehensive optimization framework that enables computing packet transmission decisions that maximize the end-to-end video quality for the given bandwidth resources, in both prospective scenarios. The core step of the optimization comprises computing the probability that a single packet will be communicated in error as a function of the expected transmission redundancy (or cost) used to communicate the packet. Through comprehensive simulation experiments, we carefully examine the performance advances that our framework enables relative to state-of-the-art scheduling systems that employ regular acknowledgement or request packets. Consistent gains in video quality of up to 2B are demonstrated across a variety of content types. We show that there is a direct analogy between the error-cost efficiency of streaming a single packet and the overall rate-distortion performance of streaming the whole content. In the case of sender-driven transmission, we develop an effective modeling approach that accurately characterizes the end-to-end performance as a function of the packet loss rate on the backward channel and the source encoding characteristics.

Invited review: Growth-promoting effects of colostrum in calves based on interaction with intestinal cell surface receptors and receptor-like transporters

The postnatal development and maturation of the gastrointestinal (GI) tract of neonatal calves is crucial for their survival. Major morphological and functional changes in the calf's GI tract initiated by colostrum bioactive substances promote the establishment of intestinal digestion and absorption of food. It is generally accepted that colostrum intake provokes the maturation of organs and systems in young calves, illustrating the significance of the cow-to-calf connection at birth. These postnatal adaptive changes of the GI tissues in neonatal calves are especially induced by the action of bioactive substances such as insulin-like growth factors, hormones, or cholesterol carriers abundantly present in colostrum. These substances interact with specific cell-surface receptors or receptor-like transporters expressed in the GI wall of neonatal calves to elicit their biological effects. Therefore, the abundance and activity of cell surface receptors and receptor-like transporters binding colostral bioactive substances are a key aspect determining the effects of the cow-to-calf connection at birth. The present review compiles the information describing the effects of colostrum feeding on selected serum metabolic and endocrine traits in neonatal calves. In this context, the current paper discusses specifically the consequences of colostrum feeding on the GI expression and activity of cell-receptors and receptor-like transporters binding growth hormone, insulin-like growth factors, insulin, or cholesterol acceptors in neonatal calves.

Increasing awareness of colorectal cancer screening through targeted exam room based video messages

Colorectal cancer (CRC) is the third largest cause of cancer death in the United States. While the disease burden is high, there are proven methods to screen for CRC and detect it at a stage that is amenable to cure. Patients with low health literacy have difficulty navigating the health care system and are at increased risk to not receive preventive care services such as colorectal cancer screening (CRCS). To address this need, an exam-room based video was developed to be played for patients in the privacy of the exam room, while they are waiting to be seen by their medical provider. In roughly 2 minutes, the video informs the patient about CRC and CRCS and how they can successfully complete CRCS. One of the key barriers to completing CRCS is the need to increase patients' knowledge and improve attitudes surrounding CRCS. This study examines the impact of the video on patients' knowledge and attitudes about CRC and CRCS in a medically underserved patient population in Houston, Texas. ^ Sixty-one patients presenting for routine medical care were enrolled in the study. Depending on their randomization, the patients either received routine information about CRC and CRCS or they watched the video. We found that the patients who did watch the video did have improvements in their knowledge and improved attitudes about CRC and CRCS. Future studies will be needed to examine whether the video improves the patients' completion of CRCS.^

Paediatric palliative home care with Internet-based video-phones: lessons learnt

We have designed and tested an Internet-based video-phone suitable for use in the homes of families in need of paediatric palliative care services. The equipment uses an ordinary telephone line and includes a PC, Web camera and modem housed in a custom-made box. In initial field testing, six clinical consultations were conducted in a one-month trial of the videophone with a family in receipt of palliative care services who were living in the outer suburbs of Brisbane. Problems with variability in call quality-namely audio and video freezing, and audio break-up-prompted further laboratory testing. We completed a programme of over 250 test calls. Fixing modem connection parameters to use the V.34 modulation protocol at a set bandwidth of 24 kbit/s improved connection stability and the reliability of the video-phone. In subsequent field testing 47 of 50 calls (94%) connected without problems. The freezes that did occur were brief (with greatly reduced packet loss) and had little effect on the ability to communicate, unlike the problems arising in the home testing. The low-bandwidth Internet-based video-phone we have developed provides a feasible means of doing telemedicine in the home.

Charting new territory for organizational ethnography:insights from a team-based video ethnography of reinsurance trading in Lloyd’s of London

An increasing interest in “bringing actors back in” and gaining a nuanced understanding of their actions and interactions across a variety of strands in the management literature, has recently helped ethnography to unknown prominence in the field of organizational studies. Yet, calls remain that ethnography should “play a much more central role in the organization and management studies repertoire than it currently does” (Watson, 2011: 202). Ironically, those organizational realities that ethnographers are called to examine have at the same time become less and less amenable to ethnographic study. In this paper, we respond to these calls for innovative ethnographic methods in two ways. First, we report on the practices and ethnographic experiences of conducting a year-long team-based video ethnography of reinsurance trading in Lloyd’s of London. Second, drawing on these experiences, we propose an initial framework for systematizing new approaches to organizational ethnography and visualizing the ways in which they are ‘expanding’ ethnography as it was traditionally practiced.

IIS : an intelligent interaction system that provides e-service, based on interaction and case-based reasoning

Mémoire numérisé par la Direction des bibliothèques de l'Université de Montréal.

IIS : an intelligent interaction system that provides e-service, based on interaction and case-based reasoning

Mémoire numérisé par la Direction des bibliothèques de l'Université de Montréal.

An Architecture for End-User TV Content Enrichment

This paper proposes an extension to the televisionwatching paradigm that permits an end-user to enrich broadcast content. Examples of this enriched content are: virtual edits that allow the order of presentation within the content to be changed or that allow the content to be subsetted; conditional text, graphic or video objects that can be placed to appear within content and triggered by viewer interaction; additional navigation links that can be added to structure how other users view the base content object. The enriched content can be viewed directly within the context of the TV viewing experience. It may also be shared with other users within a distributed peer group. Our architecture is based on a model that allows the original content to remain unaltered, and which respects DRM restrictions on content reuse. The fundamental approach we use is to define an intermediate content enhancement layer that is based on the W3C’s SMIL language. Using a pen-based enhancement interface, end-users can manipulate content that is saved in a home PDR setting. This paper describes our architecture and it provides several examples of how our system handles content enhancement. We also describe a reference implementation for creating and viewing enhancements.

Personalised placement in networked video

Personalised video can be achieved by inserting objects into a video play-out according to the viewer's profile. Content which has been authored and produced for general broadcast can take on additional commercial service features when personalised either for individual viewers or for groups of viewers participating in entertainment, training, gaming or informational activities. Although several scenarios and use-cases can be envisaged, we are focussed on the application of personalised product placement. Targeted advertising and product placement are currently garnering intense interest in the commercial networked media industries. Personalisation of product placement is a relevant and timely service for next generation online marketing and advertising and for many other revenue generating interactive services. This paper discusses the acquisition and insertion of media objects into a TV video play-out stream where the objects are determined by the profile of the viewer. The technology is based on MPEG-4 standards using object based video and MPEG-7 for metadata. No proprietary technology or protocol is proposed. To trade the objects into the video play-out, a Software-as-a-Service brokerage platform based on intelligent agent technology is adopted. Agencies, libraries and service providers are represented in a commercial negotiation to facilitate the contractual selection and usage of objects to be inserted into the video play-out.