Quantifying epistemic actions in human-computer interaction

As digital systems move away from traditional desktop setups, new interaction paradigms are emerging that better integrate with users’ realworld surroundings, and better support users’ individual needs. While promising, these modern interaction paradigms also present new challenges, such as a lack of paradigm-specific tools to systematically evaluate and fully understand their use. This dissertation tackles this issue by framing empirical studies of three novel digital systems in embodied cognition – an exciting new perspective in cognitive science where the body and its interactions with the physical world take a central role in human cognition. This is achieved by first, focusing the design of all these systems on a contemporary interaction paradigm that emphasizes physical interaction on tangible interaction, a contemporary interaction paradigm; and second, by comprehensively studying user performance in these systems through a set of novel performance metrics grounded on epistemic actions, a relatively well established and studied construct in the literature on embodied cognition. The first system presented in this dissertation is an augmented Four-in-a-row board game. Three different versions of the game were developed, based on three different interaction paradigms (tangible, touch and mouse), and a repeated measures study involving 36 participants measured the occurrence of three simple epistemic actions across these three interfaces. The results highlight the relevance of epistemic actions in such a task and suggest that the different interaction paradigms afford instantiation of these actions in different ways. Additionally, the tangible version of the system supports the most rapid execution of these actions, providing novel quantitative insights into the real benefits of tangible systems. The second system presented in this dissertation is a tangible tabletop scheduling application. Two studies with single and paired users provide several insights into the impact of epistemic actions on the user experience when these are performed outside of a system’s sensing boundaries. These insights are clustered by the form, size and location of ideal interface areas for such offline epistemic actions to occur, as well as how can physical tokens be designed to better support them. Finally, and based on the results obtained to this point, the last study presented in this dissertation directly addresses the lack of empirical tools to formally evaluate tangible interaction. It presents a video-coding framework grounded on a systematic literature review of 78 papers, and evaluates its value as metric through a 60 participant study performed across three different research laboratories. The results highlight the usefulness and power of epistemic actions as a performance metric for tangible systems. In sum, through the use of such novel metrics in each of the three studies presented, this dissertation provides a better understanding of the real impact and benefits of designing and developing systems that feature tangible interaction.

Development of Multi-modal and Super-resolved Retinal Imaging Systems

Advancements in retinal imaging technologies have drastically improved the quality of eye care in the past couple decades. Scanning laser ophthalmoscopy (SLO) and optical coherence tomography (OCT) are two examples of critical imaging modalities for the diagnosis of retinal pathologies. However current-generation SLO and OCT systems have limitations in diagnostic capability due to the following factors: the use of bulky tabletop systems, monochromatic imaging, and resolution degradation due to ocular aberrations and diffraction.

Bulky tabletop SLO and OCT systems are incapable of imaging patients that are supine, under anesthesia, or otherwise unable to maintain the required posture and fixation. Monochromatic SLO and OCT imaging prevents the identification of various color-specific diagnostic markers visible with color fundus photography like those of neovascular age-related macular degeneration. Resolution degradation due to ocular aberrations and diffraction has prevented the imaging of photoreceptors close to the fovea without the use of adaptive optics (AO), which require bulky and expensive components that limit the potential for widespread clinical use.

In this dissertation, techniques for extending the diagnostic capability of SLO and OCT systems are developed. These techniques include design strategies for miniaturizing and combining SLO and OCT to permit multi-modal, lightweight handheld probes to extend high quality retinal imaging to pediatric eye care. In addition, a method for extending true color retinal imaging to SLO to enable high-contrast, depth-resolved, high-fidelity color fundus imaging is demonstrated using a supercontinuum light source. Finally, the development and combination of SLO with a super-resolution confocal microscopy technique known as optical photon reassignment (OPRA) is demonstrated to enable high-resolution imaging of retinal photoreceptors without the use of adaptive optics.

An Examination of Customers’ Attitudes about Table Top Technology in Full-Service Restaurants

This paper examines the influence of customer-facing technology in full-service restaurants. As a new addition to the service experience, tabletop devices offer the customer more control over the dining experience, and also increase customer participation in the service process, which has the potential to upset the traditional exchange between service providers and customers in restaurants. To examine how customers react to the use of tabletop devices, this study examines 1,343 point-of-sales transactions from 20 units of a full-service casual dining restaurant chain and matches customer in-restaurant transactions to their reactions to tabletop devices used during their meals. Results show that over 70% of the customers who used tabletop devices reported positive affect toward the device, with approximately 79% of customers reporting that the device improved their experience, citing convenience, ease of use, and credit card security as some benefits of using the technology. Approximately 80% of the customers who used the device reported that they would return to the restaurant because of the positive affect. The results also indicate that likeability of the device and tip percentage were positively and significantly connected to customer reports of the devices having a positive effect on experience and on desire to return. In addition, when customers reported increased return intentions, likeability of the device was higher regardless of reports of the device improving restaurant experience, showing that the introduction of tabletop devices had a positive effect for most—but not all—customers.

The Influence of Table Top Technology in Full-service Restaurants

The use of tabletop technology continues to grow in the restaurant industry, and this study identifies the strengths and weakness of the technology, how it influences customers, and how it can improve the bottom line for managers and business owners. Results from two studies involving a full-service casual dining chain show that dining time was significantly reduced among patrons who used the tabletop hardware to order or pay for their meals, as was the time required for servers to meet the needs of customers. Also, those who used the devices to order a meal tended to spend more than those who did not. Patrons across the industry have embraced guest-facing technology, such as online reservation systems, mobile apps, payment apps, and tablet-based systems, and may in fact look for such technology when deciding where to dine. Guests’ reactions have been overwhelmingly positive, with 70 to 80 percent of consumers citing the benefits of guest-facing technology and applications. The introduction of tabletop technology in the full-service segment has been slower than in quick-service restaurants (QSRs), and guests cite online reservation systems, online ordering, and tableside payment as preferred technologies. Restaurant operators have also cited benefits of guest-facing technology, for example, the use of electronic ordering, which led to increased sales as such systems can induce the purchase of more expensive menu items and side dishes while allowing managers to store order and payment information for future transactions. Researchers have also noted the cost of the technology and potential problems with integration into other systems as two main factors blocking adoption.

SMILE: Simulator for Maryland Imitation Learning Environment

As robot imitation learning is beginning to replace conventional hand-coded approaches in programming robot behaviors, much work is focusing on learning from the actions of demonstrators. We hypothesize that in many situations, procedural tasks can be learned more effectively by observing object behaviors while completely ignoring the demonstrator's motions. To support studying this hypothesis and robot imitation learning in general, we built a software system named SMILE that is a simulated 3D environment. In this virtual environment, both a simulated robot and a user-controlled demonstrator can manipulate various objects on a tabletop. The demonstrator is not embodied in SMILE, and therefore a recorded demonstration appears as if the objects move on their own. In addition to recording demonstrations, SMILE also allows programing the simulated robot via Matlab scripts, as well as creating highly customizable objects for task scenarios via XML. This report describes the features and usages of SMILE.

Playing with the history of Middle-Earth: board games, transmedia storytelling, and The Lord of the Rings

Contemporary cases of transmedia storytelling have thrown many conventional understandings of ‘adaptation’ into disarray. The resurgence of tabletop game culture has thus far played a significant role in this, though scholars have largely neglected the subject, particularly in terms of how transmedia relationships reconfigure the meaning(s) shaped by and through games by players. This paper addresses this phenomenon through a close analysis of two board games based on The Lord of the Rings, in which the (re)construction of the story-world of the source text(s) impacts strongly on ‘conventional’ modes of narrative and identification. Governed by the adoption of various mechanics and innovative uses of the ‘competitive-cooperative’ spectrum, such transformations frequently have significant implications for how narrative meanings might be generated through play.