Connecting the person with dementia and family : a feasibility study of a telepresence robot

Background Maintenance of communication is important for people with dementia living in long-term care. The purpose of this study was to assess the feasibility of using “Giraff”, a telepresence robot to enhance engagement between family and a person with dementia living in long-term care. Methods A mixed-methods approach involving semi-structured interviews, call records and video observational data was used. Five people with dementia and their family member participated in a discussion via the Giraff robot for a minimum of six times over a six-week period. A feasibility framework was used to assess feasibility and included video analysis of emotional response and engagement. Results Twenty-six calls with an average duration of 23 mins took place. Residents showed a general state of positive emotions across the calls with a high level of engagement and a minimal level of negative emotions. Participants enjoyed the experience and families reported that the Giraff robot offered the opportunity to reduce social isolation. A number of software and hardware challenges were encountered. Conclusions Participants perceived this novel approach to engage families and people with dementia as a feasible option. Participants were observed and also reported to enjoy the experience. The technical challenges identified have been improved in a newer version of the robot. Future research should include a feasibility trial of longer duration, with a larger sample and a cost analysis.

A helmet mounted display system with active gaze control for visual telepresence

The objective of a Visual Telepresence System is to provide the operator with a high fidelity image from a remote stereo camera pair linked to a pan/tilt device such that the operator may reorient the camera position by use of head movement. Systems such as these which utilise virtual reality style helmet mounted displays have a number of limitations. The geometry of the camera positions and of the displays is generally fixed and is most suitable only for viewing elements of a scene at a particular distance. To address such limitations, a prototype system has been developed where the geometry of the displays and cameras is dynamically controlled by the eye movement of the operator. This paper explores why it is necessary to actively adjust the display system as well as the cameras and justifies the use of mechanical adjustment of the displays as an alternative to adjustment by electronic or image processing methods. The electronic and mechanical design is described including optical arrangements and control algorithms. The performance and accuracy of the system is assessed with respect to eye movement.

Judging size, distance and depth with an active telepresence system

A visual telepresence system has been developed at the University of Reading which utilizes eye tracing to adjust the horizontal orientation of the cameras and display system according to the convergence state of the operator's eyes. Slaving the cameras to the operator's direction of gaze enables the object of interest to be centered on the displays. The advantage of this is that the camera field of view may be decreased to maximize the achievable depth resolution. An active camera system requires an active display system if appropriate binocular cues are to be preserved. For some applications, which critically depend upon the veridical perception of the object's location and dimensions, it is imperative that the contribution of binocular cues to these judgements be ascertained because they are directly influenced by camera and display geometry. Using the active telepresence system, we investigated the contribution of ocular convergence information to judgements of size, distance and shape. Participants performed an open- loop reach and grasp of the virtual object under reduced cue conditions where the orientation of the cameras and the displays were either matched or unmatched. Inappropriate convergence information produced weak perceptual distortions and caused problems in fusing the images.

Dynamic vergence telepresence system incorporating active gaze control

Visual Telepresence system which utilize virtual reality style helmet mounted displays have a number of limitations. The geometry of the camera positions and of the display is fixed and is most suitable only for viewing elements of a scene at a particular distance. In such a system, the operator's ability to gaze around without use of head movement is severely limited. A trade off must be made between a poor viewing resolution or a narrow width of viewing field. To address these limitations a prototype system where the geometry of the displays and cameras is dynamically controlled by the eye movement of the operator has been developed. This paper explores the reasons why is necessary to actively adjust both the display system and the cameras and furthermore justifies the use of mechanical adjustment of the displays as an alternative to adjustment by electronic or image processing methods. The electronic and mechanical design is described including optical arrangements and control algorithms, An assessment of the performance of the system against a fixed camera/display system when operators are assigned basic tasks involving depth and distance/size perception. The sensitivity to variations in transient performance of the display and camera vergence is also assessed.

Feasibility of using eye tracking to increase resolution for visual telepresence

Visual telepresence seeks to extend existing teleoperative capability by supplying the operator with a 3D interactive view of the remote environment. This is achieved through the use of a stereo camera platform which, through appropriate 3D display devices, provides a distinct image to each eye of the operator, and which is slaved directly from the operator's head and eye movements. However, the resolution within current head mounted displays remains poor, thereby reducing the operator's visual acuity. This paper reports on the feasibility of incorporation of eye tracking to increase resolution and investigates the stability and control issues for such a system. Continuous domain and discrete simulations are presented which indicates that eye tracking provides a stable feedback loop for tracking applications, though some empirical testing (currently being initiated) of such a system will be required to overcome indicated stability problems associated with micro saccades of the human operator.

Understanding virtual experience and telepresence - a review and synthesis of literature

To enable buyers to be better informed before purchasing, products and services can be virtually experienced on the internet. Research into virtual experience (VE) and the related construct of telepresence (TP) as means of online marketing has made great progress in recent years. However, there is still disagreement in the literature concerning the exact understanding of these terms. In this study, the two terms are analyzed by means of a systematically executed literature review, differentiated from one another, and their understandings explained. This study is to our knowledge the first to compare the concepts of VE and TP in a systematic way. The analysis shows that TP is regarded as the feeling of presence conveyed by a communication medium. VE, on the other hand, is to be defined as an active state of a consumer through the use of computer-based presentation formats, and constituting a subtype of TP. These findings are intended to help VE and TP become more uniformly understood and make it easier to compare the results of future studies. Finally, from the literature review, it is possible to derive focal points for research in future studies.

An assisted navigation method for telepresence robots

Telepresence robots have emerged as a new means of interaction in remote environments. However, the use of such robots is still limited due to safety and usability issues when operating in human-like environments. This work addresses these issues by enhancing the robot navigation through a collaborative control method that assists the user to negotiate obstacles. The method has been implemented in a commercial telepresence robot and a user study has been conducted in order to test the suitability of our approach.

Access all

Access All was performance produced following a three-month mentorship in web-based performance that I was commissioned to conduct for the performance company Igneous. This live, triple-site performance event for three performers in three remote venues was specifically designed for presentation at Access Grid Nodes - conference rooms located around the globe equipped with a high end, open source computer teleconferencing technology that allowed multiple nodes to cross-connect with each other. Whilst each room was setup somewhat differently they all deployed the same basic infrastructre of multiple projectors, cameras, and sound as well as a reconfigurable floorspace. At that time these relatively formal setups imposed a clear series of limitations in terms of software capabilities and basic infrastructure and so there was much interest in understanding how far its capabilities might be pushed.----- Numerous performance experiments were undertaken between three Access Grid nodes in QUT Brisbane, VISLAB Sydney and Manchester Supercomputing Centre, England, culminating in the public performance staged simultaneously between the sites with local audiences at each venue and others online. Access All was devised in collaboration with interdisciplinary performance company Bonemap, Kelli Dipple (Interarts curator, Tate Modern London) and Mike Stubbs British curator and Director of FACT (Liverpool).----- This period of research and development was instigated and shaped by a public lecture I had earlier delivered in Sydney for the ‘Global Access Grid Network, Super Computing Global Conference’ entitled 'Performance Practice across Electronic Networks'. The findings of this work went on to inform numerous future networked and performative works produced from 2002 onwards.

Skype : a communications framework for robotics

This paper describes an architecture for robotic telepresence and teleoperation based on the well known tools ROS and Skype. We discuss how Skype can be used as a framework for robotic communication and can be integrated into a ROS/Linux framework to allow a remote user to not only interact with people near the robot, but to view maps, sensory data, robot pose and to issue commands to the robot’s navigation stack. This allows the remote user to exploit the robot’s autonomy, providing a much more convenient navigation interface than simple remote joysticking.

Intimate Transactions Stage 4

A telepresence-based interactive installation allowing people at three sites (The National Art Museum of China, Beijing; The Imperial City Art Museum, Beijing; CalPoly University, California, USA) to interact simultaneously using only their bodies. Each participant used a physical interface called a ‘Bodyshelf’ and wore a sound vibration transmission device called a ‘haptic pendant’ around their necks. By gently moving their bodies and engaging through this ‘smart furniture’, they instigated ‘intimate transactions’, which influenced an evolving computationally-generated ‘world’ created from digital imagery, multichannel sound and tactile feedback. Intimate Transactions (Version 4) was the culmination of a long-term interdisciplinary research project developed in four distinct stages. It was launched in in 2008 and subsequently acquired on invitation by Professor Peter Weibel for the ZKM Media Art History Museum Karlsruhe in 2012.

移动机器人遥操作中力反馈技术的研究

在已有的遥操作系统中增加力反馈,通过计算移动机器人与周围障碍物之间的虚拟交互力,并将其映射到操纵杆上变成操作者可以感知的力,这样操作者能感觉到机器人与环境之间的作用力,从而有效地完成操作任务.实验结果表明该方法能够有效控制机器人行走,显示了在非结构性环境下临场感在增强人机交互能力方面的优越性.

基于Internet的力反馈技术研究

论述了基于Internet的力反馈技术及其相关技术的发展和研究意义 ,综合机器人遥操作控制领域的理论方法 ,结合多媒体技术的最新发展 ,构建了一种基于事件的系统结构及其设计方法 .基于该方法 ,分析了系统的可靠性、稳定性及力媒体传输的透明性 ,并设计了一个基于Internet的力反馈技术的系统实例