Novel hardwired distributive tactile sensing system for medical applications

This thesis described the research carried out on the development of a novel hardwired tactile sensing system tailored for the application of a next generation of surgical robotic and clinical devices, namely a steerable endoscope with tactile feedback, and a surface plate for patient posture and balance. Two case studies are examined. The first is a one-dimensional sensor for the steerable endoscope retrieving shape and ‘touch’ information. The second is a two-dimensional surface which interprets the three-dimensional motion of a contacting moving load. This research can be used to retrieve information from a distributive tactile sensing surface of a different configuration, and can interpret dynamic and static disturbances. This novel approach to sensing has the potential to discriminate contact and palpation in minimal invasive surgery (MIS) tools, and posture and balance in patients. The hardwired technology uses an embedded system based on Field Programmable Gate Arrays (FPGA) as the platform to perform the sensory signal processing part in real time. High speed robust operation is an advantage from this system leading to versatile application involving dynamic real time interpretation as described in this research. In this research the sensory signal processing uses neural networks to derive information from input pattern from the contacting surface. Three neural network architectures namely single, multiple and cascaded were introduced in an attempt to find the optimum solution for discrimination of the contacting outputs. These architectures were modelled and implemented into the FPGA. With the recent introduction of modern digital design flows and synthesis tools that essentially take a high-level sensory processing behaviour specification for a design, fast prototyping of the neural network function can be achieved easily. This thesis outlines the challenge of the implementations and verifications of the performances.

A novel actuated digit with tactile feedback for clinical applications

This thesis describes the work carried out on the development of a novel digit actuator system with tactile perception feedback to a user and demonstrated as a master-slave system. For the tactile surface of the digit, contrasting sensor elements of resistive strain gauges and optical fibre Bragg grating sensors were evaluated. A distributive tactile sensing system consisting of optimised neural networking schemes was developed, resulting in taxonomy of artificial touch. The device is suitable for use in minimal invasive surgical (MIS) procedures as a steerable tip and a digit constructed wholly from polymers makes it suitable for use in Magnetic Resonance Imaging (MRI) environments enabling active monitoring of the patient during a procedure. To provide a realistic template of the work the research responded to the needs of two contrasting procedures: palpation of the prostate and endotracheal intubation in anaesthesia where the application of touch sense can significantly assist navigation. The performance of the approach was demonstrated with an experimental digit constructed for use in the laboratory in phantom trials. The phantom unit was developed to resemble facets of the clinical applications and digit system is able to evaluate reactive force distributions acting over the surface of the digit as well as different descriptions of contact and motion relative to the surface of the lumen. Completing control of the digit is via an instrumented glove, such that the digit actuates in sympathy with finger gesture and tactile information feedback is achieved by a combination of the tactile and visual means.

Fibre Bragg grating sensors for distributive tactile sensing

Distributive tactile sensing is a method of tactile sensing in which a small number of sensors monitors the behaviour of a flexible substrate which is in contact with the object being sensed. This paper describes the first use of fibre Bragg grating sensors in such a system. Two systems are presented: the first is a one-dimensional metal strip with an array of four sensors, which is capable of detecting the magnitude and position of a contacting load. This system is favourably compared experimentally with a similar system using resistive strain gauges. The second system is a two-dimensional steel plate with nine sensors which is able to distinguish the position and shape of a contacting load, or the positions of two loads simultaneously. This system is compared with a similar system using 16 infrared displacement sensors. Each system uses neural networks to process the sensor data to give information concerning the type of contact. Issues and limitations of the systems are discussed, along with proposed solutions to some of the difficulties.

Tactile sensing with fibre Bragg gratings and neural networks

Fibre Bragg grating sensors are usually expensive to interrogate, and part of this thesis describes a low cost interrogation system for a group of such devices which can be indefinitely scaled up for larger numbers of sensors without requiring an increasingly broadband light source. It incorporates inherent temperature correction and also uses fewer photodiodes than the number or sensors it interrogates, using neural networks to interpret the photodiode data. A novel sensing arrangement using an FBG grating encapsulated in a silicone polymer is presented. This sensor is capable of distinguishing between different surface profiles with ridges 0.5 to 1mm deep and 2mm pitch and either triangular, semicircular or square in profile. Early experiments using neural networks to distinguish between these profiles are also presented. The potential applications for tactile sensing systems incorporating fibre Bragg gratings and neural networks are explored.

Distributive tactile sensing using fibre Bragg grating sensors

Two distributive tactile sensing systems are presented, based on fibre Bragg grating sensors. The first is a onedimensional metal strip with an array of 4 sensors, which is capable of detecting the magnitude and position of a contacting load. This system is compared experimentally with a similar system using resistive strain gauges. The second is a two-dimensional steel plate with 9 sensors which is able to distinguish the position and shape of a contacting load. This system is compared with a similar system using 16 infrared displacement sensors. Each system uses neural networks to process the sensor data to give information concerning the type of contact.

The two forms of visuo-spatial perspective taking are differently embodied and subserve different spatial prepositions

We set out to distinguish level 1 (VPT-1) and level 2 (VPT-2) perspective taking with respect to the embodied nature of the underlying processes as well as to investigate their dependence or independence of response modality (motor vs. verbal). While VPT-1 reflects understanding of what lies within someone else’s line of sight, VPT-2 involves mentally adopting someone else’s spatial point of view. Perspective taking is a high-level conscious and deliberate mental transformation that is crucially placed at the convergence of perception, mental imagery, communication, and even theory of mind in the case of VPT-2. The differences between VPT-1 and VPT-2 mark a qualitative boundary between humans and apes, with the latter being capable of VPT-1 but not of VPT-2. However, our recent data showed that VPT-2 is best conceptualized as the deliberate simulation or emulation of a movement, thus underpinning its embodied origins. In the work presented here we compared VPT-2 to VPT-1 and found that VPT-1 is not at all, or very differently embodied. In a second experiment we replicated the qualitatively different patterns for VPT-1 and VPT-2 with verbal responses that employed spatial prepositions. We conclude that VPT-1 is the cognitive process that subserves verbal localizations using “in front” and “behind,” while VPT-2 subserves “left” and “right” from a perspective other than the egocentric. We further conclude that both processes are grounded and situated, but only VPT-2 is embodied in the form of a deliberate movement simulation that increases in mental effort with distance and incongruent proprioception. The differences in cognitive effort predict differences in the use of the associated prepositions. Our findings, therefore, shed light on the situated, grounded and embodied basis of spatial localizations and on the psychology of their use.

A cable actuated flexible digit with tactile feedback for use in clinical applications

DUE TO COPYRIGHT RESTRICTIONS ONLY AVAILABLE FOR CONSULTATION AT ASTON UNIVERSITY LIBRARY AND INFORMATION SERVICES WITH PRIOR ARRANGEMENT

A pneumatic balloon actuated cantilever beam with tactile feedback for use in minimally invasive surgery.

DUE TO COPYRIGHT RESTRICTIONS ONLY AVAILABLE FOR CONSULTATION AT ASTON UNIVERSITY LIBRARY AND INFORMATION SERVICES WITH PRIOR ARRANGEMENT

Fibre Bragg grating sensors for distributive tactile sensing

Distributive tactile sensing is a method of tactile sensing in which a small number of sensors monitors the behaviour of a flexible substrate which is in contact with the object being sensed. This paper describes the first use of fibre Bragg grating sensors in such a system. Two systems are presented: the first is a one-dimensional metal strip with an array of four sensors, which is capable of detecting the magnitude and position of a contacting load. This system is favourably compared experimentally with a similar system using resistive strain gauges. The second system is a two-dimensional steel plate with nine sensors which is able to distinguish the position and shape of a contacting load, or the positions of two loads simultaneously. This system is compared with a similar system using 16 infrared displacement sensors. Each system uses neural networks to process the sensor data to give information concerning the type of contact. Issues and limitations of the systems are discussed, along with proposed solutions to some of the difficulties. © 2007 IOP Publishing Ltd.

Flexible tactile digital feedback for clinical applications

Trauma and damage to the delicate structures of the inner ear frequently occurs during insertion of electrode array into the cochlea. This is strongly related to the excessive manual insertion force of the surgeon without any tool/tissue interaction feedback. The research is examined tool-tissue interaction of large prototype scale (12.5:1) digit embedded with distributive tactile sensor based upon cochlear electrode and large prototype scale (4.5:1) cochlea phantom for simulating the human cochlear which could lead to small scale digit requirements. This flexible digit classified the tactile information from the digit-phantom interaction such as contact status, tip penetration, obstacles, relative shape and location, contact orientation and multiple contacts. The digit, distributive tactile sensors embedded with silicon-substrate is inserted into the cochlea phantom to measure any digit/phantom interaction and position of the digit in order to minimize tissue and trauma damage during the electrode cochlear insertion. The digit is pre-curved in cochlea shape so that the digit better conforms to the shape of the scala tympani to lightly hug the modiolar wall of a scala. The digit have provided information on the characteristics of touch, digit-phantom interaction during the digit insertion. The tests demonstrated that even devices of such a relative simple design with low cost have potential to improve cochlear implants surgery and other lumen mapping applications by providing tactile feedback information by controlling the insertion through sensing and control of the tip of the implant during the insertion. In that approach, the surgeon could minimize the tissue damage and potential damage to the delicate structures within the cochlear caused by current manual electrode insertion of the cochlear implantation. This approach also can be applied diagnosis and path navigation procedures. The digit is a large scale stage and could be miniaturized in future to include more realistic surgical procedures.

An optical fiber Bragg grating tactile sensor

Tactile sensors are needed for many emerging robotic and telepresence applications such as keyhole surgery and robot operation in unstructured environments. We have proposed and demonstrated a tactile sensor consisting of a fibre Bragg grating embedded in a polymer "finger". When the sensor is placed in contact with a surface and translated tangentially across it measurements on the changes in the reflectivity spectrum of the grating provide a measurement of the spatial distribution of forces perpendicular to the surface and thus, through the elasticity of the polymer material, to the surface roughness. Using a sensor fabricated from a Poly Siloxane polymer (Methyl Vinyl Silicone rubber) spherical cap 50 mm in diameter, 6 mm deep with an embedded 10 mm long Bragg grating we have characterised the first and second moment of the grating spectral response when scanned across triangular and semicircular periodic structures both with a modulation depth of 1 mm and a period of 2 mm. The results clearly distinguish the periodicity of the surface structure and the differences between the two different surface profiles. For the triangular structure a central wavelength modulation of 4 pm is observed and includes a fourth harmonic component, the spectral width is modulated by 25 pm. Although crude in comparison to human senses these results clearly shown the potential of such a sensor for tactile imaging and we expect that with further development in optimising both the grating and polymer "finger" properties a much increased sensitivity and spatial resolution is achievable.

Distributive tactile sensing using fibre Bragg grating sensors for biomedical applications

Artificial tactile sensing systems using the distributive tactile sensing technique and fibre Bragg grating sensors are presented. A one-dimensional arrangement, with possible applications in an endoscope, is compared with a similar arrangement using conventional electronic sensors. A two-dimensional sensing surface is described, with potential applications in human balance and gait analysis, capable of detecting simultaneously the position and shape of an object placed upon it. It is believed that this work represents the first use of fibre Bragg grating sensors in a distributive sensing regime.

Distributive tactile sensing using fibre bragg grating sensors

Two distributive tactile sensing systems are presented, based on fibre Bragg grating sensors. The first is a one-dimensional metal strip with an array of 4 sensors, which is capable of detecting the magnitude and position of a contacting load. This system is compared experimentally with a similar system using resistive strain gauges. The second is a two-dimensional steel plate with 9 sensors which is able to distinguish the position and shape of a contacting load. This system is compared with a similar system using 16 infrared displacement sensors. Each system uses neural networks to process the sensor data to give information concerning the type of contact.