TESSA - Toolkit for experimentation with multimodal sensory substitution and augmentation

TESSA is a toolkit for experimenting with sensory augmentation. It includes hardware and software to facilitate rapid prototyping of interfaces that can enhance one sense using information gathered from another sense. The toolkit contains a range of sensors (e.g. ultrasonics, temperature sensors) and actuators (e.g. tactors or stereo sound), designed modularly so that inputs and outputs can be easily swapped in and out and customized using TESSA’s graphical user interface (GUI), with “real time” feedback. The system runs on a Raspberry Pi with a built-in touchscreen, providing a compact and portable form that is amenable for field trials. At CHI Interactivity, the audience will have the opportunity to experience sensory augmentation effects using this system, and design their own sensory augmentation interfaces.

Effects of electrotactile vestibular substitution on rehabilitation of patients with bilateral vestibular loss

The present study evaluated the effectiveness of electrotactile tongue biofeedback (BrainPort (R)) as a sensory substitute for the vestibular apparatus in patients with bilateral vestibular loss (BVL) who did not have a good response to conventional vestibular rehabilitation (VR). Seven patients with BVL were trained to use the device. Stimulation on the surface of the tongue was created by a dynamic pattern of electrical pulses and the patient was able to adjust the intensity of stimulation and spatially centralize the stimulus on the electrode array. Patients were directed to continuously adjust head orientation and to maintain the stimulus pattern at the center of the array. Postural tasks that present progressive difficulties were given during the use of the device. Pre- and post-treatment distribution of the sensory organization test (SOT) composite score showed an average value of 38.3 +/- 8.7 and 59.9 +/- 11.3, respectively, indicating a statistically significant improvement (p = 0.01). Electrotactile tongue biofeedback significantly improved the postural control of the study group, even if they had not improved with conventional VR. The electrotactile tongue biofeedback system was able to supply additional information about head position with respect to gravitational vertical orientation in the absence of vestibular input, improving postural control. Patients with BVL can integrate electrotactile information in their postural control in order to improve stability after conventional VR. These results were obtained and verified not only by the subjective questionnaire but also by the SOT composite score. The limitations of the study are the small sample size and short duration of the follow-up. The current findings show that the sensory substitution mediated by electrotactile tongue biofeedback may contribute to the improved balance experienced by these patients compared to VR. (C) 2010 Elsevier Ireland Ltd. All rights reserved.

Methods of sensory augmentation through electro-tactile stimulation of the tongue

This paper details an investigation into sensory substitution by means of direct electrical stimulation of the tongue for the purpose of information input to the human brain. In particular, a device has been constructed and a series of trials have been performed in order to demonstrate the efficacy and performance of an electro-tactile array mounted onto the tongue surface for the purpose of sensory augmentation. Tests have shown that by using a low resolution array a computer-human feedback loop can be successfully implemented by humans in order to complete tasks such as object tracking, surface shape identification and shape recognition with no training or prior experience with the device. Comparisons of this technique have been made with visual alternatives and these show that the tongue based tactile array can match such methods in convenience and accuracy in performing simple tasks.

Sensory enhancement, a pilot perceptual study of subdermal magnetic implants

Subdermal magnetic implants originated as an art form in the world of body modification. To date an in depth scientific analysis of the benefits of this implant has yet to be established. This research explores the concept of sensory extension of the tactile sense utilising this form of implantation. This relatively simple procedure enables the tactile sense to respond to static and alternating magnetic fields. This is not to say that the underlying biology of the system has changed; i.e. the concept does not increase our tactile frequency response range or sensitivity to pressure, but now does invoke a perceptual response to a stimulus that is not innately available to humans. Within this research two social surveys have been conducted in order to ascertain one, the social acceptance of the general notion of human enhancement, and two the perceptual experiences of individuals with the magnetic implants themselves. In terms of acceptance to the notion of sensory improvement (via implantation) ~39% of the general population questioned responded positively with a further ~25% of the respondents answering with the indecisive response. Thus with careful dissemination a large proportion of individuals may adopt this technology much like this if it were to become available for consumers. Interestingly of the responses collected from the magnetic implants survey ~60% of the respondents actually underwent the implant for magnetic vision purposes. The main contribution of this research however comes from a series of psychophysical testing. In which 7 subjects with subdermal magnetic implants, were cross compared with 7 subjects that had similar magnets superficially attached to their dermis. The experimentation examined multiple psychometric thresholds of the candidates including intensity, frequency and temporal. Whilst relatively simple, the experimental setup for the perceptual experimentation conducted was novel in that custom hardware and protocols were created in order to determine the subjective thresholds of the individuals. Abstract iv The overall purpose of this research is to utilise this concept in high stress scenarios, such as driving or piloting; whereby alerts and warnings could be relayed to an operator without intruding upon their other (typically overloaded) exterior senses (i.e. the auditory and visual senses). Hence each of the thresholding experiments were designed with the intention of utilising the results in the design of signals for information transfer. The findings from the study show that the implanted group of subjects significantly outperformed the superficial group in the absolute intensity threshold experiment, i.e. the implanted group required significantly less force than the superficial group in order to perceive the stimulus. The results for the frequency difference threshold showed no significant difference in the two groups tested. Interestingly however at low frequencies, i.e. 20 and 50 Hz, the ability of the subjects tested to discriminate frequencies significantly increased with more complex waveforms i.e. square and sawtooth, when compared against the typically used sinewave. Furthermore a novel protocol for establishing the temporal gap detection threshold during a temporal numerosity study has been established in this thesis. This experiment measured the subjects’ capability to correctly determine the number of concatenated signals presented to them whilst the time between the signals, referred to as pulses, tended to zero. A significant finding was that when altering the length of, the frequency of, and the number of cycles of the pulses, the time between pulses for correct recognition altered. This finding will ultimately aid in the design of the tactile alerts for this method of information transfer. Preliminary development work for the use of this method of input to the body, in an automotive scenario, is also presented within this thesis in the form of a driving simulation. The overall goal of which is to present warning alerts to a driver, such as rear-to-end collision, or excessive speeds on roads, in order to prevent incidents and penalties from occurring. Discussion on the broader utility of this implant has been presented, reflecting on its potential use as a basis for vibrotactile, and sensory substitution, devices. This discussion furthers with postulations on its use as a human machine interface, as well as how a similar implant could be used within the ear as a hearing aid device.

Un oeil sur la langue : aspects neuro-cognitifs du processus de la navigation chez l'aveugle-né

La vision est un élément très important pour la navigation en général. Grâce à des mécanismes compensatoires les aveugles de naissance ne sont pas handicapés dans leurs compétences spatio-cognitives, ni dans la formation de nouvelles cartes spatiales. Malgré l’essor des études sur la plasticité du cerveau et la navigation chez les aveugles, les substrats neuronaux compensatoires pour la préservation de cette fonction demeurent incompris. Nous avons démontré récemment (article 1) en utilisant une technique d’analyse volumétrique (Voxel-Based Morphometry) que les aveugles de naissance (AN) montrent une diminution de la partie postérieure de l’hippocampe droit, structure cérébrale importante dans la formation de cartes spatiales. Comment les AN forment-ils des cartes cognitives de leur environnement avec un hippocampe postérieur droit qui est significativement réduit ? Pour répondre à cette question nous avons choisi d’exploiter un appareil de substitution sensorielle qui pourrait potentiellement servir à la navigation chez les AN. Cet appareil d’affichage lingual (Tongue display unit -TDU-) retransmet l’information graphique issue d’une caméra sur la langue. Avant de demander à nos sujets de naviguer à l’aide du TDU, il était nécessaire de nous assurer qu’ils pouvaient « voir » des objets dans l’environnement grâce au TDU. Nous avons donc tout d’abord évalué l’acuité « visuo »-tactile (article 2) des sujets AN pour les comparer aux performances des voyants ayant les yeux bandées et munis du TDU. Ensuite les sujets ont appris à négocier un chemin à travers un parcours parsemé d’obstacles i (article 3). Leur tâche consistait à pointer vers (détection), et contourner (négociation) un passage autour des obstacles. Nous avons démontré que les sujets aveugles de naissance non seulement arrivaient à accomplir cette tâche, mais encore avaient une performance meilleure que celle des voyants aux yeux bandés, et ce, malgré l’atrophie structurelle de l’hippocampe postérieur droit, et un système visuel atrophié (Ptito et al., 2008). Pour déterminer quels sont les corrélats neuronaux de la navigation, nous avons créé des routes virtuelles envoyées sur la langue par le biais du TDU que les sujets devaient reconnaitre alors qu’ils étaient dans un scanneur IRMf (article 4). Nous démontrons grâce à ces techniques que les aveugles utilisent un autre réseau cortical impliqué dans la mémoire topographique que les voyants quand ils suivent des routes virtuelles sur la langue. Nous avons mis l’emphase sur des réseaux neuronaux connectant les cortex pariétaux et frontaux au lobe occipital puisque ces réseaux sont renforcés chez les aveugles de naissance. Ces résultats démontrent aussi que la langue peut être utilisée comme une porte d’entrée vers le cerveau en y acheminant des informations sur l’environnement visuel du sujet, lui permettant ainsi d’élaborer des stratégies d’évitement d’obstacles et de se mouvoir adéquatement.

Developing Synaesthesia

Synaesthesia is a condition in which a stimulus elicits an additional subjective experience. For example, the letter E printed in black (the inducer) may trigger an additional colour experience as a concurrent (e.g., blue). Synaesthesia tends to run in families and thus, a genetic component is likely. However, given that the stimuli that typically induce synaesthesia are cultural artefacts, a learning component must also be involved. Moreover, there is evidence that synaesthetic experiences not only activate brain areas typically involved in processing sensory input of the concurrent modality; synaesthesia seems to cause a structural reorganisation of the brain. Attempts to train non-synaesthetes with synaesthetic associations have been successful in mimicking certain behavioural aspects and posthypnotic induction of synaesthetic experiences in non-synaesthetes has even led to the according phenomenological reports. These latter findings suggest that structural brain reorganization may not be a critical precondition, but rather a consequence of the sustained coupling of inducers and concurrents. Interestingly, synaesthetes seem to be able to easily transfer synaesthetic experiences to novel stimuli. Beyond this, certain drugs (e.g., LSD) can lead to synaesthesia-like experiences and may provide additional insights into the neurobiological basis of the condition. Furthermore, brain damage can both lead to a sudden presence of synaesthetic experiences in previously non-synaesthetic individuals and a sudden absence of synaesthesia in previously synaesthetic individuals. Moreover, enduring sensory substitution has been effective in inducing a kind of acquired synaesthesia. Besides informing us about the cognitive mechanisms of synaesthesia, synaesthesia research is relevant for more general questions, for example about consciousness such as the binding problem, about crossmodal correspondences and about how individual differences in perceiving and experiencing the world develop. Hence the aim of the current Research Topic is to provide novel insights into the development of synaesthesia both in its genuine and acquired form. We welcome novel experimental work and theoretical contributions (e.g., review and opinion articles) focussing on factors such as brain maturation, learning, training, hypnosis, drugs, sensory substitution and brain damage and their relation to the development of any form of synaesthesia.

Effect of the Partial Substitution of Soy Proteins by Highly Methyl-esterified Pectin on Chemical and Sensory Characteristics of Sausages

Pectin can be used as a natural emulsifier in food formulations. In this study, textured soybean protein (TSP), used as an emulsifier in commercial sausages, was partially replaced by a mixture containing pectin and isolated soybean proteins, which were either extruded (EXT) or not extruded (MIX), and the chemical and sensory characteristics of samples were evaluated after 60 days of storage at 4 degrees C. Responses such as oxidation measured by PV and TBARS, hardness, color, pH and sensory characteristics were compared with those of a commercial sausage (CON). The mixture containing highly methyl-esterified pectin, textured soybean proteins and isolated soybean proteins, as emulsifier agent, reduced the hardness (EXT: 21.69 +/- 0.98 and MIX: 20.17 +/- 2.76 N) and the pH (EXT: 5.46 +/- 0.03 and MIX: 5.29 +/- 0.01) of the samples and increased the concentration of peroxides (EXT: 0.10 +/- 0.01 and MIX: 0.15 +/- 0.01 meq/kg) when compared with samples formulated only with TSP (28.57 +/- 2.54 N, pH of 6.92 +/- 0.04 and PV = 0.07 +/- 0.01 meq/kg). These effects were likely caused by the anionic character of the emulsifier. However, no sensory difference was observed between the sausages containing highly methyl-esterified pectin, textured soybean proteins and isolated soybean proteins submitted to the extrusion process (EXT) and the control sausages, suggesting that the formulation proposed in this study can be a potential alternative for the further development of sausages that have functional properties or are free of artificial additives.

Effects of refrigeration, freezing and replacement of milk fat by inulin and whey protein concentrate on texture profile and sensory acceptance of synbiotic guava mousses

The effects of refrigeration, freezing and substitution of milk fat by inulin and whey protein concentrate (WPC) on the texture and sensory features of synbiotic guava mousses supplemented with the probiotic, Lactobacillus acidophilus La-5, and the prebiotic fibre oligofructose, were studied. The frozen storage (-18 +/- 1 degrees C), followed by thawing at 4 degrees C before the analyses, and the complete replacement of the milk fat by inulin plus WPC, led to significant differences in the instrumental texture parameters of mousses (P < 0.05). Nonetheless, these changes did not affect the sensory acceptability of the products studied. The frozen storage may be employed to extend the shelf-life of synbiotic guava mousses. Additionally, to obtain a texture profile similar to the traditional product, the simultaneous addition of inulin and WPC is recommended only for the partial replacement of milk fat in refrigerated and frozen mousses, and the total proportion of both ingredients together should not exceed 2.6%. (C) 2010 Elsevier Ltd. All rights reserved.

Synergism between lipoxygenase-active soybean flour and ascorbic acid on rheological and sensory properties of wheat bread

BACKGROUND: The interaction between lipoxygenase-active soybean flour (LOX) and ascorbic acid (AA), on colour, rheological and sensory properties of wheat bread was studied with the aim of reducing the applied quantity of additives in bread formulations. RESULTS: The ascorbic acid (0-500 ppm) and active soybean flour (0-1%) mixture improved bread-crumb colour by lowering the yellow hue in a higher proportion than those expressed by the components alone, characterising a synergistic mechanism ((y) over cap (b) = 15.1- (1.7 x LOX) - (0.5 x AA) - (5.8 x LOX x AA), where : (y) over cap (b) represent the estimated value for the yellow hue parameter). No differences in flavour and porosity were seen between the samples. As supported by the instrumental methods, breads made with active soybean flour and ascorbic acid (LOX + AA) had whiter crumbs and were softer and springier than controls as assessed by a trained sensory panel. In summary, the combination of both active soybean flour and ascorbic acid showed synergism, promoting a greater bleaching effect than when used alone. CONCLUSION: These results suggest the potential use of active soybean flour as a synergistic ingredient in the substitution of artificial additives in bread making. Since the interaction on the bleaching response was not linear and active soybean flour showed a higher iron concentration (66.40 +/- 4.23 mu g g(-1)) than non-active soybean flour (52.30 +/- 0.40 mu g g(-1)), more studies are warranted to establish the biochemical mechanisms involved in this interaction. (c) 2007 Society of Chemical Industry.

Effect of reducing and replacing pork fat on the physicochemical, instrumental and sensory characteristics throughout storage time of small caliber non-acid fermented sausages with reduced sodium content

The effect of pork fat reduction (from 44% to 20% final fat content) and its partial substitution by sunflower oil (3% addition) on the physicochemical, instrumental and sensory properties throughout storage time of small caliber non-acid fermented sausages (fuet type) with reduced sodium content (with partial substitution of NaCl by KCl and K-lactate) and without direct addition of nitrate and nitrite (natural nitrate source used instead), was studied. Results showed that sausages with reduced fat (10% initial fat content) and with acceptable sensory characteristics can be obtained by adding to the shoulder lean (8% fat content) during the grinding, either 3.3% backfat (3% fat content) or 3% sunflower oil, both previously finely comminuted with lean. Furthermore, sunflower oil showed to be suitable for partial pork backfat substitution in very lean fermented sausages, conferring desirable sensory properties similar to those of sausages with standard fat content. The sensory quality of the sausages was maintained after three-month cold storage in modified atmosphere.

Chemical and sensory characteristics of pulp and peel 'cajá-manga' (Spondias cytherea Sonn.) jelly

Cajá-manga (Spondias cytherea) is a fruit with intense aroma and a sweet sour taste, thus being very appreciated. Its peel, in spite of being more fibrous, is tender and many times consumed with the pulp. The peel is a part of foods normally discarded, but many times, it is rich in taste and fibers, representing an option at the elaboration of new foods. Since there are no reports in the literature on the use of cajá-manga peel for jelly making, this work had the purpose of developing and evaluating this product. Based on the results, it was noted that the peels presented higher contents of protein, lipids, ashes, food fiber, total carbohydrates and pectin, and lower content of moisture, when compared to the pulp. The peel and the pulp (control) jellies presented the following physical-chemical characteristics: moisture, 29.5 and 34.2%; proteins, 0.19 and 0.27%; lipids, 0.11 and 0.16%; total sugars, 56.5 and 65.5%; and total soluble solids, 69 and 66 ºBrix, respectively. The sensory analysis indicated that the product elaborated from the peel presented satisfactory acceptance for all the assessed attributes: appearance, color, odor, texture, taste and global evaluation. It is concluded that the total substitution of the pulp by the peel in the formulation, results in a product with good nutritional value with no sensory damages.

Partial substitution of nitrite by chitosan and the effect on the quality properties of pork sausages

The aim of the study was to evaluate the influence of partial nitrite replacement by chitosan on the quality of Ham Visking (a type of pork sausages). Five Ham Visking formulations were elaborated modifying the sodium nitrite (0.011; 0.016 or 0.0212%) and chitosan concentrations (0.25 or 0.5%) in the products. Sausages were stored at 4 ºC and physicochemical, microbiological, and sensorial evaluations were performed in order to estimate their shelf life. Chitosan can be used in pork sausages without affecting ensory attributes such as color although the panelists detected textural differences among the samples with chitosan, which suggests that there is some influence of deacetylation degree of chitosan on the textural behavior of sausages which still needed to be explained for a successful application of chitosan in meat products. The reduction of residual sodium nitrite did not affect the color and flavor of such products, but the use of chitosan increasedsignificantly the shelf life of sausages.

Physical, chemical, technological and sensory characteristics of Frankfurter type sausage containing okara flour

The addition of okara flour to an emulsified meat product (Frankfurter type sausage) was evaluated based on the physical, chemical, technological, and sensory characteristics of the final product. Okara, residue from soymilk production, was provided by two soymilk producing companies whose production systems were based on the hot disintegration of the decorticated (company B) or undecorticated (company A) soybeans. The okara was dehydrated using a flash dryer and then ground into flour (>420 µm). However, The okara flours A and B showed approximately the same amount of protein (35 and 40 g.100 g-1 dwb). However, the okara flour A presented higher values (p < 0.05) for all technological functional properties studied (emulsification capacity, emulsion stability, protein solubility, and water hold capacity) than those of okara flour B. The A and B okara flours were used in a frankfurter sausage formulation as substitution of 1.5% and 4% of meat. The results showed that the sausages containing okara flours A and B, as well as the control sausage, were accepted by the sensory panel. Moreover, there were no significant differences (p < 0.05) in the physical (color, objective texture, and emulsion stability) and chemical (pH and proximate composition) measurements of the sausages with and without the okara flour.

Effects of micronized sodium chloride on the sensory profile and consumer acceptance of turkey ham with reduced sodium content

The impact of sodium chloride reduction and its substitution for micronized salt on consumer acceptance of turkey ham was investigated. Five formulations - F1 (control - 2.0% NaCl), F2 (1.7% NaCl), F3 (1.4% NaCl), F4 (1.7% micronized NaCl), and F5 (1.4% micronized NaCl) - were evaluated with respect to sodium chloride content and by consumers using a nine-point hedonic scale for overall acceptability and CATA (check-all-that-apply) using 24 sensory descriptors. Trained panelists characterized the products using the flash profiling technique. Reductions in the salt content by up to 30% did not affect the overall acceptability of the samples by the consumers. However, the consumers characterized the formulations with lower salt content as "less salty and less seasoned" in comparison to the contents in the control. Products containing 1.7% NaCl were considered very similar to the control. The results obtained indicate that it is possible to reduce NaCl content by 30% without affecting consumer acceptance of the product. The use of micronized salt did not affect the sensory characteristics when compared with those of formulations containing the same level of sodium chloride indicating that micronized salt does not influence perception of salt.

Sensory response and physical characteristics of gluten-free and gum-free bread with chia flour

Abstract The aim of this study was to evaluate the physical quality and sensory acceptance of gluten-free breads with different percentages of chia flour (Salvia Hispanica L .). The chia flour was used to substitute rice flour and soy flour in order to replace the gum required in this type of bread. Four formulations were developed; a standard made with gum, and three formulations with 2.5%, 5.0% and 7.5% of chia flour. Analyses of specific volume, cooking losses and the rise in dough of the breads were performed. Sensory analysis included tests for affective acceptability and purchase intent. The results showed that the bread with 2.5% chia flour had specific volume and cooking losses similar to the standard. In terms of the rise in dough, the standard showed the highest values, followed by the bread made with 5.0% chia flour. The substitution of soy and rice flour with 2.5% of chia flour produced bread with sensory characteristics similar to the standard in all of the analyzed attributes; it also received higher purchase intent. Using chia flour at a concentration of 2.5%, compared to rice flour and soy flour, proved that it was possible to replace gum in the bread formulation.