Measuring end-to-end delay in real-time auralisation systems

One of the major challenges in the development of an immersive system is handling the delay between the tracking of the user’s head position and the updated projection of a 3D image or auralised sound, also called end-to-end delay. Excessive end-to-end delay can result in the general decrement of the “feeling of presence”, the occurrence of motion sickness and poor performance in perception-action tasks. These latencies must be known in order to provide insights on the technological (hardware/software optimization) or psychophysical (recalibration sessions) strategies to deal with them. Our goal was to develop a new measurement method of end-to-end delay that is both precise and easily replicated. We used a Head and Torso simulator (HATS) as an auditory signal sensor, a fast response photo-sensor to detect a visual stimulus response from a Motion Capture System, and a voltage input trigger as real-time event. The HATS was mounted in a turntable which allowed us to precisely change the 3D sound relative to the head position. When the virtual sound source was at 90º azimuth, the correspondent HRTF would set all the intensity values to zero, at the same time a trigger would register the real-time event of turning the HATS 90º azimuth. Furthermore, with the HATS turned 90º to the left, the motion capture marker visualization would fell exactly in the photo-sensor receptor. This method allowed us to precisely measure the delay from tracking to displaying. Moreover, our results show that the method of tracking, its tracking frequency, and the rendering of the sound reflections are the main predictors of end-to-end delay.

Exploring the properties of genetically engineered silk-elastin-like protein films

Free standing films of a genetically engineered silk-elastin-like protein (SELP) were prepared using water and formic acid as solvents. Exposure to methanol-saturated air promoted the formation of aggregated β-strands rendering aqueous insolubility and improved the mechanical properties leading to a 10-fold increase in strain-to-failure. The films were optically clear with resistivity values similar to natural rubber and thermally stable up to 180 °C. Addition of glycerol showed to enhance the flexibility of SELP/glycerol films by interacting with SELP molecules through hydrogen bonding, interpenetrating between the polymer chains and granting more conformational freedom. This detailed characterization provides cues for future and unique applications using SELP based biopolymers.

Estimating the colors of paintings

Observers can adjust the spectrum of illumination on paintings for optimal viewing experience. But can they adjust the colors of paintings for the best visual impression? In an experiment carried out on a calibrated color moni- tor images of four abstract paintings obtained from hyperspectral data were shown to observers that were unfamiliar with the paintings. The color volume of the images could be manipulated by rotating the volume around the axis through the average (a*, b*) point for each painting in CIELAB color space. The task of the observers was to adjust the angle of rotation to produce the best subjective impression from the paintings. It was found that the distribution of angles selected for data pooled across paintings and observers could be de- scribed by a Gaussian function centered at 10o, i.e. very close to the original colors of the paintings. This result suggest that painters are able to predict well what compositions of colors observers prefer.