Real-time hand tracking for rehabilitation and character animation

Hand and finger tracking has a major importance in healthcare, for rehabilitation of hand function required due to a neurological disorder, and in virtual environment applications, like characters animation for on-line games or movies. Current solutions consist mostly of motion tracking gloves with embedded resistive bend sensors that most often suffer from signal drift, sensor saturation, sensor displacement and complex calibration procedures. More advanced solutions provide better tracking stability, but at the expense of a higher cost. The proposed solution aims to provide the required precision, stability and feasibility through the combination of eleven inertial measurements units (IMUs). Each unit captures the spatial orientation of the attached body. To fully capture the hand movement, each finger encompasses two units (at the proximal and distal phalanges), plus one unit at the back of the hand. The proposed glove was validated in two distinct steps: a) evaluation of the sensors’ accuracy and stability over time; b) evaluation of the bending trajectories during usual finger flexion tasks based on the intra-class correlation coefficient (ICC). Results revealed that the glove was sensitive mainly to magnetic field distortions and sensors tuning. The inclusion of a hard and soft iron correction algorithm and accelerometer and gyro drift and temperature compensation methods provided increased stability and precision. Finger trajectories evaluation yielded high ICC values with an overall reliability within application’s satisfying limits. The developed low cost system provides a straightforward calibration and usability, qualifying the device for hand and finger tracking in healthcare and animation industries.

Local piezoelectric response of single poly(vinylidene fluoride) electrospun fibers

It is shown that electrospun poly(vynilidene fluoride) nanofibers are fully poled right after preparation and show b-phase contents of 70%, therefore being able to be implemented into electroactive devices without further processing steps. Further,the local piezoelectric properties of individual electrospun fibers have been studied by piezoresponse force microscopy. Piezoelectric response, polarization switching, and nanoscale patterning of the fibers have been demonstrated.

Osteoblast, fibroblast and in vivo biological response to poly(vinylidene fluoride) based composite materials

Electroactivematerials can be taken to advantage for the development of sensors and actuators as well as for novel tissue engineering strategies. Composites based on poly(vinylidenefluoride),PVDF,have been evaluated with respect to their biological response. Cell viability and proliferation were performed in vitro both with Mesenchymal Stem Cells differentiated to osteoblasts and Human Fibroblast Foreskin 1. In vivo tests were also performed using 6-week-old C57Bl/6 mice. It was concluded that zeolite and clay composites are biocompatible materials promoting cell response and not showing in vivo pro-inflammatory effects which renders both of them attractive for biological applications and tissue engineering, opening interesting perspectives to development of scaffolds from these composites. Ferrite and silver nanoparticle composites decrease osteoblast cell viability and carbon nanotubes decrease fibroblast viability. Further, carbon nanotube composites result in a significant increase in local vascularization accompanied an increase of inflammatory markers after implantation.

Energy harvesting performance of piezoelectric electrospun polymer fibers and polymer/ceramic composites

The energy harvesting efficiency of electrospun poly(vinylidene fluoride), its copolymer vinylidene fluoride-trifluoroethylene and composites of the later with piezoelectric BaTiOon interdigitated electrodes has been investigated. Further, a study of the influence of the electrospinning processing parameters on the size and distribution of the composites fibers has been performed. It is found that the best energy harvesting performance is obtained for the pure poly(vinylidene fluoride) fibers, with power outputs up to 0.03 W and 25 W under low and high mechanical deformation. The copolymer and the composites show reduced power output due to increased mechanical stiffness. The obtained values, among the largest found in the literature, the easy processing and the low cost and robustness of the polymer, demonstrate the applicability of the developed system.

Effect of poling state and morphology of piezoelectric poly(vinylidene fluoride) membranes for skeletal muscle tissue engineering

This work reports on the influence of polarization and morphology of electroactive poly(vinylidene fluoride), PVDF, on the biological response of myoblast cells. Non-poled, ‘‘poled +’’ and “poled-“ -PVDF were prepared in the form of films. Further, random and aligned electrospun -PVDF fiber mats were also prepared. It is demonstrated that negatively charged surfaces improve cell adhesion and proliferation and that the directional growth of the myoblast cells can be achieved by the cell culture on oriented fibers. Therefore, the potential application of electroative materials for muscle regeneration is demonstrated.

Mechanical, electrical and electro-mechanical properties of thermoplastic elastomer styrene–butadiene–styrene/multiwal carbon nanotubes composites

Composites of styrene–butadiene–styrene (SBS) block copolymer with multiwall carbon nanotubes were processed by solution casting to investigate the influence of filler content, the different ratios of styrene/butadiene in the copolymer and the architecture of the SBS matrix on the electrical, mechanical and electro-mechanical properties of the composites. It was found that filler content and elastomer matrix architecture influence the percolation threshold and consequently the overall composite electrical conductivity. Themechanical properties aremainly affected by the styrene and filler content. Hopping between nearest fillers is proposed as the main mechanism for the composite conduction. The variation of the electrical resistivity is linear with the deformation. This fact, together with the gauge factor values in the range of 2–18, results in appropriate composites to be used as (large) deformation sensors.

Mechanical, electrical and electro-mechanical properties of thermoplastic elastomer styrene–butadiene–styrene/multiwall carbon nanotubes composites

Composites of styrene–butadiene–styrene (SBS) block copolymer with multiwall carbon nanotubes were processed by solution casting to investigate the influence of filler content, the different ratios of styrene/butadiene in the copolymer and the architecture of the SBS matrix on the electrical, mechanical and electro-mechanical properties of the composites. It was found that filler content and elastomer matrix architecture influence the percolation threshold and consequently the overall composite electrical conductivity. The mechanical properties are mainly affected by the styrene and filler content. Hopping between nearest fillers is proposed as the main mechanism for the composite conduction. The variation of the electrical resistivity is linear with the deformation. This fact, together with the gauge factor values in the range of 2–18, results in appropriate composites to be used as (large) deformation sensors.

Electro-mechanical properties of triblock copolymer styrene-butadiene-styrene / carbon nanotube composites for large deformation sensor applications

Thermoplastic elastomer/carbon nanotube composites are studied for sensor applications due to their excellent mechanical and electrical properties. Piezoresisitive properties of tri-block copolymer styrene-butadiene-styrene (SBS)/ carbon nanotubes (CNT) prepared by solution casting have been investigated. Young modulus of the SBS/CNT composites increases with the amount of CNT filler content present in the samples, without losing the high strain deformation on the polymer matrix (~1500 %). Further, above the percolation threshold these materials are unique for the development of large deformation sensors due to the strong piezoresistive response. Piezoresistive properties evaluated by uniaxial stretching in tensile mode and 4-point bending showed a Gauge Factors up to 120. The excellent linearity obtained between strain and electrical resistance makes these composites interesting for large strain piezoresistive sensors applications.

Fatigue Prediction on Fibrin Poly-ε-caprolactone Macroporous Scaffolds

Tissue engineering applications rely on scaffolds that during its service life, either for in-vivo or in vitro applications, are under mechanical solicitations. The variation of the mechanical condition of the scaffold is strongly relevant for cell culture and has been scarcely addressed. Fatigue life cycle of poly-ε-caprolactone, PCL, scaffolds with and without fibrin as filler of the pore structure were characterized both dry and immersed in liquid water. It is observed that the there is a strong increase from 100 to 500 in the number of loading cycles before collapse in the samples tested in immersed conditions due to the more uniform stress distributions within the samples, the fibrin loading playing a minor role in the mechanical performance of the scaffolds

Piezoresistive sensors for force mapping of hip-prostheses

The success of artificial prosthetic replacements depends on the fixation of the artificial prosthetic component after being implanted in the thighbone. The materials for fixation are subject to mechanical stresses, which originate permanent deformations, incipient cracks and even fatigue fractures. This work shows the possibility of monitoring the mechanical stress over time in prosthesis. In this way, highly sensitive silicon thin-film piezoresistive sensors were developed attached to prosthesis and their results compared with commercial strain gauge sensors. Mechanical stress-strain experiments were performed in compressive mode, during 10,000 cycles. Experimental data was acquired at mechanical vibration frequencies of 0.5 Hz, 1 Hz and 5 Hz, and sent to a computer by means of a wireless link. The results show that there is a decrease in sensitivity of the thin-film silicon piezoresistive sensors when they are attached to the prosthesis, but this decrease does not compromise its monitoring performance. The sensitivity, compared to that of commercial strain gauges, is much larger due to their higher gauge factors (-23.5), when compared to the GFs of commercial sensors (2).

Collecting system percutaneous access using real-time tracking sensors: first pig model in vivo experience

Purpose: Precise needle puncture of the renal collecting system is an essential but challenging step for successful percutaneous nephrolithotomy. We evaluated the efficiency of a new real-time electromagnetic tracking system for in vivo kidney puncture. Materials and Methods: Six anesthetized female pigs underwent ureterorenoscopy to place a catheter with an electromagnetic tracking sensor into the desired puncture site and ascertain puncture success. A tracked needle with a similar electromagnetic tracking sensor was subsequently navigated into the sensor in the catheter. Four punctures were performed by each of 2 surgeons in each pig, including 1 each in the kidney, middle ureter, and right and left sides. Outcome measurements were the number of attempts and the time needed to evaluate the virtual trajectory and perform percutaneous puncture. Results: A total of 24 punctures were easily performed without complication. Surgeons required more time to evaluate the trajectory during ureteral than kidney puncture (median 15 seconds, range 14 to 18 vs 13, range 11 to 16, p ¼ 0.1). Median renal and ureteral puncture time was 19 (range 14 to 45) and 51 seconds (range 45 to 67), respectively (p ¼ 0.003). Two attempts were needed to achieve a successful ureteral puncture. The technique requires the presence of a renal stone for testing. Conclusions: The proposed electromagnetic tracking solution for renal collecting system puncture proved to be highly accurate, simple and quick. This method might represent a paradigm shift in percutaneous kidney access techniques

Neural Electrode Array Based on Aluminum: Fabrication and Characterization

A unique neural electrode design is proposed with 3 mm long shafts made from an aluminum-based substrate. The electrode is composed by 100 individualized shafts in a 10 × 10 matrix, in which each aluminum shafts are precisely machined via dicing-saw cutting programs. The result is a bulk structure of aluminum with 65 ° angle sharp tips. Each electrode tip is covered by an iridium oxide thin film layer (ionic transducer) via pulsed sputtering, that provides a stable and a reversible behavior for recording/stimulation purposes, a 40 mC/cm2 charge capacity and a 145 Ω impedance in a wide frequency range of interest (10 Hz-100 kHz). Because of the non-biocompatibility issue that characterizes aluminum, an anodization process is performed that forms an aluminum oxide layer around the aluminum substrate. The result is a passivation layer fully biocompatible that furthermore, enhances the mechanical properties by increasing the robustness of the electrode. For a successful electrode insertion, a 1.1 N load is required. The resultant electrode is a feasible alternative to silicon-based electrode solutions, avoiding the complexity of its fabrication methods and limitations, and increasing the electrode performance.

Collecting system percutaneous access using real-time tracking sensors: first pig model in vivo experience

Purpose: Precise needle puncture of the renal collecting system is an essential but challenging step for successful percutaneous nephrolithotomy. We evaluated the efficiency of a new real-time electromagnetic tracking system for in vivo kidney puncture. Materials and Methods: Six anesthetized female pigs underwent ureterorenoscopy to place a catheter with an electromagnetic tracking sensor into the desired puncture site and ascertain puncture success. A tracked needle with a similar electromagnetic tracking sensor was subsequently navigated into the sensor in the catheter. Four punctures were performed by each of 2 surgeons in each pig, including 1 each in the kidney, middle ureter, and right and left sides. Outcome measurements were the number of attempts and the time needed to evaluate the virtual trajectory and perform percutaneous puncture. Results: A total of 24 punctures were easily performed without complication. Surgeons required more time to evaluate the trajectory during ureteral than kidney puncture (median 15 seconds, range 14 to 18 vs 13, range 11 to 16, p ¼ 0.1). Median renal and ureteral puncture time was 19 (range 14 to 45) and 51 seconds (range 45 to 67), respectively (p ¼ 0.003). Two attempts were needed to achieve a successful ureteral puncture. The technique requires the presence of a renal stone for testing. Conclusions: The proposed electromagnetic tracking solution for renal collecting system puncture proved to be highly accurate, simple and quick. This method might represent a paradigm shift in percutaneous kidney access techniques.

A-scan ultrasound system for real-time puncture safety assessment during percutaneous nephrolithotomy

Background: Kidney stone is a major universal health problem, affecting 10% of the population worldwide. Percutaneous nephrolithotomy is a first-line and established procedure for disintegration and removal of renal stones. Its surgical success depends on the precise needle puncture of renal calyces, which remains the most challenging task for surgeons. This work describes and tests a new ultrasound based system to alert the surgeon when undesirable anatomical structures are in between the puncture path defined through a tracked needle. Methods: Two circular ultrasound transducers were built with a single 3.3-MHz piezoelectric ceramic PZT SN8, 25.4 mm of radius and resin-epoxy matching and backing layers. One matching layer was designed with a concave curvature to work as an acoustic lens with long focusing. The A-scan signals were filtered and processed to automatically detect reflected echoes. Results: The transducers were mapped in water tank and tested in a study involving 45 phantoms. Each phantom mimics different needle insertion trajectories with a percutaneous path length between 80 and 150 mm. Results showed that the beam cross-sectional area oscillates around the ceramics radius and it was possible to automatically detect echo signals in phantoms with length higher than 80 mm. Conclusions: This new solution may alert the surgeon about anatomical tissues changes during needle insertion, which may decrease the need of X-Ray radiation exposure and ultrasound image evaluation during percutaneous puncture.