Head Tracking via Robust Registration in Texture Map Images

A novel method for 3D head tracking in the presence of large head rotations and facial expression changes is described. Tracking is formulated in terms of color image registration in the texture map of a 3D surface model. Model appearance is recursively updated via image mosaicking in the texture map as the head orientation varies. The resulting dynamic texture map provides a stabilized view of the face that can be used as input to many existing 2D techniques for face recognition, facial expressions analysis, lip reading, and eye tracking. Parameters are estimated via a robust minimization procedure; this provides robustness to occlusions, wrinkles, shadows, and specular highlights. The system was tested on a variety of sequences taken with low quality, uncalibrated video cameras. Experimental results are reported.

Fast Head Tilt Detection for Human-Computer Interaction

Accurate head tilt detection has a large potential to aid people with disabilities in the use of human-computer interfaces and provide universal access to communication software. We show how it can be utilized to tab through links on a web page or control a video game with head motions. It may also be useful as a correction method for currently available video-based assistive technology that requires upright facial poses. Few of the existing computer vision methods that detect head rotations in and out of the image plane with reasonable accuracy can operate within the context of a real-time communication interface because the computational expense that they incur is too great. Our method uses a variety of metrics to obtain a robust head tilt estimate without incurring the computational cost of previous methods. Our system runs in real time on a computer with a 2.53 GHz processor, 256 MB of RAM and an inexpensive webcam, using only 55% of the processor cycles.

A Neural Model of Visually Guided Steering, Obstacle Avoidance, and Route Selection

A neural model is developed to explain how humans can approach a goal object on foot while steering around obstacles to avoid collisions in a cluttered environment. The model uses optic flow from a 3D virtual reality environment to determine the position of objects based on motion discotinuities, and computes heading direction, or the direction of self-motion, from global optic flow. The cortical representation of heading interacts with the representations of a goal and obstacles such that the goal acts as an attractor of heading, while obstacles act as repellers. In addition the model maintains fixation on the goal object by generating smooth pursuit eye movements. Eye rotations can distort the optic flow field, complicating heading perception, and the model uses extraretinal signals to correct for this distortion and accurately represent heading. The model explains how motion processing mechanisms in cortical areas MT, MST, and VIP can be used to guide steering. The model quantitatively simulates human psychophysical data about visually-guided steering, obstacle avoidance, and route selection.

A Neural Model of Visually Guided Steering, Obstacle Avoidance, and Route Selection

A neural model is developed to explain how humans can approach a goal object on foot while steering around obstacles to avoid collisions in a cluttered environment. The model uses optic flow from a 3D virtual reality environment to determine the position of objects based on motion discontinuities, and computes heading direction, or the direction of self-motion, from global optic flow. The cortical representation of heading interacts with the representations of a goal and obstacles such that the goal acts as an attractor of heading, while obstacles act as repellers. In addition the model maintains fixation on the goal object by generating smooth pursuit eye movements. Eye rotations can distort the optic flow field, complicating heading perception, and the model uses extraretinal signals to correct for this distortion and accurately represent heading. The model explains how motion processing mechanisms in cortical areas MT, MST, and posterior parietal cortex can be used to guide steering. The model quantitatively simulates human psychophysical data about visually-guided steering, obstacle avoidance, and route selection.

Cerebellar Learning in an Opponent Motor Controller for Adaptive Load Compensation and Synergy Formation

This paper shows how a minimal neural network model of the cerebellum may be embedded within a sensory-neuro-muscular control system that mimics known anatomy and physiology. With this embedding, cerebellar learning promotes load compensation while also allowing both coactivation and reciprocal inhibition of sets of antagonist muscles. In particular, we show how synaptic long term depression guided by feedback from muscle stretch receptors can lead to trans-cerebellar gain changes that are load-compensating. It is argued that the same processes help to adaptively discover multi-joint synergies. Simulations of rapid single joint rotations under load illustrates design feasibility and stability.

A Biomechanical Model of Human Oculomotor Plant Kinematics Based Upon Geometric Algebra

A biomechanical model of the human oculomotor plant kinematics in 3-D as a function of muscle length changes is presented. It can represent a range of alternative interpretations of the data as a function of one parameter. The model is free from such deficits as singularities and the nesting of axes found in alternative formulations such as the spherical wrist (Paul, l98l). The equations of motion are defined on a quaternion based representation of eye rotations and are compact atnd computationally efficient.

The Perception of Globally Coherent Motion

How do human observers perceive a coherent pattern of motion from a disparate set of local motion measures? Our research has examined how ambiguous motion signals along straight contours are spatially integrated to obtain a globally coherent perception of motion. Observers viewed displays containing a large number of apertures, with each aperture containing one or more contours whose orientations and velocities could be independently specified. The total pattern of the contour trajectories across the individual apertures was manipulated to produce globally coherent motions, such as rotations, expansions, or translations. For displays containing only straight contours extending to the circumferences of the apertures, observers' reports of global motion direction were biased whenever the sampling of contour orientations was asymmetric relative to the direction of motion. Performance was improved by the presence of identifiable features, such as line ends or crossings, whose trajectories could be tracked over time. The reports of our observers were consistent with a pooling process involving a vector average of measures of the component of velocity normal to contour orientation, rather than with the predictions of the intersection-of-constraints analysis in velocity space.

A Self-Organizing Neural Model of Motor Equivalent Reaching and Tool Use by a Multijoint Arm

This paper describes a self-organizing neural model for eye-hand coordination. Called the DIRECT model, it embodies a solution of the classical motor equivalence problem. Motor equivalence computations allow humans and other animals to flexibly employ an arm with more degrees of freedom than the space in which it moves to carry out spatially defined tasks under conditions that may require novel joint configurations. During a motor babbling phase, the model endogenously generates movement commands that activate the correlated visual, spatial, and motor information that are used to learn its internal coordinate transformations. After learning occurs, the model is capable of controlling reaching movements of the arm to prescribed spatial targets using many different combinations of joints. When allowed visual feedback, the model can automatically perform, without additional learning, reaches with tools of variable lengths, with clamped joints, with distortions of visual input by a prism, and with unexpected perturbations. These compensatory computations occur within a single accurate reaching movement. No corrective movements are needed. Blind reaches using internal feedback have also been simulated. The model achieves its competence by transforming visual information about target position and end effector position in 3-D space into a body-centered spatial representation of the direction in 3-D space that the end effector must move to contact the target. The spatial direction vector is adaptively transformed into a motor direction vector, which represents the joint rotations that move the end effector in the desired spatial direction from the present arm configuration. Properties of the model are compared with psychophysical data on human reaching movements, neurophysiological data on the tuning curves of neurons in the monkey motor cortex, and alternative models of movement control.

Manipulation of magnetic anisotropy in nanostructures

Of late, the magnetic properties of micro/nano-structures have attracted intense research interest both fundamentally and technologically particularly to address the question that how the manipulation in the different layers of nanostructures, geometry of a patterned structure can affect the overall magnetic properties, while generating novel applications such as in magnetic sensors, storage devices, integrated inductive components and spintronic devices. Depending on the applications, materials with high, medium or low magnetic anisotropy and their possible manipulation are required. The most dramatic manifestation in this respect is the chance to manipulate the magnetic anisotropy over the intrinsic preferential direction of the magnetization, which can open up more functionality particularly for device applications. Types of magnetic anisotropies of different nanostructured materials and their manipulation techniques are investigated in this work. Detail experimental methods for the quantitative determination of magnetic anisotropy in nanomodulated Ni45Fe55 thin film are studied. Magnetic field induced in-plane rotations within the nanomodulated Ni45Fe55 continuous films revealed various rotational symmetries of magnetic anisotropy due to dipolar interactions showing a crossover from lower to higher fold of symmetry as a function of modulation geometry. In a second approach, the control of exchange anisotropy at ferromagnetic (FM) – aniferomagnetic (AFM) interface in multifferoic nanocomposite materials, where two different phase/types of materials were simultaneously synthesized, was investigated. The third part of this work was to study the electroplated thin films of metal alloy nanocomposite for enhanced exchange anisotropy. In this work a unique observation of an anti-clock wise as well as a clock wise hysteresis loop formation in the Ni,Fe solid solution with very low coercivity and large positive exchange anisotropy/exchange bias have been investigated. Hence, controllable positive and negative exchange anisotropy has been observed for the first time which has high potential applications such as in MRAM devices.

Jamming for a 2D granular material

This paper focuses on the nature of jamming, as seen in two-dimensional frictional granular systems consisting of photoelastic particles. The photoelastic technique is unique at this time, in its capability to provide detailed particle-scale information on forces and kinematic quantities such as particle displacements and rotations. These experiments first explore isotropic stress states near point J through measurements of the mean contact number per particle, Z, and the pressure, P as functions of the packing fraction, . In this case, the experiments show some but not all aspects of jamming, as expected on the basis of simulations and models that typically assume conservative, hence frictionless, forces between particles. Specifically, there is a rapid growth in Z, at a reasonable which we identify with as c. It is possible to fit Z and P, to power law expressions in - c above c, and to obtain exponents that are in agreement with simulations and models. However, the experiments differ from theory on several points, as typified by the rounding that is observed in Z and P near c. The application of shear to these same 2D granular systems leads to phenomena that are qualitatively different from the standard picture of jamming. In particular, there is a range of packing fractions below c, where the application of shear strain at constant leads to jammed stress-anisotropic states, i.e. they have a non-zero shear stress, τ. The application of shear strain to an initially isotropically compressed (hence jammed) state, does not lead to an unjammed state per se. Rather, shear strain at constant first leads to an increase of both τ and P. Additional strain leads to a succession of jammed states interspersed with relatively localized failures of the force network leading to other stress-anisotropic states that are jammed at typically somewhat lower stress. The locus of jammed states requires a state space that involves not only and τ, but also P. P, τ, and Z are all hysteretic functions of shear strain for fixed . However, we find that both P and τ are roughly linear functions of Z for strains large enough to jam the system. This implies that these shear-jammed states satisfy a Coulomb like-relation, τ = μP. © 2010 The Royal Society of Chemistry.

Locomotor head movements and semicircular canal morphology in primates.

Animal locomotion causes head rotations, which are detected by the semicircular canals of the inner ear. Morphologic features of the canals influence rotational sensitivity, and so it is hypothesized that locomotion and canal morphology are functionally related. Most prior research has compared subjective assessments of animal "agility" with a single determinant of rotational sensitivity: the mean canal radius of curvature (R). In fact, the paired variables of R and body mass are correlated with agility and have been used to infer locomotion in extinct species. To refine models of canal functional morphology and to improve locomotor inferences for extinct species, we compare 3D vector measurements of head rotation during locomotion with 3D vector measures of canal sensitivity. Contrary to the predictions of conventional models that are based upon R, we find that axes of rapid head rotation are not aligned with axes of either high or low sensitivity. Instead, animals with fast head rotations have similar sensitivities in all directions, which they achieve by orienting the three canals of each ear orthogonally (i.e., along planes at 90° angles to one another). The extent to which the canal configuration approaches orthogonality is correlated with rotational head speed independent of body mass and phylogeny, whereas R is not.

Application-Specific Instruction Set Processor for SoC implementation of Modern Signal Processing Algorithms

A novel application-specific instruction set processor (ASIP) for use in the construction of modern signal processing systems is presented. This is a flexible device that can be used in the construction of array processor systems for the real-time implementation of functions such as singular-value decomposition (SVD) and QR decomposition (QRD), as well as other important matrix computations. It uses a coordinate rotation digital computer (CORDIC) module to perform arithmetic operations and several approaches are adopted to achieve high performance including pipelining of the micro-rotations, the use of parallel instructions and a dual-bus architecture. In addition, a novel method for scale factor correction is presented which only needs to be applied once at the end of the computation. This also reduces computation time and enhances performance. Methods are described which allow this processor to be used in reduced dimension (i.e., folded) array processor structures that allow tradeoffs between hardware and performance. The net result is a flexible matrix computational processing element (PE) whose functionality can be changed under program control for use in a wider range of scenarios than previous work. Details are presented of the results of a design study, which considers the application of this decomposition PE architecture in a combined SVD/QRD system and demonstrates that a combination of high performance and efficient silicon implementation are achievable. © 2005 IEEE.

CORDIC based application-specific instruction set processor for QRD/SVD

An application specific programmable processor (ASIP) suitable for the real-time implementation of matrix computations such as Singular Value and QR Decomposition is presented. The processor incorporates facilities for the issue of parallel instructions and a dual-bus architecture that are designed to achieve high performance. Internally, it uses a CORDIC module to perform arithmetic operations, with pipelining of the internal recursive loop exploited to multiplex the two independent micro-rotations onto a single piece of hardware. The net result is a flexible processing element whose functionality can be changed under program control, which combines high performance with efficient silicon implementation. This is illustrated through the results of a detailed silicon design study and the applications of the techniques to a combined SVD/QRD system.

The Synergistic Organization of Muscle Recruitment Constrains Visuomotor Adaptation

Reaching to visual targets engages the nervous system in a series of transformations between sensory information and motor commands. That which remains to be determined is the extent to which the processes that mediate sensorimotor adaptation to novel environments engage neural circuits that represent the required movement in joint-based or muscle-based coordinate systems. We sought to establish the contribution of these alternative representations to the process of visuomotor adaptation. To do so we applied a visuomotor rotation during a center-out isometric torque production task that involved flexion/extension and supination/pronation at the elbow-joint complex. In separate sessions, distinct half-quadrant rotations (i.e., 45°) were applied such that adaptation could be achieved either by only rescaling the individual joint torques (i.e., the visual target and torque target remained in the same quadrant) or by additionally requiring torque reversal at a contributing joint (i.e., the visual target and torque target were in different quadrants). Analysis of the time course of directional errors revealed that the degree of adaptation was lower (by ~20%) when reversals in the direction of joint torques were required. It has been established previously that in this task space, a transition between supination and pronation requires the engagement of a different set of muscle synergists, whereas in a transition between flexion and extension no such change is required. The additional observation that the initial level of adaptation was lower and the subsequent aftereffects were smaller, for trials that involved a pronation–supination transition than for those that involved a flexion–extension transition, supports the conclusion that the process of adaptation engaged, at least in part, neural circuits that represent the required motor output in a muscle-based coordinate system.

Violations of Bell's inequality for Gaussian states with homodyne detection and nonlinear interactions

We show that homodyne measurements can be used to demonstrate violations of Bell's inequality with Gaussian states, when the local rotations used for these types of tests are implemented using nonlinear unitary operations. We reveal that the local structure of the Gaussian state under scrutiny is crucial in the performance of the test. The effects of finite detection efficiency are thoroughly studied and shown to only mildly affect the revelation of Bell violations. We speculate that our approach may be extended to other applications such as entanglement distillation where local operations are necessary elements besides quantum entanglement.