Kinematic parameters of throwing performance in patients with schizophrenia using a markerless motion capture system

Motor dysfunction is consistently reported but understudied in schizophrenia. It has been hypothesized that this abnormality may reflect a neuro-developmental disorder underlying this illness. The main goal of this study was to analyze movement patterns used by participants with schizophrenia and healthy controls during overarm throwing performance, using a markerless motion capture system. Thirteen schizophrenia patients and 16 healthy control patients performed the overarm throwing task in a markerless motion capture system. Participants were also examined for the presence of motor neurological soft signs (mNSS) using the Brief Motor Scale. Schizophrenia patients demonstrated a less developed movement pattern with low individualization of components compared to healthy controls. The schizophrenia group also displayed a higher incidence of mNSS. The presence of a less mature movement pattern can be an indicator of neuro-immaturity and a marker for atypical neurological development in schizophrenia. Our findings support the understanding of motor dysfunction as an intrinsic part of the disorder of schizophrenia.

Motion capture amb Microsoft Kinect

El proyecto trata de convertirse en una herramienta para animadores 3D, tanto para los que hacen películas como para los que modelan videojuegos, que necesiten de un software para simplificar el trabajo que conlleva animar un modelo 3D. Todo sin necesidad de usar trajes especializados. El proyecto, usando Kinect, convertirá los movimientos captados por la cámara y los agregará al modelo, creando una animación basándose en los movimientos reales de una persona.

Using Three Dimensional Motion Capture Technology to Describe and Assess Piano Technique: A Case Study

The purpose of the study was to examine any differences that exist in the quality of motions employed by pianists when they are sight-reading versus performing repertoire. A secondary question of interest was whether or not an improvement in the efficiency of motion could be observed between two sight-reading trials of the same musical excerpt. While data analysis for the full study is ongoing, the following results from a case study are illustrative.

Progetto e sviluppo di un banco prova per articolazioni protesiche attive ad un grado di libertà basato su programmable automation controller e motion capture

L'elaborato descrive il lavoro svolto in cinque mesi presso il Centro Protesi INAIL di Budrio (BO), che ha portato allo sviluppo di un banco prova per testare articolazioni elettromeccaniche. I dispositivi target, in particolare, sono stati due gomiti mioelettrici: il primo di produzione interna INAIL e il secondo prodotto da Selex ES in collaborazione con il Centro Protesi stesso. Per il controllo del movimento e l'acquisizione dei segnali elettrici si è scelto il PAC CompactRIO (National Instruments), mentre per le acquisizioni cinematiche di angolo e velocità angolare si è sfruttata la stereofotogrammetria.

Ottimizzazione di un'unita di controllo per protesi mioelettrica di arto superiore e confronto prestazionale tramite programmable automation controller e motion capture

Con il passare degli anni le tecnologie nel campo delle protesi mioelettriche di arto superiore stanno compiendo sempre più passi in avanti. In questo elaborato di tesi si darà un iniziale introduzione sulla protesica di arto superiore cercando di coprire tutte le possibili tipologie di protesi, prestando particolare attenzione agli arti artificiali mioelettrici. Gli scopi di questo studio sono in prima analisi una miglioria dell'unità di controllo di una protesi comandata da segnali elettromiografici di superficie, tramite l'utilizzo del nuovo IDE della Microchip (MPLAB X). In seconda analisi, invece, si attuerà un confronto prestazionale a livello di consumo in corrente di un prototipo di protesi mioelettrica nata dalla sinergia tra l'azienda "Selex ES" e il "Centro Protesi INAIL di Vigorso di Budrio". Per questo studio ci si è serviti di stereofotogrammetrica per la determinazione delle grandezze meccaniche, mentre tramite un sistema PAC si è riusciti ad ottenere specifiche grandezze elettriche. Lo studio ha portato, a livello di Firmware, l'inserimento del giusto comando di attuazione di un servofreno comandato in corrente e l'introduzione di una particolare modalità a basso consumo che consente un risparmio energetico di circa il 60% rispetto alla vecchia modalità. Discorso diverso per i risultati del confronto prestazionale che non ha portato ai risultati sperati in fase di progetto.

Real-time Human Motion Capture with Simple Marker Sets and Monocular Video

In this paper we present a hybrid method to track human motions in real-time. With simplified marker sets and monocular video input, the strength of both marker-based and marker-free motion capturing are utilized: A cumbersome marker calibration is avoided while the robustness of the marker-free tracking is enhanced by referencing the tracked marker positions. An improved inverse kinematics solver is employed for real-time pose estimation. A computer-visionbased approach is applied to refine the pose estimation and reduce the ambiguity of the inverse kinematics solutions. We use this hybrid method to capture typical table tennis upper body movements in a real-time virtual reality application.

Depth sensors-based upper limb motion capture system for functional neurorehabilitation

Versatile and accurate motion capture systems, with the required properties to be integrated within both clinical and domiciliary environments, would represent a significant advance in following the progress of the patients as well as in allowing the incorporation of new data exploitation and analysis methods to enhance the functional neurorehabilitation therapeutic processes. Besides, these systems would permit the later development of new applications focused on the automatization of the therapeutic tasks in order to increase the therapist/patient ratio, thus decreasing the costs [1]. However, current motion capture systems are not still ready to work within uncontrolled environments.

Improved Accuracy in Optical Motion Capture Measurements Leads to Increased Sensitivity to Kinematic Changes

Clinical optical motion capture allows us to obtain kinematic and kinetic outcome measures that aid clinicians in diagnosing and treating different pathologies affecting healthy gait. The long term aim for gait centres is for subject-specific analyses that can predict, prevent, or reverse the effects of pathologies through gait retraining. To track the body, anatomical segment coordinate systems are commonly created by applying markers to the surface of the skin over specific, bony anatomy that is manually palpated. The location and placement of these markers is subjective and precision errors of up to 25mm have been reported [1]. Additionally, the selection of which anatomical landmarks to use in segment models can result in large angular differences; for example angular differences in the trunk can range up to 53o for the same motion depending on marker placement [2]. These errors can result in erroneous kinematic outcomes that either diminish or increase the apparent effects of a treatment or pathology compared to healthy data. Our goal was to improve the accuracy and precision of optical motion capture outcome measures. This thesis describes two separate studies. In the first study we aimed to establish an approach that would allow us to independently quantify the error among trunk models. Using this approach we determined if there was a best model to accurately track trunk motion. In the second study we designed a device to improve precision for test, re-test protocols that would also reduce the set-up time for motion capture experiments. Our method to compare a kinematically derived centre of mass velocity to one that was derived kinetically was successful in quantifying error among trunk models. Our findings indicate that models that use lateral shoulder markers as well as limit the translational degrees of freedom of the trunk through shared pelvic markers result in the least amount of error for the tasks we studied. We also successfully reduced intra- and inter-operator anatomical marker placement errors using a marker alignment device. The improved accuracy and precision resulting from the methods established in this thesis may lead to increased sensitivity to changes in kinematics, and ultimately result in more consistent treatment outcomes.

MIMU sensors for joint kinematic estimation: anatomical landmarking and frame correction

The ability to capture human motion allows researchers to evaluate an individual’s gait. Gait can be measured in different ways, from camera-based systems to Magnetic and Inertial Measurement Units (MIMU). The former uses cameras to track positional information of photo-reflective markers, while the latter uses accelerometers, gyroscopes, and magnetometers to measure segment orientation. Both systems can be used to measure joint kinematics, but the results vary because of their differences in anatomical calibrations. The objective of this thesis was to study potential solutions for reducing joint angle discrepancies between MIMU and camera-based systems. The first study worked to correct the anatomical frame differences between MIMU and camera-based systems via the joint angles of both systems. This study looked at full lower body correction versus correcting a single joint. Single joint correction showed slightly better alignment of both systems, but does not take into account that body segments are generally affected by more than one joint. The second study explores the possibility of anatomical landmarking using a single camera and a pointer apparatus. Results showed anatomical landmark position could be determined using a single camera, as the anatomical landmarks found from this study and a camera-based system showed similar results. This thesis worked on providing a novel way for obtaining anatomical landmarks with a single point-and-shoot camera, as well aligning anatomical frames between MIMUs and camera-based systems using joint angles.

VISUAL-INERTIAL INTEGRATION FOR HUMAN MOTION TRACKING AND NAVIGATION IN FREE-LIVING ENVIRONMENTS

The aging population has become a burning issue for all modern societies around the world recently. There are two important issues existing now to be solved. One is how to continuously monitor the movements of those people having suffered a stroke in natural living environment for providing more valuable feedback to guide clinical interventions. The other one is how to guide those old people effectively when they are at home or inside other buildings and to make their life easier and convenient. Therefore, human motion tracking and navigation have been active research fields with the increasing number of elderly people. However, motion capture has been extremely challenging to go beyond laboratory environments and obtain accurate measurements of human physical activity especially in free-living environments, and navigation in free-living environments also poses some problems such as the denied GPS signal and the moving objects commonly presented in free-living environments. This thesis seeks to develop new technologies to enable accurate motion tracking and positioning in free-living environments. This thesis comprises three specific goals using our developed IMU board and the camera from the imaging source company: (1) to develop a robust and real-time orientation algorithm using only the measurements from IMU; (2) to develop a robust distance estimation in static free-living environments to estimate people’s position and navigate people in static free-living environments and simultaneously the scale ambiguity problem, usually appearing in the monocular camera tracking, is solved by integrating the data from the visual and inertial sensors; (3) in case of moving objects viewed by the camera existing in free-living environments, to firstly design a robust scene segmentation algorithm and then respectively estimate the motion of the vIMU system and moving objects. To achieve real-time orientation tracking, an Adaptive-Gain Orientation Filter (AGOF) is proposed in this thesis based on the basic theory of deterministic approach and frequency-based approach using only measurements from the newly developed MARG (Magnet, Angular Rate, and Gravity) sensors. To further obtain robust positioning, an adaptive frame-rate vision-aided IMU system is proposed to develop and implement fast vIMU ego-motion estimation algorithms, where the orientation is estimated in real time from MARG sensors in the first step and then used to estimate the position based on the data from visual and inertial sensors. In case of the moving objects viewed by the camera existing in free-living environments, a robust scene segmentation algorithm is firstly proposed to obtain position estimation and simultaneously the 3D motion of moving objects. Finally, corresponding simulations and experiments have been carried out.

Spatio-temporal gait analysis in children with cerebral palsy using, foot-worn inertial sensors.

A child's natural gait pattern may be affected by the gait laboratory environment. Wearable devices using body-worn sensors have been developed for gait analysis. The purpose of this study was to validate and explore the use of foot-worn inertial sensors for the measurement of selected spatio-temporal parameters, based on the 3D foot trajectory, in independently walking children with cerebral palsy (CP). We performed a case control study with 14 children with CP aged 6-15 years old and 15 age-matched controls. Accuracy and precision of the foot-worn device were measured using an optical motion capture system as the reference system. Mean accuracy±precision for both groups was 3.4±4.6cm for stride length, 4.3±4.2cm/s for speed and 0.5±2.9° for strike angle. Longer stance and shorter swing phases with an increase in double support were observed in children with CP (p=0.001). Stride length, speed and peak angular velocity during swing were decreased in paretic limbs, with significant differences in strike and lift-off angles. Children with cerebral palsy showed significantly higher inter-stride variability (measured by their coefficient of variation) for speed, stride length, swing and stance. During turning trajectories speed and stride length decreased significantly (p<0.01) for both groups, whereas stance increased significantly (p<0.01) in CP children only. Foot-worn inertial sensors allowed us to analyze gait spatiotemporal data outside a laboratory environment with good accuracy and precision and congruent results with what is known of gait variations during linear walking in children with CP.

3D gait assessment in young and elderly subjects using foot-worn inertial sensors.

This study describes the validation of a new wearable system for assessment of 3D spatial parameters of gait. The new method is based on the detection of temporal parameters, coupled to optimized fusion and de-drifted integration of inertial signals. Composed of two wirelesses inertial modules attached on feet, the system provides stride length, stride velocity, foot clearance, and turning angle parameters at each gait cycle, based on the computation of 3D foot kinematics. Accuracy and precision of the proposed system were compared to an optical motion capture system as reference. Its repeatability across measurements (test-retest reliability) was also evaluated. Measurements were performed in 10 young (mean age 26.1±2.8 years) and 10 elderly volunteers (mean age 71.6±4.6 years) who were asked to perform U-shaped and 8-shaped walking trials, and then a 6-min walking test (6MWT). A total of 974 gait cycles were used to compare gait parameters with the reference system. Mean accuracy±precision was 1.5±6.8cm for stride length, 1.4±5.6cm/s for stride velocity, 1.9±2.0cm for foot clearance, and 1.6±6.1° for turning angle. Difference in gait performance was observed between young and elderly volunteers during the 6MWT particularly in foot clearance. The proposed method allows to analyze various aspects of gait, including turns, gait initiation and termination, or inter-cycle variability. The system is lightweight, easy to wear and use, and suitable for clinical application requiring objective evaluation of gait outside of the lab environment.

Functional calibration procedure for 3D knee joint angle description using inertial sensors.

Measurement of three-dimensional (3D) knee joint angle outside a laboratory is of benefit in clinical examination and therapeutic treatment comparison. Although several motion capture devices exist, there is a need for an ambulatory system that could be used in routine practice. Up-to-date, inertial measurement units (IMUs) have proven to be suitable for unconstrained measurement of knee joint differential orientation. Nevertheless, this differential orientation should be converted into three reliable and clinically interpretable angles. Thus, the aim of this study was to propose a new calibration procedure adapted for the joint coordinate system (JCS), which required only IMUs data. The repeatability of the calibration procedure, as well as the errors in the measurement of 3D knee angle during gait in comparison to a reference system were assessed on eight healthy subjects. The new procedure relying on active and passive movements reported a high repeatability of the mean values (offset<1 degrees) and angular patterns (SD<0.3 degrees and CMC>0.9). In comparison to the reference system, this functional procedure showed high precision (SD<2 degrees and CC>0.75) and moderate accuracy (between 4.0 degrees and 8.1 degrees) for the three knee angle. The combination of the inertial-based system with the functional calibration procedure proposed here resulted in a promising tool for the measurement of 3D knee joint angle. Moreover, this method could be adapted to measure other complex joint, such as ankle or elbow.

Heel and toe clearance estimation for gait analysis using wireless inertial sensors.

Tripping is considered a major cause of fall in older people. Therefore, foot clearance (i.e., height of the foot above ground during swing phase) could be a key factor to better understand the complex relationship between gait and falls. This paper presents a new method to estimate clearance using a foot-worn and wireless inertial sensor system. The method relies on the computation of foot orientation and trajectory from sensors signal data fusion, combined with the temporal detection of toe-off and heel-strike events. Based on a kinematic model that automatically estimates sensor position relative to the foot, heel and toe trajectories are estimated. 2-D and 3-D models are presented with different solving approaches, and validated against an optical motion capture system on 12 healthy adults performing short walking trials at self-selected, slow, and fast speed. Parameters corresponding to local minimum and maximum of heel and toe clearance were extracted and showed accuracy ± precision of 4.1 ± 2.3 cm for maximal heel clearance and 1.3 ± 0.9 cm for minimal toe clearance compared to the reference. The system is lightweight, wireless, easy to wear and to use, and provide a new and useful tool for routine clinical assessment of gait outside a dedicated laboratory.