Impact of bulk cardiac motion on right coronary MR angiography and vessel wall imaging.

The purpose of this study was to investigate the impact of in-plane coronary artery motion on coronary magnetic resonance angiography (MRA) and coronary MR vessel wall imaging. Free-breathing, navigator-gated, 3D-segmented k-space turbo field echo ((TFE)/echo-planar imaging (EPI)) coronary MRA and 2D fast spin-echo coronary vessel wall imaging of the right coronary artery (RCA) were performed in 15 healthy adult subjects. Images were acquired at two different diastolic time periods in each subject: 1) during a subject-specific diastasis period (in-plane velocity <4 cm/second) identified from analysis of in-plane coronary artery motion, and 2) using a diastolic trigger delay based on a previously implemented heart-rate-dependent empirical formula. RCA vessel wall imaging was only feasible with subject-specific middiastolic acquisition, while the coronary wall could not be identified with the heart-rate-dependent formula. For coronary MRA, RCA border definition was improved by 13% (P < 0.001) with the use of subject-specific trigger delay (vs. heart-rate-dependent delay). Subject-specific middiastolic image acquisition improves 3D TFE/EPI coronary MRA, and is critical for RCA vessel wall imaging.

3D coronary vessel wall imaging utilizing a local inversion technique with spiral image acquisition.

Current 2D black blood coronary vessel wall imaging suffers from a relatively limited coverage of the coronary artery tree. Hence, a 3D approach facilitating more extensive coverage would be desirable. The straightforward combination of a 3D-acquisition technique together with a dual inversion prepulse can decrease the effectiveness of the black blood preparation. To minimize artifacts from insufficiently suppressed blood signal of the nearby blood pools, and to reduce residual respiratory motion artifacts from the chest wall, a novel local inversion technique was implemented. The combination of a nonselective inversion prepulse with a 2D selective local inversion prepulse allowed for suppression of unwanted signal outside a user-defined region of interest. Among 10 subjects evaluated using a 3D-spiral readout, the local inversion pulse effectively suppressed signal from ventricular blood, myocardium, and chest wall tissue in all cases. The coronary vessel wall could be visualized within the entire imaging volume.

Cardiac motion estimation by joint alignment of tagged MRI sequences

Image registration has been proposed as an automatic method for recovering cardiac displacement fields from Tagged Magnetic Resonance Imaging (tMRI) sequences. Initially performed as a set of pairwise registrations, these techniques have evolved to the use of 3D+t deformation models, requiring metrics of joint image alignment (JA). However, only linear combinations of cost functions defined with respect to the first frame have been used. In this paper, we have applied k-Nearest Neighbors Graphs (kNNG) estimators of the -entropy (H ) to measure the joint similarity between frames, and to combine the information provided by different cardiac views in an unified metric. Experiments performed on six subjects showed a significantly higher accuracy (p < 0.05) with respect to a standard pairwise alignment (PA) approach in terms of mean positional error and variance with respect to manually placed landmarks. The developed method was used to study strains in patients with myocardial infarction, showing a consistency between strain, infarction location, and coronary occlusion. This paper also presentsan interesting clinical application of graph-based metric estimators, showing their value for solving practical problems found in medical imaging.

Automatic quality assessment in structural brain magnetic resonance imaging

MRI has evolved into an important diagnostic technique in medical imaging. However, reliability of the derived diagnosis can be degraded by artifacts, which challenge both radiologists and automatic computer-aided diagnosis. This work proposes a fully-automatic method for measuring image quality of three-dimensional (3D) structural MRI. Quality measures are derived by analyzing the air background of magnitude images and are capable of detecting image degradation from several sources, including bulk motion, residual magnetization from incomplete spoiling, blurring, and ghosting. The method has been validated on 749 3D T(1)-weighted 1.5T and 3T head scans acquired at 36 Alzheimer's Disease Neuroimaging Initiative (ADNI) study sites operating with various software and hardware combinations. Results are compared against qualitative grades assigned by the ADNI quality control center (taken as the reference standard). The derived quality indices are independent of the MRI system used and agree with the reference standard quality ratings with high sensitivity and specificity (>85%). The proposed procedures for quality assessment could be of great value for both research and routine clinical imaging. It could greatly improve workflow through its ability to rule out the need for a repeat scan while the patient is still in the magnet bore.

Comparison of Roadway Roughness Derived from LIDAR and SFM 3D Point Clouds, HR-3001, 2015

This report describes a short-term study undertaken to investigate the potential for using dense three-dimensional (3D) point clouds generated from light detection and ranging (LIDAR) and photogrammetry to assess roadway roughness. Spatially continuous roughness maps have potential for the identification of localized roughness features, which would be a significant improvement over traditional profiling methods. This report specifically illustrates the use of terrestrial laser scanning (TLS) and photogrammetry using a process known as structure from motion (SFM) to acquire point clouds and illustrates the use of these point clouds in evaluating road roughness. Five roadway sections were chosen for scanning and testing: three gravel road sections, one portland cement concrete (PCC) section, and one asphalt concrete (AC) section. To compare clouds obtained from terrestrial laser scanning and photogrammetry, the coordinates of the clouds for the same section on the same date were matched using open source computer code. The research indicates that the technologies described are very promising for evaluating road roughness. The major advantage of both technologies is the large amount of data collected, which allows the evaluation of the full surface. Additional research is needed to further develop the use of dense 3D point clouds for roadway assessment.

Computer Aided Detection and measurement of peripheral artery disease.

Computer-Aided Tomography Angiography (CTA) images are the standard for assessing Peripheral artery disease (PAD). This paper presents a Computer Aided Detection (CAD) and Computer Aided Measurement (CAM) system for PAD. The CAD stage detects the arterial network using a 3D region growing method and a fast 3D morphology operation. The CAM stage aims to accurately measure the artery diameters from the detected vessel centerline, compensating for the partial volume effect using Expectation Maximization (EM) and a Markov Random field (MRF). The system has been evaluated on phantom data and also applied to fifteen (15) CTA datasets, where the detection accuracy of stenosis was 88% and the measurement accuracy was with an 8% error.

Free-breathing whole-heart coronary MRA with 3D radial SSFP and self-navigated image reconstruction.

Respiratory motion is a major source of artifacts in cardiac magnetic resonance imaging (MRI). Free-breathing techniques with pencil-beam navigators efficiently suppress respiratory motion and minimize the need for patient cooperation. However, the correlation between the measured navigator position and the actual position of the heart may be adversely affected by hysteretic effects, navigator position, and temporal delays between the navigators and the image acquisition. In addition, irregular breathing patterns during navigator-gated scanning may result in low scan efficiency and prolonged scan time. The purpose of this study was to develop and implement a self-navigated, free-breathing, whole-heart 3D coronary MRI technique that would overcome these shortcomings and improve the ease-of-use of coronary MRI. A signal synchronous with respiration was extracted directly from the echoes acquired for imaging, and the motion information was used for retrospective, rigid-body, through-plane motion correction. The images obtained from the self-navigated reconstruction were compared with the results from conventional, prospective, pencil-beam navigator tracking. Image quality was improved in phantom studies using self-navigation, while equivalent results were obtained with both techniques in preliminary in vivo studies.

Real-time MR imaging of myocardial regional function using strain-encoding (SENC) with tissue through-plane motion tracking.

PURPOSE: To implement real-time myocardial strain-encoding (SENC) imaging in combination with tracking the tissue displacement in the through-plane direction. MATERIALS AND METHODS: SENC imaging was combined with the slice-following technique by implementing three-dimensional (3D) selective excitation. Certain adjustments were implemented to reduce scan time to one heartbeat. A total of 10 volunteers and five pigs were scanned on a 3T MRI scanner. Spatial modulation of magnetization (SPAMM)-tagged images were acquired on planes orthogonal to the SENC planes for comparison. Myocardial infarction (MI) was induced in two pigs and the resulting SENC images were compared to standard delayed-enhancement (DE) images. RESULTS: The strain values computed from SENC imaging with slice-following showed significant difference from those acquired without slice-following, especially during systole (P < 0.01). The strain curves computed from the SENC images with and without slice-following were similar to those computed from the orthogonal SPAMM images, with and without, respectively, tracking the tag line displacement in the strain direction. The resulting SENC images showed good agreement with the DE images in identifying MI in infarcted pigs. CONCLUSION: Correction of through-plane motion in real-time cardiac functional imaging is feasible using slice-following. The strain measurements are more accurate than conventional SENC measurements in humans and animals, as validated with conventional MRI tagging.

Forecasting coal resources and reserves in heterogeneous coal zones using 3D facies models (As Pontes Basin, NW Spain)

Forecasting coal resources and reserves is critical for coal mine development. Thickness maps are commonly used for assessing coal resources and reserves; however they are limited for capturing coal splitting effects in thick and heterogeneous coal zones. As an alternative, three-dimensional geostatistical methods are used to populate facies distributionwithin a densely drilled heterogeneous coal zone in the As Pontes Basin (NWSpain). Coal distribution in this zone is mainly characterized by coal-dominated areas in the central parts of the basin interfingering with terrigenous-dominated alluvial fan zones at the margins. The three-dimensional models obtained are applied to forecast coal resources and reserves. Predictions using subsets of the entire dataset are also generated to understand the performance of methods under limited data constraints. Three-dimensional facies interpolation methods tend to overestimate coal resources and reserves due to interpolation smoothing. Facies simulation methods yield similar resource predictions than conventional thickness map approximations. Reserves predicted by facies simulation methods are mainly influenced by: a) the specific coal proportion threshold used to determine if a block can be recovered or not, and b) the capability of the modelling strategy to reproduce areal trends in coal proportions and splitting between coal-dominated and terrigenousdominated areas of the basin. Reserves predictions differ between the simulation methods, even with dense conditioning datasets. Simulation methods can be ranked according to the correlation of their outputs with predictions from the directly interpolated coal proportion maps: a) with low-density datasets sequential indicator simulation with trends yields the best correlation, b) with high-density datasets sequential indicator simulation with post-processing yields the best correlation, because the areal trends are provided implicitly by the dense conditioning data.

Tuotteen suunnitteluketjun tehostaminen 3D-ympäristössä

Tämä diplomityö on tehty Andritz Oy:lle Washers & Filters tuoteryhmään. Työ on osa 3D-suunnittelujärjestelmän käyttöönottoprojektia. Tavoitteena on arvioida uuden laitesuunnittelujärjestelmän vaikutuksia yrityksen tietojärjestelmiin ja toimintatapoihin sekä etsiä potentiaalisia tulevaisuuden kehityskohteita. Suunnittelutietoa hyödyntäviä sidosryhmien edustajia haastattelemalla selvitettiin järjestelmille ja ohjelmistoille asetettavia vaatimuksia. Ohjelmistoihin tutustumalla saatiin käsitys niiden nykytilasta ja kehityssuunnista. 3D-geometrian hyödyntämiseen perustuvilla järjestelmillä voidaan poistaa päällekäistä työtä sekä lyhentää läpimenoaikoja suunnittelussa ja valmistuksessa sijoittamalla työvaiheita rinnakkain. Suurimmat 3D-suunnittelun edut saavutetaan tuotekehitysvaiheessa, tuotemuutoksia tehtäessä sekä valmistusprosesseja suunniteltaessa. Ongelmallisimmat osa-alueet tietojärjestelmien kehittämisessä ovat ensi-sijaisesti tiedonsiirto ohjelmistojen välillä, työntekijöiden muutosvastarinta sekä laadukkaiden järjestelmien korkea hinta. Laajojen tietojärjestelmä-projektien läpivienti on hyvin haastavaa ja onnistuminen vaatii kaikkien sidosryhmien mukana olemista ja tarkkaa projektin koordinointia.

Cardiovascular magnetic resonance imaging techniques for motion-suppressed multi-dimensional coronary artery imaging with high spatial and temporal resolution

L'imagerie par résonance magnétique (IRM) peut fournir aux cardiologues des informations diagnostiques importantes sur l'état de la maladie de l'artère coronarienne dans les patients. Le défi majeur pour l'IRM cardiaque est de gérer toutes les sources de mouvement qui peuvent affecter la qualité des images en réduisant l'information diagnostique. Cette thèse a donc comme but de développer des nouvelles techniques d'acquisitions des images IRM, en changeant les techniques de compensation du mouvement, pour en augmenter l'efficacité, la flexibilité, la robustesse et pour obtenir plus d'information sur le tissu et plus d'information temporelle. Les techniques proposées favorisent donc l'avancement de l'imagerie des coronaires dans une direction plus maniable et multi-usage qui peut facilement être transférée dans l'environnement clinique. La première partie de la thèse s'est concentrée sur l'étude du mouvement des artères coronariennes sur des patients en utilisant la techniques d'imagerie standard (rayons x), pour mesurer la précision avec laquelle les artères coronariennes retournent dans la même position battement après battement (repositionnement des coronaires). Nous avons découvert qu'il y a des intervalles dans le cycle cardiaque, tôt dans la systole et à moitié de la diastole, où le repositionnement des coronaires est au minimum. En réponse nous avons développé une nouvelle séquence d'acquisition (T2-post) capable d'acquérir les données aussi tôt dans la systole. Cette séquence a été testée sur des volontaires sains et on a pu constater que la qualité de visualisation des artère coronariennes est égale à celle obtenue avec les techniques standard. De plus, le rapport signal sur bruit fourni par la séquence d'acquisition proposée est supérieur à celui obtenu avec les techniques d'imagerie standard. La deuxième partie de la thèse a exploré un paradigme d'acquisition des images cardiaques complètement nouveau pour l'imagerie du coeur entier. La technique proposée dans ce travail acquiert les données sans arrêt (free-running) au lieu d'être synchronisée avec le mouvement cardiaque. De cette façon, l'efficacité de la séquence d'acquisition est augmentée de manière significative et les images produites représentent le coeur entier dans toutes les phases cardiaques (quatre dimensions, 4D). Par ailleurs, l'auto-navigation de la respiration permet d'effectuer cette acquisition en respiration libre. Cette technologie rend possible de visualiser et évaluer l'anatomie du coeur et de ses vaisseaux ainsi que la fonction cardiaque en quatre dimensions et avec une très haute résolution spatiale et temporelle, sans la nécessité d'injecter un moyen de contraste. Le pas essentiel qui a permis le développement de cette technique est l'utilisation d'une trajectoire d'acquisition radiale 3D basée sur l'angle d'or. Avec cette trajectoire, il est possible d'acquérir continûment les données d'espace k, puis de réordonner les données et choisir les paramètres temporel des images 4D a posteriori. L'acquisition 4D a été aussi couplée avec un algorithme de reconstructions itératif (compressed sensing) qui permet d'augmenter la résolution temporelle tout en augmentant la qualité des images. Grâce aux images 4D, il est possible maintenant de visualiser les artères coronariennes entières dans chaque phase du cycle cardiaque et, avec les mêmes données, de visualiser et mesurer la fonction cardiaque. La qualité des artères coronariennes dans les images 4D est la même que dans les images obtenues avec une acquisition 3D standard, acquise en diastole Par ailleurs, les valeurs de fonction cardiaque mesurées au moyen des images 4D concorde avec les valeurs obtenues avec les images 2D standard. Finalement, dans la dernière partie de la thèse une technique d'acquisition a temps d'écho ultra-court (UTE) a été développée pour la visualisation in vivo des calcifications des artères coronariennes. Des études récentes ont démontré que les acquisitions UTE permettent de visualiser les calcifications dans des plaques athérosclérotiques ex vivo. Cepandent le mouvement du coeur a entravé jusqu'à maintenant l'utilisation des techniques UTE in vivo. Pour résoudre ce problème nous avons développé une séquence d'acquisition UTE avec trajectoire radiale 3D et l'avons testée sur des volontaires. La technique proposée utilise une auto-navigation 3D pour corriger le mouvement respiratoire et est synchronisée avec l'ECG. Trois échos sont acquis pour extraire le signal de la calcification avec des composants au T2 très court tout en permettant de séparer le signal de la graisse depuis le signal de l'eau. Les résultats sont encore préliminaires mais on peut affirmer que la technique développé peut potentiellement montrer les calcifications des artères coronariennes in vivo. En conclusion, ce travail de thèse présente trois nouvelles techniques pour l'IRM du coeur entier capables d'améliorer la visualisation et la caractérisation de la maladie athérosclérotique des coronaires. Ces techniques fournissent des informations anatomiques et fonctionnelles en quatre dimensions et des informations sur la composition du tissu auparavant indisponibles. CORONARY artery magnetic resonance imaging (MRI) has the potential to provide the cardiologist with relevant diagnostic information relative to coronary artery disease of patients. The major challenge of cardiac MRI, though, is dealing with all sources of motions that can corrupt the images affecting the diagnostic information provided. The current thesis, thus, focused on the development of new MRI techniques that change the standard approach to cardiac motion compensation in order to increase the efficiency of cardioavscular MRI, to provide more flexibility and robustness, new temporal information and new tissue information. The proposed approaches help in advancing coronary magnetic resonance angiography (MRA) in the direction of an easy-to-use and multipurpose tool that can be translated to the clinical environment. The first part of the thesis focused on the study of coronary artery motion through gold standard imaging techniques (x-ray angiography) in patients, in order to measure the precision with which the coronary arteries assume the same position beat after beat (coronary artery repositioning). We learned that intervals with minimal coronary artery repositioning occur in peak systole and in mid diastole and we responded with a new pulse sequence (T2~post) that is able to provide peak-systolic imaging. Such a sequence was tested in healthy volunteers and, from the image quality comparison, we learned that the proposed approach provides coronary artery visualization and contrast-to-noise ratio (CNR) comparable with the standard acquisition approach, but with increased signal-to-noise ratio (SNR). The second part of the thesis explored a completely new paradigm for whole- heart cardiovascular MRI. The proposed techniques acquires the data continuously (free-running), instead of being triggered, thus increasing the efficiency of the acquisition and providing four dimensional images of the whole heart, while respiratory self navigation allows for the scan to be performed in free breathing. This enabling technology allows for anatomical and functional evaluation in four dimensions, with high spatial and temporal resolution and without the need for contrast agent injection. The enabling step is the use of a golden-angle based 3D radial trajectory, which allows for a continuous sampling of the k-space and a retrospective selection of the timing parameters of the reconstructed dataset. The free-running 4D acquisition was then combined with a compressed sensing reconstruction algorithm that further increases the temporal resolution of the 4D dataset, while at the same time increasing the overall image quality by removing undersampling artifacts. The obtained 4D images provide visualization of the whole coronary artery tree in each phases of the cardiac cycle and, at the same time, allow for the assessment of the cardiac function with a single free- breathing scan. The quality of the coronary arteries provided by the frames of the free-running 4D acquisition is in line with the one obtained with the standard ECG-triggered one, and the cardiac function evaluation matched the one measured with gold-standard stack of 2D cine approaches. Finally, the last part of the thesis focused on the development of ultrashort echo time (UTE) acquisition scheme for in vivo detection of calcification in the coronary arteries. Recent studies showed that UTE imaging allows for the coronary artery plaque calcification ex vivo, since it is able to detect the short T2 components of the calcification. The heart motion, though, prevented this technique from being applied in vivo. An ECG-triggered self-navigated 3D radial triple- echo UTE acquisition has then been developed and tested in healthy volunteers. The proposed sequence combines a 3D self-navigation approach with a 3D radial UTE acquisition enabling data collection during free breathing. Three echoes are simultaneously acquired to extract the short T2 components of the calcification while a water and fat separation technique allows for proper visualization of the coronary arteries. Even though the results are still preliminary, the proposed sequence showed great potential for the in vivo visualization of coronary artery calcification. In conclusion, the thesis presents three novel MRI approaches aimed at improved characterization and assessment of atherosclerotic coronary artery disease. These approaches provide new anatomical and functional information in four dimensions, and support tissue characterization for coronary artery plaques.

3D-tuoteyhdistelmämallien ja mittakuvien tuottaminen PDM-järjestelmästä

Tämä diplomityö on selvitystyö mittakuvien ja kolmiulotteisten CAD-mallien tuottamisesta. Mittakuvat ja 3D-CAD-mallit halutaan Neles-tuotemerkin omaaville tuotteille. Olennaisena osana työssä on tuotetiedonhallintajärjestelmä AtonPDM, koska mittakuvia ja malleja toivottaisiin hallittavan AtonPDM-järjestelmällä. Työ tehdään Metso Automationin (MA) Flow Control (FC) –liiketoimintalinjalle. Nykyiset mittakuvat aiheuttavat ongelmia sekä MA:ssa että asiakkaille. MA:ssa mittakuvien tekeminen kestää kauemmin kuin asiakas toivoisi. Nykyisen mittakuvaohjelmiston riittämättömät ominaisuudet aiheuttavat lisätyötä mittakuvien valmistuksessa. Asiakkaille mittakuvien viivästyminen on suunnittelua hidastava tekijä. Mittakuvissa olevat virheet ja puutteet vaikeuttavat asiakkaan suunnittelutyötä ja saattavat päästä läpi tarkatuksien myös loppusuunnitelmiin, jolloin seurauksena voi olla rahallisia menetyksiä. Tämän päivän putkistosuunnittelu hoidetaan suurimmaksi osaksi 3D-CADohjelmistoilla. Suunnittelua helpotetaan ja nopeutetaan valmiilla komponenttien 3Dmalleilla, joihin on liitetty tuotetietoa. Työssä on haastateltu MA:n henkilökuntaa, CAD-järjestelmien toimittajia ja asiakkaita. Haastattelut ovat työn tärkein tiedonlähde. Teoriatietoa on selvitetty kirjoista, lehdistä ja internetistä. Teoriaosiossa käydään läpi tuotetiedonhallinta (Product Data Management, PDM), tietokanta ja parametrinen mallintaminen. Työn lopputuloksena on pyritty saamaan kuvaus siitä miten tuotetaan 3D-CAD-mallit ja mittakuvat Neles-tuotteista käyttäen tiedonlähteenä AtonPDM:ää ja millaisia 3Dmallien ja mittakuvien tulee olla. Malleja ja mittakuvia tuottavaan järjestelmään on etsitty ratkaisuja CAD-ohjelmistoista. Ratkaisuja on verrattu keskenään ominaisuuksien, joustavuuden ja AtonPDM yhteensopivuuden perusteella.

Apnea-like suppression of respiratory motion: First evaluation in radiotherapy.

BACKGROUND AND PURPOSE: Compensation for respiratory motion is needed while administering radiotherapy (RT) to tumors that are moving with respiration to reduce the amount of irradiated normal tissues and potentially decrease radiation-induced collateral damages. The purpose of this study was to test a new ventilation system designed to induce apnea-like suppression of respiratory motion and allow long enough breath hold durations to deliver complex RT. MATERIAL AND METHODS: The High Frequency Percussive Ventilation system was initially tested in a series of 10 volunteers and found to be well tolerated, allowing a median breath hold duration of 11.6min (range 3.9-16.5min). An evaluation of this system was subsequently performed in 4 patients eligible for adjuvant breast 3D conformal RT, for lung stereotactic body RT (SBRT), lung volumetric modulated arc therapy (VMAT), and VMAT for palliative pleural metastases. RESULTS: When compared to free breathing (FB) and maximal inspiration (MI) gating, this Percussion Assisted RT (PART) offered favorable dose distribution profiles in 3 out of the 4 patients tested. PART was applied in these 3 patients with good tolerance, without breaks during the "beam on time period" throughout the overall courses of RT. The mean duration of the apnea-like breath hold that was necessary for delivering all the RT fractions was 7.61min (SD=2.3). CONCLUSIONS: This first clinical implementation of PART was found to be feasible, tolerable and offers new opportunities in the field of RT for suppressing respiratory motion.

Strategies to evaluate the impact of rectal volume on prostate motion during three-dimensional conformal radiotherapy for prostate cancer

Abstract Objective: To evaluate the rectal volume influence on prostate motion during three-dimensional conformal radiotherapy (3D-CRT) for prostate cancer. Materials and Methods: Fifty-one patients with prostate cancer underwent a series of three computed tomography scans including an initial planning scan and two subsequent scans during 3D-CRT. The organs of interest were outlined. The prostate contour was compared with the initial CT images considering the anterior, posterior, superior, inferior and lateral edges of the organ. Variations in the anterior limits and volume of the rectum were assessed and correlated with prostate motion in the anteroposterior direction. Results: The maximum range of prostate motion was observed in the superoinferior direction, followed by the anteroposterior direction. A significant correlation was observed between prostate motion and rectal volume variation ( p = 0.037). A baseline rectal volume superior to 70 cm3 had a significant influence on the prostate motion in the anteroposterior direction ( p = 0.045). Conclusion: The present study showed a significant interfraction motion of the prostate during 3D-CRT with greatest variations in the superoinferior and anteroposterior directions, and that a large rectal volume influences the prostate motion with a cutoff value of 70 cm3. Therefore, the treatment of patients with a rectal volume > 70 cm3 should be re-planned with appropriate rectal preparation.

Bowing the violin : a case study for auditory-motor pattern modelling in the context of music performance

This project addresses methodological and technological challenges in the development of multi-modal data acquisition and analysis methods for the representation of instrumental playing technique in music performance through auditory-motor patterning models. The case study is violin playing: a multi-modal database of violin performances has been constructed by recording different musicians while playing short exercises on different violins. The exercise set and recording protocol have been designed to sample the space defined by dynamics (from piano to forte) and tone (from sul tasto to sul ponticello), for each bow stroke type being played on each of the four strings (three different pitches per string) at two different tempi. The data, containing audio, video, and motion capture streams, has been processed and segmented to facilitate upcoming analyses. From the acquired motion data, the positions of the instrument string ends and the bow hair ribbon ends are tracked and processed to obtain a number of bowing descriptors suited for a detailed description and analysis of the bow motion patterns taking place during performance. Likewise, a number of sound perceptual attributes are computed from the audio streams. Besides the methodology and the implementation of a number of data acquisition tools, this project introduces preliminary results from analyzing bowing technique on a multi-modal violin performance database that is unique in its class. A further contribution of this project is the data itself, which will be made available to the scientific community through the repovizz platform.