Deep learning for computer vision: a comparison between convolutional neural networks and hierarchical temporal memories on object recognition tasks

In recent years, Deep Learning techniques have shown to perform well on a large variety of problems both in Computer Vision and Natural Language Processing, reaching and often surpassing the state of the art on many tasks. The rise of deep learning is also revolutionizing the entire field of Machine Learning and Pattern Recognition pushing forward the concepts of automatic feature extraction and unsupervised learning in general. However, despite the strong success both in science and business, deep learning has its own limitations. It is often questioned if such techniques are only some kind of brute-force statistical approaches and if they can only work in the context of High Performance Computing with tons of data. Another important question is whether they are really biologically inspired, as claimed in certain cases, and if they can scale well in terms of "intelligence". The dissertation is focused on trying to answer these key questions in the context of Computer Vision and, in particular, Object Recognition, a task that has been heavily revolutionized by recent advances in the field. Practically speaking, these answers are based on an exhaustive comparison between two, very different, deep learning techniques on the aforementioned task: Convolutional Neural Network (CNN) and Hierarchical Temporal memory (HTM). They stand for two different approaches and points of view within the big hat of deep learning and are the best choices to understand and point out strengths and weaknesses of each of them. CNN is considered one of the most classic and powerful supervised methods used today in machine learning and pattern recognition, especially in object recognition. CNNs are well received and accepted by the scientific community and are already deployed in large corporation like Google and Facebook for solving face recognition and image auto-tagging problems. HTM, on the other hand, is known as a new emerging paradigm and a new meanly-unsupervised method, that is more biologically inspired. It tries to gain more insights from the computational neuroscience community in order to incorporate concepts like time, context and attention during the learning process which are typical of the human brain. In the end, the thesis is supposed to prove that in certain cases, with a lower quantity of data, HTM can outperform CNN.

Numerical model of the human cornea based on stromal microstructure: identification of mechanical properties for two age groups

The optical quality of the human eye mainly depends on the refractive performance of the cornea. The shape of the cornea is a mechanical balance between intraocular pressure and tissue intrinsic stiffness. Several surgical procedures in ophthalmology alter the biomechanics of the cornea to provoke local or global curvature changes for vision correction. Legitimated by the large number of surgical interventions performed every day, the demand for a deeper understanding of corneal biomechanics is rising to improve the safety of procedures and medical devices. The aim of our work is to propose a numerical model of corneal biomechanics, based on the stromal microstructure. Our novel anisotropic constitutive material law features a probabilistic weighting approach to model collagen fiber distribution as observed on human cornea by Xray scattering analysis (Aghamohammadzadeh et. al., Structure, February 2004). Furthermore, collagen cross-linking was explicitly included in the strain energy function. Results showed that the proposed model is able to successfully reproduce both inflation and extensiometry experimental data (Elsheikh et. al., Curr Eye Res, 2007; Elsheikh et. al., Exp Eye Res, May 2008). In addition, the mechanical properties calculated for patients of different age groups (Group A: 65-79 years; Group B: 80-95 years) demonstrate an increased collagen cross-linking, and a decrease in collagen fiber elasticity from younger to older specimen. These findings correspond to what is known about maturing fibrous biological tissue. Since the presented model can handle different loading situations and includes the anisotropic distribution of collagen fibers, it has the potential to simulate clinical procedures involving nonsymmetrical tissue interventions. In the future, such mechanical model can be used to improve surgical planning and the design of next generation ophthalmic devices.

Properties of low-threshold motor axons in the human median nerve

This study investigated the excitability and accommodative properties of low-threshold human motor axons to test whether these motor axons have greater expression of the persistent Na(+) conductance, I(NaP). Computer-controlled threshold tracking was used to study 22 single motor units and the data were compared with compound motor potentials of various amplitudes recorded in the same experimental session. Detailed comparisons were made between the single units and compound potentials that were 40% or 5% of maximal amplitude, the former because this is the compound potential size used in most threshold tracking studies of axonal excitability, the latter because this is the compound potential most likely to be composed entirely of motor axons with low thresholds to electrical recruitment. Measurements were made of the strength-duration relationship, threshold electrotonus, current-voltage relationship, recovery cycle and latent addition. The findings did not support a difference in I(NaP). Instead they pointed to greater activity of the hyperpolarization-activated inwardly rectifying current (I(h)) as the basis for low threshold to electrical recruitment in human motor axons. Computer modelling confirmed this finding, with a doubling of the hyperpolarization-activated conductance proving the best single parameter adjustment to fit the experimental data. We suggest that the hyperpolarization-activated cyclic nucleotide-gated (HCN) channel(s) expressed on human motor axons may be active at rest and contribute to resting membrane potential.

Mesh-based vs. Image-based Statistical Appearance Model of the Human Femur: a Preliminary Comparison Study for the Creation of Finite Element Meshes

Statistical models have been recently introduced in computational orthopaedics to investigate the bone mechanical properties across several populations. A fundamental aspect for the construction of statistical models concerns the establishment of accurate anatomical correspondences among the objects of the training dataset. Various methods have been proposed to solve this problem such as mesh morphing or image registration algorithms. The objective of this study is to compare a mesh-based and an image-based statistical appearance model approaches for the creation of nite element(FE) meshes. A computer tomography (CT) dataset of 157 human left femurs was used for the comparison. For each approach, 30 finite element meshes were generated with the models. The quality of the obtained FE meshes was evaluated in terms of volume, size and shape of the elements. Results showed that the quality of the meshes obtained with the image-based approach was higher than the quality of the mesh-based approach. Future studies are required to evaluate the impact of this finding on the final mechanical simulations.

Ultrasound-guided percutaneous tracheal puncture: a computer-tomographic controlled study in cadavers

Ultrasound-guided techniques are increasingly used in anaesthetic practice to identify tissues beneath the skin and to increase the accuracy of placement of needles close to targeted structures. To examine ultrasound's usefulness for dilatational tracheostomy, we performed ultrasound-guided tracheal punctures in human cadavers followed by computer-tomographic (CT) control.

Feature Versus Spatial Strategies by Orangutans (Pongo abelii) and Human Children (Homo sapiens) in a Cross-Dimensional Task

Despite the fact that photographic stimuli are used across experimental contexts with both human and nonhuman subjects, the nature of individuals' perceptions of these stimuli is still not well understood. In the present experiments, we tested whether three orangutans and 36 human children could use photographic information presented on a computer screen to solve a perceptually corresponding problem in the physical domain. Furthermore, we tested the cues that aided in this process by pitting featural information against spatial position in a series of probe trials. We found that many of the children and one orangutan were successfully able to use the information cross-dimensionally; however, the other two orangutans and almost a quarter of the children failed to acquire the task. Species differences emerged with respect to ease of task acquisition. More striking, however, were the differences in cues that participants used to solve the task: Whereas the orangutan used a spatial strategy, the majority of children used a feature one. Possible reasons for these differences are discussed from both evolutionary and developmental perspectives. The novel results found here underscore the need for further testing in this area to design appropriate experimental paradigms in future comparative research settings.

Surfactant protein D modulates allergen particle uptake and inflammatory response in a human epithelial airway model

Background Allergen-containing subpollen particles (SPP) are released from whole plant pollen upon contact with water or even high humidity. Because of their size SPP can preferentially reach the lower airways where they come into contact with surfactant protein (SP)-D. The aim of the present study was to investigate the influence of SP-D in a complex three-dimensional human epithelial airway model, which simulates the most important barrier functions of the epithelial airway. The uptake of SPP as well as the secretion of pro-inflammatory cytokines was investigated. Methods SPP were isolated from timothy grass and subsequently fluorescently labeled. A human epithelial airway model was built by using human Type II-pneumocyte like cells (A549 cells), human monocyte derived macrophages as well as human monocyte derived dendritic cells. The epithelial cell model was incubated with SPP in the presence and absence of surfactant protein D. Particle uptake was evaluated by confocal microscopy and advanced computer-controlled analysis. Finally, human primary CD4+ T-Cells were added to the epithelial airway model and soluble mediators were measured by enzyme linked immunosorbent assay or bead array. Results SPP were taken up by epithelial cells, macrophages, and dendritic cells. This uptake coincided with secretion of pro-inflammatory cytokines and chemokines. SP-D modulated the uptake of SPP in a cell type specific way (e.g. increased number of macrophages and epithelial cells, which participated in allergen particle uptake) and led to a decreased secretion of pro-inflammatory cytokines. Conclusion These results display a possible mechanism of how SP-D can modulate the inflammatory response to inhaled allergen.

Creation of Computer Simulation Model for Ecological Consequences Prognosis of Toxic Chemicals Discharge from Sunken on Baltic Sea Bottom Weapons"

This study summarises all the accessible data on old German chemical weapons dumped in the Baltic Sea. Mr. Goncharov formulated a concept of ecological impact evaluation of chemical warfare agents (CWA) on the marine environment and structured a simulation model adapted to the specific character of the hydrological condition and hydrobiological subjects of the Bornholm Deep. The mathematical model he has created describes the spreading of contaminants by currents and turbulence in the near bottom boundary layer. Parameters of CWA discharge through corrosion of canisters were given for various kinds of bottom sediments with allowance for current velocity. He created a method for integral estimations and a computer simulation model and completed a forecast for CWA "Mustard", which showed that in normal hydrometeorological conditions there are local toxic plumes drifting along the bottom for a distance of up to several kilometres. With storm winds the toxic plumes from separate canisters interflow and lengthen and can reach fishery areas near Bornholm Island. When salt water from the North Sea flows in, the length of toxic zones can increase up to and over 100 kilometres and toxic water masses can spread into the northern Baltic. On this basis, Mr. Goncharov drew up recommendations to reduce dangers for human ecology and proposed the creation of a special system for the forecasting and remote sensing of the environmental conditions of CWA burial places.

Computer-assisted arthroplasty using bioengineered autografts

Recent advances in tissue-engineered cartilage open the door to new clinical treatments of joint lesions. Common to all therapies with in-vitro-engineered autografts is the need for optimal fit of the construct to allow screwless implantation and optimal integration into the live joint. Computer-assisted surgery (CAS) techniques are prime candidates to ensure the required accuracy, while at the same time simplifying the procedure. A pilot study has been conducted aiming at assembling a new set of methods to support ankle joint arthroplasty using bioengineered autografts. Computer assistance allows planning of the implant shape on a computed tomography (CT) image, manufacturing the construct according to the plan, and interoperatively navigating the surgical tools for implantation. A rotational symmetric model of the joint surface was used to avoid segmentation of the CT image; new software was developed to determine the joint axis and make the implant shape parameterizable. A complete cycle of treatment from planning to operation was conducted on a human cadaveric foot, thus proving the feasibility of computer-assisted arthroplasty using bioengineered autografts

Real-time Human Motion Capture with Simple Marker Sets and Monocular Video

In this paper we present a hybrid method to track human motions in real-time. With simplified marker sets and monocular video input, the strength of both marker-based and marker-free motion capturing are utilized: A cumbersome marker calibration is avoided while the robustness of the marker-free tracking is enhanced by referencing the tracked marker positions. An improved inverse kinematics solver is employed for real-time pose estimation. A computer-visionbased approach is applied to refine the pose estimation and reduce the ambiguity of the inverse kinematics solutions. We use this hybrid method to capture typical table tennis upper body movements in a real-time virtual reality application.

Embedding of human vertebral bodies leads to higher ultimate load and altered damage localisation under axial compression

Computer tomography (CT)-based finite element (FE) models of vertebral bodies assess fracture load in vitro better than dual energy X-ray absorptiometry, but boundary conditions affect stress distribution under the endplates that may influence ultimate load and damage localisation under post-yield strains. Therefore, HRpQCT-based homogenised FE models of 12 vertebral bodies were subjected to axial compression with two distinct boundary conditions: embedding in polymethylmethalcrylate (PMMA) and bonding to a healthy intervertebral disc (IVD) with distinct hyperelastic properties for nucleus and annulus. Bone volume fraction and fabric assessed from HRpQCT data were used to determine the elastic, plastic and damage behaviour of bone. Ultimate forces obtained with PMMA were 22% higher than with IVD but correlated highly (R2 = 0.99). At ultimate force, distinct fractions of damage were computed in the endplates (PMMA: 6%, IVD: 70%), cortex and trabecular sub-regions, which confirms previous observations that in contrast to PMMA embedding, failure initiated underneath the nuclei in healthy IVDs. In conclusion, axial loading of vertebral bodies via PMMA embedding versus healthy IVD overestimates ultimate load and leads to distinct damage localisation and failure pattern.

Bone mineral density (BMD) and computer tomographic measurements of the equine proximal phalanx in correlation with breaking strength

Despite the fact that bone mineral density (BMD) is an important fracture risk predictor in human medicine, studies in equine orthopedic research are still lacking. We hypothesized that BMD correlates with bone failure and fatigue fractures of this bone. Thus, the objectives of this study were to measure the structural and mechanical properties of the proximal phalanx with dual energy X-ray absorptiometry (DXA), to correlate the data obtained from DXA and computer tomography (CT) measurements to those obtained by loading pressure examination and to establish representative region of interest (ROI) for in vitro BMD measurements of the equine proximal phalanx for predicting bone failure force. DXA was used to measure the whole bone BMD and additional three ROI sites in 14 equine proximal phalanges. Following evaluation of the bone density, whole bone, cortical width and area in the mid-diaphyseal plane were measured on CT images. Bones were broken using a manually controlled universal bone crusher to measure bone failure force and reevaluated for the site of fractures on follow-up CT images. Compressive load was applied at a constant displacement rate of 2 mm/min until failure, defined as the first clear drop in the load measurement. The lowest BMD was measured at the trabecular region (mean +/- SD: 1.52 +/- 0.12 g/cm2; median: 1.48 g/cm2; range: 1.38-1.83 g/cm2). There was a significant positive linear correlation between trabelcular BMD and the breaking strength (P = 0.023, r = 0.62). The trabecular region of the proximal phalanx appears to be the only significant indicator of failure of strength in vitro. This finding should be reassessed to further reveal the prognostic value of trabecular BMD in an in vivo fracture risk model.