A model based factorization approach for dense 3D recovery from monocular video

Feature track matrix factorization based methods have been attractive solutions to the Structure-front-motion (Sfnl) problem. Group motion of the feature points is analyzed to get the 3D information. It is well known that the factorization formulations give rise to rank deficient system of equations. Even when enough constraints exist, the extracted models are sparse due the unavailability of pixel level tracks. Pixel level tracking of 3D surfaces is a difficult problem, particularly when the surface has very little texture as in a human face. Only sparsely located feature points can be tracked and tracking error arc inevitable along rotating lose texture surfaces. However, the 3D models of an object class lie in a subspace of the set of all possible 3D models. We propose a novel solution to the Structure-from-motion problem which utilizes the high-resolution 3D obtained from range scanner to compute a basis for this desired subspace. Adding subspace constraints during factorization also facilitates removal of tracking noise which causes distortions outside the subspace. We demonstrate the effectiveness of our formulation by extracting dense 3D structure of a human face and comparing it with a well known Structure-front-motion algorithm due to Brand.

Molecular genetics of Usher syndrome -inherited deafness and blindness

Usher syndrome (USH) is an inherited blindness and deafness disorder with variable vestibular dysfunction. The syndrome is divided into three subtypes according to the progression and severity of clinical symptoms. The gene mutated in Usher syndrome type 3 (USH3), clarin 1 (CLRN1), was identified in Finland in 2001 and two mutations were identified in Finnish patients at that time. Prior to this thesis study, the two CLRN1 gene mutations were the only USH mutations identified in Finnish USH patients. To further clarify the Finnish USH mutation spectrum, all nine USH genes were studied. Seven mutations were identified: one was a previously known mutation in CLRN1, four were novel mutations in myosin VIIa (MYO7A) and two were a novel and a previously known mutation in usherin (USH2A). Another aim of this thesis research was to further study the structure and function of the CLRN1 gene, and to clarify the effects of mutations on protein function. The search for new splice variants resulted in the identification of eight novel splice variants in addition to the three splice variants that were already known prior to this study. Studies of the possible promoter regions for these splice variants showed the most active region included the 1000 bases upstream of the translation start site in the first exon of the main three exon splice variant. The 232 aa CLRN1 protein encoded by the main (three-exon) splice variant was transported to the plasma membrane when expressed in cultured cells. Western blot studies suggested that CLRN1 forms dimers and multimers. The CLRN1 mutant proteins studied were retained in the endoplasmic reticulum (ER) and some of the USH3 mutations caused CLRN1 to be unstable. During this study, two novel CLRN1 sequence alterations were identified and their pathogenicity was studied with cell culture protein expression. Previous studies with mice had shown that Clrn1 is expressed in mouse cochlear hair cells and spiral ganglion cells, but the expression profile in mouse retina remained unknown. The Clrn1 knockout mice display cochlear cell disruption/death, but do not have a retinal phenotype. The zebrafish, Danio rerio, clrn1 was found to be expressed in hair cells associated with hearing and balance. Clrn1 expression was also found in the inner nuclear layer (INL), photoreceptor layer and retinal pigment epithelium layer (RPE) of the zebrafish retina. When Clrn1 production was knocked down with injected morpholino oligonucleotides (MO) targeting Clrn1 translation or correct splicing, the zebrafish larvae showed symptoms similar to USH3 patients. These larvae had balance/hearing problems and reduced response to visual stimuli. The knowledge this thesis research has provided about the mutations in USH genes and the Finnish USH mutation spectrum are important in USH patient diagnostics. The extended information about the structure and function of CLRN1 is a step further in exploring USH3 pathogenesis caused by mutated CLRN1 as well as a step in finding a cure for the disease.

Mitigating Scarring and Inflammation during Corneal Wound Healing using Nanofiber-Hydrogel Scaffolds

Due to the universal lack of donor tissue, there has been emerging interest in engineering materials to stimulate living cells to restore the features and functions of injured organs. We are particularly interested in developing materials for corneal use, where the necessity to maintain the tissue’s transparency presents an additional challenge. Every year, there are 1.5 – 2 million new cases of monocular blindness due to irregular healing of corneal injuries, dwarfing the approximately 150,000 corneal transplants performed. The large gap between the need and availability of cornea transplantation motivates us to develop a wound-healing scaffold that can prevent corneal blindness.

To develop such a scaffold, it is necessary to regulate the cells responsible for repairing the damaged cornea, namely myofibroblasts, which are responsible for the disordered and non-refractive index matched scar that leads to corneal blindness. Using in vitro assays, we identified that protein nanofibers of certain orientation can promote cell migration and modulate the myofibroblast phenotype. The nanofibers are also transparent, easy to handle and non-cytotoxic. To adhere the nanofibers to a wound bed, we examined the use of two different in situ forming hydrogels: an artificial extracellular matrix protein (aECM)-based gel and a photo-crosslinkable heparin-based gel. Both hydrogels can be formed within minutes, are transparent upon gelation and are easily tunable.

Using an in vivo mouse model for epithelial defects, we show that our corneal scaffolds (nanofibers together with hydrogel) are well-tolerated (no inflammatory response or turbidity) and support epithelium regrowth. We developed an ex vivo corneal tissue culture model where corneas that are wounded and treated with our scaffold can be cultured while retaining their ability to repair wounds for up to 21 days. Using this technique, we found that the aECM-based treatment induced a more favorable wound response than the heparin-based treatment, prompting us to further examine the efficacy of the aECM-based treatment in vivo using a rabbit model for stromal wounds. Results show that treated corneas have fewer myofibroblasts and immune cells than untreated ones, indicating that our corneal scaffold shows promise in promoting a calmer wound response and preventing corneal haze formation.

Ensaio sobre as imagens. A criação do roteiro de Blindness de Fernando Meireles, adaptado do romance: Ensaio sobre a cegueira de José Saramago para as telas de cinema

A dissertação se propõe a investigar as diferentes formas de estruturas narrativas para o desenvolvimento em um roteiro cinematográfico, adaptado de uma obra literária. Para este trabalho, vamos usar como corpus o romance Ensaio sobre a cegueira de José Saramago que foi adaptado pelo roteirista Don Mckellar, originando o filme dirigido por Fernando Meirelles, em 2008. A finalidade deste recorte é mostrar o processo de construção narrativa no audiovisual, tendo como base o livro. Nessa investigação, o suporte para análise do audiovisual será realizado com conceituados especialistas em roteiros cinematográfico como Linda Hutcheon, Robert Mckee, Jean-Claude Carriére, Flávio de Campos e David Howard. As possibilidades da criação do roteiro seguirão o mote em quatro divisões: narrativa, estrutura, ensaio sobre imagens e da palavra para imagem, procurando responder como a linguagem intervém no sentido da palavra para imagem e como ocorre o conceito de autoria nessa vertente da adaptação. A trama de Ensaio sobre a cegueira, traz elementos clássicos da estrutura dramática e amplia sua dimensão em relação ao conteúdo da estória na roteirização de Don Mckellar. Com esta pesquisa, esperamos contribuir para um melhor entendimento na construção e organização de um roteiro no processo de adaptação em si

3D multi-car tracking based on monocular video

We propose a system that can reliably track multiple cars in congested traffic environments. Our system's key basis is the implementation of a sequential Monte Carlo algorithm, which introduces robustness against problems arising due to the proximity between vehicles. By directly modelling occlusions and collisions between cars we obtain promising results on an urban traffic dataset. Extensions to this initial framework are also suggested. © 2010 IEEE.

Optimized selection of key frames for monocular videogrammetric surveying of civil infrastructure

Videogrammetry is an inexpensive and easy-to-use technology for spatial 3D scene recovery. When applied to large scale civil infrastructure scenes, only a small percentage of the collected video frames are required to achieve robust results. However, choosing the right frames requires careful consideration. Videotaping a built infrastructure scene results in large video files filled with blurry, noisy, or redundant frames. This is due to frame rate to camera speed ratios that are often higher than necessary; camera and lens imperfections and limitations that result in imaging noise; and occasional jerky motions of the camera that result in motion blur; all of which can significantly affect the performance of the videogrammetric pipeline. To tackle these issues, this paper proposes a novel method for automating the selection of an optimized number of informative, high quality frames. According to this method, as the first step, blurred frames are removed using the thresholds determined based on a minimum level of frame quality required to obtain robust results. Then, an optimum number of key frames are selected from the remaining frames using the selection criteria devised by the authors. Experimental results show that the proposed method outperforms existing methods in terms of improved 3D reconstruction results, while maintaining the optimum number of extracted frames needed to generate high quality 3D point clouds.© 2012 Elsevier Ltd. All rights reserved.

Unconstrained monocular 3D human pose estimation by action detection and cross-modality regression forest

This work addresses the challenging problem of unconstrained 3D human pose estimation (HPE) from a novel perspective. Existing approaches struggle to operate in realistic applications, mainly due to their scene-dependent priors, such as background segmentation and multi-camera network, which restrict their use in unconstrained environments. We therfore present a framework which applies action detection and 2D pose estimation techniques to infer 3D poses in an unconstrained video. Action detection offers spatiotemporal priors to 3D human pose estimation by both recognising and localising actions in space-time. Instead of holistic features, e.g. silhouettes, we leverage the flexibility of deformable part model to detect 2D body parts as a feature to estimate 3D poses. A new unconstrained pose dataset has been collected to justify the feasibility of our method, which demonstrated promising results, significantly outperforming the relevant state-of-the-arts. © 2013 IEEE.