Applicazioni di Mixed Reality e Microsoft Hololens: studio e riprogettazione del concetto di ologramma e della relativa gestione all'interno di un'applicazione olografica.

La tesi presenta una panoramica sull'augmented, virtual e mixed reality, descrivendone le caratteristiche e le modalità di sviluppo. Come caso di studio viene analizzato il dispositivo Microsoft Hololens, descrivendone le caratteristiche concettuali, hardware e software. Per le applicazioni di questo dispositivo viene effettuata una riprogettazione della gestione e del concetto di ologramma all'interno di un'applicazione olografica, analizzandone i motivi e i vantaggi. E' fornita una overview sui dettagli implementativi della riprogettazione al fine di chiarire ogni aspetto dell'applicazione.

Learning at the Interstices; Locating Practical Philosophies for Understanding Physical/virtual Inter-spaces

Virtual worlds are relatively recent developments, and so it is tempting to believe that they need to be understood through newly developed theories and philosophies. However, humans have long thought about the nature of reality and what it means to be “real.” This paper examines the three persistent philosophical concepts of Metaxis, Liminality and Space that have evolved across more than 2000 years of meditation, contemplation and reflection. Our particular focus here is on the nature of the interface between the virtual and the physical: at the interstices, and how the nature of transactions and transitions across those interfaces may impact upon learning. This may, at first, appear to be an esoteric pursuit, but we ground our arguments in primary and secondary data from research studies in higher education.

Applying Augmented Reality to Outdoors Industrial Use

Augmented Reality (AR) is currently gaining popularity in multiple different fields. However, the technology for AR still requires development in both hardware and software when considering industrial use. In order to create immersive AR applications, more accurate pose estimation techniques to define virtual camera location are required. The algorithms for pose estimation often require a lot of processing power, which makes robust pose estimation a difficult task when using mobile devices or designated AR tools. The difficulties are even larger in outdoor scenarios where the environment can vary a lot and is often unprepared for AR. This thesis aims to research different possibilities for creating AR applications for outdoor environments. Both hardware and software solutions are considered, but the focus is more on software. The majority of the thesis focuses on different visual pose estimation and tracking techniques for natural features. During the thesis, multiple different solutions were tested for outdoor AR. One commercial AR SDK was tested, and three different custom software solutions were developed for an Android tablet. The custom software solutions were an algorithm for combining data from magnetometer and a gyroscope, a natural feature tracker and a tracker based on panorama images. The tracker based on panorama images was implemented based on an existing scientific publication, and the presented tracker was further developed by integrating it to Unity 3D and adding a possibility for augmenting content. This thesis concludes that AR is very close to becoming a usable tool for professional use. The commercial solutions currently available are not yet ready for creating tools for professional use, but especially for different visualization tasks some custom solutions are capable of achieving a required robustness. The panorama tracker implemented in this thesis seems like a promising tool for robust pose estimation in unprepared outdoor environments.

Multi-physics modelling - A vital component of virtual manufacturing

One of the core tasks of the virtual-manufacturing environment is to characterise the transformation of the state of material during each of the unit processes. This transformation in shape, material properties, etc. can only be reliably achieved through the use of models in a simulation context. Unfortunately, many manufacturing processes involve the material being treated in both the liquid and solid state, the trans-formation of which may be achieved by heat transfer and/or electro-magnetic fields. The computational modelling of such processes, involving the interactions amongst various interacting phenomena, is a consider-able challenge. However, it must be addressed effectively if Virtual Manufacturing Environments are to become a reality! This contribution focuses upon one attempt to develop such a multi-physics computational toolkit. The approach uses a single discretisation procedure and provides for direct interaction amongst the component phenomena. The need to exploit parallel high performance hardware is addressed so that simulation elapsed times can be brought within the realms of practicality. Examples of Multiphysics modelling in relation to shape casting, and solder joint formation reinforce the motivation for this work.

Redes de conversação como possibilidade de formação do professor tutor virtual na mediação pedagógica da educação profissional a distância

A educação a distância apoiada pelos meios de comunicação digital ampliou as possibilidades de interação, flexibilizando o processo de mediação pedagógica no tempo e no espaço. Nessa perspectiva, a educação profissional democratizou seu acesso, na qual os conhecimentos de nível técnico são customizados em um Ambiente Virtual de Aprendizagem (AVA) para serem mediados a distância. Esta tese, apresentada na forma de artigos, problematiza o processo de mediação pedagógica realizado pelo professor tutor virtual na Rede e-Tec Brasil do Instituto Federal de Educação, Ciência e Tecnologia Sul-rio-grandense (IFSul) Campus Visconde da Graça (CAVG). Nesse modelo de ensino, o professor tutor virtual é contratado para atuar, pelo período de dois anos, em todas as disciplinas curriculares de um curso técnico. Se, por um lado, isso permite-lhe conhecer a realidade de seus alunos; por outro, exige-lhe um esforço pedagógico de apropriação e mediação dos conteúdos específicos nas diversas disciplinas que integram os currículos de cada curso. A pesquisa buscou conhecer como o professor tutor virtual apropria-se dos conhecimentos específicos nos cursos técnicos para mediá-los pedagogicamente com os alunos. Apresentamos, como hipótese explicativa neste estudo, que é na convivência com o professor pesquisador que o professor tutor virtual encontra a possibilidade de se apropriar dos conhecimentos curriculares para poder mediá-los pedagogicamente com os alunos. Para sustentar teoricamente nossas proposições na experiência vivida, estabelecemos uma rede de conversação com os autores Humberto Maturana, Pierre Lévy, Lee Shulman e Maurice Tardif, por meio dos conceitos: cultura em redes de conversação; inteligência coletiva; conhecimento pedagógico do conteúdo; e formação profissional docente. Como procedimento metodológico, encontramos na técnica do Discurso do Sujeito Coletivo (DSC), de Lefèvre e Lefèvre, uma estratégia de abordagem qualitativa para analisar as recorrências encontradas nos discursos dos professores tutores virtuais. O estudo aponta que uma rede de conversação recursiva entre o professor pesquisador e o professor tutor virtual possibilita a apropriação de conhecimentos técnicos e específicos necessários ao processo de mediação pedagógica com os estudantes. Essa convivência, no caminho da constituição de um coletivo inteligente, favorece o trabalho colaborativo no ambiente da tutoria, contribuindo para profissionalizar o processo de mediação pedagógica na educação profissional a distância do IFSul CAVG. Supported by digital media, distance learning has increased the possibilities of interaction, easing the process of pedagogical mediation in time and space. From this perspective, the access to professional education has been democratized: technical knowledge is customized in a Learning Managing System and later delivered by means of mediated distance education courses. Structured in a sequence of articles, this dissertation addresses the problem of the pedagogical mediation process performed by on-line tutor teachers at Rede e-Tec Brasil of the Instituto Federal Sul- rio-grandense (IF-Sul), Campus Visconde da Graça (CAVG). This model of education establishes that on-line tutor teachers are hired to work with all the curriculum courses of a technical program for two years. If, on the hand, it allows these teachers to know the reality of their students well, on the other hand it demands them a pedagogical effort of appropriation and mediation of the specific contents guiding the various courses that comprise the curriculum of each program. This research aimed to find out how on-line tutor teachers appropriate expertise from technical programs to mediate it with their students in a pedagogical way. The explanatory hypothesis given is that by working together and sharing experience with the teacher/researcher, on-line tutor teachers will be able to appropriate of curricular knowledge and pedagogically mediate it with their students afterwards. To support our theoretical propositions, a network of conversation was established with authors like Humberto Maturana, Pierre Lévy, Lee Shulman, and Maurice Tardif through the concepts of culture in networks of conversation, collective intelligence, pedagogical content knowledge, and teacher training. As a methodological procedure, the technique of the Collective Subject Discourse (CSD), by Lefèvre and Lefèvre, was found to offer a strategy of qualitative approach to analyze the recurrences seen in the speech of on-line tutor teachers. The study shows that a recursive network of conversation between the teacher/researcher and the on-line tutor teacher enables the appropriation of specific and technical knowledge required for the process of pedagogical mediation with students. The experience of sharing a consensual professional relationship, in which one respects and accepts the other as a way of establishing a collective intelligence, encourages collaborative work in the tutoring environment, helping professionalize the process of pedagogical mediation in distance professional education at IFSul CAVG.

Miradouro Virtual(R)

Esta tese pretende descrever o desenvolvimento e arquitectura do software que constitui o Miradouro Virtual@, mais especificamente do componente referente à interface. O Miradouro Virtual@ é um dispositivo cujo propósito à semelhança dos tradicionais binóculos turísticos, é observar a paisagem, mas cuja interacção não está limitada à simples observação individual. Recorre à realidade aumentada para sobrepôr imagens geradas por computador a imagens reais, capturadas por um dispositivo para aquisição de imagem real (tipicamente uma câmara de vídeo), e mostra-as num ecrã touchscreen, permitindo deste modo, combinar elementos virtuais e multimédia com a paisagem real. A imagem final, composta, dá ao utilizador uma nova dimensão do espaço envolvente, permitindo-lhe explorar uma nova camada de informação não visível anteriormente. Sendo sensíveis à orientação do Miradouro Virtual@, os elementos virtuais e multimédia adaptam-se de acordo com os movimentos do dispositivo. O Miradouro Virtual@ é um produto composto por diversos elementos de hardware e software. O foco desta tese recai apenas nos componentes de software, mais especificamente na interface. Pretende dar a conhecer as limitações da versão anterior do software e mostrar as soluções encontradas que permitiram ultrapassar algumas dessas limitações. ABSTRACT; This thesis focuses on the design and development of the Virtual Sightseeing™ software, more specifically on the interface component. The Virtual Sightseeing™ is a device similar to the traditional scenic viewers that takes advantage of its generally known and popularity to build an innovative system. It works by using augmented reality to superimpose, in real-time, images generated by a computer onto a live stream captured by a video camera and displaying them on a touchscreen display. It allows adding multimedia elements to the real scenery by composing them in the image that is presented to the user. The multimedia information and virtual elements that are displayed are sensitive to the orientation and position of the device. They change as the user manually changes the orientation of the device. The Virtual Sightseeing™ is comprised of several hardware and software components. The focus of this thesis is on the software part, more specifically on the interface component. It intends to show the known limitations of the previous software version and how they were overcome in this new version.

O museu virtual Google Art Project : um estudo de caso em contexto de ensino-aprendizagem da educação visual

A educação na arte e pela arte confere a todos os seus intervenientes a estimulação da sua criatividade e da sua consciência cultural, proporcionando meios para se exprimirem e participarem ativamente no mundo que nos rodeia. A integração das tecnologias de informação e comunicação no processo de ensino-aprendizagem veio alargar o papel que a arte pode desempenhar neste processo, promovendo novas formas de aprender, de ensinar e de pensar. Assim, a utilização de ambientes virtuais em contexto educativo tem revelado um enorme potencial, sobretudo ao nível da comunicação e da interação entre alunos e obras de arte. Neste sentido, considerou-se importante desenvolver um estudo de caso em contexto de sala de aula da Educação Visual, promovendo uma aprendizagem baseada na articulação entre a observação, interpretação e análise da obra de arte e o museu virtual. Assim o principal objetivo deste estudo foi avaliar as potencialidades do Google Art Project, enquanto objeto de aprendizagem, na promoção da aprendizagem na área da literacia em artes. Para além disso, procurámos ainda avaliar se a utilização de ferramentas multimédia como o referido Google Art Project e o Quadro Interativo, constituem fatores de motivação na aprendizagem da disciplina de Educação Visual. Do ponto de vista metodológico desenvolvemos uma estratégia baseada na investigação-ação. Procurámos, por um lado, descobrir e compreender o significado de uma realidade vivida por um grupo de alunos e, por outro lado, refletir sobre a prática educativa com o intuito de a melhorar e transformar. Este estudo envolveu cinco turmas do sexto ano do ensino público. Para a recolha de dados utilizámos técnicas baseadas na conversação e na observação, no questionário e nas notas de campo. Os resultados deste estudo revelam que as ferramentas tecnológicas utilizadas podem efetivamente contribuir para a promoção da aprendizagem dos alunos na área da Educação Visual, mais concretamente ao nível do domínio da literacia artística, da representação e da interpretação visual.

Design and Development of a Research Framework for Prototyping Control Tower Augmented Reality Tools

The purpose of the air traffic management system is to ensure the safe and efficient flow of air traffic. Therefore, while augmenting efficiency, throughput and capacity in airport operations, attention has rightly been placed on doing it in a safe manner. In the control tower, many advances in operational safety have come in the form of visualization tools for tower controllers. However, there is a paradox in developing such systems to increase controllers' situational awareness: by creating additional computer displays, the controller's vision is pulled away from the outside view and the time spent looking down at the monitors is increased. This reduces their situational awareness by forcing them to mentally and physically switch between the head-down equipment and the outside view. This research is based on the idea that augmented reality may be able to address this issue. The augmented reality concept has become increasingly popular over the past decade and is being proficiently used in many fields, such as entertainment, cultural heritage, aviation, military & defense. This know-how could be transferred to air traffic control with a relatively low effort and substantial benefits for controllers’ situation awareness. Research on this topic is consistent with SESAR objectives of increasing air traffic controllers’ situation awareness and enable up to 10 % of additional flights at congested airports while still increasing safety and efficiency. During the Ph.D., a research framework for prototyping augmented reality tools was set up. This framework consists of methodological tools for designing the augmented reality overlays, as well as of hardware and software equipment to test them. Several overlays have been designed and implemented in a simulated tower environment, which is a virtual reconstruction of Bologna airport control tower. The positive impact of such tools was preliminary assessed by means of the proposed methodology.

Application of augmented reality in craniofacial surgery: a feasibility study

Augmented Reality (AR) is a novel promising technology, which is gaining success in the medical field. A number of applications in surgery have been described, but few studies have been focusing on pediatric craniofacial surgery. In this research project, the Authors have been implementing a system for intraoperative surgical navigation by means of HoloLens 2 by Microsoft, applied to pediatric craniofacial surgery. The Authors tested the device in a preclinical setting first, and then moved to patients. The Authors assessed the accuracy of the HoloLens 2 by performing 36 procedures in vitro on a printed 3D model of a patient. In clinical setting, 10 patients were prospectively enrolled in the study. The virtual surgical planning was designed for each patient and uploaded onto the software which allows for the AR interface and the standard neurosurgical navigator. For each patient, the surgeon has been drawing osteotomy lines both under the guidance of HoloLens2 and of the neurosurgical navigator. The Author then checked the accuracy with calibrated CAD CAM cutting guides with different grooves, in order to assess the accuracy of the osteotomies performed. We tested levels of accuracy of ±1.5 mm and ±1mm . In the preclinical setting, the HoloLens 2 performed with levels of accuracy of 1.5 mm, whereas in the real setting, surgeons were able to trace the osteotomy lines under the AR guidance for an amount of 45% (0.4 SD) of the entire line, with an accuracy level of ±1.5 mm. This percentage lowers to 34% (0.4 SD) when assessing accuracy level of ±1 mm. The results of the same tasks for the standard navigator are 36% and 16%, for ±1.5 mm and ± 1 mm accuracy level, respectively. The Authors reported encouraging results both in the preclinical and the clinical setting.

The road to augmented reality: a comprehensive study of hardware and applications over the last ten years

Augmented reality has been growing extensively over the years in all aspects and multiple fields. My aim in this paper is to present a comprehensive study on augmented reality(AR) hardware and its applications from early developments to the possible future trends. Particularly my research is more focused on last 11 years(2012-2022), where I systematically reviewed 30 research papers per year to get a clear knowledge on trends of AR. A total of 330 publications were reviewed and grouped according to their application. The review's main contribution is to show the entire landscape of AR research and to provide a broad view of how it has evolved. Along with various AR glasses history and specifications are presented in detail. In the penultimate chapter I explained my methodology of research following my analysis from the past to the present along with my thoughts for the future. To conclude my study, In the final chapter I made some statements about possible future with AR, VR and XR(extended reality).

Enhanced switchgear connection testing through augmented reality: early developments

Augmented reality is an emerging field of interactive design in which virtual material is seamlessly blended with displays of real world environments. The tremendous potential of augmented reality has begun to be explored with the emergence of personal mobile devices capable of constructing engaging augmented reality experiences. This work is part of a project aiming at using augmented reality goggles to bring advance information to the user interacting with switch-gear during automation cabling. In particular we will be focusing on the recognition and definition of the figures of the component on the AR device. In this part we are using standard camera that allows us to get real images and helps us to localize the gearbox in space through ARUCO marker and we can exploit in order to re-project the actual shape of the component that are currently interested in manipulation by exploiting the data provided by the database. The experiments are carried out using the camera to get the images of the real world switch-gear and re-project those images with the component superimposed on it. Using transforms of the database we did localization to re-project the rendered image of component exactly on the real world component, which can be further integrated in AR goggles to see the component superimposed in real-time.

Avoiding Pitfalls Of Intraoperative Peripheral Endovascular Surgery With The Aid Of Osirix: Expanding The Use Of Virtual Fluoroscopy.

We have shown how the analysis of the angiotomography reconstruction through OsiriX program has assisted in endovascular perioperative programming. We presented its application in situations when an unexpected existence of metallic overlapping artifact (orthopedic osteosynthesis) compromised the adequate visualization of the arterial lesion during the procedure. Through manipulation upon OsiriX software, with assistance of preview under virtual fluoroscopy, it was possible to obtain the angles that would avoid this juxtaposition. These angles were reproduced in the C-arm, allowing visualization of the occluded segment, reducing the need for repeated image acquisitions and contrast overload, allowing the continuation of the procedure.

O ambiente virtual de aprendizagem e sua incorporação na Unicamp

The text describes a study about the adoption of virtual learning environments and its consequences to the learning process of undergraduate students at the State University of Campinas - Unicamp. These environments can be incorporated in various ways into the academic daily life of students and teachers. One efficient way to promote the adoption of these environments, as observed by the Distance Learning support team, is to train teachers and students in their use. Two training alternatives are described in this text to instruct the academic community in the use of TelEduc, a freeware developed and coordinated by the NIED - Núcleo de Informática Aplicada à Educação (Center for Information Technology Applied to Education), and officially adopted by Unicamp. Training courses are offered in two ways - presence or distance learning - to suit each teacher's preferences. This article compares the two modes of training, showing their strong and weak points. The adoption of TelEduc and its direct consequences to the learning process are described in a study carried out with some engineering undergraduates at Unicamp. The authors' questions and the general views of teachers and students regarding the effectiveness of the use of TelEduc as a supporting tool to presence teaching are presented. This investigation revealed the importance of training teachers in the effective use of these environments.

Centro esportivo virtual : um recurso de informação em educação fisica e esportes na internet

Universidade Estadual de Campinas . Faculdade de Educação Física