Virtual Reality as a tool to Assist Learning in Aerospace Assembly

This study examines whether virtual reality (VR) is more superior to paper-based instructions in increasing the speed at which individuals learn a new assembly task. Specifically, the work seeks to quantify any learning benefits when individuals have been given the opportunity and compares the performance of two groups using virtual and hardcopy media types to pre-learn the task. A build experiment based on multiple builds of an aircraft panel showed that a group of people who pre-learned the assembly task using a VR environment completed their builds faster (average build time 29.5% lower). The VR group also made fewer references to instructional materials (average number of references 38% lower) and made fewer errors than a group using more traditional, hard copy instructions. These outcomes were more pronounced during build one with differences in build time and number of references showing limited statistical differences.

Simulations in 3D research : Can Unity3D be used to simulate a 3D display system?

Mid Sweden University is currently researching how to capture more of a scene with a camera and how to create 3D images that does not require extra equipment for the viewer. In the process of this research they have started looking into simulating some of the tests that they wish to conduct. The goal of this project is to research whether the 3D graphics engine Unity3D could be used to simulate these tests, and to what degree. To test this a simulation was designed and implemented. The simulation used a split display system where each camera is directly connected to a part of the screen and using the position of the viewer the correct part of the camera feed is shown. Some literary studies were also done into how current 3D technology works. The simulation was successfully implemented and shows that simple simulation can be done in Unity3D, however, some problems were encountered in the process. The conclusion of the project show that there is much work left before simulation is viable but that there is potential in the technology and that the research team should continue to investigate it.

Aceitação e uso de ambiente virtual de aprendizagem no contexto de um curso de capacitação para servidores públicos

This study aimed to examine how students perceives the factors that may influence them to attend a training course offered in the distance virtual learning environment (VLE) of the National School of Public Administration (ENAP). Thus, as theoretical basis it was used the Unified Theory of Acceptance and Use of Technology (UTAUT), the result of an integration of eight previous models which aimed to explain the same phenomenon (acceptance/use of information technology). The research approach was a quantitative and qualitative. To achieve the study objectives were made five semi-structured interviews and an online questionnaire (websurvey) in a valid sample of 101 public employees scattered throughout the country. The technique used to the analysis of quantitative data was the structural equation modeling (SEM), by the method of Partial Least Square Path Modeling (PLS-PM). To qualitative data was the thematic content analysis. Among the results, it was found that, in the context of public service, the degree whose the individual believes that the use of an AVA will help its performance at work (performance expectancy) is a factor to its intended use and also influence its use. Among the results, it was found that the belief which the public employee has in the use of a VLE as a way to improve the performance of his work (performance expectation) was determinant for its intended use that, in turn, influenced their use. It was confirmed that, under the voluntary use of technology, the general opinion of the student s social circle (social influence) has no effect on their intention to use the VLE. The effort expectancy and facilitating conditions were not directly related to the intended use and use, respectively. However, emerged from the students speeches that the opinions of their coworkers, the ease of manipulate the VLE, the flexibility of time and place of the distance learning program and the presence of a tutor are important to their intentions to do a distance learning program. With the results, it is expected that the managers of the distance learning program of ENAP turn their efforts to reduce the impact of the causes of non-use by those unwilling to adopt voluntarily the e-learning, and enhance the potentialities of distance learning for those who are already users

Utilização de um ambiente virtual de aprendizagem: um estudo na perspectiva da prática docente

Advances related to information technology are visible and inherent to the management of contemporary organizations, regardless of industrial action. Synchronized with this dynamic, educational institutions are incorporating technological tools that assist its management and academic support to teachers in teaching and interaction with the students. Given that technological innovations are not always taken homogeneously and with the same degree of coverage, remain current and relevant studies on how these technologies are being used in academia. The objective of this research is to identify the usage profile of the functionality of a virtual learning environment related to teaching (undergraduate or postgraduate), demographic variables (age and gender) and institutional (time of admission and academic center of origin.) The methodology applied to the study is descriptive and quantitative. The research is characterized as census, covering all 2152 teachers of undergraduate and graduate students of the Federal University of Rio Grande do Norte, Brazil, who accessed the virtual classes of the Integrated Management of Academic Activities. The study findings revealed that there is a statistically significant difference regarding the use of these tools to teachers who work with undergraduate (49.3%) compared to graduate (6.6%). Regarding gender, women (40.1%) use the system more than men (38.5%). It was also observed that the younger teachers, aged 37 years, are the most active users (42.5%) of the Virtual Class with respect to their elders. For teachers with up to three years time of admission to the UFRN, the pattern of use is more advanced than those with more seniority, as well as the faculty of the Center for Science and Technology are the least likely to use the tools available in relation to other academic centers. It is hoped that with this study managers can direct actions to improve and expand the use of this environment by teachers

On precise three-dimensional environment modeling via UAV-based photogrammetric systems

Abstract : Images acquired from unmanned aerial vehicles (UAVs) can provide data with unprecedented spatial and temporal resolution for three-dimensional (3D) modeling. Solutions developed for this purpose are mainly operating based on photogrammetry concepts, namely UAV-Photogrammetry Systems (UAV-PS). Such systems are used in applications where both geospatial and visual information of the environment is required. These applications include, but are not limited to, natural resource management such as precision agriculture, military and police-related services such as traffic-law enforcement, precision engineering such as infrastructure inspection, and health services such as epidemic emergency management. UAV-photogrammetry systems can be differentiated based on their spatial characteristics in terms of accuracy and resolution. That is some applications, such as precision engineering, require high-resolution and high-accuracy information of the environment (e.g. 3D modeling with less than one centimeter accuracy and resolution). In other applications, lower levels of accuracy might be sufficient, (e.g. wildlife management needing few decimeters of resolution). However, even in those applications, the specific characteristics of UAV-PSs should be well considered in the steps of both system development and application in order to yield satisfying results. In this regard, this thesis presents a comprehensive review of the applications of unmanned aerial imagery, where the objective was to determine the challenges that remote-sensing applications of UAV systems currently face. This review also allowed recognizing the specific characteristics and requirements of UAV-PSs, which are mostly ignored or not thoroughly assessed in recent studies. Accordingly, the focus of the first part of this thesis is on exploring the methodological and experimental aspects of implementing a UAV-PS. The developed system was extensively evaluated for precise modeling of an open-pit gravel mine and performing volumetric-change measurements. This application was selected for two main reasons. Firstly, this case study provided a challenging environment for 3D modeling, in terms of scale changes, terrain relief variations as well as structure and texture diversities. Secondly, open-pit-mine monitoring demands high levels of accuracy, which justifies our efforts to improve the developed UAV-PS to its maximum capacities. The hardware of the system consisted of an electric-powered helicopter, a high-resolution digital camera, and an inertial navigation system. The software of the system included the in-house programs specifically designed for camera calibration, platform calibration, system integration, onboard data acquisition, flight planning and ground control point (GCP) detection. The detailed features of the system are discussed in the thesis, and solutions are proposed in order to enhance the system and its photogrammetric outputs. The accuracy of the results was evaluated under various mapping conditions, including direct georeferencing and indirect georeferencing with different numbers, distributions and types of ground control points. Additionally, the effects of imaging configuration and network stability on modeling accuracy were assessed. The second part of this thesis concentrates on improving the techniques of sparse and dense reconstruction. The proposed solutions are alternatives to traditional aerial photogrammetry techniques, properly adapted to specific characteristics of unmanned, low-altitude imagery. Firstly, a method was developed for robust sparse matching and epipolar-geometry estimation. The main achievement of this method was its capacity to handle a very high percentage of outliers (errors among corresponding points) with remarkable computational efficiency (compared to the state-of-the-art techniques). Secondly, a block bundle adjustment (BBA) strategy was proposed based on the integration of intrinsic camera calibration parameters as pseudo-observations to Gauss-Helmert model. The principal advantage of this strategy was controlling the adverse effect of unstable imaging networks and noisy image observations on the accuracy of self-calibration. The sparse implementation of this strategy was also performed, which allowed its application to data sets containing a lot of tie points. Finally, the concepts of intrinsic curves were revisited for dense stereo matching. The proposed technique could achieve a high level of accuracy and efficiency by searching only through a small fraction of the whole disparity search space as well as internally handling occlusions and matching ambiguities. These photogrammetric solutions were extensively tested using synthetic data, close-range images and the images acquired from the gravel-pit mine. Achieving absolute 3D mapping accuracy of 11±7 mm illustrated the success of this system for high-precision modeling of the environment.

Applying Augmented Reality to Outdoors Industrial Use

Augmented Reality (AR) is currently gaining popularity in multiple different fields. However, the technology for AR still requires development in both hardware and software when considering industrial use. In order to create immersive AR applications, more accurate pose estimation techniques to define virtual camera location are required. The algorithms for pose estimation often require a lot of processing power, which makes robust pose estimation a difficult task when using mobile devices or designated AR tools. The difficulties are even larger in outdoor scenarios where the environment can vary a lot and is often unprepared for AR. This thesis aims to research different possibilities for creating AR applications for outdoor environments. Both hardware and software solutions are considered, but the focus is more on software. The majority of the thesis focuses on different visual pose estimation and tracking techniques for natural features. During the thesis, multiple different solutions were tested for outdoor AR. One commercial AR SDK was tested, and three different custom software solutions were developed for an Android tablet. The custom software solutions were an algorithm for combining data from magnetometer and a gyroscope, a natural feature tracker and a tracker based on panorama images. The tracker based on panorama images was implemented based on an existing scientific publication, and the presented tracker was further developed by integrating it to Unity 3D and adding a possibility for augmenting content. This thesis concludes that AR is very close to becoming a usable tool for professional use. The commercial solutions currently available are not yet ready for creating tools for professional use, but especially for different visualization tasks some custom solutions are capable of achieving a required robustness. The panorama tracker implemented in this thesis seems like a promising tool for robust pose estimation in unprepared outdoor environments.

Multi-physics modelling - A vital component of virtual manufacturing

One of the core tasks of the virtual-manufacturing environment is to characterise the transformation of the state of material during each of the unit processes. This transformation in shape, material properties, etc. can only be reliably achieved through the use of models in a simulation context. Unfortunately, many manufacturing processes involve the material being treated in both the liquid and solid state, the trans-formation of which may be achieved by heat transfer and/or electro-magnetic fields. The computational modelling of such processes, involving the interactions amongst various interacting phenomena, is a consider-able challenge. However, it must be addressed effectively if Virtual Manufacturing Environments are to become a reality! This contribution focuses upon one attempt to develop such a multi-physics computational toolkit. The approach uses a single discretisation procedure and provides for direct interaction amongst the component phenomena. The need to exploit parallel high performance hardware is addressed so that simulation elapsed times can be brought within the realms of practicality. Examples of Multiphysics modelling in relation to shape casting, and solder joint formation reinforce the motivation for this work.

A integração e compreensão do desenho na modelação 3D : enquadramento académico

Na medida em que os produtos e os processos de criação são cada vez mais mediados digitalmente, existe uma reflexão recente acerca da relação entre as imagens e as ferramentas usadas para a sua produção. A relação natural e estreita entre a dimensão conceptual e a dimensão física abre a discussão ao nível da semântica e dos processos da projetação e manipulação das imagens, nas quais estão naturalmente incluídas as ferramentas CAD. Tendo o desenho um papel inequívoco e fundamental no exercício da projetação e da modelação 3D é pertinente perceber a relação e a articulação entre estas duas ferramentas. Reconhecendo o desenho como uma ferramenta de domínio físico capaz de expressar o pensamento que opera a transformação de concepções abstratas em concepções concretas, reconhecê-lo refletido na dimensão virtual através de um software CAD 3D não é trivial, já que este, na generalidade, é processado através de um pensamento cujo contexto é distante da materialidade. Metodologicamente, abordaremos esta questão procurando a verificação da hipótese através de uma proposta de exercício prático que procura avaliar o efeito que as imagens analógicas poderão ter sobre o reconhecimento e operatividade da ferramenta Blender num enquadramento académico. Pretende-se, pois, perceber como o desenho analógico pode integrar o processo de modelação 3D e qual a relação que mantém com quem elas opera. A articulação do desenho com as ferramentas de produção de design, especificamente CAD 3D, permitirá compreender na especialidade a articulação entre ferramentas de diferentes naturezas tanto no processo da projetação quanto na criação de artefactos visuais. Assim como poderá lançar a discussão acerca das estratégias pedagógicas de ensino do desenho e do 3D num curso de Design.

Design of Streaming Media Panoramic Video System Based on WebGL

2016 is the outbreak year of the virtual reality industry. In the field of virtual reality, 3D surveying plays an important role. Nowadays, 3D surveying technology has received increasing attention. This project aims to establish and optimize a WebGL three-dimensional broadcast platform combined with streaming media technology. It takes streaming media server and panoramic video broadcast in browser as the application background. Simultaneously, it discusses about the architecture from streaming media server to panoramic media player and analyzing relevant theory problem. This paper focuses on the debugging of streaming media platform, the structure of WebGL player environment, different types of ball model analysis, and the 3D mapping technology. The main work contains the following points: Initially, relay on Easy Darwin open source streaming media server, built a streaming service platform. It can realize the transmission from RTSP stream to streaming media server, and forwards HLS slice video to clients; Then, wrote a WebGL panoramic video player based on Three.js lib with JQuery browser playback controls. Set up a HTML5 panoramic video player; Next, analyzed the latitude and longitude sphere model which from Three.js library according to WebGL rendering method. Pointed out the drawbacks of this model and the breakthrough point of improvement; After that, on the basis of Schneider transform principle, established the Schneider sphere projection model, and converted the output OBJ file to JS file for media player reading. Finally implemented real time panoramic video high precision playing without plugin; At last, I summarized the whole project. Put forward the direction of future optimization and extensible market.

3D-grafiikan selaintekniikat, erikoistapauksena karttasovellukset

Harava on karttapohjainen kyselypalvelu, jonka avulla voidaan kerätä tietoa erilaisista kyselykohteista. Harava-kyselypalvelussa kyselyihin voidaan vastata muun muassa tekstikentillä, monivalinnoilla ja merkitsemällä alueita ja pisteitä karttapohjaan. Tutkielman tavoitteena oli löytää Harava-kyselypalvelun 2D-karttojen rinnalle 3D-karttavaihtoehto. Aluksi tutkittiin, mitä eri vaihtoehtoja löytyy 3D-komponenttien esittämiseen selaimessa. Tutkituista vaihtoehdoista parhaimmaksi tähän tarkoitukseen osoittautui WebGL-kirjasto. WebGL-kirjaston käyttö suoraan osoittautui vaikeaksi, joten etsittiin rajapintaa, jonka avulla WebGL-kirjaston käyttö helpottuisi. Käsittelyyn otettiin karttapalveluita sekä 3D-mallien esittämiseen tarkoitettuja JavaScript-kirjastoja, jotka käyttävät WebGL-kirjastoa rajapinnan kautta. Näistä sopivimmaksi osoittautui Cesium. Cesium on JavaScript-kirjasto, jonka avulla voidaan toteuttaa 2D-kartta ja 3D-karttapallo sekä upottaa karttapohjaan 3D-elementtejä.

Redes de conversação como possibilidade de formação do professor tutor virtual na mediação pedagógica da educação profissional a distância

A educação a distância apoiada pelos meios de comunicação digital ampliou as possibilidades de interação, flexibilizando o processo de mediação pedagógica no tempo e no espaço. Nessa perspectiva, a educação profissional democratizou seu acesso, na qual os conhecimentos de nível técnico são customizados em um Ambiente Virtual de Aprendizagem (AVA) para serem mediados a distância. Esta tese, apresentada na forma de artigos, problematiza o processo de mediação pedagógica realizado pelo professor tutor virtual na Rede e-Tec Brasil do Instituto Federal de Educação, Ciência e Tecnologia Sul-rio-grandense (IFSul) Campus Visconde da Graça (CAVG). Nesse modelo de ensino, o professor tutor virtual é contratado para atuar, pelo período de dois anos, em todas as disciplinas curriculares de um curso técnico. Se, por um lado, isso permite-lhe conhecer a realidade de seus alunos; por outro, exige-lhe um esforço pedagógico de apropriação e mediação dos conteúdos específicos nas diversas disciplinas que integram os currículos de cada curso. A pesquisa buscou conhecer como o professor tutor virtual apropria-se dos conhecimentos específicos nos cursos técnicos para mediá-los pedagogicamente com os alunos. Apresentamos, como hipótese explicativa neste estudo, que é na convivência com o professor pesquisador que o professor tutor virtual encontra a possibilidade de se apropriar dos conhecimentos curriculares para poder mediá-los pedagogicamente com os alunos. Para sustentar teoricamente nossas proposições na experiência vivida, estabelecemos uma rede de conversação com os autores Humberto Maturana, Pierre Lévy, Lee Shulman e Maurice Tardif, por meio dos conceitos: cultura em redes de conversação; inteligência coletiva; conhecimento pedagógico do conteúdo; e formação profissional docente. Como procedimento metodológico, encontramos na técnica do Discurso do Sujeito Coletivo (DSC), de Lefèvre e Lefèvre, uma estratégia de abordagem qualitativa para analisar as recorrências encontradas nos discursos dos professores tutores virtuais. O estudo aponta que uma rede de conversação recursiva entre o professor pesquisador e o professor tutor virtual possibilita a apropriação de conhecimentos técnicos e específicos necessários ao processo de mediação pedagógica com os estudantes. Essa convivência, no caminho da constituição de um coletivo inteligente, favorece o trabalho colaborativo no ambiente da tutoria, contribuindo para profissionalizar o processo de mediação pedagógica na educação profissional a distância do IFSul CAVG. Supported by digital media, distance learning has increased the possibilities of interaction, easing the process of pedagogical mediation in time and space. From this perspective, the access to professional education has been democratized: technical knowledge is customized in a Learning Managing System and later delivered by means of mediated distance education courses. Structured in a sequence of articles, this dissertation addresses the problem of the pedagogical mediation process performed by on-line tutor teachers at Rede e-Tec Brasil of the Instituto Federal Sul- rio-grandense (IF-Sul), Campus Visconde da Graça (CAVG). This model of education establishes that on-line tutor teachers are hired to work with all the curriculum courses of a technical program for two years. If, on the hand, it allows these teachers to know the reality of their students well, on the other hand it demands them a pedagogical effort of appropriation and mediation of the specific contents guiding the various courses that comprise the curriculum of each program. This research aimed to find out how on-line tutor teachers appropriate expertise from technical programs to mediate it with their students in a pedagogical way. The explanatory hypothesis given is that by working together and sharing experience with the teacher/researcher, on-line tutor teachers will be able to appropriate of curricular knowledge and pedagogically mediate it with their students afterwards. To support our theoretical propositions, a network of conversation was established with authors like Humberto Maturana, Pierre Lévy, Lee Shulman, and Maurice Tardif through the concepts of culture in networks of conversation, collective intelligence, pedagogical content knowledge, and teacher training. As a methodological procedure, the technique of the Collective Subject Discourse (CSD), by Lefèvre and Lefèvre, was found to offer a strategy of qualitative approach to analyze the recurrences seen in the speech of on-line tutor teachers. The study shows that a recursive network of conversation between the teacher/researcher and the on-line tutor teacher enables the appropriation of specific and technical knowledge required for the process of pedagogical mediation with students. The experience of sharing a consensual professional relationship, in which one respects and accepts the other as a way of establishing a collective intelligence, encourages collaborative work in the tutoring environment, helping professionalize the process of pedagogical mediation in distance professional education at IFSul CAVG.

3D modelling of mango fruit skin blush in the tree canopy

The fruit of certain mango cultivars (e.g., 'Honey Gold') can develop blush on their skin. Skin blush due to red pigmentation is from the accumulation of anthocyanins. Anthocyanin biosynthesis is related to environmental determinants, including light received by the fruit. It has been observed that mango skin blush varies with position in the tree canopy. However, little investigation into this spatial relationship has been conducted. The objective of this preliminary study was to describe a 'Honey Gold' mango tree by capturing its three-dimensional (3D) architecture. A light path tracing model QuasiMC was then used to predict light received by fruit. The use of this 3D model was to better understand the relationship between mango fruit skin blush and fruit position in the canopy. The digitised mango tree mimicked the real tree at a high level of detail. Observations on mango skin blush distribution supported the proposition that sunlight exposure is an absolute requirement for anthocyanin development. No blush development occurred on shaded skin. It was affirmed that 3D mapping could allow for virtual experiments. For example, for virtual canopy thinning (e.g., 'window pruning') to admit more sunlight with a view to improve fruit blush. Improvements to 3D modelling of mango skin blush could focus on increasing accuracy, e.g., measurement of leaf light reflectance and transmission and the inclusion of the effect shading by branches.

Metodologia do Projecto Tecnológico : estudo comparativo de várias plataformas digitais (Moodle, Second Life e Sloodle) na aprendizagem dos mestrandos de ECM

Relatório de Estágio apresentado para a obtenção do grau de mestre em Educação e Comunicação Multiméddia

Expertise sportive et entraînement perceptivo-cognitif de l’athlète

Pour être performant au plus haut niveau, les athlètes doivent posséder une capacité perceptivo-cognitive supérieure à la moyenne. Cette faculté, reflétée sur le terrain par la vision et l’intelligence de jeu des sportifs, permet d’extraire l’information clé de la scène visuelle. La science du sport a depuis longtemps observé l’expertise perceptivo-cognitive au sein de l’environnement sportif propre aux athlètes. Récemment, des études ont rapporté que l’expertise pouvait également se refléter hors de ce contexte, lors d’activités du quotidien par exemple. De plus, les récentes théories entourant la capacité plastique du cerveau ont amené les chercheurs à développer des outils pour entraîner les capacités perceptivo-cognitives des athlètes afin de les rendre plus performants sur le terrain. Ces méthodes sont la plupart du temps contextuelles à la discipline visée. Cependant, un nouvel outil d’entraînement perceptivo-cognitif, nommé 3-Dimensional Multiple Object Tracking (3D-MOT) et dénué de contexte sportif, a récemment vu le jour et a fait l’objet de nos recherches. Un de nos objectifs visait à mettre en évidence l’expertise perceptivo-cognitive spécifique et non-spécifique chez des athlètes lors d’une même étude. Nous avons évalué la perception du mouvement biologique chez des joueurs de soccer et des non-athlètes dans une salle de réalité virtuelle. Les sportifs étaient systématiquement plus performants en termes d’efficacité et de temps de réaction que les novices pour discriminer la direction du mouvement biologique lors d’un exercice spécifique de soccer (tir) mais également lors d’une action issue du quotidien (marche). Ces résultats signifient que les athlètes possèdent une meilleure capacité à percevoir les mouvements biologiques humains effectués par les autres. La pratique du soccer semble donc conférer un avantage fondamental qui va au-delà des fonctions spécifiques à la pratique d’un sport. Ces découvertes sont à mettre en parallèle avec la performance exceptionnelle des athlètes dans le traitement de scènes visuelles dynamiques et également dénuées de contexte sportif. Des joueurs de soccer ont surpassé des novices dans le test de 3D-MOT qui consiste à suivre des cibles en mouvement et stimule les capacités perceptivo-cognitives. Leur vitesse de suivi visuel ainsi que leur faculté d’apprentissage étaient supérieures. Ces résultats confirmaient des données obtenues précédemment chez des sportifs. Le 3D-MOT est un test de poursuite attentionnelle qui stimule le traitement actif de l’information visuelle dynamique. En particulier, l’attention sélective, dynamique et soutenue ainsi que la mémoire de travail. Cet outil peut être utilisé pour entraîner les fonctions perceptivo-cognitives des athlètes. Des joueurs de soccer entraînés au 3D-MOT durant 30 sessions ont montré une amélioration de la prise de décision dans les passes de 15% sur le terrain comparés à des joueurs de groupes contrôles. Ces données démontrent pour la première fois un transfert perceptivo-cognitif du laboratoire au terrain suivant un entraînement perceptivo-cognitif non-contextuel au sport de l’athlète ciblé. Nos recherches aident à comprendre l’expertise des athlètes par l’approche spécifique et non-spécifique et présentent également les outils d’entraînements perceptivo-cognitifs, en particulier le 3D-MOT, pour améliorer la performance dans le sport de haut-niveau.

Metodologia do Projecto Tecnológico : estudo comparativo de várias plataformas digitais (Moodle, Second Life e Sloodle) na aprendizagem dos mestrandos de ECM

Relatório de Estágio apresentado para a obtenção do grau de mestre em Educação e Comunicação Multiméddia