A grammatical approach to the modeling of an autonomous robot

Virtual Worlds Generator is a grammatical model that is proposed to define virtual worlds. It integrates the diversity of sensors and interaction devices, multimodality and a virtual simulation system. Its grammar allows the definition and abstraction in symbols strings of the scenes of the virtual world, independently of the hardware that is used to represent the world or to interact with it. A case study is presented to explain how to use the proposed model to formalize a robot navigation system with multimodal perception and a hybrid control scheme of the robot. The result is an instance of the model grammar that implements the robotic system and is independent of the sensing devices used for perception and interaction. As a conclusion the Virtual Worlds Generator adds value in the simulation of virtual worlds since the definition can be done formally and independently of the peculiarities of the supporting devices.

Piloto automático: Sistema de navegação autónoma

Desde o início do crescente interesse na área de robótica que a navegação autónoma se apresenta como um problema de complexa resolução que, por isso, desperta vasto interesse no meio científico. Além disso, as capacidades da navegação autónoma aliadas à robótica permitem o desenvolvimento de variadas aplicações. O objectivo da navegação autónoma é conferir, a um dispositivo motor, capacidade de decisão relativa à locomoção. Para o efeito, utilizam-se sensores, como os sensores IMU, o receptor GPS e os encoders, para fornecer os dados essenciais à navegação. A dificuldade encontra-se no correcto processamento destes sinais uma vez que são susceptíveis a fontes de ruído. Este trabalho apresenta um sistema de navegação autónomo aplicado ao controlo de um robot. Para tal, desenvolveu-se uma aplicação que alberga todo o sistema de localização, navegação e controlo, acrescido de uma interface gráfica, que permite a visualização em mapa da movimentação autónoma do robot. Recorre-se ao Filtro de Kalman como método probabilístico de estimação de posição, em que os sinais dos vários sensores são conjugados e filtrados. Foram realizados vários testes de modo a avaliar a capacidade do robot atingir os pontos traçados e a sua autonomia no seguimento da trajectória pretendida.

Tecniche GPS/INS per l'anilisi dinamica di un ciclomotore

Nel seguente elaborato si espone l’utilizzo del sistema GPS/INS per la valutazione del moto di un ciclomotore. Tale sistema è composto da sensori GPS ( Global Navigation System ) per la misurazione della posizione, e da sensori INS ( Inertial Navigation System) per la misurazione dell’accelerazione e delle velocità angolari rispetto a tre assi coordinati. Chiaramente le misure di accelerazioni e di velocità angolari da parte dei sensori, presentano dei minimi errori, che però si ripercuotono sul posizionamento finale. Per limitare questo fenomeno e rendere la misura di velocità e posizione utilizzabile, un filtro di Kalman viene impiegato per correggere il risultato dell'integrazione usando le misurazioni del GPS. Il connubio tra il sistema INS e il sistema GPS è molto efficacie anche quando si ha una assenza di ricezione satellitare o perdita parziale dei satelliti (cycle slip). Infine è stato utilizzato uno smartphone sfruttando i sensori in esso presenti : accelerometri, giroscopi, GPS, per analizzare la dinamica di un ciclomotore, concentrandosi sull’assetto in particolar modo l’angolo di rollio. Tale prova è stata affrontata non tanto per validare il sistema GPS/INS, ma per provare una soluzione comoda e di basso costo per analizzare il moto di un ciclomotore.

Omega table.

Mode of access: Internet.

Multi-robot control in highly dynamic, competitive environments

The control and coordination of multiple mobile robots is a challenging task; particularly in environments with multiple, rapidly moving obstacles and agents. This paper describes a robust approach to multi-robot control, where robustness is gained from competency at every layer of robot control. The layers are: (i) a central coordination system (MAPS), (ii) an action system (AES), (iii) a navigation module, and (iv) a low level dynamic motion control system. The multi-robot coordination system assigns each robot a role and a sub-goal. Each robot’s action execution system then assumes the assigned role and attempts to achieve the specified sub-goal. The robot’s navigation system directs the robot to specific goal locations while ensuring that the robot avoids any obstacles. The motion system maps the heading and speed information from the navigation system to force-constrained motion. This multi-robot system has been extensively tested and applied in the robot soccer domain using both centralized and distributed coordination.

Visualisation and browsing of image databases

In this chapter we provide a comprehensive overview of the emerging field of visualising and browsing image databases. We start with a brief introduction to content-based image retrieval and the traditional query-by-example search paradigm that many retrieval systems employ. We specify the problems associated with this type of interface, such as users not being able to formulate a query due to not having a target image or concept in mind. The idea of browsing systems is then introduced as a means to combat these issues, harnessing the cognitive power of the human mind in order to speed up image retrieval.We detail common methods in which the often high-dimensional feature data extracted from images can be used to visualise image databases in an intuitive way. Systems using dimensionality reduction techniques, such as multi-dimensional scaling, are reviewed along with those that cluster images using either divisive or agglomerative techniques as well as graph-based visualisations. While visualisation of an image collection is useful for providing an overview of the contained images, it forms only part of an image database navigation system. We therefore also present various methods provided by these systems to allow for interactive browsing of these datasets. A further area we explore are user studies of systems and visualisations where we look at the different evaluations undertaken in order to test usability and compare systems, and highlight the key findings from these studies. We conclude the chapter with several recommendations for future work in this area. © 2011 Springer-Verlag Berlin Heidelberg.

Algoritmo eficiente para aquisição de sinais de GPS por software

O NAVSTAR/GPS (NAVigation System with Timing And Ranging/Global Po- sitioning System), mais conhecido por GPS, _e um sistema de navegacão baseado em sat_elites desenvolvido pelo departamento de defesa norte-americano em meados de 1970. Criado inicialmente para fins militares, o GPS foi adaptado para o uso civil. Para fazer a localização, o receptor precisa fazer a aquisição de sinais dos satélites visíveis. Essa etapa é de extrema importância, pois é responsável pela detecção dos satélites visíveis, calculando suas respectivas frequências e fases iniciais. Esse processo pode demandar bastante tempo de processamento e precisa ser implementado de forma eficiente. Várias técnicas são utilizadas atualmente, mas a maioria delas colocam em conflito questões de projeto tais como, complexidade computacional, tempo de aquisição e recursos computacionais. Objetivando equilibrar essas questões, foi desenvolvido um método que reduz a complexidade do processo de aquisição utilizando algumas estratégias, a saber, redução do efeito doppler, amostras e tamanho do sinal utilizados, além do paralelismo. Essa estratégia é dividida em dois passos, um grosseiro em todo o espaço de busca e um fino apenas na região identificada previamente pela primeira etapa. Devido a busca grosseira, o limiar do algoritmo convencional não era mais aceitável. Nesse sentido, um novo limiar foi estabelecido baseado na variância dos picos de correlação. Inicialmente, é feita uma busca com pouca precisão comparando a variância dos cinco maiores picos de correlação encontrados. Caso a variância ultrapasse um certo limiar, a região de maior pico torna-se candidata à detecção. Por fim, essa região passa por um refinamento para se ter a certeza de detecção. Os resultados mostram que houve uma redução significativa na complexidade e no tempo de execução, sem que tenha sido necessário utilizar algoritmos muito complexos.

Seabed photographs taken along OFOS profiles during POLARSTERN cruise PS96 (ANT-XXXI/2 FROSN)

Within the context of the overall ecological working programme Dynamics of Antarctic Marine Shelf Ecosystems (DynAMo) of the PS96 (ANT-XXXI/2) cruise of RV "Polarstern" to the Weddell Sea (Dec 2015 to Feb 2016), seabed imaging surveys were carried out along drift profiles by means of the Ocean Floor Observation System (OFOS) of the Alfred Wegener Institute, Helmholtz Centre for Polar and Marine Research (AWI) Bremerhaven. The setup and mode of deployment of the OFOS was similar to that described by Bergmann and Klages (2012, doi:10.1016/j.marpolbul.2012.09.018). OFOS is a surface-powered gear equipped with two downward-looking cameras installed side-by-side: one high-resolution, wide-angle still camera (CANON® EOS 5D Mark III; lens: Canon EF 24 f/1.4L II, f stop: 13, exposure time: 1/125 sec; in-air view angles: 74° (horizontal), 53° (vertical), 84° (diagonal); image size: 5760 x 3840 px = 21 MPix; front of pressure resistant camera housing consisting of plexiglass dome port) and one high-definition color video camera (SONY® FCB-H11). The system was vertically lowered over the stern of the ship with a broadband fibre-optic cable, until it hovers approximately 1.5 m above the seabed. It was then towed after the slowly sailing ship at a speed of approximately 0.5 kn (0.25 m/s). The ship's Global Acoustic Positioning System (GAPS), combining Ultra Short Base Line (USBL), Inertial Navigation System (INS) and satellite-based Global Positioning System (GPS) technologies, was used to gain highly precise underwater position data of the OFOS. During the profile, OFOS was kept hanging at the preferred height above the seafloor by means of the live video feed and occasional minor cable-length adjustments with the winch to compensate small-scale bathymetric variations in seabed morphology. Information on water depth and height above the seafloor were continuously recorded by means of OFOS-mounted sensors (GAPS transponder, Tritech altimeter). Three lasers, which are placed beside the still camera, emit parallel beams and project red light points, arranged as an equilateral triangle with a side length of 50 cm, in each photo, thus providing a scale that can be used to calculate the seabed area depicted in each image and/or measure the size of organisms or seabed features visible in the image. In addition, the seabed area depicted was estimated using altimeter-derived height above seafloor and optical characteristics of the OFOS still camera. In automatic mode, a seabed photo, depicting an area of approximately 3.45 m**2 (= 2.3 m x 1.5 m; with variations depending on the actual height above ground), was taken every 30 seconds to obtain series of "TIMER" stills distributed at regular distances along the profiles that vary in length depending on duration of the cast. At a ship speed of 0.5 kn, the average distance between seabed images was approximately 5 m. Additional "HOTKEY" photos were taken from interesting objects (organisms, seabed features, such as putative iceberg scours) when they appeared in the live video feed (which was also recorded, in addition to the stills, for documentation and possible later analysis). If any image from this collection is used, please cite the reference as given above.

On precise three-dimensional environment modeling via UAV-based photogrammetric systems

Abstract : Images acquired from unmanned aerial vehicles (UAVs) can provide data with unprecedented spatial and temporal resolution for three-dimensional (3D) modeling. Solutions developed for this purpose are mainly operating based on photogrammetry concepts, namely UAV-Photogrammetry Systems (UAV-PS). Such systems are used in applications where both geospatial and visual information of the environment is required. These applications include, but are not limited to, natural resource management such as precision agriculture, military and police-related services such as traffic-law enforcement, precision engineering such as infrastructure inspection, and health services such as epidemic emergency management. UAV-photogrammetry systems can be differentiated based on their spatial characteristics in terms of accuracy and resolution. That is some applications, such as precision engineering, require high-resolution and high-accuracy information of the environment (e.g. 3D modeling with less than one centimeter accuracy and resolution). In other applications, lower levels of accuracy might be sufficient, (e.g. wildlife management needing few decimeters of resolution). However, even in those applications, the specific characteristics of UAV-PSs should be well considered in the steps of both system development and application in order to yield satisfying results. In this regard, this thesis presents a comprehensive review of the applications of unmanned aerial imagery, where the objective was to determine the challenges that remote-sensing applications of UAV systems currently face. This review also allowed recognizing the specific characteristics and requirements of UAV-PSs, which are mostly ignored or not thoroughly assessed in recent studies. Accordingly, the focus of the first part of this thesis is on exploring the methodological and experimental aspects of implementing a UAV-PS. The developed system was extensively evaluated for precise modeling of an open-pit gravel mine and performing volumetric-change measurements. This application was selected for two main reasons. Firstly, this case study provided a challenging environment for 3D modeling, in terms of scale changes, terrain relief variations as well as structure and texture diversities. Secondly, open-pit-mine monitoring demands high levels of accuracy, which justifies our efforts to improve the developed UAV-PS to its maximum capacities. The hardware of the system consisted of an electric-powered helicopter, a high-resolution digital camera, and an inertial navigation system. The software of the system included the in-house programs specifically designed for camera calibration, platform calibration, system integration, onboard data acquisition, flight planning and ground control point (GCP) detection. The detailed features of the system are discussed in the thesis, and solutions are proposed in order to enhance the system and its photogrammetric outputs. The accuracy of the results was evaluated under various mapping conditions, including direct georeferencing and indirect georeferencing with different numbers, distributions and types of ground control points. Additionally, the effects of imaging configuration and network stability on modeling accuracy were assessed. The second part of this thesis concentrates on improving the techniques of sparse and dense reconstruction. The proposed solutions are alternatives to traditional aerial photogrammetry techniques, properly adapted to specific characteristics of unmanned, low-altitude imagery. Firstly, a method was developed for robust sparse matching and epipolar-geometry estimation. The main achievement of this method was its capacity to handle a very high percentage of outliers (errors among corresponding points) with remarkable computational efficiency (compared to the state-of-the-art techniques). Secondly, a block bundle adjustment (BBA) strategy was proposed based on the integration of intrinsic camera calibration parameters as pseudo-observations to Gauss-Helmert model. The principal advantage of this strategy was controlling the adverse effect of unstable imaging networks and noisy image observations on the accuracy of self-calibration. The sparse implementation of this strategy was also performed, which allowed its application to data sets containing a lot of tie points. Finally, the concepts of intrinsic curves were revisited for dense stereo matching. The proposed technique could achieve a high level of accuracy and efficiency by searching only through a small fraction of the whole disparity search space as well as internally handling occlusions and matching ambiguities. These photogrammetric solutions were extensively tested using synthetic data, close-range images and the images acquired from the gravel-pit mine. Achieving absolute 3D mapping accuracy of 11±7 mm illustrated the success of this system for high-precision modeling of the environment.

Sistema de realidade aumentada no procedimento cirúrgico de remoção de pedras nos rins

A inovação tecnológica e as facilidades que gera tem tido um impacto crescente em diversas área, inclusivamente na medicina. A rápida evolução por parte de algumas tecnologias, como é o caso da Realidade Aumentada (RA), criam excelentes oportunidades, nomeadamente para intervenções cirúrgicas laparoscópicas, que apresentam especialmente problemas ao nível da exposição do doente a radiação. O presente documento detalha todo o processo de investigação e desenvolvimento realizado com a pretensão de criar um sistema de navegação por RA que auxilie o procedimento cirúrgico laparoscópico de remoção de pedras nos rins. Com este objetivo em perspetiva, e numa parceria com a empresa ECmedica LTD, foram desenvolvidos quatro protótipo funcionais. Com o intuito de compreender as melhores práticas de sistemas de input, interface e sistema de registo a aplicar, estes integraram aspetos inovadores tais como a utilização de uma sonda ultra-som, como substituta do raioX, e um registo feito através de sensores magnéticos. Apoiados numa metodologia de design centrado no utilizador e em instrumentos de análise como entrevistas e observação natural, os protótipos foram testados, obtendo respostas esclarecedoras relativamente ao objetivos dos protótipos. Foi observado que a RA é vista pelos médicos como uma solução com potencial, com as soluções apresentadas ao nível de inputs, interface e registo a serem bem recebidas. A projeção bidimensional oferecida pela imagem ultra-som foi encarada como insuficientes, sendo sugerida a sua substituição por um aumento tridimensional capaz de facilitar a correta inserção da agulha.

Prioritizing Purposes: Two American History Teachers' Choices Among Subject Matter and Classroom-Related Purposes

This study explores how two American history teachers - one novice and one experienced – make in-the-moment choices among their history subject matter and classroom-related purposes during the teaching of an American history unit. Using classroom observations, lesson artifacts, student work products, and deep, retrospective interviews with the teachers as they watched videos of their teaching, this study maps out in detail the teachers’ purposes, both within and across different lesson activity structures. This study finds that the novice and the experienced teacher navigated among their purposes differently from each other, and that the characteristics of each teacher’s purposes navigation aligned with student outcomes in that teacher’s class. The novice teacher acted more like a juggler, with visible, reactive navigation among each purpose operational throughout his teaching; student outcomes in his class were similarly fragmented and discrete. The experienced teacher presented more like an orchestra conductor, interweaving his purposes and anticipating the navigation decisions that would create a more seamless whole; student outcomes in his class were aligned with his holistic navigation of purposes. Findings from this study have important implications for education research and teacher practice, including the relationship between teachers’ navigation among purposes and desired student outcomes, the integral role of classroom-related purposes interwoven with history subject matter purposes in teachers’ decision-making, and the differences in purposes navigation between a novice and an experienced history teacher.

Aportaciones de la cirugía guiada por ordenador y navegación en oncología de cabeza y cuello: una revisión bibliográfica sistemática y actualización

Introducción: El objetivo de este trabajo es hacer una revisión y actualización de la literatura sobre la aportación de la planificación quirúrgica y de la navegación en el manejo de la enfermedad oncológica de cabeza y cuello, para valorar y determinar sus aplicaciones actuales. Material y métodos: Se realiza una búsqueda electrónica empleando los términos craniomaxillofacial tumors, head and neck cancer, navigation system, computer-assisted surgery y oral cancer. Resultados: El número de artículos encontrados en la revisión de la literatura ha sido de 16, publicados entre los años 1991 y 2014. Entre ellos no hay ninguna revisión sistemática, hay 5 artículos de revisión, 6 series de casos y 5 casos clínicos. Solo 10 artículos aportan información completa en relación con la enfermedad oncológica manejada con tecnología de navegación quirúrgica. Actualmente las aplicaciones de la navegación en oncología de cabeza y cuello pueden enumerarse en las siguientes áreas: biopsia guiada, resección y reconstrucción de tumores, monitorización del volumen del tumor, control de márgenes de resección quirúrgica basados en TC, RMN o PET y sistema de comunicación interdisciplinar. Conclusiones: Actualmente hay un número escaso de publicaciones sobre las aplicaciones de la navegación quirúrgica en el novedoso ámbito de la oncología de cabeza y cuello. A pesar de la ausencia de revisiones sistemáticas, parece tener un futuro prometedor por la valiosa aportación que hace para el manejo de tumores de cabeza y cuello, como proporcionar precisión anatómica, precisión diagnóstica y seguridad quirúrgica, siendo de gran utilidad en el tratamiento oncológico multidisciplinar.

Valutazione cimenatica di tre tecniche di ricostruzione di legamento crociato anteriore con sistema di navigazione intraoperatorio

In caso di una lesione del legamento crociato anteriore (ACL), l'approccio chirurgico gold standard è la tecnica di ricostruzione ACL Single-Bundle (SB). Recentemente, sono state proposte altre tecniche alternative per ridurre il rischio di lassità residua post-operatoria, come la ricostruzione del Single Bundle con aggiunta di palstica latearle (SBLP) e le procedure a doppio fascio (DB). Quarantadue pazienti sottoposti a ricostruzione ACL sono stati inclusi prospetticamente nello studio. È stata eseguita una randomizzazione per allocare i pazienti nei diversi gruppi di studio: Single-Bundle-Lateral-Plasty, Single-Bundle e Double-Bundle. Un sistema di navigazione intraoperatorio è stato utilizzato per valutare i valori di lassità. I valori di lassità pre e post-chirurgici sono stati valutati tramite i test Lachman test (AP30), Drawer test (AP90), Varus-Valgus stress test a 0° e 30° flessione del ginocchio (VV0, VV30), rotazione esterna interna (IE30, IE90), e il test del pivot shift (PS). . In tutti e tre i gruppi, i valori di lassità post-ricostruzione sono risultati statisticamente ridotti rispetto ai valori pre-ricostruzione (P < 0,05) per tutti i test analizzati. Considerando l'analisi del test del cassetto e della rotazione interna-esterna a 30 e 90 gradi di flessione del ginocchio, è stata identificata una differenza significativa tra le diverse ricostruzioni chirurgiche. La tecnica SBLP ha portato ad avere i valori di migliori rispetto alle tecniche SB (PIE90 - 0,001) e DB (PAP90 - 0.012; PIE30 - 0,021; PIE90 - 0,003). La tecnica SBLP ha ottenuto risultati significativamente migliori rispetto alle altre tecniche studiate in termini di riduzione della lassità antero-posteriore e interna-esterna a tempo zero dopo la ricostruzione del legamento crociato anteriore.

Studio e sperimentazione di missioni autonome di un veicolo terrestre controllato con sistemi inerziali e satellitari

L'argomento del lavoro di tesi svolto ha lo scopo di testare le prestazioni di dispositivi riceventi per Global Navigation Satellite System (GNSS) che utilizzano la tecnologia di posizionamento Real-Time Kinematics (RTK) e valutarne le prestazioni rispetto alle tradizionali riceventi GNSS, nello sviluppo di missioni autonome per veicoli di terra di piccole dimensioni. Per questi esperimenti è stato usato un rover di piccole dimensioni alimentato a batteria, su cui è stato installato un autopilota Pixhawk Cube Orange con firmware Ardupilot, nello specifico Ardurover. Attraverso il software Mission Planner è stato richiesto al rover di effettuare completamente in autonomia delle missioni per testare sia le prestazioni dei sistemi GNSS tradizionali sia dei sistemi RTK. Attraverso i dati raccolti durante le sperimentazioni è stato fatto un confronto tra GNSS e RTK. I dati raccolti sono stati utilizzati per valutare le prestazioni in termini di precisione dei sistemi e non sono state rilevate significative differenze durante l'utilizzo del dispositivo RTK per lo svolgimento della missione richiesta al rover, con l'architettura hardware proposta.

An optical flow-based sensing system for reactive mobile robot navigation

This work discusses the use of optical flow to generate the sensorial information a mobile robot needs to react to the presence of obstacles when navigating in a non-structured environment. A sensing system based on optical flow and time-to-collision calculation is here proposed and experimented, which accomplishes two important paradigms. The first one is that all computations are performed onboard the robot, in spite of the limited computational capability available. The second one is that the algorithms for optical flow and time-to-collision calculations are fast enough to give the mobile robot the capability of reacting to any environmental change in real-time. Results of real experiments in which the sensing system here proposed is used as the only source of sensorial data to guide a mobile robot to avoid obstacles while wandering around are presented, and the analysis of such results allows validating the proposed sensing system.