Open source computer-vision based guidance system for UAVs on-board decision making

The use of UAVs for remote sensing tasks; e.g. agriculture, search and rescue is increasing. The ability for UAVs to autonomously find a target and perform on-board decision making, such as descending to a new altitude or landing next to a target is a desired capability. Computer-vision functionality allows the Unmanned Aerial Vehicle (UAV) to follow a designated flight plan, detect an object of interest, and change its planned path. In this paper we describe a low cost and an open source system where all image processing is achieved on-board the UAV using a Raspberry Pi 2 microprocessor interfaced with a camera. The Raspberry Pi and the autopilot are physically connected through serial and communicate via MAVProxy. The Raspberry Pi continuously monitors the flight path in real time through USB camera module. The algorithm checks whether the target is captured or not. If the target is detected, the position of the object in frame is represented in Cartesian coordinates and converted into estimate GPS coordinates. In parallel, the autopilot receives the target location approximate GPS and makes a decision to guide the UAV to a new location. This system also has potential uses in the field of Precision Agriculture, plant pest detection and disease outbreaks which cause detrimental financial damage to crop yields if not detected early on. Results show the algorithm is accurate to detect 99% of object of interest and the UAV is capable of navigation and doing on-board decision making.

A Distributed Robotic Vision Service

Robotic vision is limited by line of sight and onboard camera capabilities. Robots can acquire video or images from remote cameras, but processing additional data has a computational burden. This paper applies the Distributed Robotic Vision Service, DRVS, to robot path planning using data outside line-of-sight of the robot. DRVS implements a distributed visual object detection service to distributes the computation to remote camera nodes with processing capabilities. Robots request task-specific object detection from DRVS by specifying a geographic region of interest and object type. The remote camera nodes perform the visual processing and send the high-level object information to the robot. Additionally, DRVS relieves robots of sensor discovery by dynamically distributing object detection requests to remote camera nodes. Tested over two different indoor path planning tasks DRVS showed dramatic reduction in mobile robot compute load and wireless network utilization.

Deploying speaker verification techniques to vision-based RPA detect and avoid

Detect and Avoid (DAA) technology is widely acknowledged as a critical enabler for unsegregated Remote Piloted Aircraft (RPA) operations, particularly Beyond Visual Line of Sight (BVLOS). Image-based DAA, in the visible spectrum, is a promising technological option for addressing the challenges DAA presents. Two impediments to progress for this approach are the scarcity of available video footage to train and test algorithms, in conjunction with testing regimes and specifications which facilitate repeatable, statistically valid, performance assessment. This paper includes three key contributions undertaken to address these impediments. In the first instance, we detail our progress towards the creation of a large hybrid collision and near-collision encounter database. Second, we explore the suitability of techniques employed by the biometric research community (Speaker Verification and Language Identification), for DAA performance optimisation and assessment. These techniques include Detection Error Trade-off (DET) curves, Equal Error Rates (EER), and the Detection Cost Function (DCF). Finally, the hybrid database and the speech-based techniques are combined and employed in the assessment of a contemporary, image based DAA system. This system includes stabilisation, morphological filtering and a Hidden Markov Model (HMM) temporal filter.

Workers are doing it for themselves? Local labor solidarity in precarious times

Historically, organized labor has played a fundamental role in guaranteeing basic rights and privileges for screen media workers and defending union and guild members (however unevenly) from egregious abuses of power. Yet, despite the recent turn to labor in media and cultural studies, organized labor today has received only scant attention, even less so in locations outside Hollywood. This presentation thus intervenes in two significant ways: first, it acknowledges the ongoing global ‘undoing’ of organized labor as a consequence of footloose production and conglomeration within the screen industries, and second, it examines a case example of worker solidarity and political praxis taking shape outside formal labor institutions in response to those structural shifts. Accordingly, it links an empirical study of individual agency to broader debates associated with the spatial dynamics of screen media production, including local capacity, regional competition, and precariousness. Drawing from ethnographic interviews with local film and television workers in Glasgow, Scotland, I consider the political alliance among three nascent labor organizations in the city: one for below-the-line crew, one for facility operators, and (oddly enough) one for producers. Collectively, the groups share a desire to transform Glasgow into a global production hub, following the infrastructure developments in nearby cities like Belfast, Prague, and Budapest. They furthermore frame their objectives in political terms: establishing global scale is considered a necessary maneuver to improve local working conditions like workplace safety, income disparity, skills training, and job access. Ultimately, I argue these groups are a product of an inadequate union structure and outdated policy vision for the screen sector , once-supportive institutions currently out of sync with the global realities of media production. Furthermore, the groups’ advocacy efforts reveal the extent to which workers themselves (in additional to capital) can seek “spatial fixes” to suture their prospects to specific political and economic goals. Of course, such activities manifest under conditions outside of the workers’ control but nevertheless point to an important tension within capitalist social relations, namely that the agency to reshape the spatial relationships in their own lives recasts the geography of labor in terms that aren’t inherent or exclusive to the interests of global capital.