Designing a Computer Vision System for Underwater Robotic Interventions

This thesis deals with the challenging problem of designing systems able to perceive objects in underwater environments. In the last few decades research activities in robotics have advanced the state of art regarding intervention capabilities of autonomous systems. State of art in fields such as localization and navigation, real time perception and cognition, safe action and manipulation capabilities, applied to ground environments (both indoor and outdoor) has now reached such a readiness level that it allows high level autonomous operations. On the opposite side, the underwater environment remains a very difficult one for autonomous robots. Water influences the mechanical and electrical design of systems, interferes with sensors by limiting their capabilities, heavily impacts on data transmissions, and generally requires systems with low power consumption in order to enable reasonable mission duration. Interest in underwater applications is driven by needs of exploring and intervening in environments in which human capabilities are very limited. Nowadays, most underwater field operations are carried out by manned or remotely operated vehicles, deployed for explorations and limited intervention missions. Manned vehicles, directly on-board controlled, expose human operators to risks related to the stay in field of the mission, within a hostile environment. Remotely Operated Vehicles (ROV) currently represent the most advanced technology for underwater intervention services available on the market. These vehicles can be remotely operated for long time but they need support from an oceanographic vessel with multiple teams of highly specialized pilots. Vehicles equipped with multiple state-of-art sensors and capable to autonomously plan missions have been deployed in the last ten years and exploited as observers for underwater fauna, seabed, ship wrecks, and so on. On the other hand, underwater operations like object recovery and equipment maintenance are still challenging tasks to be conducted without human supervision since they require object perception and localization with much higher accuracy and robustness, to a degree seldom available in Autonomous Underwater Vehicles (AUV). This thesis reports the study, from design to deployment and evaluation, of a general purpose and configurable platform dedicated to stereo-vision perception in underwater environments. Several aspects related to the peculiar environment characteristics have been taken into account during all stages of system design and evaluation: depth of operation and light conditions, together with water turbidity and external weather, heavily impact on perception capabilities. The vision platform proposed in this work is a modular system comprising off-the-shelf components for both the imaging sensors and the computational unit, linked by a high performance ethernet network bus. The adopted design philosophy aims at achieving high flexibility in terms of feasible perception applications, that should not be as limited as in case of a special-purpose and dedicated hardware. Flexibility is required by the variability of underwater environments, with water conditions ranging from clear to turbid, light backscattering varying with daylight and depth, strong color distortion, and other environmental factors. Furthermore, the proposed modular design ensures an easier maintenance and update of the system over time. Performance of the proposed system, in terms of perception capabilities, has been evaluated in several underwater contexts taking advantage of the opportunity offered by the MARIS national project. Design issues like energy power consumption, heat dissipation and network capabilities have been evaluated in different scenarios. Finally, real-world experiments, conducted in multiple and variable underwater contexts, including open sea waters, have led to the collection of several datasets that have been publicly released to the scientific community. The vision system has been integrated in a state of the art AUV equipped with a robotic arm and gripper, and has been exploited in the robot control loop to successfully perform underwater grasping operations.

Autonomous underwater vehicles: development and implementation of time and energy efficient trajectories

Autonomous underwater vehicles (AUVs) are increasingly used, both in military and civilian applications. These vehicles are limited mainly by the intelligence we give them and the life of their batteries. Research is active to extend vehicle autonomy in both aspects. Our intent is to give the vehicle the ability to adapt its behavior under different mission scenarios (emergency maneuvers versus long duration monitoring). This involves a search for optimal trajectories minimizing time, energy or a combination of both. Despite some success stories in AUV control, optimal control is still a very underdeveloped area. Adaptive control research has contributed to cost minimization problems, but vehicle design has been the driving force for advancement in optimal control research. We look to advance the development of optimal control theory by expanding the motions along which AUVs travel. Traditionally, AUVs have taken the role of performing the long data gathering mission in the open ocean with little to no interaction with their surroundings, MacIver et al. (2004). The AUV is used to find the shipwreck, and the remotely operated vehicle (ROV) handles the exploration up close. AUV mission profiles of this sort are best suited through the use of a torpedo shaped AUV, Bertram and Alvarez (2006), since straight lines and minimal (0 deg - 30 deg) angular displacements are all that are necessary to perform the transects and grid lines for these applications. However, the torpedo shape AUV lacks the ability to perform low-speed maneuvers in cluttered environments, such as autonomous exploration close to the seabed and around obstacles, MacIver et al. (2004). Thus, we consider an agile vehicle capable of movement in six degrees of freedom without any preference of direction.

A low-complexity flight controller for Unmanned Aircraft Systems with constrained control allocation

In this paper, we propose a framework for joint allocation and constrained control design of flight controllers for Unmanned Aircraft Systems (UAS). The actuator configuration is used to map actuator constraint set into the space of the aircraft generalised forces. By constraining the demanded generalised forces, we ensure that the allocation problem is always feasible; and therefore, it can be solved without constraints. This leads to an allocation problem that does not require on-line numerical optimisation. Furthermore, since the controller handles the constraints, and there is no need to implement heuristics to inform the controller about actuator saturation. The latter is fundamental for avoiding Pilot Induced Oscillations (PIO) in remotely operated UAS due to the rate limit on the aircraft control surfaces.

Manobras de condução assistida para veículos submarinos subactuados

A intervenção humana no manuseamento de veículos submarinos operados remotamente (ROVs) é um requisito necessário para garantir o sucesso da missão e a integridade do equipamento. Contudo, a sua teleoperação não é fácil, pelo que a condução assistida destes veículos torna-se relevante. Esta dissertação propõe uma solução para este problema para ROVs de 3DOF (surge, heave e yaw). São propostas duas abordagens distintas – numa primeira propõe-se um sistema de controlo Image Based Visual Servoing (IBVS) tendo em vista a utilização exclusiva de uma câmara (sensor existente neste tipo de sistemas) por forma a melhorar significativamente a teleoperação de um pequeno ROV; na segunda, propõe-se um sistema de controlo cinemático para o plano horizontal do veículo e um algoritmo de uma manobra capaz de dotar o ROV de movimento lateral através de uma trajectória dente-de-serra. Demonstrou-se em cenários de operação real que o sistema proposto na primeira abordagem permite ao operador de um ROV com 3DOF executar tarefas de alguma complexidade (estabilização) apenas através de comandos de alto nível, melhorando assim drasticamente a teleoperação e qualidade de inspecção do veículo em questão. Foi também desenvolvido um simulador do ROV em MATLAB para validação e avaliação das manobras, onde o sistema proposto na segunda abordagem foi validado com sucesso.

A remotely interrogated all-optical Rb-87 magnetometer

Atomic magnetometry was performed at Earth's magnetic field over a free-space distance of ten meters. Two laser beams aimed at a distant alkali-vapor cell excited and detected the Rb-87 magnetic resonance, allowing the magnetic field within the cell to be interrogated remotely. Operated as a driven oscillator, the magnetometer measured the geomagnetic field with less than or similar to 3.5 pT precision in a similar to 2 s data acquisition; this precision was likely limited by ambient field fluctuations. The sensor was also operated in self-oscillating mode with a 5.3 pT root Hz noise floor. Further optimization will yield a high-bandwidth, fully remote magnetometer with sub-pT sensitivity. (C) 2012 American Institute of Physics. [http://dx.doi.org/10.1063/1.4747206]

Making informed decisions on selecting promising Work Zone Safety Treatments

Lack of detailed and accurate safety records on incidents in Australian work zones prevents a thorough understanding of the relevant risks and hazards. Consequently it is difficult to select appropriate treatments for improving the safety of roadworkers and motorists alike. This paper presents a method for making informed decisions about safety treatments by 1) identifying safety issues and hazards in work zones, 2) understanding the attitudes and perceptions of both roadworkers and motorists, 3) reviewing the effectiveness of work zone safety treatments according to existing research, and 4) incorporating local expert opinion on the feasibility and usefulness of the safety treatments. Using data collected through semi-structured interviews with roadwork personnel and online surveys of Queensland drivers, critical safety issues were identified. The effectiveness of treatments for addressing the issues was understood through rigorous literature review and consultations with local road authorities. Promising work zone safety treatments include enforcement, portable rumble strips, perceptual measures to imply reduced lane width, automated or remotely-operated traffic lights, end of queue measures, and more visible and meaningful signage.

Towards making informed decisions on selecting promising work zone safety treatments

Lack of detailed and accurate safety records on incidents in Australian work zones prevents a thorough understanding of the relevant risks and hazards. Consequently it is difficult to select appropriate treatments for improving the safety of roadworkers and motorists alike. This paper outlines development of a conceptual framework for making informed decisions about safety treatments by: 1) identifying safety issues and hazards in work zones; 2) understanding the attitudes and perceptions of both roadworkers and motorists; 3) reviewing the effectiveness of work zone safety treatments according to existing research, and; 4) incorporating local expert opinion on the feasibility and usefulness of the safety treatments. Using data collected through semi-structured interviews with roadwork personnel and online surveys of Queensland drivers, critical safety issues were identified. The effectiveness of treatments for addressing the issues was understood through rigorous literature review and consultations with local road authorities. Promising work zone safety treatments include enforcement, portable rumble strips, perceptual measures to imply reduced lane width, automated or remotely-operated traffic lights, end of queue measures, and more visible and meaningful signage.

Evaluation of internal navigation sensor suites for underground mining vehicle navigation

This paper describes a series of trials that were done at an underground mine in New South Wales, Australia. Experimental results are presented from the data obtained during the field trials and suitable sensor suites for an autonomous mining vehicle navigation system are evaluated.

New insights from IODP Expedition 340 offshore Montserrat: First drilling of large volcanic island landslides

Montserrat now provides one of the most complete datasets for understanding the character and tempo of hazardous events at volcanic islands. Much of the erupted material ends up offshore, and this offshore record may be easier to date due to intervening hemiplegic sediments between event beds. The offshore dataset includes the first scientific drilling of volcanic island landslides during IODP Expedition 340, together with an unusually comprehensive set of shallow sediment cores and 2-D and 3-D seismic surveys. Most recently in 2013, Remotely Operated Vehicle (ROV) dives mapped and sampled the surface of the main landslide deposits. This contribution aims to provide an overview of key insights from ongoing work on IODP Expedition 340 Sites offshore Montserrat.Key objectives are to understand the composition (and hence source), emplacement mechanism (and hence tsunami generation) of major landslides, together with their frequency and timing relative to volcanic eruption cycles. The most recent major collapse event is Deposit 1, which involved ~1.8 km cubed of material and produced a blocky deposit at ~12-14ka. Deposit 1 appears to have involved not only the volcanic edifice, but also a substantial component of a fringing bioclastic shelf, and material locally incorporated from the underlying seafloor. This information allows us to test how first-order landslide morphology (e.g. blocky or elongate lobes) is related to first-order landslide composition. Preliminary analysis suggests that Deposit 1 occurred shortly before a second major landslide on the SW of the island (Deposit 5). It may have initiated English's Crater, but was not associated with a major change in magma composition. An associated turbidite-stack suggests it was emplaced in multiple stages, separated by at least a few hours and thus reducing the tsunami magnitude. The ROV dives show that mega-blocks in detail comprise smaller-scale breccias, which can travel significant distances without complete disintegration. Landslide Deposit 2 was emplaced at ~130ka, and is more voluminous (~8.4km cubed). It had a much more profound influence on the magmatic system, as it was linked to a major explosive mafic eruption and formation of a new volcanic centre (South Soufriere Hills) on the island. Site U1395 confirms a hypothesis based on the site survey seismic data that Deposit 2 includes a substantial component of pre-existing seafloor sediment. However, surprisingly, this pre-existing seafloor sediment in the lower part of Deposit 2 at Site U1395 is completely undeformed and flat lying, suggesting that Site U1395 penetrated a flat lying block. Work to date material from the upper part of U1396, U1395 and U1394 will also be summarised. This work is establishing a chronostratigraphy of major events over the last 1 Ma, with particularly detailed constraints during the last ~250ka. This is helping us to understand whether major landslides are related to cycles of volcanic eruptions.

ROV-based Deep Water Monitoring of the Northern Channel Islands Marine Protected Areas Annual Report - 2007

Research cruises were conducted in August-October 2007 to complete the third annual remotely operated vehicle (ROV)-based assessments of nearshore rocky bottom finfish at ten sites in the northern Channel Islands. Annual surveys at the Channel Islands have been conducted since 2004 at four sites and were expanded to ten sites in 2005 to monitor potential marine protected area (MPA)effects on baseline fish density. Six of the ten sites are in MPAs and four in nearby fished reference areas. In 2007 the amount of soft-only substrate on the 141 track lines surveyed was again estimated in real-time in order to target rocky bottom habitat. These real-time estimates of hard and mixed substrate for all ten sites averaged 57%, 1% more than the post-processed average of 56%. Surveys generated 69.9 km of usable video for use in finfish density calculations, with target rocky bottom habitat accounting for 56% (39.1 km) for all sites combined. The amount of rocky habitat sampled by site averaged 3.8 km and ranged from 3.3 km sampled at South Point, a State Marine Reserve (SMR) off Santa Rosa Island, to 4.7 km at Anacapa Island SMR. A sampling goal of 75 transects at all 10 sites was met using real-time habitat estimates combined with precautionary over-sampling by 10%. A total of seventy kilometers of sampling is projected to produce at least seventy-five 100 m2 transects per site. Thirteen of 26 finfish taxa observed were selected for quantitative evaluation over the time series based on a minimum criterion of abundance (0.05/100 m2). Ten of these 13 finfish appear to be more abundant at the state marine reserves relative to fished areas when densities were averaged across the 2005 to 2007 period. One of the species that appears to be more abundant in fished areas was señorita, a relatively small prey species that is not a commercial or recreational target. (PDF contains 83 pages.)

Cruise Report NOAA Ship McARTHUR II Cruise AR-04-04: Leg 2 (June 1-12, 2004): A pilot survey of deepwater coral/sponge assemblages and their susceptibility to fishing/harvest impacts at the Olympic Coast National Marine Sanctuary (OCNMS)

Summary: The offshore shelf and canyon habitats of the OCNMS (Fig. 1) are areas of high primary productivity and biodiversity that support extensive groundfish fisheries. Recent acoustic surveys conducted in these waters have indicated the presence of hard-bottom substrates believed to harbor unique deep-sea coral and sponge assemblages. Such fauna are often associated with shallow tropical waters, however an increasing number of studies around the world have recorded them in deeper, cold-water habitats in both northern and southern latitudes. These habitats are of tremendous value as sites of recruitment for commercially important fishes. Yet, ironically, studies have shown how the gear used in offshore demersal fishing, as well as other commercial operations on the seafloor, can cause severe physical disturbances to resident benthic fauna. Due to their exposed structure, slow growth and recruitment rates, and long life spans, deep-sea corals and sponges may be especially vulnerable to such disturbances, requiring very long periods to recover. Potential effects of fishing and other commercial operations in such critical habitats, and the need to define appropriate strategies for the protection of these resources, have been identified as a high-priority management issue for the sanctuary. To begin addressing this issue, an initial pilot survey was conducted June 1-12, 2004 at six sites in offshore waters of the OCNMS (Fig. 2, average depths of 147-265 m) to explore for the presence of deep-sea coral/sponge assemblages and to look for evidence of potential anthropogenic impacts in these critical habitats. The survey was conducted on the NOAA Ship McARTHUR-II using the Navy’s Phantom DHD2+2 remotely operated vehicle (ROV), which was equipped with a video camera, lasers, and a manipulator arm for the collection of voucher specimens. At each site, a 0.1-m2 grab sampler also was used to collect samples of sediments for the analysis of macroinfauna (> 1.0 mm), total organic carbon (TOC), grain size, and chemical contaminants. Vertical profiles of salinity, dissolved oxygen (DO), temperature, and pressure were recorded at each site with a small SeaCat conductivity-temperature-depth (CTD) profiler. Niskin bottles attached to the CTD also obtained near-bottom water samples in support of a companion study of microbial indicators of coral health and general ecological condition across these sites. All samples except the sediment-contaminant samples are being analyzed with present project funds. Original cruise plans included a total of 12 candidate stations to investigate (Fig. 3). However, inclement weather and equipment failures restricted the sampling to half of these sites. In spite of the limited sampling, the work completed was sufficient to address key project objectives and included several significant scientific observations. Foremost, the cruise was successful in demonstrating the presence of target deepwater coral species in these waters. Patches of the rare stony coral Lophelia pertusa, more characteristic of deepwater coral/sponge assemblages in the North Atlantic, were observed for the first time in OCNMS at a site in 271 meters of water. A large proportion of these corals consisted of dead and broken skeletal remains, and a broken gorgonian (soft coral) also was observed nearby. The source of these disturbances is not known. However, observations from several sites included evidence of bottom trawl marks in the sediment and derelict fishing gear (long lines). Preliminary results also support the view that these areas are important reservoirs of marine biodiversity and of value as habitat for demersal fishes. For example, onboard examination of 18 bottom-sediment grabs revealed benthic infaunal species representative of 14 different invertebrate phyla. Twenty-eight species of fishes from 11 families, including 11 (possibly 12) species of ommercially important rockfishes, also were identified from ROV video footage. These initial discoveries have sparked considerable interests in follow-up studies to learn more about the spatial extent of these assemblages and magnitude of potential impacts from commercial-fishing and other anthropogenic activities in the area. It is essential to expand our knowledge of these deep-sea communities and their vulnerability to potential environmental risks in order to determine the most appropriate management strategies. The survey was conducted under a partnership between NOAA’s National Centers for Coastal Ocean Science (NCCOS) and National Marine Sanctuary Program (NMSP) and included scientists from NCCOS, OCNMS, and several other west-coast State, academic, private, and tribal research institutions (see Section 4 for a complete listing of participating scientists). (PDF contains 20 pages)

A comparison of seafloor habitats and associated benthic fauna in areas open and closed to bottom trawling along the central California Continental Shelf

Executive Summary: A number of studies have shown that mobile, bottom-contact fishing gear (such as otter trawls) can alter seafloor habitats and associated biota. Considerably less is known about the recovery of these resources following such disturbances, though this information is critical for successful management. In part, this paucity of information can be attributed to the lack of access to adequate control sites – areas of the seafloor that are closed to fishing activity. Recent closures along the coast of central California provide an excellent opportunity to track the recovery of historically trawled areas and to compare recovery rates to adjacent areas that continue to be trawled. In June 2006 we initiated a multi-year study of the recovery of seafloor microhabitats and associated benthic fauna inside and outside two new Essential Fish Habitat (EFH) closures within the Cordell Bank and Gulf of the Farallones National Marine Sanctuaries. Study sites inside the EFH closure at Cordell Bank were located in historically active areas of fishing effort, which had not been trawled since 2003. Sites outside the EFH closure in the Gulf of Farallones were located in an area that continues to be actively trawled. All sites were located in unconsolidated sands at equivalent water depths. Video and still photographic data collected via a remotely operated vehicle (ROV) were used to quantify the abundance, richness, and diversity of microhabitats and epifaunal macro-invertebrates at recovering and actively trawled sites, while bottom grabs and conductivity/temperature/depth (CTD) casts were used to quantify infaunal diversity and to characterize local environmental conditions. Analysis of still photos found differences in common seafloor microhabitats between the recovering and actively trawled areas, while analysis of videographic data indicated that biogenic mound and biogenic depression microhabitats were significantly less abundant at trawled sites. Each of these features provides structure with which demersal fishes, across a wide range of size classes, have been observed to associate. Epifaunal macro-invertebrates were sparsely distributed and occurred in low numbers in both treatments. However, their total abundance was significantly different between treatments, which was attributable to lower densities at trawled sites. In addition, the dominant taxa were different between the two sites. Patchily-distributed buried brittle stars dominated the recovering site, and sea whips (Halipteris cf. willemoesi) were most numerous at the trawled site though they occurred in only five of ten transects. Numerical classification (cluster analysis) of the infaunal samples also revealed a clear difference between benthic assemblages in the recovering vs. trawled areas due to differences in the relative abundances of component species. There were no major differences in infaunal species richness, H′ diversity, or J′ evenness between recovering vs. trawled site groups. However, total infaunal abundance showed a significant difference attributable to much lower densities at trawled sites. This pattern was driven largely by the small oweniid polychaete Myriochele gracilis, which was the most abundant species in the overall study region though significantly less abundant at trawled sites. Other taxa that were significantly less abundant at trawled sites included the polychaete M. olgae and the polychaete family Terebellidae. In contrast, the thyasirid bivalve Axinopsida serricata and the polychaetes Spiophanes spp. (mostly S. duplex), Prionospio spp., and Scoloplos armiger all had significantly to near significantly higher abundances at trawled sites. As a result of such contrasting species patterns, there also was a significant difference in the overall dominance structure of infaunal assemblages between the two treatments. It is suggested that the observed biological patterns were the result of trawling impacts and varying levels of recovery due to the difference in trawling status between the two areas. The EFH closure was established in June 2006, within a month of when sampling was conducted for the present study, however, the stations within this closure area are at sites that actually have experienced little trawling since 2003, based on National Marine Fishery Service trawl records. Thus, the three-year period would be sufficient time for some post-trawling changes to have occurred. Other results from this study (e.g., similarly moderate numbers of infaunal species in both areas that are lower than values recorded elsewhere in comparable habitats along the California continental shelf) also indicate that recovery within the closure area is not yet complete. Additional sampling is needed to evaluate subsequent recovery trends and persistence of effects. Furthermore, to date, the study has been limited to unconsolidated substrates. Ultimately, the goal of this project is to characterize the recovery trajectories of a wide spectrum of seafloor habitats and communities and to link that recovery to the dynamics of exploited marine fishes. (PDF has 48 pages.)

Observations of deep coral and sponge assemblages in Olympic Coast National Marine Sanctuary, Washington. Cruise Report: NOAA Ship McArthur II Cruise AR06-07/07

From May 22 to June 4, 2006, NOAA scientists led a research cruise using the ROPOS Remotely Operated Vehicle (ROV) to conduct a series of dives at targeted sites in the Olympic Coast National Marine Sanctuary (OCNMS) with the goal of documenting deep coral and sponge communities. Dive sites were selected from areas for which OCNMS had side scan sonar data indicating the presence of hard or complex substrate. The team completed 11 dives in sanctuary waters ranging from six to 52 hours in length, at depths ranging from 100 to 650 meters. Transect surveys were completed at 15 pre-selected sites, with additional observations made at five other sites. The survey locations included sites both inside and outside the Essential Fish Habitat (EFH) Conservation Area, known as Olympic 2, established by the Pacific Fishery Management Council, enacted on June 12, 2006. Bottom trawling is prohibited in the Olympic 2 Conservation Area for nontribal fishermen. The Conservation Area covers 159.4 square nautical miles or about 15 percent of the sanctuary. Several species of corals and sponges were documented at 14 of the 15 sites surveyed, at sites both inside and outside the Conservation Area, including numerous gorgonians and the stony corals Lophelia pertusa and Desmophyllum dianthus, as well as small patches of the reef building sponge Farrea occa. The team also documented Lophelia sp. and Desmophyllum sp. coral rubble, dead gorgonians, lost fishing gear, and other anthropogenic debris, supporting concerns over potential risks of environmental disturbances to coral health. (PDF contains 60 pages.)

Benthic habitat mapping in the Olympic Coast National Marine Sanctuary: Classification of side scan sonar data from survey HMPR-108-2002-01: Version I

In September 2002, side scan sonar was used to image a portion of the sea floor in the northern OCNMS and was mosaiced at 1-meter pixel resolution using 100 kHz data collected at 300-meter range scale. Video from a remotely-operated vehicle (ROV), bathymetry data, sedimentary samples, and sonar mapping have been integrated to describe geological and biological aspects of habitat and polygon features have been created and attributed with a hierarchical deep-water marine benthic classification scheme (Greene et al. 1999). The data can be used with geographic information system (GIS) software for display, query, and analysis. Textural analysis of the sonar images provided a relatively automated method for delineating substrate into three broad classes representing soft, mixed sediment, and hard bottom. Microhabitat and presence of certain biologic attributes were also populated into the polygon features, but strictly limited to areas where video groundtruthing occurred. Further groundtruthing work in specific areas would improve confidence in the classified habitat map. (PDF contains 22 pages.)

Deepwater reef fishes and multibeam bathymetry of the Tortugas South Ecological Reserve, Florida Keys National Marine Sanctuary, Florida

The Tortugas South Ecological Reserve, located along the margin of the southwest Florida carbonate platform, is part of the largest no-take marine reserve in the U.S. Established in July 2001, the reserve is approximately 206 km2 in area, and ranges in depths from 30 m at Riley’s Hump to over 600 m at the southern edge of the reserve. Geological and biological information for the Tortugas South Reserve is lacking, and critical for management of the area. Bathymetric surveys were conducted with a Simrad EM 3000 multibeam echosounder at Riley’s Hump and Miller’s Ledge, located in the northern and central part of the reserve. Resulting data were used to produce basemaps to obtain geological ground truth and visual surveys of biological communities, including reef fishes. Visual surveys were conducted using SCUBA and the Phantom S2 Remotely Operated Vehicle (ROV) at Riley’s Hump. Visual surveys were conducted using the ROV and the Deepworker 2000 research submersible along Miller’s Ledge, within and outside of the reserve. A total of 108 fishes were recorded during SCUBA, ROV, and submersible observations. Replicate survey transects resulted in over 50 fishes documented at Miller’s Ledge, and eight of the top ten most abundant species were planktivores. Many species of groupers, including scamp (Mycteroperca phenax), red grouper (Epinephelus morio), snowy grouper (E. niveatus), speckled hind (E. drummondhayi), and Warsaw grouper (E. nigritus), are present in the sanctuary. Numerous aggregations of scamp and a bicolor phase of the Warsaw grouper were observed, indicating the importance of Miller’s Ledge as a potential spawning location for both commercially important and rare deep reef species, and as a potential source of larval recruits for the Florida Keys and other deep reef ecosystems of Florida