Underwater Systems

Lab overview

Andrea Munafo
Andrea Munafo
Riccardo Costanzi
Riccardo Costanzi
Andrea Caiti
Andrea Caiti
Francesco Ruscio
Francesco Ruscio
Olga Sambataro
Olga Sambataro
Simone Tani
Simone Tani

Robots and Platforms

Zeno AUV
AUV Zeno
X300/Folaga
AUV X300
BlueRov
BlueROV

Locations

<iframe src="https://isme.unige.it" width="1000" height="600"></iframe>

Some Recent and Current Projects

Human-Machine Teaming For the Maritime Environment

Hume
Human-Machine Teaming For the Maritime Environment

Multiple Autonomies

Multi-Autonomy
MOOS-IvP autonomy system and human-machine teaming put into practice at the MIT facilities. (Courtesy of MIT)

Underwater acoustic source localization using a multi-robot system

DAMPS
Underwater acoustic source localization using a multi-robot system

What’s in this introduction?

  • Motivations
  • Why using robots to explore, monitor, inspect, etc. the sea?
  • A short and rough description of underwater systems
  • The Topics of the course

Motivations

Science Questions

Climate Change

Climate change, as we’ve seen in recent news and scientific reports, is a global phenomenon with far-reaching impacts on both terrestrial and aquatic ecosystems.

Global Temperature Rise

Climate change is fundamentally driven by the increase in global average temperatures year after year. This rise in temperature is not a uniform process but varies across different regions and timescales.

_129755832_avg_temp_change_chart-nc

The plot illustrating this is the global average temperature relative to the pre-industrial average (1850-1900) shown above and taken from BBC | Global warming set to break key 1.5C limit for first time

In this plot: - Zero on the Vertical Axis: This represents a 50-year average temperature leading up to the 20th century. - Red and Blue Bars: These bars show annual average temperatures relative to the zero point. Red bars indicate years warmer than the average, and blue bars indicate cooler years.

It’s important to note that a global temperature rise of about 1.1 degrees Celsius over the last century might seem small, but it signifies a substantial energy imbalance in the Earth’s system. This energy imbalance is a key contributor to various climatic changes.

The energy required to raise the temperature of the Earth by one degree Celsius is immense.

Effects of Temperature Rise

The consequences of this temperature rise are diverse, including:

  • Extreme Weather Events: Such as droughts and floods.
  • Melting Glaciers and Polar Ice Caps: Leading to rising sea levels.
  • Impact on Marine Life: Changes in ocean temperatures and chemistry affect marine ecosystems.

The Role of Human Activities

Human activities, particularly the burning of fossil fuels like coal, oil, and gas, have been central to the rise in global temperatures.

1.Global-energy-substitution

Burning fossil fuels releases greenhouse gases (GHGs) like carbon dioxide (CO2), methane (CH4), and others into the atmosphere. These gases trap heat from the sun, leading to a warming effect known as the greenhouse effect.

1.Co2-levels-800k CO2
  • Measurements of air in ice cores show that for the past 800,000 years up until the 20th century, the atmospheric CO2 concentration stayed within the range 170 to 300 parts per million (ppm), making the recent rapid rise to more than 400 ppm over 200 years particularly remarkable.

see also here and here.

The levels of CO2 in the atmosphere have been remarkably stable over millennia but have shown an unprecedented rise in the last century. Understanding this requires examining historical data:

  • Ice Core Data: Scientists analyze ice cores to measure historical CO2 levels. These cores contain air bubbles that serve as time capsules, preserving atmospheric samples from the past.
  • Trends Observed: Historical data shows a dramatic increase in CO2 levels, especially in recent decades. This rise is directly linked to human activities, particularly the burning of fossil fuels.
  • Acceleration of CO2 Increase: The rate of increase in CO2 levels is not constant but accelerating. This acceleration implies a continually increasing rate of heat trapping in the atmosphere.

See also NASA | Ice Cores

Global Temperature Anomalies

Lobal warming is not uniform across the Earth. Variations exist due to factors like geographical location, land-sea distribution, and atmospheric circulation patterns.

from IPython.display import YouTubeVideo

YouTubeVideo('LwRTw_7NNJs', width=800, height=600)

Oceans Are Absorbing Almost All of the Globe’s Excess Heat

Ocean Warming
  • More than 90 percent of the excess heat retained by the Earth as a result of increased greenhouse gases has been absorbed by the oceans.
  • Ocean temperatures have been consistently rising for at least three decades.

Marine Robotics and Underwater Systems are central to this problem

MIT Understanding the Arctic. Ref. https://news.mit.edu/2021/navigating-beneath-arctic-ice-0423

Celebrating Marie Tharp

  • American geologist and oceanographic cartographer who helped prove the theories of continental drift.
  • She co-published the first world map of the ocean floors.
  • On Nov 21, 1998, the Library of Congress named Tharp one of the greatest cartographers of the 20th century.
<iframe src="https://www.google.com/doodles/celebrating-marie-tharp" width="1000" height="600"></iframe>
World ocean floor

Manuscript painting of Heezen-Tharp “World ocean floor” map by Berann (~1955)

Finding the Endurance

The wreck of Sir Ernest Shackleton’s ship ‘Endurance’ has been found off the coast of Antarctica more than a century after it sank.

Historian Dan Snow, who is a member of the Endurance22 expedition team, said the discovery was ‘like a miracle’ and the ship is ‘almost perfectly preserved’

endurace black-box
black-box black-box

see this for more!


Blackbox recovery

Air France 447 crash from Rio to Paris, June 1st, 2009

flight-bbc
</tr>
black-box black-box

Countries involved - Origin - Destination - Airspace at accident location - Airline company - Engines manufactures - Insurance companies - Passengers citizenship

Recovery

  • 13 aircrafts and 2 helicopters (Brasil, France, USA, Spain)
  • 8 Ships (Brasil, France, USA)
  • 2 6000m Manned Submarine (the Nautile)
  • 1 Nuclear Submarine (France)
  • 3 Autonomous Underwater Vehicles (AUVs)
  • 1 Remotely Operated Vehicle (ROV)
  • 1 million \(km^2\) of ocean explored
    • According to Wikipedia, the continental United States of America (the 48 states between Canada and Mexico) is 8,080,464.4 square kilometers.
  • cost \(\approx 30\) MEuros (in 2009)
  • completed 2Y after the crash
<td> <img src="./images/1.introduction/6.remora.png" alt="black-box" style="height: 250px;"/> </td> 
</tr>
flight-bbc black-box

Installation of Procution Well Jumper

Well Jumper Installation
  • Vehicle localised using acoustic baselines

Operating ROVs

  • Remotely operated vehicles, or ROVs, allow us to explore the ocean without actually being in the ocean.

  • These underwater machines are controlled by a person typically on a surface vessel, using a joystick in a similar way that you would play a video game. A group of cables, or tether, connects the ROV to the ship, sending electrical signals back and forth between the operator and the vehicle.

  • Most ROVs are equipped with at least a still camera, video camera, and lights, meaning that they can transit images and video back to the ship. Additional equipment, such as a manipulator or cutting arm, water samplers, and instruments that measure parameters like water clarity and temperature, may also be added to vehicles to allow for sample collection.

  • First developed for industrial purposes, such as internal and external inspections of underwater pipelines and the structural testing of offshore platforms, ROVs are now used for many applications, many of them scientific.

  • They have proven extremely valuable in ocean exploration and are also used for educational programs at aquaria and to link to scientific expeditions live via the Internet.

  • ROVs range in size from that of a small computer to as large as a small truck. Larger ROVs are very heavy and need other equipment such as a winch to put them over the side of a ship and into the water.

  • While using ROVs eliminates the “human presence” in the water, in most cases, ROV operations are simpler and safer to conduct than any type of occupied-submersible or diving operation because operators can stay safe (and dry!) on ship decks.

  • ROVs allow us to investigate areas that are too deep for humans to safely dive themselves, and ROVs can stay underwater much longer than a human diver, expanding the time available for exploration.

WHOI Engineer Jared Schwartz pilots the remotely operated vehicle, Saab Seaeye Falcon to investigate an unrecovered mooring anchor. (Photo by Daniel Hentz, Woods Hole Oceanographic Institution)
WHOI Engineer Jared Schwartz pilots the remotely operated vehicle, Saab Seaeye Falcon to investigate an unrecovered mooring anchor. (Photo by Daniel Hentz, Woods Hole Oceanographic Institution). Ref. https://www.whoi.edu/news-insights/content/flight-of-the-underwater-falcon/
13.rov-control-full-view black-box

Old approach:

  • Off-shore operator acts on the vehicle
  • Off-shore operator controls the arm motors directly (typically limited number of joints)
  • Interactions between arm and vehicle’s body
  • Voice coordination between the two
  • Manned Visual Feedback

ROV More recently

<figcaption>Video by the National Oceanography Centre of the UK. 
    Ref. https://www.youtube.com/watch?v=d6_dc25U4Uk</figcaption>
</figure>

On the18 August 2012 Isis, the UK’s iconic robotic submarine or ROV (Remotely Operated Vehicle) entered the cold waters of the Atlantic 300 miles from the coast of Spain. The NERC research vessel RRS James Cook carried the newly rebuilt vehicle on its first sea trials after an accident in early 2011 seriously damaged the research ROV.

  • Structured environments
    • Operators know how the environment looks like
    • ROV have automatic controls for:
      • station keeping (attitude and position) using up to 8 motors (depends on how many DoF they can control)
    • Force feedback to control the arm
    • Operator acts on a representation of the manipulator (task space)

Working with ROVs

  • 13 people / 24h
    • 8 Pilot/Technicians (4h shift)
    • 4 Supervisors (4h shift)
    • 1 Superintendent (on call)
  • How long onboard?
    • 4 to 6 weeks
    • ROV crews work 6h 7/7
ROV Jason helps recover two other underwater vehicles. (Photo by Woods Hole Oceanographic Institution)
Photo by Woods Hole Oceanographic Institution. Ref. https://www.whoi.edu/press-room/news-release/whois-rov-jason-assists-with-the-successful-recovery-of-two-other-underwater-vehicles/

Ocean Exploration Trust’s ROV Hercules and Argus were stranded on the seafloor last week, but were recovered thanks to cooperation from several ocean science and exploration institutions Woods Hole, MA — On Thursday, September 2, 2021 the remotely operated vehicle (ROV) Jason succeeded in helping recover two other underwater vehicles, ROV Hercules and Argus, that were stranded on the seafloor off the coast of British Columbia last week when their tether to the surface broke. The operation came about as a result of close collaboration and mutual aid that are a hallmark of the ocean science and exploration community and the maritime community as a whole.

Renewable energy

  • Marine energy: Tidal stream and wave power
<figcaption>Video by the Alstom.</figcaption>
</figure>
  • Power/communication cables

  • Fisheries and aquaculture

Fisheries
NTNU AMOS - Centre for Autonomous Marine Operations and Systems
  • Food
  • Health
  • Security
  • Safe
<figcaption>Video by Google.</figcaption>
</figure>

Other applications

  • Harbour Security
  • Mine-Counter Measurements
  • Intelligence, Surveillance and Reconnaissance
  • Inspections, Survey, Monitoring
from IPython.display import YouTubeVideo

display(YouTubeVideo('tefDNodT1jY', width=800, height=600))

Autonomous Vehicles

  • ROV
  • AUV
  • Gliders
  • Surface vehicles
1.rov-component-diagram-1024x455.jpg
<td> <img src="./images/1.introduction/1.auv-example.png" alt="1.auv-example" style="height: 350px;"/> </td>    
</tr>
1.Examples-of-currently-available-AUVs-illustrating-the-diversity-in-size-and-shape-in-AUV_W640.jpg
1.A-sample-of-current-propeller-driven-gray-and-gliders-black-AUVs-comparing-their_W640.jpg
1.noc-res-mars-glider-schematic.jpg 1-Figure1-1
  • Energetic efficient zig zag movement by adjusting resoirting forces

Wavegliders and Interventions

1.waveglider.jpg 1.girona-500.png

Bioinspired Robotics

1.44295_2023_10_Fig3_HTML 1.Eelume_Ekstrabilde_U_tekst.jpg

Costs

  • 1 day of operation for a research vessel: 50K Euros
  • 1 day of operation with a working class ROV: 100-300K Euros
  • 1 Robotic Arm suitable for underwater work: 400K Euros
  • 1 day of grophysical surveys: 1-3M Euros
  • Air France black box recovery: 30M Euros
  • Vessel for geophyical surveys (From design to launch): 200M Euros

Early Autonomy

hugin
  • Researcher/Scientists were not content to be limited to the vehicle manufacturer’s autonomy system.

  • How can they run the autonomy system from the payload computer, i.e., Payload Autonomy

  • Do you see limitations or concerns with this?

Autonomy can be complex, sometime is data driven, might be not deterministic and might increase the risk of losing a vehicle. Losing an AUV might set a research group back many years.

Next Challenges

Roles and next challenges
See 00_Syllabus.ipynb

for course structure.