USGS ScienceSearch

USGS · 70215202

From the oceans to the cloud: Opportunities and challenges for data, models, computation and workflows

Abstract

Advances in ocean observations and models mean increasing flows of data. Integrating observations between disciplines over spatial scales from regional to global presents challenges. Running ocean models and managing the results is computationally demanding. The rise of cloud computing presents an opportunity to rethink traditional approaches. This includes developing shared data processing workflows utilizing common, adaptable software to handle data ingest and storage, and an associated framework to manage and execute downstream modeling. Working in the cloud presents challenges: migration of legacy technologies and processes, cloud-to-cloud interoperability, and the translation of legislative and bureaucratic requirements for “on-premises” systems to the cloud. To respond to the scientific and societal needs of a fit-for-purpose ocean observing system, and to maximize the benefits of more integrated observing, research on utilizing cloud infrastructures for sharing data and models is underway. Cloud platforms and the services/APIs they provide offer new ways for scientists to observe and predict the ocean’s state. High-performance mass storage of observational data, coupled with on-demand computing to run model simulations in close proximity to the data, tools to manage workflows, and a framework to share and collaborate, enables a more flexible and adaptable observation and prediction computing architecture. Model outputs are stored in the cloud and researchers either download subsets for their interest/area or feed them into their own simulations without leaving the cloud. Expanded storage and computing capabilities make it easier to create, analyze, and distribute products derived from long-term datasets. In this paper, we provide an introduction to cloud computing, describe current uses of the cloud for management and analysis of observational data and model results, and describe workflows for running models and streaming observational data. We discuss topics that must be considered when moving to the cloud: costs, security, and organizational limitations on cloud use. Future uses of the cloud via computational sandboxes and the practicalities and considerations of using the cloud to archive data are explored. We also consider the ways in which the human elements of ocean observations are changing – the rise of a generation of researchers whose observations are likely to be made remotely rather than hands on – and how their expectations and needs drive research towards the cloud. In conclusion, visions of a future where cloud computing is ubiquitous are discussed.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Tiffany Vance, Micah Wengren, Eugene F. Burger, Debra Hernandez, Timothy Kearns, Encarni Medina-Lopez, Nazila Merati, Kevin O’Brien, Jonathan O’Neil, J. Potemra, Richard P. Signell, Kyle Wilcox. 2019-05-21. From the oceans to the cloud: Opportunities and challenges for data, models, computation and workflows. https://doi.org/10.3389/fmars.2019.00211

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related USGS reports

Repeated coral bleaching events have eroded reef accretion potential in the Florida Keys

Coral bleaching is now the primary driver of coral-reef degradation globally, threatening the persistence of coral-reef functions and the invaluable ecosystem services they support. The Florida Keys have been impacted by four severe, regional-scale coral-bleaching events, which occurred in 1997–1998, 2005, 2014–2015, and 2023. Our aim in this study was to quantify the effects of those thermal-stress events on the persistence of coral-reef structures. We leveraged long-term coral-reef monitoring data to quantify the impacts of coral bleaching on coral cover, carbonate production, and reef-accretion potential throughout the Florida Keys from 1996–2024. Our study indicates that coral bleaching drove significant declines of reef-building corals, which successively diminished regional-scale reef-accretion potential (from 1.65 ± 0.33 mm y -1 in 1996) and culminated with a regional-scale transition to net reef erosion (-0.12 ± 0.08 mm y -1 ) following the 2023 event. Coral bleaching was the primary driver of declining reef-building capacity, with the cumulative impacts of the four coral-bleaching events accounting for >75% of total declines since 1996. The 1997–1998 event alone drove ~50% of overall declines, largely due to losses of the shallow-water ecosystem engineer, Acropora palmata . More moderate impacts of thermal stress on regional reef-accretion potential in 2005 (6%) and 2014–2015 (9%) could lend some support to the hypothesis that the remaining corals were more thermally tolerant; however, the unprecedented thermal stress event in 2023 caused widespread coral-bleaching and bleaching-related mortality, and caused an additional 12% of the total decline in reef-accretion potential. Stony-coral tissue loss disease accounted for an additional 6% of the decline, with the remaining 19% unexplained. Coral bleaching has already dramatically reshaped the structure and function of coral reefs in the Florida Keys over the last three decades. With the high likelihood that thermal stress will accelerate moving forward, the persistence of Florida’s essential coral-reef functions and services is uncertain.

Florida

Fatal leptospirosis in southern sea otters from Central California: Pathologic findings and detection of Leptospira interrogans

Leptospira interrogans serovar Pomona infections cause periodic outbreaks in California sea lions (CSLs; Zalophus californianus ) and sporadic deaths in phocids. However, the frequency of infection and associated health impacts remain uncharacterized in sympatric threatened southern sea otters (SSOs; Enhydra lutris nereis ), which serve as important sentinels of coastal health. Given the broad impacts of L. interrogans on other marine mammals, our objective was to screen selected SSOs for infection, determine whether leptospirosis contributes to SSO mortality, and describe leptospiral-associated lesions. A retrospective review (2005–2025) identified 19 candidate cases that underwent detailed review, including Leptospira immunohistochemistry (IHC), serology, and polymerase chain reaction (PCR), with a special focus on renal and hepatic lesions. Kidney samples were PCR-positive for 74% (14/19) of suspected cases. For eight of these, DNA sequence-based serogroup typing detected L. interrogans serogroup Pomona. Seven of the 14 PCR-positive leptospirosis cases were classified as fatal based on positive renal IHC and moderate to severe tubulointerstitial nephritis. All fatal cases had anti- L. interrogans serovar Pomona antibody titers ≥1:25,600. The remaining seven PCR-positive cases were considered nonfatal leptospirosis due to minimal and/or unrelated renal lesions and negative IHC. Nonfatal Leptospira -infected cases ranged from seronegative to low positive (1:400) for serovar Pomona. Antibody titers for Leptospira PCR-negative cases were negative. In fatal cases, gross renal changes were often inapparent or characterized by miliary white cortical foci. Renal histologic lesions included tubulointerstitial nephritis, acute tubular necrosis, and suppurative tubulitis with intratubular bacteria, along with positive IHC staining for leptospiral antigen in the lesions. Gross hepatic changes were also inapparent in fatal cases, and histologic lesions were rare, characterized in one animal by hepatocellular dissociation and in two sea otters by limited leptospiral antigen detection by IHC. Most Leptospira -infected sea otters (71%, 10/14) stranded during higher rainfall months in California, suggesting possible land-to-sea transmission from terrestrial hosts. Given these findings, and because L. interrogans serovar Pomona infections have been confirmed in sympatric CSLs and terrestrial mammals from adjacent watersheds, a focused investigation of potential marine and terrestrial disease transmission dynamics could provide new information to reduce SSO mortalities.

California

Widespread reproductive deficits in Chesapeake Bay ospreys

Introduction: Ospreys ( Pandion haliaetus ) are well-known sentinels of aquatic ecosystem health and are indicators of both environmental contaminants and fish stocks. The Chesapeake Bay supports one of the largest osprey breeding populations in the world, but recent studies have documented declining reproductive performance and increasing food stress in some portions of the estuary. Methods: We monitored osprey nests (N = 571) throughout the Chesapeake Bay during the 2024 breeding season and compared breeding metrics between high-salinity (>10 parts per thousand [ppt]) and low-salinity (<5 ppt) study areas. We also compared contemporary breeding performance within four high-salinity sites to historical data collected during the 1980s. Results: Salinity was strongly associated with breeding performance and the likelihood that pairs achieved productivity levels required for population maintenance. All high-salinity study areas functioned as demographic sinks, whereas low-salinity areas functioned as demographic sources. Breeding metrics including the proportion of pairs breeding, clutch size, nesting failure, brood reduction, and nestling loss all suggested greater food stress within high-salinity areas. Temporal comparisons documented substantial declines in reproductive performance between the 1980s and 2024 within high-salinity study sites. High-salinity sites during the 1980s exhibited breeding performance comparable to low-salinity sites in 2024. Discussion: Although several factors may influence osprey productivity within the Chesapeake Bay, we suggest that reduced availability of Atlantic menhaden ( Brevoortia tyrannus ) is a primary driver of poor reproductive performance within high-salinity waters.

Maryland, Virginia