SEARCH · USGS Science

Results for “Open Geospatial Data, Software and Standards”

Search indexed USGS publications on groundwater, aquifers, geologic maps, mineral resources and earthquakes. Explore source records by subject and place.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

13 recordsLinked to original sources

USGS2018

The conceptual schema in geospatial data standard design with application to GroundWaterML2

The explosive growth of geospatial data has stimulated the development of many standards aimed at decreasing data heterogeneity and enhancing data use. Well-established design methods for geospatial data standards typically involve the creation of two schemas for data structure, designated here as logical and physical, but this can lead to conceptual inconsistencies and modelling inefficiencies. In this paper we describe a design method that overcomes these issues by incorporating an additional schema – the conceptual schema – and demonstrate its application to the design of GroundWaterML 2 (GWML 2 ), a new international standard for groundwater data. Results include not only a new data standard, robustly constructed and tested, but also an enhanced method for geospatial data standard design.

Open Geospatial Data, Software and Standards↗

USGS2017

Oregon OCS seafloor mapping: Selected lease blocks relevant to renewable energy

In 2014 the U.S. Geological Survey (USGS) and the Bureau of Ocean Energy Management (BOEM) entered into Intra-agency agreement M13PG00037 to map an area of the Oregon Outer Continental Shelf (OCS) off of Coos Bay, Oregon, under consideration for development of a floating wind energy farm. The BOEM requires seafloor mapping and site characterization studies in order to evaluate the impact of seafloor and sub-seafloor conditions on the installation, operation, and structural integrity of proposed renewable energy projects, as well as to assess the potential effects of construction and operations on archaeological resources. The mission of the USGS is to provide geologic, topographic, and hydrologic information that contributes to the wise management of the Nation's natural resources and that promotes the health, safety, and well being of the people. This information consists of maps, databases, and descriptions and analyses of the water, energy, and mineral resources, land surface, underlying geologic structure, and dynamic processes of the earth. For the Oregon OCS study, the USGS acquired multibeam echo sounder and seafloor video data surrounding the proposed development site, which is 95 km2 in area and 15 miles offshore from Coos Bay. The development site had been surveyed by Solmar Hydro Inc. in 2013 under a contract with WindFloat Pacific. The USGS subsequently produced a bathymetry digital elevation model and a backscatter intensity grid that were merged with existing data collected by the contractor. The merged grids were published along with visual observations of benthic geo-habitat from the video data in an associated USGS data release (Cochrane and others, 2015). This report includes the results of analysis of the video data conducted by Oregon State University and the geo-habitat interpretation of the multibeam echo sounder (MBES) data conducted by the USGS. MBES data was published in Cochrane and others (2015). Interpretive data associated with this publication is published in Cochrane (2017). All the data is provided as geographic information system (GIS) files that contain both Esri ArcGIS geotiffs or shapefiles. For those who do not own the full suite of Esri GIS and mapping software, the data can be read using Esri ArcReader, a free viewer that is available at http://www.esri.com/software/arcgis/arcreader/index.html (last accessed August 29, 2016). Web services, which consist of standard implementations of ArcGIS representational state transfer (REST) Service and Open Geospatial Consortium (OGC) GIS web map service (WMS), also are available for all published GIS data. Web services were created using an ArcGIS service definition file, resulting in data layers that are symbolized as shown on the associated report figures. Both the ArcGIS REST Service and OGC WMS Service include all the individual GIS layers. Data layers are bundled together in a map-area web service; however, each layer can be symbolized and accessed individually after the web service is ingested into a desktop application or web map. Web services enable users to download and view data, as well as to easily add data to their own workflows, using any browser-enabled, standalone or mobile device. Though the surficial substrate is dominated by combinations of mud and sand substrate, a diverse assortment of geomorphologic features are related to geologic processes—one anticlinal ridge where bedrock is exposed, a slump and associated scarps, and pockmarks. Pockmarks are seen in the form of fields of small pockmarks, a lineation of large pockmarks with methanogenic carbonates, and areas of large pockmarks that have merged into larger variously shaped depressions. The slump appears to have originated at the pockmark lineation. Video-supervised numerical analysis of the MBES backscatter intensity data and vector ruggedness derived from the MBES bathymetry data was used to produce a substrate model called a seafloor character raster for the study area. The seafloor character raster consists of three substrate classes: soft-flat areas, hard-flat areas, and hard-rugged areas. A Coastal and Marine Ecological Classification Standard (CMECS) geoform and substrate map was also produced using depth, slope, and benthic position index classes to delineate geoform boundaries. Seven geoforms were identified in this process, including ridges, slump scars, slump deposits, basins, and pockmarks. Statistical analysis of the video data for correlations between substrate, depth, and invertebrate assemblages resulted in the identification of seven biomes: three hard-bottom biomes and four softbottom biomes. A similar analysis of vertebrate observations produces a similar set of biomes. The biome between-group dissimilarity was very high or high. Invertebrates alone represent most of the structure of the whole benthic community into different assemblages. A biotope map was generated using the seafloor character raster and the substrate and depth values of the biomes. Hard substrate biotopes were small in size and were located primarily on the ridge and in pockmarks along the pockmark lineation. The soft-bottom bitopes consisted of large contiguous areas delimited by isobaths.

Open-File Report↗

USGS2014

Metadata Wizard: an easy-to-use tool for creating FGDC-CSDGM metadata for geospatial datasets in ESRI ArcGIS Desktop

Creating compliant metadata for scientific data products is mandated for all federal Geographic Information Systems professionals and is a best practice for members of the geospatial data community. However, the complexity of the The Federal Geographic Data Committee’s Content Standards for Digital Geospatial Metadata, the limited availability of easy-to-use tools, and recent changes in the ESRI software environment continue to make metadata creation a challenge. Staff at the U.S. Geological Survey Fort Collins Science Center have developed a Python toolbox for ESRI ArcDesktop to facilitate a semi-automated workflow to create and update metadata records in ESRI’s 10.x software. The U.S. Geological Survey Metadata Wizard tool automatically populates several metadata elements: the spatial reference, spatial extent, geospatial presentation format, vector feature count or raster column/row count, native system/processing environment, and the metadata creation date. Once the software auto-populates these elements, users can easily add attribute definitions and other relevant information in a simple Graphical User Interface. The tool, which offers a simple design free of esoteric metadata language, has the potential to save many government and non-government organizations a significant amount of time and costs by facilitating the development of The Federal Geographic Data Committee’s Content Standards for Digital Geospatial Metadata compliant metadata for ESRI software users. A working version of the tool is now available for ESRI ArcDesktop, version 10.0, 10.1, and 10.2 (downloadable at http:/www.sciencebase.gov/metadatawizard ).

Open-File Report↗

USGS2012

Advancing global marine biogeography research with open-source GIS software and cloud-computing

Across many scientific domains, the ability to aggregate disparate datasets enables more meaningful global analyses. Within marine biology, the Census of Marine Life served as the catalyst for such a global data aggregation effort. Under the Census framework, the Ocean Biogeographic Information System was established to coordinate an unprecedented aggregation of global marine biogeography data. The OBIS data system now contains 31.3 million observations, freely accessible through a geospatial portal. The challenges of storing, querying, disseminating, and mapping a global data collection of this complexity and magnitude are significant. In the face of declining performance and expanding feature requests, a redevelopment of the OBIS data system was undertaken. Following an Open Source philosophy, the OBIS technology stack was rebuilt using PostgreSQL, PostGIS, GeoServer and OpenLayers. This approach has markedly improved the performance and online user experience while maintaining a standards-compliant and interoperable framework. Due to the distributed nature of the project and increasing needs for storage, scalability and deployment flexibility, the entire hardware and software stack was built on a Cloud Computing environment. The flexibility of the platform, combined with the power of the application stack, enabled rapid re-development of the OBIS infrastructure, and ensured complete standards-compliance.

Transactions in GIS↗

USGS2011

OpenStreetMap Collaborative Prototype, Phase 1

Phase One of the OpenStreetMap Collaborative Prototype (OSMCP) attempts to determine if the open source software developed for the OpenStreetMap (OSM, http://www.openstreetmap.org) can be used for data contributions and improvements that meet or exceed the requirements for integration into The National Map (http://www.nationalmap.gov). OpenStreetMap Collaborative Prototype Phase One focused on road data aggregated at the state level by the Kansas Data Access and Support Center (DASC). Road data from the DASC were loaded into a system hosted by the U.S. Geological Survey (USGS) National Geospatial Technical Operations Center (NGTOC) in Rolla, Missouri. U.S. Geological Survey editing specifications were developed by NGTOC personnel (J. Walters and G. Matthews, USGS, unpub. report, 2010). Interstate and U.S. Highways in the dataset were edited to the specifications by NGTOC personnel while State roads were edited by DASC personnel. Resulting data were successfully improved to meet standards for The National Map once the system and specifications were in place. The OSM software proved effective in providing a usable platform for collaborative data editing

Open-File Report↗

USGS2022

A geospatial knowledge graph prototype for national topographic mapping

Knowledge graphs are a form of database representation and handling that show the potential to better meet the challenges of data interoperability, semi-automated information reasoning, and information retrieval. Geospatial knowledge graphs (GKG) have at their core specialized forms of applied ontology that provide coherent spatial context to a domain of information including non-spatial attributes. This paper discusses research toward the development of a prototype GKG based on national topographic databases of geospatial feature instances, attributes, properties, metadata, and annotations. The challenges are to capture and represent geographic semantics inherent in the source data, to align such graph models with standards where possible, to test logical computations, and to visualize the data using a cartographic user interface. Data integration from outside sources was tested through SPARQL and GeoSPARQL queries. Called the MapKB, the approaches applied in this prototype use a number of software components to build a system architecture aligned with those objectives and are composed entirely of free and open-source software. The system and ontology design were validated through reasoning and competency questions. Technical aspects of the prototype software succeeded, but customization was found to be needed for user-based design.

International Archives of the Photogrammetry, Remo↗

USGS2016

Dynamic reusable workflows for ocean science

Digital catalogs of ocean data have been available for decades, but advances in standardized services and software for catalog search and data access make it now possible to create catalog-driven workflows that automate — end-to-end — data search, analysis and visualization of data from multiple distributed sources. Further, these workflows may be shared, reused and adapted with ease. Here we describe a workflow developed within the US Integrated Ocean Observing System (IOOS) which automates the skill-assessment of water temperature forecasts from multiple ocean forecast models, allowing improved forecast products to be delivered for an open water swim event. A series of Jupyter Notebooks are used to capture and document the end-to-end workflow using a collection of Python tools that facilitate working with standardized catalog and data services. The workflow first searches a catalog of metadata using the Open Geospatial Consortium (OGC) Catalog Service for the Web (CSW), then accesses data service endpoints found in the metadata records using the OGC Sensor Observation Service (SOS) for in situ sensor data and OPeNDAP services for remotely-sensed and model data. Skill metrics are computed and time series comparisons of forecast model and observed data are displayed interactively, leveraging the capabilities of modern web browsers. The resulting workflow not only solves a challenging specific problem, but highlights the benefits of dynamic, reusable workflows in general. These workflows adapt as new data enters the data system, facilitate reproducible science, provide templates from which new scientific workflows can be developed, and encourage data providers to use standardized services. As applied to the ocean swim event, the workflow exposed problems with two of the ocean forecast products which led to improved regional forecasts once errors were corrected. While the example is specific, the approach is general, and we hope to see increased use of dynamic notebooks across the geoscience domains.

Journal of Marine Science and Engineering↗

USGS2010

Visualizing NetCDF Files by Using the EverVIEW Data Viewer

Over the past few years, modelers in South Florida have started using Network Common Data Form (NetCDF) as the standard data container format for storing hydrologic and ecologic modeling inputs and outputs. With its origins in the meteorological discipline, NetCDF was created by the Unidata Program Center at the University Corporation for Atmospheric Research, in conjunction with the National Aeronautics and Space Administration and other organizations. NetCDF is a portable, scalable, self-describing, binary file format optimized for storing array-based scientific data. Despite attributes which make NetCDF desirable to the modeling community, many natural resource managers have few desktop software packages which can consume NetCDF and unlock the valuable data contained within. The U.S. Geological Survey and the Joint Ecosystem Modeling group, an ecological modeling community of practice, are working to address this need with the EverVIEW Data Viewer. Available for several operating systems, this desktop software currently supports graphical displays of NetCDF data as spatial overlays on a three-dimensional globe and views of grid-cell values in tabular form. An included Open Geospatial Consortium compliant, Web-mapping service client and charting interface allows the user to view Web-available spatial data as additional map overlays and provides simple charting visualizations of NetCDF grid values.

Fact Sheet↗

USGS2011

A working environment for digital planetary data processing and mapping using ISIS and GRASS GIS

Since the beginning of planetary exploration, mapping has been fundamental to summarize observations returned by scientific missions. Sensor-based mapping has been used to highlight specific features from the planetary surfaces by means of processing. Interpretative mapping makes use of instrumental observations to produce thematic maps that summarize observations of actual data into a specific theme. Geologic maps, for example, are thematic interpretative maps that focus on the representation of materials and processes and their relative timing. The advancements in technology of the last 30 years have allowed us to develop specialized systems where the mapping process can be made entirely in the digital domain. The spread of networked computers on a global scale allowed the rapid propagation of software and digital data such that every researcher can now access digital mapping facilities on his desktop. The efforts to maintain planetary missions data accessible to the scientific community have led to the creation of standardized digital archives that facilitate the access to different datasets by software capable of processing these data from the raw level to the map projected one. Geographic Information Systems (GIS) have been developed to optimize the storage, the analysis, and the retrieval of spatially referenced Earth based environmental geodata; since the last decade these computer programs have become popular among the planetary science community, and recent mission data start to be distributed in formats compatible with these systems. Among all the systems developed for the analysis of planetary and spatially referenced data, we have created a working environment combining two software suites that have similar characteristics in their modular design, their development history, their policy of distribution and their support system. The first, the Integrated Software for Imagers and Spectrometers (ISIS) developed by the United States Geological Survey, represents the state of the art for processing planetary remote sensing data, from the raw unprocessed state to the map projected product. The second, the Geographic Resources Analysis Support System (GRASS) is a Geographic Information System developed by an international team of developers, and one of the core projects promoted by the Open Source Geospatial Foundation (OSGeo). We have worked on enabling the combined use of these software systems throughout the set-up of a common user interface, the unification of the cartographic reference system nomenclature and the minimization of data conversion. Both software packages are distributed with free open source licenses, as well as the source code, scripts and configuration files hereafter presented. In this paper we describe our work done to merge these working environments into a common one, where the user benefits from functionalities of both systems without the need to switch or transfer data from one software suite to the other one. Thereafter we provide an example of its usage in the handling of planetary data and the crafting of a digital geologic map. ?? 2010 Elsevier Ltd. All rights reserved.

Conference Paper↗

USGS2016

Technical Note: Harmonizing met-ocean model data via standard web services within small research groups

Work over the last decade has resulted in standardised web services and tools that can significantly improve the efficiency and effectiveness of working with meteorological and ocean model data. While many operational modelling centres have enabled query and access to data via common web services, most small research groups have not. The penetration of this approach into the research community, where IT resources are limited, can be dramatically improved by (1) making it simple for providers to enable web service access to existing output files; (2) using free technologies that are easy to deploy and configure; and (3) providing standardised, service-based tools that work in existing research environments. We present a simple, local brokering approach that lets modellers continue to use their existing files and tools, while serving virtual data sets that can be used with standardised tools. The goal of this paper is to convince modellers that a standardised framework is not only useful but can be implemented with modest effort using free software components. We use NetCDF Markup language for data aggregation and standardisation, the THREDDS Data Server for data delivery, pycsw for data search, NCTOOLBOX (MATLAB®) and Iris (Python) for data access, and Open Geospatial Consortium Web Map Service for data preview. We illustrate the effectiveness of this approach with two use cases involving small research modelling groups at NATO and USGS.

Ocean science and engineering↗

USGS2017

Elevation Difference and Bouguer Anomaly Analysis Tool (EDBAAT) User's Guide

This report describes a software tool that imports gravity anomaly point data from the Gravity Database of the United States (GDUS) of the National Geospatial-Intelligence Agency and University of Texas at El Paso along with elevation data from The National Map (TNM) of the U.S. Geological Survey that lie within a user-specified geographic area of interest. Further, the tool integrates these two sets of data spatially and analyzes the consistency of the elevation of each gravity station from the GDUS with TNM elevation data; it also evaluates the consistency of gravity anomaly data within the GDUS data repository. The tool bins the GDUS data based on user-defined criteria of elevation misfit between the GDUS and TNM elevation data. It also provides users with a list of points from the GDUS data, which have Bouguer anomaly values that are considered outliers (two standard deviations or greater) with respect to other nearby GDUS anomaly data. “Nearby” can be defined by the user at time of execution. These outputs should allow users to quickly and efficiently choose which points from the GDUS would be most useful in reconnaissance studies or in augmenting and extending the range of individual gravity studies.

Open-File Report↗

USGS2023

Guidelines for calibration of uncrewed aircraft systems imagery

Executive Summary This report outlines quality assurance (QA) processes, including radiometric and geometric calibration guidelines, and guidelines for data acquisition and quality control to be followed by U.S. Geological Survey (USGS) researchers for acquiring and processing uncrewed aircraft systems (UAS) data. These QA processes ensure that UAS data can be used for quantitative analysis and are comparable with other standard geospatial data. Remote sensing data play a critical role in monitoring Earth’s resources. Traditionally, the USGS and Department of the Interior have used well calibrated metric sensors mounted on satellite or aircraft platforms to collect these data. These sensors and platforms are stable, and data have been processed using standard pipelines. These processes ensured that the data are generally consistent with each other and benefitted a diverse group of users. These data are shared among multiple researchers around the world through the internet and other means, using standard formats and metadata. In the last few years, UAS platforms have democratized the remote sensing data collection further, bringing an unparalleled level of control of time, sensors, and processes to individual researchers. Together with the development of cheaper and lighter sensors and relaxation of prohibitions against UAS operation in the National Airspace System by the Federal Aviation Authority, researchers can collect remote sensing data using UAS platforms. Researchers often customize the sensors on these UAS systems based on their specific requirements and use ad hoc processing steps to generate data. A challenge is that these data are often produced by a wide array of sensors and processes that render them potentially inconsistent with each other. Therefore, unlike data collected from metric sensors, UAS-based data are designed to benefit only specific user groups. The data thus generated often lack traceability to known standards, making them difficult to use with other geospatial data. This report provides radiometric and geometric calibration guidelines, as well as guidelines for data acquisition and quality control, that can be followed by USGS researchers in acquiring and processing UAS data. Instead of calibrating sensors, researchers collecting UAS data can focus on calibrating the data. Various radiometric calibration processes are provided, and the two panel empirical line method is highlighted for radiometric calibration. For geometric calibration, USGS and Department of the Interior researchers are experienced in following standard calibration procedures provided by standard UAS data processing software. However, researchers may be aided in paying attention to the tie points and the accuracy of the ground control points used for geometric calibration and data production. The accuracy of ground control points are related to the requirements of the project. The ground control points and the quality of tie points directly contribute to the geometric accuracy of the data, regardless of the ground sample distance of the imagery. The guidelines outlined in this report are intended to ensure that the data are in common units and are quantifiable and comparable with other data. These QA and calibration processes can be critical in ensuring that these datasets are used to the maximum extent possible. Including the calibration parameters (and their uncertainties) as part of metadata can allow for easier data discovery and analytical filters.

Open-File Report↗

USGS2002

Rationale and operational plan to upgrade the U.S. gravity database

A concerted effort is underway to prepare a substantially upgraded digital gravity anomaly database for the United States and to make this data set and associated usage tools available on the internet. This joint effort, spearheaded by the geophysics groups at the National Imagery and Mapping Agency (NIMA), University of Texas at El Paso (UTEP), U.S. Geological Survey (USGS), and National Oceanic and Atmospheric Administration (NOAA), is an outgrowth of the new geoscientific community initiative called Geoinformatics (www.geoinformaticsnetwork.org). This dominantly geospatial initiative reflects the realization by Earth scientists that existing information systems and techniques are inadequate to address the many complex scientific and societal issues. Currently, inadequate standardization and chaotic distribution of geoscience data, inadequate accompanying documentation, and the lack of easy-to-use access tools and computer codes for analysis are major obstacles for scientists, government agencies, and educators. An example of the type of activities envisioned, within the context of Geoinformatics, is the construction, maintenance, and growth of a public domain gravity database and development of the software tools needed to access, implement, and expand it. This product is far more than a high quality database; it is a complete data system for a specific type of geophysical measurement that includes, for example, tools to manipulate the data and tutorials to understand and properly utilize the data. On August 9, 2002, twenty-one scientists from the federal, private and academic sectors met at a workshop to discuss the rationale for upgrading both the United States and North American gravity databases (including offshore regions) and, more importantly, to begin developing an operational plan to effectively create a new gravity data system. We encourage anyone interested in contributing data or participating in this effort to contact G.R. Keller or T.G. Hildenbrand. This workshop was the first step in building a web-based data system for sharing quality gravity data and methodology, and it builds on existing collaborative efforts. This compilation effort will result in significant additions to and major refinement of the U.S. database that is currently released publicly by NOAA’s National Geophysical Data Center and will also include an additional objective to substantially upgrade the North American database, released over 15 years ago (Committee for the Gravity Anomaly Map of North America, 1987).

Open-File Report↗