USGS Science⌕ Search

USGS · 70202166

Uncertainty in quantitative analyses of topographic change: Error propagation and the role of thresholding

Abstract

Topographic surveys inevitably contain error, introducing uncertainty into estimates of volumetric or mean change based on the differencing of repeated surveys. In the geomorphic community, uncertainty has often been framed as a problem of separating out real change from apparent change due purely to error, and addressed by removing measured change considered indistinguishable from random noise from analyses (thresholding). Thresholding is important when quantifying gross changes (i.e. total erosion or total deposition), which are systematically biased by random errors in stable parts of a landscape. However, net change estimates are not substantially influenced by those same random errors, and the use of thresholds results in inherently biased, and potentially misleading, estimates of net change and uncertainty. More generally, thresholding is unrelated to the important process of propagating uncertainty in order to place uncertainty bounds around final estimates. Error propagation methods for uncorrelated, correlated, and systematic errors are presented. Those equations demonstrate that uncertainties in modern net change analyses, as well as in gross change analyses using reasonable thresholds, are likely to be dominated by low‐magnitude but highly correlated or systematic errors, even after careful attempts to reduce those errors. In contrast, random errors with little to no correlation largely cancel to negligible levels when averaged or summed. Propagated uncertainty is then typically insensitive to the precision of individual measurements, and is instead defined by the relative mean error (accuracy) over the area of interest. Given that real‐world mean elevation changes in many landscape settings are often similar in magnitude to potential mean errors in repeat topographic analyses, reducing highly correlated or systematic errors will be central to obtaining accurate change estimates, while placing uncertainty bounds around those results provides essential context for their interpretation.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Scott W. Anderson. 2019-02-10. Uncertainty in quantitative analyses of topographic change: Error propagation and the role of thresholding. https://doi.org/10.1002/esp.4551

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related USGS reports

Remote detection of streambank erosion and channel incision using high-resolution, repeat lidar-derived metrics in Raleigh, North Carolina

This study evaluated the use of lidar data to detect streambank erosion and channel incision throughout Raleigh, North Carolina. The study included five components. (1) Generation of lidar-derived rasters, including a digital elevation model of difference that represented channel erosion and positive openness rasters that represented channel incision. (2) Completion of site-based field assessments throughout the study area. (3) Spatial analysis of raster datasets at three spatial scales: erosion patches, channel segments, and subbasins. (4) Comparison of field assessment results with lidar-derived metrics. (5) Pairing of landscape attributes with lidar-derived metrics to evaluate potential causative factors associated with variations in channel incision. Field assessment results indicated 74% of surveyed sites had Bank Erosion Hazard Index ratings ranging from ‘high’ to ‘extreme’ and 77% had ‘high’ or ‘severe’ degrees of channel incision. Select field measures showed agreement with lidar-derived metrics. Lidar-derived erosion patches, ranging in size from 20 to 948 m 2 , were detected in 24.3% of channel segments, and patch density increased with Strahler stream order. Channel segments, ranging from 50 to 150 m, had inconsistent spatial patterns of erosion and incision. Erosion in channel segments increased with Strahler stream order and 36% of channel segments became more incised during the study period. Lidar-derived metrics across subbasins revealed variability of erosion and incision throughout the study area. The assessment of landscape drivers could not explain variability at the channel-segment scale, but subbasins with fewer forests tended to have greater erosion and incision. However, unexplained variability remained, demonstrating the complexity of stream stability in urban watersheds. As lidar datasets become more widespread, pairing remote data with field assessments may be a viable approach to characterize and understand stream geomorphology in urban settings.

North Carolina↗

Deep learning models for mapping surficial geology in selected physiographic regions of New York

Surficial geologic mapping is required for decisions including infrastructure and water-resource development and management. Deep learning, a type of machine learning that uses training data to self-learn and perform tasks, is explored as a tool to help increase efficiency of the labour- and time-intensive mapping process. Deep learning models were trained, and their potential to aid in mapping surficial geology was explored for two physiographic regions in New York: the high-relief Allegheny Plateau and the low-relief Erie-Ontario Lowlands. Key to the development of deep learning models is the availability of highly detailed surficial geologic maps in each of these regions from which the models can learn. Through exploring different groupings of surficial deposits and their corresponding spatial data, deep learning models were iteratively developed to reproduce published mapping for greater than 79% of the training areas, and with similar accuracy in test areas within the same physiographic region. These models were trained using only two inputs: high-resolution lidar data and previously published surficial geologic maps. This straightforward approach is intended to make the methods and models created easily reproducible using widely accessible datasets. This research describes the strengths and limitations of lidar-derived surficial geologic models and how broadly grouping surficial types, characteristics of different physiographic regions, and testing models in physiographic regions outside of their training areas affect model creation and performance. In addition, the models created could be used as a tool for mapping surficial geology in similar physiographic regions, in addition to establishing a framework for creating similar models elsewhere.

New York↗

Regional models for postfire debris-flow likelihood and rainfall thresholds across the western United States

The U.S. Geological Survey (USGS) uses an empirical model developed with logistic regression (the ‘M1’ model) to rapidly assess debris-flow likelihood and to identify quantitative rainfall thresholds for debris flows after wildfire in the western United States. The M1 model was calibrated to a debris-flow inventory from southern California (United States) and has been applied throughout the western United States. Limited spatial coverage in the calibration dataset has motivated evaluation of M1 model accuracy outside the calibration region (e.g., the Sierra Nevada or the eastern Cascade Range, United States). Previous test cases showed that M1 overpredicts debris-flow likelihood and underpredicts rainfall thresholds for some locations (e.g., Arizona, northern California, Colorado, New Mexico, United States). We sought to improve the regional applicability of a debris-flow likelihood model by expanding the debris-flow inventory used for calibration, testing multiple potential models and generating an updated model framework. The updated inventory includes 3788 observations from 67 burned areas paired with short duration rainfall ratios. The updated model framework consists of a modified model structure and sets of coefficients calibrated separately to the entire updated inventory and to subsets of the inventory that intersect three Environmental Protection Agency (EPA) Level 2 ecoregions (Mediterranean California, Upper Gila Mountains and Western Cordillera). Comparisons of predictions from the updated models with observed rainfall and debris-flow activity show that the updated models outperform the M1 model by ~15%–60% and improve the uniformity of predictive performance across the western United States. The updated models also reduce false positive rates relative to M1 and generate rainfall thresholds that are better aligned with relative differences in regional climatology and debris-flow activity.

Arizona, California, Colorado, Idaho, Montana, Nev↗