USGS Science⌕ Search
Home/Archive/USGS

USGS · 70252763

Propensity score matching mitigates risk of faulty inferences in observational studies of effectiveness of restoration trials

Chad Raymond Kluender·Matthew J. Germino·Christopher A Anthony
View original source ↗Export metadata ↓

Abstract

Determining effectiveness of restoration treatments is an important requirement of adaptive management, but it can be non-trivial where only portions of large and heterogeneous landscapes of concern can be treated and sampled. Bias and non-randomness in the spatial deployment of treatment and thus sampling is nearly unavoidable in the data available for large-scale management trials, and the biophysical landscape characteristics underlying the bias are key but rare considerations in analyses of treatment effects. Treatment effects from large-scale management trials are typically estimated with multivariable regression (MVR) models. However, this method is unsuited to reliable estimations of treatment effects when treated and untreated areas differ in their underlying biophysical variability. An alternative to conventional regression is to use propensity score (PS) matching, which can limit the differences in confounding variables among treatment groups and assure the data collected or selected for analysis are more consistent with a randomized and unconfounded experiment. Thus, PS is expected to identify treatment effects more accurately. We used data from a large-scale monitoring effort of a megafire to evaluate the efficacy of PS matching in making inferences on treatment effects when treatments are applied non-randomly over a large heterogeneous area. We compared the resulting inference to both traditional MVR methods and to “naïve” methods that do not consider treatment allocation bias. Treatment effects varied between the different statistical methods for controlling selection bias and confounding biophysical factors. The PS-matched model revealed a weaker treatment effect of drill seeding and a greater effect of herbicide spraying on the cover of perennial bunchgrasses when compared to MVR or naïve modelled estimates. The inferences from the PS-matched model are considered more reliable because the treated and untreated plots are more similar in their underlying biophysical characteristics. Synthesis and applications . Failure to consider the non-random and selective deployment of restoration treatments by managers leads to faulty inference on their effectiveness. However, tools such as propensity-score matching can be used to remove the bias from analyses of the outcomes of management trials or to devise sampling plans that efficiently protect against the bias.

Explore related subjects

Journal of Applied EcologyArticle

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Chad Raymond Kluender, Matthew J. Germino, Christopher A Anthony. 2024-04-03. Propensity score matching mitigates risk of faulty inferences in observational studies of effectiveness of restoration trials. https://doi.org/10.1111/1365-2664.14638

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related USGS reports

USGS2026

Testing the efficacy of industrial mitigation measures for caribou in the Arctic

1. Mitigation measures are commonly employed to reduce the negative effects of industrial development on wildlife but are not often evaluated for their efficacy. For example, oil fields in the Arctic typically incorporate design features intended to increase permeability for migratory, barren-ground caribou ( Rangifer tarandus) , even though there is limited empirical evidence of the effectiveness of some of these features. 2. Given expected increases in energy development in the North American Arctic, we examined whether two mitigation measures commonly used for migratory caribou, elevating pipelines and separating roads and pipelines, were effective at increasing the probability caribou would cross infrastructure. 3. We conducted our investigation on adult female caribou in the Central Arctic Herd of Alaska during summer, analyzing movement data from telemetry collars (2015-2020) in conjunction with spatial data on oil field infrastructure. To evaluate whether caribou would cross infrastructure as a function of the mitigation measures, we employed a generalized additive modeling framework capable of detecting non-linear and threshold responses. 4. We found that caribou were more likely to cross a pipeline when the nearest pipeline was elevated (≥1.9-m), a result that supports current mitigation recommendations. We also found that caribou were more likely to cross both a road and pipeline when they were directly adjacent to one another, as opposed to being spatially separated, a result that contradicts recommended mitigation strategies. 5. Synthesis and applications . As new energy projects are designed and implemented in environments around the globe, it is important to ensure that mitigation efforts for wildlife are scientifically validated for their efficacy. In the North American Arctic, such efforts will be critical for minimizing the impacts of expanding industrial development on migratory caribou and on the human communities that rely on them for subsistence.

Alaska↗
USGS2026

Disease-associated mortality drives reduction in Yukon River Chinook salmon escapement: A novel method for quantifying the negative impacts of ‘misfit’ parasites to improve fisheries management

Parasites can suppress host populations through parasite-induced mortality. However, the negative effects of parasites are difficult to measure in wild populations and we have few tools for quantifying the magnitude of parasite-induced mortality. This is especially true for many ‘misfit’ parasites that do not fit into standard classifications (e.g. fungal-like parasites and myxozoans). As such, we are limited in our ability to include the effects of parasites in fish and wildlife management strategies. Chinook salmon ( Oncorhynchus tshawytscha ) are a species of immense cultural and ecological significance but populations are declining across much of their range. In the Yukon River, Alaska, USA, episodic outbreaks of the ichthyosporean parasite Ichthyophonus have been linked to declines, but population-level effects of Ichthyophonus on Yukon Chinook salmon remain largely unknown. We developed a novel model that leverages changes in parasite intensity distributions to quantify the magnitude of disease-induced mortality occurring in host populations. We used it to address two questions to inform management of Yukon Chinook salmon: (i) Is parasite-induced mortality occurring in Chinook salmon and at what magnitude? (ii) What are the drivers of spatio-temporal variability in parasite-induced mortality? Using 3 years of surveys, we quantified the evidence for the presence, magnitude, and variability in Ichthyophonus -induced mortality in Chinook salmon. Our model predicted that Ichthyophonus was responsible for between 8% and 15% mortality of the migrating Chinook salmon population prior to reaching the Canadian border and could describe nearly 35% of unaccounted for mortality at the border. The model predicted that variability in mortality among years could largely be explained by differences in parasite acquisition in the marine environment rather than differences in infection dynamics in the river. Synthesis and applications . Alaska Department of Fish and Game is implementing an annual monitoring program at the mouth of the Yukon River where our model will estimate the proportion of fish at risk from parasite-induced mortality to inform annual management. Moreover, the model is broadly applicable to other fungal-like and myxozoan parasites of conservation concern, where improved estimates of parasite-induced mortality could be used to predict parasite suppression of wild and managed host populations.

Alaska↗
USGS2026

Biocrust and seed placement influence emergence rates of perennial grass Elymus elymoides across five North American deserts

1. Dryland vascular plant emergence is often limited by water availability especially with projected climate and precipitation changes. Biological soil crusts (biocrusts) can promote water retention and nutrient availability that benefit germination, and emergence yet can also act as a surface barrier preventing critical seed soil contact and hindering emergence. Alongside these factors, dryland fire frequency has increased with the inclusion of invasive species and vegetation structural changes. With enhanced continuous fine fuel distribution there is a high potential to disrupt biocrust-plant interactions and influence associated management actions. 2. This study explores the dynamic relationship between biocrusts and fire-related heating effects on seedling emergence across five North American deserts: the Chihuahuan Desert, Colorado Plateau, Great Basin, Mojave Desert and Sonoran Desert. We conducted a greenhouse-based seedling emergence experiment using Elymus elymoides (bottlebrush squirreltail), a common perennial grass, with biocrust and bare soil mesocosms in which half were heated to mimic the effects of wildfire temperature. 3. The variables that had the greatest influence on germination rate and germination timing were the presence of biocrust and seed placement (on top of vs within the biocrust/soil matrix). Emergence rate was greatest atop bare soil followed by seeds inserted into biocrust. Emergence timing was faster with biocrust present, but only when seeds were inserted into it. Desert origin of biocrust and soil collection also influenced germination where the probability of any one seed emerging was highest in the Chihuahuan and Mojave desert sites relative to the Sonoran desert site which showed the lowest probability. Heating had mixed effects whereby it increased the likelihood of emergence but did not affect the overall rate or timing. 4. Synthesis and applications . This study underscores the importance of healthy and impaired biocrusts in dryland systems and suggests ways in which the combination of biocrust and seed placement can influence plant establishment, in addition to providing insight into seeding strategies for managers and restoration practitioners working in dryland sites.

Arizona, California, Colorado, Nevada, New Mexico↗