Validation of the SCEC broadband platform V14.3 simulation methods using pseudo spectral acceleration data
This paper summarizes the evaluation of ground motion simulation methods implemented on the SCEC Broadband Platform (BBP), version 14.3 (as of March 2014). A seven-member panel, the authorship of this article, was formed to evaluate those methods for the prediction of pseudo-‐spectral accelerations (PSAs) of ground motion. The panel’s mandate was to evaluate the methods using tools developed through the validation exercise (Goulet et al. ,2014), and to define validation metrics for the assessment of the methods’ performance. This paper summarizes the evaluation process and conclusions from the panel. The five broadband, finite-source simulation methods on the BBP include two deterministic approaches herein referred to as CSM (Anderson, 2014) and UCSB (Crempien and Archuleta, 2014); a band-‐limited stochastic white noise method called EXSIM (Atkinson and Assatourians, 2014); and two hybrid approaches, referred to as G&P (Graves and Pitarka, 2014) and SDSU (Olsen and Takedatsu, 2014), which utilize a deterministic Green’s function approach for periods longer than 1 second and stochastic methods for periods shorter than 1 second. Two acceptance tests were defined to validate the broadband finite‐source ground methods (Goulet et al., 2014). Part A compared observed and simulated PSAs for periods from 0.01 to 10 seconds for 12 moderate to large earthquakes located in California, Japan, and the eastern US. Part B compared the median simulated PSAs to published NGA-‐West1 (Abrahamson and Silva, 2008; Boore and Atkinson, 2008; Campbell and Bozorgnia, 2008; and Chiou and Youngs, 2008) ground motion prediction equations (GMPEs) for specific magnitude and distance cases using a pass-‐fail criteria based on a defined acceptable range around the spectral shape of the GMPEs. For the initial Part A and Part B validation exercises during the summer of 2013, the software for the five methods was locked in at version 13.6 (see Maechling et al., 2014). In the spring of 2014, additional moderate events were considered for the Part A validation, and additional magnitude and distance cases were considered for the Part B validation, for the software locked in at version 14.3. Several of the simulation procedures, specifically UCSB and SDSU, changed significantly between versions 13.6 and 14.3. The CSM code was not submitted in time for the v14.3 evaluation and its detailed performance is not addressed in this paper. As described in Goulet et al. (2014) and Maechling et al. (2014), the BBP generates a variety of products, including three-‐component acceleration time series. A series of post-‐processing codes were developed to provide individual component PSAs and average median horizontal-‐component PSA (referred to as RotD50; Boore, 2010) for oscillator periods ranging from 0.01 to 10 seconds, as well as median PSA values computed using the NGA-‐West 1 GMPEs. The BBP was also configured to provide statistical analysis of simulation results relative to recordings (Part A) and GMPEs (Part B) as described further in sections below. As part of our evaluation, we reviewed documentation provided by each of the developers, which included the technical basis behind the methods and the developer’s self-‐assessments regarding the extrapolation capabilities (in terms of magnitude and distance ranges) of their methods. Two workshops were held in which methods and results were presented, and the panel was given the opportunity to question the developers and to have detailed technical discussions. A SCEC report (Dreger et al., 2013) describes the results of this review for BBP version 13.6. This paper summarizes that work and presents results for the more recent BBP 14.3 validation.