Display Abstract

Title Linear theory for filtering nonlinear multiscale systems with model error

Name John Harlim
Country USA
Email jharlim@psu.edu
Co-Author(s) Tyrus Berry
Submit Time 2014-02-28 07:01:27
Session
Special Session 81: Improving climate and weather prediction through data-driven statistical modeling
Contents
We will discuss filtering of multiscale dynamical systems with model error arising from limitations in resolving the smaller scale processes. From the mathematical analysis, we learn that for a continuous time linear model with Gaussian noise, there exists a unique choice of parameters in a linear reduced model for the slow variables which gives the optimal filtering when only the slow variables are observed. Moreover, these parameters simultaneously gives the best equilibrium statistical estimates, and as a consequence they can be estimated offline from the equilibrium statistics. By examining a nonlinear test model, we show that the linear theory extends in this non-Gaussian, nonlinear configuration as long as we know the optimal stochastic parameterization and the correct observation model. However, when the stochastic parameterization model is inappropriate, parameters chosen for good filter performance may give poor equilibrium statistical estimates and vice versa; this finding is based on analytical and numerical results on our nonlinear test model and the two-layer Lorenz-96 model. Finally, even when the correct stochastic ansatz is given, it is imperative to estimate the parameters simultaneously and to account for the nonlinear feedback of the stochastic parameters into the reduced filter estimates. In numerical experiments on the two-layer Lorenz-96 model, we find that the parameters estimated \emph{online}, as part of a filtering procedure, simultaneously produces accurate filtering and equilibrium statistical prediction. In contrast, a linear regression based offline method, which fits the parameters to a given training data set independently from the filter, yields filter estimates which are worse than the observations or even divergent when the slow variables are not fully observed. This finding does not imply that all offline methods are inherently inferior to the online method in nonlinear estimation problems, it only suggests that an ideal estimation technique should estimate all parameters simultaneously whether it is online or offline.