3 Short Term Trend Analysis

Description: Time series trend analysis for short time series

Found in: State of the Ecosystem - Gulf of Maine & Georges Bank (2025+), State of the Ecosystem - Mid-Atlantic (2025+)

Indicator category: Extensive analysis, not yet published

Contributor(s): Andy Beet

Data steward: NA

Point of contact: Andy Beet,

Public availability statement: NA

3.1 Methods

In prep: A.Beet “A test for short term trend detection in the presence of autocorrelation”

The specific model addressed here is of the form,

\[\begin{equation} Y_t = \beta_0 + \beta_1 t + \epsilon_t \end{equation}\]

where \(\epsilon_t = \phi\epsilon_{t-1} + z_t\) is a stationary first order autoregressive process with \(z_t \sim N(0,\sigma^2)\). Interest centers on testing the null hypothesis, \(H_0:\beta_1 = 0\) against the alternative, \(H_1:\beta_1 \neq 0\)

Testing for a trend in time series data has been addressed by many authors from a wide range of disciplines including economics, statistics, hydrology, ecology, fisheries, and epidemiology (Cochrane and Orcutt (1949), Prais and Winsten (1954), Beach and MacKinnon (1978), Park and Mitchell (1980), Brillinger (1994), Bence (1995), Woodward, Bottone, and Gray (1997), X. Zhang et al. (2000), Yue et al. (2002), Wang et al. (2015) ,Hardison et al. (2019b)). These approaches have typically taken one of three paths; non parametric methods such as the Mann Kendall test and its pre-whitening variants (Hamed and Ramachandra Rao (1998), X. Zhang et al. (2000), Yue and Wang (2002), Wang et al. (2015)); parametric methods involving data transformation such as Cochrane and Orcutt (1949), Prais and Winsten (1954), Woodward, Bottone, and Gray (1997); parametric methods such as generalized least squares and maximum likelihood estimation (Beach and MacKinnon (1978), Davidson and Mackinnon (1999), J. C. Pinheiro and Bates (2000)).

It has been well documented that under the null hypothesis of no trend, \(H_0:\beta_1=0\), in the presence of autocorrelation, parametric tests relying on asymptotic distribution theory reject the null hypothesis too frequently, leading to nominal significance levels that are too high, even for relatively long time series of length n = 100 (Woodward, Bottone, and Gray (1997)). Non parametric tests like those listed above also suffer the same problem.

We introduce a test that, like Beach and MacKinnon (1978), uses maximum likelihood for parameter estimation, but differs in that the significance of the likelihood ratio statistic, LR, is assessed via a parametric bootstrap (Efron and J. (1993)). Parametric bootstrap procedures have been used in some of the aforementioned work. Woodward, Bottone, and Gray (1997) uses an alternative statistic, the Cochrane-Orchutt statistic, for detecting a trend. Rayner (1990) focuses on the significance of the AR(1) parameter and Bence (1995) focuses on adjusting confidence intervals. We use the parametric bootstrap as an alternative means of assessing the significance of the LR statistic.

The Likelihood ratio statistic combined with a parametric bootstrap is employed to test for a linear trend in the presence of autocorrelation in the form of an AR(1) process. Small samples of size, n = 10, are of particular interest.

3.1.1 Data source(s)

NA

3.1.2 Data extraction

NA

3.1.3 Data analysis

Code used for the fitting and evaluation of short term trend can be found here.

catalog link No associated catalog page

References

Beach, Charles M., and James G. MacKinnon. 1978. “A Maximum Likelihood Procedure for Regression with Autocorrelated Errors.” Econometrica 46 (1): 51. https://doi.org/10.2307/1913644.
Bence, James R. 1995. “Analysis of Short Time Series: Correcting for Autocorrelation.” Ecology 76 (2): 628–39. https://doi.org/10.2307/1941218.
Brillinger, David R. 1994. “Trend Analysis: Time Series and Point Process Problems.” Environmetrics 5 (1): 1–19. https://doi.org/10.1002/env.3170050102.
Cochrane, D., and G. H. Orcutt. 1949. “Application of Least Squares Regression to Relationships Containing Auto-Correlated Error Terms.” Journal of the American Statistical Association 44 (245): 32–61. https://doi.org/10.1080/01621459.1949.10483290.
Davidson, R., and J. G. Mackinnon. 1999. “Economic Theory and Methods.” Oxford University Press, New York.
Efron, B., and Tibshirani R. J. 1993. “An Inrtoduction to the Bootstrap.” Chapman and Hall, New York.
Hamed, Khaled H., and A. Ramachandra Rao. 1998. “A Modified Mann-Kendall Trend Test for Autocorrelated Data.” Journal of Hydrology 204 (1-4): 182–96. https://doi.org/10.1016/S0022-1694(97)00125-X.
———. 2019b. “A Simulation Study of Trend Detection Methods for Integrated Ecosystem Assessment.” Edited by Marta Coll. ICES Journal of Marine Science 76 (7): 2060–69. https://doi.org/10.1093/icesjms/fsz097.
Park, Rolla Edward, and Bridger M. Mitchell. 1980. “Estimating the Autocorrelated Error Model with Trended Data.” Journal of Econometrics 13 (2): 185–201. https://doi.org/10.1016/0304-4076(80)90014-7.
Pinheiro, J. C., and D. M. Bates. 2000. “Mixed-Effects Models in s and s-PLUS.” Springer, New York.
Prais, S. J., and C. B. Winsten. 1954. “Trend Estimators and Serial Correlation.” Cowles Commission Discussion Paper No. 383. Chicago.
Rayner, Robert K. 1990. “Bootstrapping p Values and Power in the First-Order Autoregression: A Monte Carlo Investigation.” Journal of Business & Economic Statistics 8 (2): 251. https://doi.org/10.2307/1391988.
Wang, Wenpeng, Yuanfang Chen, Stefan Becker, and Bo Liu. 2015. “Linear Trend Detection in Serially Dependent Hydrometeorological Data Based on a Variance Correction Spearman Rho Method.” Water 7 (12): 7045–65. https://doi.org/10.3390/w7126673.
Woodward, Wayne A., Steven Bottone, and H. L. Gray. 1997. “Improved Tests for Trend in Time Series Data.” Journal of Agricultural, Biological, and Environmental Statistics 2 (4): 403. https://doi.org/10.2307/1400511.
Yue, Sheng, Paul Pilon, Bob Phinney, and George Cavadias. 2002. “The Influence of Autocorrelation on the Ability to Detect Trend in Hydrological Series.” Hydrological Processes 16 (9): 1807–29. https://doi.org/10.1002/hyp.1095.
Yue, Sheng, and Chun Yuan Wang. 2002. “Applicability of Prewhitening to Eliminate the Influence of Serial Correlation on the Mann-Kendall Test: TECHNICAL NOTE.” Water Resources Research 38 (6): 4-1-4-7. https://doi.org/10.1029/2001WR000861.
Zhang, Xuebin, Lucie A. Vincent, W. D. Hogg, and Ain Niitsoo. 2000. “Temperature and Precipitation Trends in Canada During the 20th Century.” Atmosphere-Ocean 38 (3): 395–429. https://doi.org/10.1080/07055900.2000.9649654.