Skip to main content

Testing for Differences in Path Forecast Accuracy: Forecast-Error Dynamics Matter


Although the trajectory and path of future outcomes plays an important role in policy decisions, analyses of forecast accuracy typically focus on individual point forecasts. However, it is important to examine the path forecasts errors since they include the forecast dynamics. We use the link between path forecast evaluation methods and the joint predictive density to propose a test for differences in system path forecast accuracy. We also demonstrate how our test relates to and extends existing joint testing approaches. Simulations highlight both the advantages and disadvantages of path forecast accuracy tests in detecting a broad range of differences in forecast errors. We compare the Federal Reserve’s Greenbook point and path forecasts against four DSGE model forecasts. The results show that differences in forecast-error dynamics can play an important role in the assessment of forecast accuracy.

JEL codes: C12, C22, C52, C53.
Keywords: GFESM, log determinant, log score, mean square error.


Suggested citation: Martinez, Andrew B., 2017. “Testing for Differences in Path Forecast Accuracy: Forecast-Error Dynamics Matter,” Federal Reserve Bank of Cleveland, Working Paper no. 17-17. https://doi.org/10.26509/frbc-wp-201717.

Upcoming EventsSEE ALL

  • 11.30.17

    2017 Financial Stability and Fintech Conference

    The Federal Reserve Bank of Cleveland, the Office of Financial Research, and the University of Maryland’s Robert H. Smith School of Business invite you to attend the 2017 Financial Stability and Fintech Conference on November 30–December 1, 2017, in Washington DC. This year’s conference will highlight research and facilitate discussions related to the impact of innovation on financial stability, policy, and regulation.

  • 05.17.18

    CALL FOR PAPERS

    Inflation: Drivers and Dynamics 2018. Researchers from academia and central banks exchange ideas on modeling inflation and inflation expectations and their relationship to the macroeconomy.

  • 06.25.18

    International Journal of Central Banking Conference

    CALL FOR PAPERS The International Journal of Central Banking (IJCB) is organizing its 2018 annual conference, "Ten Years after the Global Financial Crisis: What Have We Learned about Ensuring Financial Stability?" The conference will be hosted by De Nederlandsche Bank (DNB) in Amsterdam, The Netherlands, on June 25-26, 2018, and is being organized by Tobias Adrian, Harrison Hong, Luc Laeven, and Loretta Mester.