MASE - Mean Absolute Scaled Error

Calculates the mean absolute scaled error (MASE) between the forecast and the eventual outcomes.

 

Syntax

MASE(X, F, M)

X is the eventual outcome time series sample data (a one-dimensional array of cells e.g. row or column).

F is the forecast time series data (a one-dimensional array of cells e.g. row or column).

M is the seasonal period (for non-seasonal time series, set M=1 (default) or leave it blank).

 

Remarks

  1. The time series is homogeneous or equally spaced.
  2. The time series X and F must be of identical size
  3. The time series X or F may include observations with missing values (e.g. #N/A or blank).
  4. Observations with missing values in Y or F are excluded from the MASE calculation.
  5. The absolute scaled error is defined as follows:

    $$ q_t = \left\{\begin{array}{l} \frac{\left | e_t \right |}{\frac{1}{n-1}\times\sum_{t=2}^n \left | y_i - y_{i-1}\right |} \\ \frac{\left |e_t \right |}{\frac{1}{n-M}\times\sum_{t=M+1}^n \left | y_i - y_{i-M}\right |} \end{array} \right. \begin{array}{l} \{y_i\}\,\mathrm{is \, non-seasonal} \\ \{y_i\}\,\mathrm{is \, seasonal} \end{array} $$
    Where:
    • $\{y_t\}$ is the actual observations time series
    • $\{e_t\}$ is the forecast error for a given period.
  6. The absolute scaled error is generally the same as the absolute error divided (i.e. scaled) by the Mean Absolute error (MAE) of the naïve benchmark model.

    $$ q_t=\left\{\begin{array}{l} \frac{\left |e_t \right |}{\mathrm{MAE^*}} \\ \frac{\left |e_t \right |}{\mathrm{MAE_M^*}} \end{array} \right. \begin{array}{l} \{y_i\}\,\mathrm{is \, non-seasonal} \\ \{y_i\}\,\mathrm{is \, seasonal} \end{array} $$
    Where
    • $\mathrm{MAE^*}$ is the mean absolute error of the naïve (aka naive 1) benchmark forecast model calculated in-sample.
    • $\mathrm{MAE_M^*}$ is the in-sample mean absolute error of the seasonal naïve (aka naive 2) benchmark forecasting model calculated in-sample.
  7. The mean absolute scaled error (MASE) is calculated according to:

    $${\displaystyle {\mathrm{MASE}=\frac{1}{N}\sum_{i=1}^N q_i=\frac{\mathrm{MAE}}{\mathrm{MAE^*}}}}$$
  8. The MASE measure is symmetrical and resistant to outliers.
  9. Division by zero occurs only in one trivial case where all the values in the input time series are equal (i.e. constant).
  10. $\mathrm{MASE} \gt 1$ implies that actual forecast does worse than a naïve benchmark forecasting method calculated in-sample.
  11. $\mathrm{MASE} \lt 1\quad$ implies that actual forecast performance better than a naïve method
  12. We can use the MASE values for comparing different forecasting methods. The lower the MASE value, the lower the relative absolute forecast error, the better the method.
  13. The MASE function is available starting with version 1.65 HAMMOCK.

Examples

Example 1:

 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
A B C
Date Data Forecast
2008-01-01 -2.9 -2.95
2008-02-01 -2.83 -2.7
2008-03-01 -0.95 -1.00
2008-04-01 -0.88 -0.68
2008-05-01 1.21 1.50
2008-06-01 -1.67 -1.00
2008-07-01 0.83 0.90
2008-08-01 -0.27 -0.37
2008-09-01 1.36 1.26
2008-10-01 -0.34 -0.54
2008-11-01 0.48 0.58
2008-12-01 -2.83 -2.13
2009-01-01 -0.95 -0.75
2009-02-01 -0.88 -0.89
2009-03-01 1.21 1.25
2009-04-01 -1.67 -1.65
2009-05-01 -2.99 -3.20
2009-06-01 1.24 1.29
2009-07-01 0.64 0.60


  Formula Description (Result)
  =MASE($B$3:$B$21,$C$3:$C$21,1) MASE (9.83%)

Files Examples

References

Have more questions? Submit a request

0 Comments