SLR_GOF - Goodness of fit for Simple Regression Model

Calculates a measure for the goodness of fit (e.g. LLF, R^2, etc.).

 

Syntax

SLR_GOF(X, Y, Intercept, Return_type)

X is the independent (aka explanatory or predictor) variable data array (one dimensional array of cells (e.g. rows or columns)).

Y is the response or the dependent variable data array (one dimensional array of cells (e.g. rows or columns)).

Intercept is the constant or the intercept value to fix (e.g. zero). If missing, an intercept will not be fixed and is computed normally.

Return_type is a switch to select the return output (1 = R-Square (default), 2 = Adj. R-Square, 3 = RMSE, 4 = LLF, 5 = AIC, 6 = SIC/BIC).

Method Description
1 R-Square
2 Adjusted R-Square
3 Regression Error
4 log-likelihood (LLF)
5 Akaike information criterion (AIC)
6 Schwartz/Bayesian information criterion (SBIC)
 

Remarks

  1. The underlying model is described here.
  2. The coefficient of determination, denoted $R^2$, provides a measure of how well observed outcomes are replicated by the model.

    $$R^2 = \frac{\mathrm{SSR}} {\mathrm{SST}} = 1 - \frac{\mathrm{SSE}} {\mathrm{SST}}$$
  3. The adjusted R-square (denoted $\bar R^2$) is an attempt to take account of the phenomenon of the $R^2$ automatically and spuriously increasing when extra explanatory variables are added to the model. The $\bar R^2$ adjusts for the number of explanatory terms in a model relative to the number of data points.
    $$\bar R^2 = {1-(1-R^{2}){N-1 \over N-2}} = {R^{2}-(1-R^{2}){1 \over N-2}} = 1 - \frac{\mathrm{SSE}/(N-2)}{\mathrm{SST}/(N-1)}$$
    Where:
    • $p$ is the number of explanatory variables in the model.
    • $N$ is the number of observations in the sample.
  4. The regression error is defined as the square root for the mean square error (RMSE):
    $$\mathrm{RMSE} = \sqrt{\frac{SSE}{N-2}}$$
  5. The log likelihood of the regression is given as:
    $$\mathrm{LLF}=-\frac{N}{2}\left(1+\ln(2\pi)+\ln\left(\frac{\mathrm{SSR}}{N} \right ) \right )$$
    The Akaike and Schwarz/Bayesian information criteria are given as:
    $$\mathrm{AIC}=-\frac{2\mathrm{LLF}}{N}+\frac{4}{N}$$
    $$\mathrm{BIC} = \mathrm{SIC}=-\frac{2\mathrm{LLF}}{N}+\frac{(2)\times\ln(2)}{N}$$
  6. The sample data may include missing values.
  7. Each column in the input matrix corresponds to a separate variable.
  8. Each row in the input matrix corresponds to an observation.
  9. Observations (i.e. rows) with missing values in X or Y are removed.
  10. The number of rows of the response variable (Y) must be equal to the number of rows of the explanatory variable (X).
  11. The SLR_GOF function is available starting with version 1.60 APACHE.

Files Examples

References

  • Hamilton, J .D.; Time Series Analysis , Princeton University Press (1994), ISBN 0-691-04289-6
  • Kenney, J. F. and Keeping, E. S. (1962) "Linear Regression and Correlation." Ch. 15 in Mathematics of Statistics, Pt. 1, 3rd ed. Princeton, NJ: Van Nostrand, pp. 252-285
Have more questions? Submit a request

0 Comments