Stepwise regression: history plot. Why yellow band = min(BIC|AICc)+10 and green = min(BIC|AICc) + 5 ?

Not_A_Student

In both the stepwise regression and in the generalized regression there is a yellow and a green band in the history plot of the V (goodness of fit)  were v is either AICc or BIC.  

 

The instruction manual tells that yellow is  min(V) + 10 and green is min(V) + 5.

In the generalized regression platform it may also be used as a stopping rule like 'biggest inside yellow'.

 

But why the +10 and +5 and has there anyone justified those values in a monograph or a presentation or another referable source?

 

And why did JMP deliberately choose those 2 numbers?

 

Related pic:

 

 

Looking forward for feedback!

Mark_Bailey

The documentation explains the use of the bands and cites the sources you want:

Comparable Model Zones

Although a model is estimated to be the best model, there can be uncertainty relative to this selection. Competing models might fit nearly as well and can contain useful information. For the AICc, BIC, KFold, and Leave-One-Out validation methods, and for a Validation Column with more than three values, the Validation Plot provides zones that identify competing models that might deserve consideration. Models that fall outside the zones are not recommended. See Burnham and Anderson (2004) and Burnham et al. (2011).

 

These criteria are not intended for inference. The information criteria are to be minimized, but like any metric, you should carefully examine the results and verify their validity, and not use them exclusively or blindly.

 

Please see the documentation for the Solution Path Plot and the associated references.