Splitting data that is not intended to be used as Validation columnsValidation Column: Quite often we need to split data in a training and test set, but not into a validation set that is used for model selection. This does not work in JMP. E.g. for modeling methods where we can use cross validation, like NN or GLR, and want to make the model selection/validation based on the training data and using the test data really only for testing the model. Further when test data are excluded, boosted trees and random forest, are using the excluded data for validating the model (possibly for NN). This requires extra steps to delete the test data for modeling and add them later again for model comparison.
Statistics and AnalyticsRe: Splitting data that is not intended to be used as Validation columnsI've recorded this internally and added the defect id above.
@reese_sj, can you please enter a new item for the second part of this request (i.e., the out of bag estimates for model validation)? These are two different requests.
Thanks!
