Hello all,
I am doing predictive modeling and would appreciate feedback on how well my model fits as I am new to modeling and don't want to make any mistakes in model selection. I have a binomial categorical response and continuous predictors (n=54, p=15). I have chosen a penalized model, Elastic Net, and my model seems to have an okay fit (RSquare = .28, ROC = .7888, pdf file attached).
I am concerned about the large confidence intervals shown in the profiler graphs, and want to make sure my model isn't overfit. That being said, the example binomial general regression shown in jmp documentation also has wide confidence intervals, so I'm wondering what is acceptable/expected with a binomial general regression (https://www.jmp.com/support/help/en/17.1/index.shtml#page/jmp/example-of-binomial-generalized-regression.shtml# ).
Do you have any feedback on if my model is showing signs of being overfit or if it looks safe to proceed? Are there any other metrics I should be considering in evaluating my fit?
Thank you in advance for taking a look at this!
