Prediction Profiler Confidence Intervals

Question

Hello,

Does anyone know how confidence intervals are calculated within the prediction profiler? My results do not make sense. The range of values presented in the confidence interval are above the range of the input data values. See below:

Screenshot of data (values in the 9s):

Screenshot of prediction profiler with confidence interval, within a Fit Least Squares Model (values in the 10s):

I do not understand the disconnect between the input data and the resulting confidence interval in the profiler. My file is attached if anyone is willing to take a look and find any mistakes. Thank you in advance!

Updated Full 27 Hours Sensitivity Analysis.jmp

dale_lehman · Answer

I don't understand why you would expect something around 9.2 or 9.3.  The mean for your response variable is 4.2.  I think you are looking at the profiler the wrong way.  It is not a prediction for any particular observation - you can simulate the prediction (and its confidence interval) for any hypothetical set of factors you enter for the factors shown in the profiler.  So, the profiler is showing a prediction interval for single hypothetical observations.

You might just save the confidence intervals (either mean or individual) after running the model (found under Save Columns) and look at the confidence intervals for the entire data set predictions.  They look about right to me (aside from any improvements to the model that might be appropriate).

md2021 · Answer

I was expecting something around [9.6, 9.7]. This is what another program (Simio) calculated, and I cross-checked it with my manual calculations in Excel using this formula:

where alpha = 0.05 and t = 1.96. I did not expect an exact match, but I did expect some overlap.

Mark_Bailey · Answer

The prediction confidence interval is the predicted mean response plus or minus a multiple of the standard error of the predicted response. The standard error is the square root of the variance of the predicted response, which is a function of the predictor levels and the covariance matrix for the parameter estimates.

Here is a simple example in which I regressed :weight versus :height from the Big Class sample data table. I set the :height = 59, the same as the first observation.

Then I held the Alt key on Windows (Option key on Macintosh) and clicked the red triangle at the top of Fit Least Squares to get this dialog from which I selected Mean Confidence Interval Formula.

You can examine the column formula to see the calculation.

The linear predictor starts the formula to estimate the mean, then the rest is subtracted for the lower confidence bound. The 2.024 multiplier is the t quantile for 95% confidence and the error degrees of freedom.

What quantity did you expect for the interval?