Full Factorial Analysis with added blocking

Question

Dear JMP Community,

Initially, I have designed the following experiment using full factorial - 3 factor (2 continuous + 1 categorical) - process chamber being the categorical factor.

For the process of concern, it is already known that there will be chamber-to-chamber variation, but all chambers must be operable within a certain specification limit. Hence, the initial decision to include the chamber as categorical parameter.

In total there were 20 runs. The experiment has been performed and data have been collected.

1. Would be better if Full factorial with blocking being used in the first place, since the chamber can be considered as random effect? If yes, then i'm screwed. :(

2. Is there any other way to use the existing data collected to properly analyze the data?

Thank you in advance

AmirSS

Phil_Kay · Answer

It seems then that the model that you show in your first post with all main effects and interactions as fixed effects will be appropriate.

You will be able to find out if there are significant interaction effects between your continuous factors and Chamber. If there are, you should be able to find settings of the continuous factors that minimise the difference between the two chambers.

Of course, understanding how this then applies to all your chambers is a different matter as you have not tested them. Perhaps you can use your prior knowledge about chamber variation to help you with this. You will need to think about how representative these 2 chambers are of the range of the 12 chambers. And you might carry out additional runs with different chambers to test your predictions.

...There is a lot to consider for your next steps but analysing your current experiment with the fixed effects model will be a good start.

AmirSS · Answer

Thanks @Phil_Kay and @statman.

To answer the questions:

The question for you therefore is whether Chamber is like the "noisy" effect of DAY in the first example or is it like the predictable effect of DAY in the second example.

If my understanding is correct, the chamber should be a predictable effect.

1. Are you actually interested in experimenting (understanding causal structure) or testing (picking a winner)?  Do you want to understand why you would be getting potentially different effects of the 2 continuous variables for each chamber?

2. Curious as to why you are not trying to understand and possibly reduce the chamber to chamber variation?

3. Is there any significant within chamber variation?  How about measurement system error?

4. Are there only 2 chambers?  If so, are you trying to find the settings that work best in each chamber?

In total, I have 12 chambers of the same type. Here only 2 chambers were chosen due to limitation in terms of resources and chamber availability.

Chamber-to-chamber variation is assumed to be minimum because the chamber's hardwares are being calibrated according to 1 common method. (Exact value for hardware used from chamber-to-chamber may differ).

All in all, my main objective is to find the best setting of the 2 continuous variable that work best and can be applied to all 12 chambers.

Thanks all and hoping that the method to analyze my DOE can be enlightened.

statman · Answer

Phil advice and explanation is excellent.  My thoughts:

1. Are you actually interested in experimenting (understanding causal structure) or testing (picking a winner)?  Do you want to understand why you would be getting potentially different effects of the 2 continuous variables for each chamber?

2. Curious as to why you are not trying to understand and possibly reduce the chamber to chamber variation?

3. Is there any significant within chamber variation?  How about measurement system error?

4. Are there only 2 chambers?  If so, are you trying to find the settings that work best in each chamber?

5. You can certainly analyze the data set you have.  It seems you have a 3^2 factorial replicated over 2 chambers.  You could analyze the results for each chamber separately (if you are just looking to find the appropriate effects for each chamber) or if you actually want to get clues to understanding the effects and why they might be different for each chamber, you can include chamber and all chamber by factor interactions in the model.