DOE Question - Too Few Degrees of FreedomI am very new to the JMP community - just got my account up and running the other day.
I am running an experiment and I wish to see the effects of the main factors and all two-level interactions. I am using an L27 Taguchi array to account for four 3-level factors with three responses per row/per trial. I left some columns blank to make room for the two-level interactions. However, what I don't understand is when I run Fit Model and look at the Effect Tests, it appears that I do not have enough degrees of freedom to see whether or not my main factors and my two-level interactions are significant. (I plan on using an F-test to determine significance).
From my understanding, the total degrees of freedom for a given design/system is N-1, where N is the number of responses, or data points. I should have (27 runs * 3 responses per run) - 1 = 80 degrees of freedom. Even with subtracting off the #levels - 1 degrees of freedom for each main factor (80 less 8 = 72 left now) and the degrees of freedom for each two-way interaction, I don't see how I could run out of degrees of freedom.
Maybe I input something wrong in the table in JMP? Note: I did change some of the combinations of the numbers/levels for each run in my Taguchi array according to the columns that I left blank; see my attachments for my JMP file and my raw data.
Thank you in advance for your help and guidance!
DOERe: DOE Question - Too Few Degrees of FreedomWelcome to the Community.
I think you need to specify your two-way interactions in the model dialog already. The script saved in your table contains only main effects.
Re: DOE Question - Too Few Degrees of FreedomYou have all of your factors set up as nominal. With three levels, that means that each main effect will require two degrees of freedom. The interactions will require even more.
If you convert your columns to be numeric, continuous, you can estimate the model that you want. I have included that revised version of your table.
Re: DOE Question - Too Few Degrees of FreedomHi @Dan_Obermiller . That worked; I can now see the effects of the main factors and interactions. Can you explain/elaborate a bit more on what you did?
Here are my questions:
1) How did you convert the columns to numeric, continuous? What guided you to make this decision? What did you mean when you said that my original model was "nominal"?
2) How did you control the degrees of freedom for each interaction/factor by making this change to numeric, continuous?
3) What are the differences between my original model (without the numeric, continuous option selected) and the revised model (including the numeric, continuous option)? Why is the revised model a better option?
Thank you for your help!
Re: DOE Question - Too Few Degrees of FreedomI have the following thoughts:
An important question regarding your "runs", are these repeats or are they replicates? If the runs are done without any change to the treatment combinations, they are repeats and are not considered independent events (so they do not contribute to degrees of freedom). I don't see run order in your table (always good to keep track of run order). It appears they are repeats as you have one SN ratio for each treatment. Therefore you have 26 degrees of freedom total; 8 for your main effects (4 linear, 4 quadratic) and 18 for higher order effects. 2-factor interactions "require" 4 degrees of freedom each, so you do not have enough DF's.
A couple of questions about the data table:
1. The mean of the three runs does not correspond to the mean column in your data table? What data was used to calculate the means? Your formula is just calculating the mean of run 1 and 3?
2. Your equation for SN ratio appears to be the standard deviation of runs 1&3? This not the correct formula for SN ratio (per Taguchi)? If the target value of the response variable is Larger or Smaller is better, then just use the Standard deviation. If you are trying to hit a target nominal, then there is a different equation. What is the target for the response?
https://www.jmp.com/support/help/en/16.2/?os=mac&source=application&utm_source=helpmenu&utm_medium=application#page/jmp/overview-of-taguchi-designs.shtml#ww74478
3. You have an unusual range of data from the 3 runs for treatment (3 2 3 3, levels corresponding to factors in order of your table)?
4. If you take your design and go to DOE>Design Diagnostics>Evaluate Design, you may be able to figure out what the appropriate model is? Here is a color map of correlations:
5. I don't see the outer array? One of the most significant contributions of Taguchi was to experiment on controllable factors over a factorial of noise factors. The SN ratio was meant to be calculated over the data collected from the repeated runs over the factorial of noise (outer array).
I've attached a data table with, I think are the correct Means and Standard deviations for each treatment. I saved the fit model platform though I did not completely diagnose the singularity.
Re: DOE Question - Too Few Degrees of FreedomBefore I explain what I did, I must point out that I am not certain that you SHOULD do it. Please see the post by @statman for some very good questions.
To answer your questions 2 and 3: I only took a very cursory look at your table and saw the factors were nominal. I also saw that the factors were "left-aligned" within the column indicating that they were text fields even though the values were numbers. Nominal factors will always take more degrees of freedom because the idea of interpolation does not exist. For example, -1, 0, +1 only uses one degree of freedom if treated as continuous. Conceptually, you can safely ignore the 0 since you can estimate the slope using only -1 and +1 (again, this is the concept, not what actually happens mathematically). But for those same three values, if they are nominal, I could call them A, B, and C. Now I need to see the effect of A as well as the effect from B. (C can be obtained by difference). That is two degrees of freedom as I cannot use interpolation to help me.
Note that I am not saying the model with continuous factors is the better model. That is a different question. I am only saying this is a way for you to get a model with interactions. Does it make sense? I don't know. You know your data. Does it make sense to think of any of these as continuous variables? Based on their names, I am not sure it does. Again, refer to some of @statman's questions. Taguchi designs are often resolution III designs which means they are not supposed to estimate interactions.
As for your first question, how did I make the changes in JMP. I selected your factor columns. I went to Cols > Standardize Attributes. I clicked on Attributes and chose Data Type. Changed the Data Type to Numeric
I went back to Attributes and selected Modeling Type. I changed the Modeling Type field to Continuous. Clicked OK. Fit the model.
Re: DOE Question - Too Few Degrees of FreedomI'm coming to this thread with a different line of questioning from @Dan_Obermiller and @statman although I concur with all their thoughts. I'm going to ask one question: What is your level of expertise wrt to the Design of Experiments and modeling process? If it's novice...I would cease and desist any further experimentation or analysis and run to the SAS "Statistical Thinking for Industrial Problem Solving" course and complete the entire course end to end. Here is a link to the course landing page:
Statistical Thinking for Industrial Problem Solving
The course is free, all you need is a web browser and curiosity. You don't even need JMP...the course design is such that as you complete the course and exercises you will be running JMP Pro in a virtual machine environment.
