nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

Help for analyzing data DOE Response Surface

Cedrick1

J’espère que vous allez bien.

Ce sont mes données sur mon étude. C’est sur la surface de réponse du DOE.

Comment analysez-vous et interprétez-vous les résultats ?

Quels indicateurs dois-je prendre en compte ?

Comment les interpréter et les valider, et choisir les meilleures formulations possibles ?

J’ai besoin d’aide

Box-Behnken 22.jmp

Accepted answers

statman

I looked at the data, but to really analyze the data, I would need to sit with the SME and discuss the findings. I added a couple of analysis scripts to your data table (attached here). It appears that all of your responses varied enough practically except for R8. The results are mixed from the model is insignificant to there are some responses that are interesting. There also appear to be some unusual data points (e.g., Treatment --0 for R2, treatment 000 for R7, R9 and R10). You might also want to look at residuals.

Your answer to Q3 is interesting and dare I say, misguided. The purpose of developing a model for prediction is to make sure the conditions of the future are represented in the experiment. If those conditions you held constant change in the future, none of your models may be useful. Holding factors constant during the experiment does the exact opposite of "ensuring the reliability of your results".

The exact standardization of experimental conditions, which is often thoughtlessly advocated as a panacea, always carries with it the real disadvantage that a highly standardized experiment supplies direct information only in respect to the narrow range of conditions achieved by the standardization. Standardization, therefore, weakens rather than strengthens our ground for inferring a like result, when, as is invariably the case in practice, these conditions are somewhat varied.

R. A. Fisher (1935), Design of Experiments (p.99-100)

“Unfortunately, future experiments (future trials, tomorrow’s production) will be affected by environmental conditions (temperature, materials, people) different from those that affect this experiment…It is only by knowledge of the subject matter, possibly aided by further experiments to cover a wider range of conditions, that one may decide, with a risk of being wrong, whether the environmental conditions of the future will be near enough the same as those of today to permit use of results in hand.”

Dr. Deming

How was the "pre-test" conducted?

You must be very careful in assessing significance. The estimate for the MSE is based on replicates at the center point (000) treatment (and some higher order terms left out of the model). it appears the center point is unusual for some responses. If this treatment was unusual, all bets are off. Typically when doing optimization type designs, I wouldn't be as concerned about statistical significance, but I do not have enough insight to your iterations.

Box-Behnken 22.jmp

All comments

statman

Here are my initial thoughts, realize you have provided limited context for performing analysis, so all I can do is ask questions:

1. What are the response variables? (Are they R1-R13?). How much of a change in those values is of practical importance? If you can find a factor that would change those values, what is the smallest increment of change you would be interested in?

2. Should the response variables correlate? Positively or negatively? Why or why not?

3. Under what "conditions" was the experiment run? How likely are those conditions to be constant in the future? (By conditions I mean inference space. How were the variables not manipulated in your experiment handled during the experiment?)

4. How were your levels selected?

5. What previous experiments or sampling plans have been run prior to this experiment? (Typically, response surface designs are optimization designs. This means, as examples, you already have a good approximation of measurement error, the effect of noise, and the stability of the system)

6. Why a Box-Behnken design? These designs preclude the the vertices of the design space. Are you concerned with the extremes of the design space? Why?

7. What are the scientific or engineering mechanisms you are trying to understand?

8. Have you predicted the results á priori? How do the results look compared to what you expect or what you predicted?

Are there any unusual data points?

Cedrick1

Thank you for getting back to me. Here is my reply.
Q1)
A change of 5 in R1 is of considerable consequence and should be kept to a minimum in the vicinity of 20.
A change of 5 in R2 is significant and should be minimised to a value close to 30.
A change of 0.02 in R3 is significant and should be minimised to a value close to 0.15.
A change of 0.5 in R4 is significant and should be close to 2. Similarly, a change of 1E-10 of R5 is significant and must be maximised close to 5 × 10-10.
A change of 5 in R6 is significant and must be maximised to a value close to 70.
A change of one unit in R7 is significant and should be minimised.
A change of 3 in R8 is significant and should be maximised to a value of approximately 10.
A change of 2 in R9 is significant and should be minimised.
A change of 5 in R10 is significant and should be maximised near 60.
A change of 5 in R11 is significant and should be minimised near 10.
A change of 1 in R12 is significant and should be maximised near 5.
A change of 5 in R13 is significant and should be maximised near 50.

Q2)
There is only a positive correlation between R3 and R5.

Q3)
It is crucial to note that the experiment was conducted under strictly controlled conditions, including a constant temperature, humidity, and lighting environment. These conditions were maintained with the utmost precision to ensure the reliability of the results.

Q4)
The selection of these levels could have been informed by an analysis of existing literature and a preliminary assessment. The experiment involved the testing of three levels of each factor, designated as low, medium, and high. These levels were selected on the basis of their practical and scientific relevance, as well as their suitability for the purposes of this study.

Q5)
A pilot study (pre-test) was conducted to identify the most significant factors.

Q6)
The presence of extreme levels of factors can result in product degradation and elevated costs. Therefore, utilising a Box-Behnken design can assist in maintaining a safer and more practical operational environment.

Q7)
The objective is to comprehend the manner in which fluctuations in variables impact responses, and to construct a model that elucidates the interrelationship between variables and responses.

Q8)

The anticipated outcomes are as follows:
It can be reasonably deduced that X1 has a significant effect on responses R2, R5, R12 and R13, which can be described as a positive correlation.
Similarly, it can be reasonably deduced that X2 has a significant effect on responses R2, R5, R12 and R13, which can be described as a positive correlation.
I don't know if there are unusual data points.

statman

R. A. Fisher (1935), Design of Experiments (p.99-100)

Dr. Deming

How was the "pre-test" conducted?

Box-Behnken 22.jmp

Cedrick1

Thank you very much for your answers, your contributions and your willingness to help me with this analysis.
I read them very carefully.
I would also like to ask you about the methodology or the steps to follow in order to analyse and interpret each response, the impact of the factors and the model as a whole with JMP.

Also, could you please clarify the following points for me:
1-"the model is insignificant"

2-"some answers are interesting"
3-"Presence of unusual data points"
4-"examine the residuals"

What does this involve? And how important is it?

5-"assessing significance"

What does this involve? How important is it? And what is its real implication for my experiment?

6-"Information about your iterations"

How can I get this information and share it with you so that you have more details?

7-The pre-test took place in the laboratory with several factors. The aim was to see the impact of these factors on just two responses, R1 and R12. There was no experimental design at this level. These were combinations that we chose at random. We then selected these three factors for this experimental design.

8-Should I repeat all the analyses or completely redesign the plan?

I must say that I am available to discuss the results.

Thank you in advance

With kind regards,