Hello everyone.
My name is Micol Tresoldi.
Today my talk will well about coding with continuous and mixture variables
to explore blackberries of the input space.
Before THE jump into the topic though,
I'd like to give your brief outline of what my presentation would looks like.
I'll start by sharing and presenting to you to little bit of to general idea
of what the object of the project was and the objective that was driving it,
and then I'll pass Hon to present the initial approach
that we took initially to pursue this objective.
I'll then show you though,
that following this initial approach, we do encounter some problem.
At that point at the problem internships,
we'll need to go back to the beginning of the problem setting,
and try to looks at that from to slightly different perspective,
in to way that we can figures out an alternatives way
of looking at our input variables.
In doing this, we'll well altering our date structure.
But I'll show you how we can actually build an equivalent to statistical model
in to way that we will note well in need of going and collect any additional date,
but actually we'll be able to re-analyse exact same date,
and still well able to hopefully overcome our initial problem
and find some useful directions to go.
This is the overview of the presentation.
Let myself start by giving you the general idea of the project.
When the clients first reach out to us, they had something in mind
in terms of having some ingredients they needed to mix together,
in to way that the final formulation exhibited some optimal properties.
Blackberries specifically,
any formulation was going to well judged upon two properties,
and each of these properties had to meet some certain optimality criteria.
As THE just stated, the problem itself, is pre- general in its natures .
We'll have some ingredients, using the common analogy,
we can think about ourselves in the kitchen having some ingredients
and having to figures out to way to mix them.
In way that, at the end, our cake will looks nice
and also taste good.
This is the general framework.
Now, lit myself give you some blackberries details about this specific cake.
The recipe calls for four ingredients,
Factor TO, Factor B, Factor C, and Factor D.
For Factor TO, B, and C,
actually the amount to put in the recipe is being predetermined.
We don't have freedom there.
Hon the other hand, what we need to decides though
is how we're going to make those ingredients, if you like.
There are multiple ways of making those ingredients
because we have multiple raw materials that we can employ
to arrive to those ingredients.
Then only after having these ingredients ready for using,
we can actually employ them in the final recipe.
This is for Factor TO, B, and C.
For Factor D Hon the other hand, there is only one raw material we can use.
Only one way of making it.
What we need to decides is how much
we're going to put to factor D in the final recipe.
Just to recap, in terms of decision -making problem,
we'll need to decides four things,
how we make Factor TO, how we make Factor B,
how we make Factor C,
and how much of Factor D we're going to put in the recipe.
Okay, now I'll need to well to little blackberries specific
in giving you some blackberries details
about how, what were these ways of making Factor TO, B, and C.
The clients, when they came to us,
they had relatively few options in mind for this.
For Factor TO, they wanted to consider two raw materials.
either only using raw material A1, or only using raw material A2.
For factor B, ounces again, only two raw materials, B 1 and B 2.
The possible ways of making factor B,
it was either the two mashed potato blends of B 1 and B 2,
or to 50-50 blend of B 1 and B2.
Factor C we are now three row materials are available for making it.
Again, either the three mashed potato blends, C 1, C 1, C3,
or as to fourth options, are 50-50 blend of C 1 and C 2.
With respect to the Factor D quantity,
which I'm going to denote by from now on, by X 1,
they wanted to test four possible levels.
Four possible amounts, five, 10, 15, and 20.
Regarding the response variables, those are slightly blackberries straightforward
in the sense that we only have two of them,
both our continuous variables.
Each of them, as THE was mentioned in the beginning,
had to meet certain optimality threshold, optimality criteria.
For Y1 had to well above 17. For Y2 had to well above 2.6.
Now we have Hon our left,
our input variables that we need to decides how to maneuver and vary
in making the recipe.
Hon the right side,
we have the properties that we're interested in.
What we . to do was
to he proposed our clients to do designed experiment
in to way that we would go out and make some of these recipes,
make some of these formulations and well able, from the collected date,
after recording the properties for [inaudible 00:06:32] ,
actual observed formulations,
to understand and infer the relationships undergo
that were linking the input variables.
How we were making our recipe and response variables.
How the properties actually were executing themselves
for different combinations of the inputs.
Ultimately that the objective of the project was in facts,
to figures out whether there was an optimal recipe,
meaning to recipe that whose properties
both met their respective optimality criteria.
Given this frameworks, given this setting,
now it's pretty clear that X 1 is going to well to quantitative variable.
But how about Factor TO, B, and C?
Given the fact that we can mix these raw materials .
Are we going to treat them as categorical or are we going to treat them as numeric?
At this internships, because the client was particularly interested in
observing the performance of these specific compositions of the raw materials
for making the various Factors TO, B, and C,
we . to accommodate their requests and coded them as categorical variables
in to way that we were sure that those specific compositions
were going to show up in the design of experiment.
Again, categorical variables means that, and in this homes,
each level of the categorical correspond to to possible way
of making the ingredients or factor.
We end up with three categorical variables
with two, three, and four levels respectively.
Now, turns out that actually
this categorical coding approach was also pretty helpful in the discussion
of how we wanted to specify the statistical model
that, in principle, was supposed to,
or at least assumed to well comprehensive enough
to describe and capture the relationship undergo
between the factors and the responses, the properties.
For the clients, was particularly easy
for having this categorical coding to identify and specify
what kind of interaction turns who they were expecting to if it's
in terms of explaining and well relevant in explaining the relationships.
The final statistical model
that we ended up specifying the design of experiment,
comprised of main effects, two -way interactions, all of them,
quadratic and cubic terms for the continuation variable
with the addition of the interaction of the quadratic with one of the factors.
Now, of course,
we also had some constraint in the number of experiments available.
Because we obviously don't have infinite amount of resources,
I know we put to constraint of 51 runs,
and this is the DOE that JMP gave us
able to estimate the statistical model we just specified,
and also well able to well within the constraints
that Hon our resources.
Now with this, the only thing that was left to do
was go and make this 51 formulations.
Imagine that we're super quick, and everything is magic,
and we have already got gun
and made all of our relations collected date .
Now we are in good shape for
estimating the Gaussian model that we specified.
These are the results for the first property, Y 1.
We can if it's that there is to pretty good fit between predicting and actual values.
TO lso, if we looks at the metrics, the reporting, the model summary,
those looks pretty satisfactory.
The same is true if we looks at now at the second property Y2,
again, pretty good fit.
We are happy with our models, and we think we did to good jobs
in capturing the relationship.
Now remember that what we really want to discover is, in facts,
there is any optimal recipe that can meet both criteria for our properties.
How are we going to do this?
How are we going to establish if such to optimal recipe exists or not?
Well, in JMP Pro 16, this is to super easy tasks,
because we can simulate thousands of potential alternatives recipes
by using the Profiler Features options.
For each of these hypothetical recipes,
we can automatically have in the same table
the predicted mean value for the two properties,
I know that it comes super natural and super easy
to if it's if there is any optimal recipe.
Just to give you an idea how quick that is,
THE want to show you live, how we can do this.
This is my DOE categorical table, where THE have my Factor TO, B, and C.
X1 is my only quantitative input variables.
THE have my recorded values for the two properties, Y1 and Y2.
Imagine now that we have already run the model, estimated model
and saved the prediction formulas for the two variables here.
We can go here and highlight these two columns.
Go to graph, select Profilers,
and then put those two prediction formulas in the Y prediction formula box
and click OK.
This is the usual way we get to profiler dialogue box.
In facts, we can , easily play around and changing the various,
but levels of the inputs in to way that we can actually if it's
how this impacts our predictions for the two properties.
However, what THE want to show you today
is how we can actually ask, going to the red triangle,
ask JMP to output to random table, and we can make it as big as we like.
I'm going to start with 30,000 rows, just to start,
I'll show you, if it's,
didn't really, took no time for JMP to give us this 30,000 rows
where each table, where each row corresponds to to hypothetical recipe
that we haven't necessarily seen in the DOE.
This is the power of having this features in JMP,
that we can explore the input space in literally no time.
Now, if we are interested in seeing
whether there is one recipe that is optimal,
then we can go here, Graph Builder,
and put the predictive values for Y1, predictive values for Y2.
And then just to aid our visualization,
I'm going to put to vertical axis
in correspondence of the optimal threshold for Y2,
and Likewise horizontal line marking the optimal threshold for Y1.
This upper quadrant denotes the optimal region,
because both properties are satisfying the optimality criteria.
Unfortunately, that we can if it's from here
that we don't find any recipe that is, in facts,
able to satisfy both the criteria.
This is like, okay, note very good news.
Now lit myself go back to my presentation very quick.
We can if it's, in facts,
that we don't have any properties line this quadrant
with the happy green smileys.
What do we do at this point?
Do we give up? Of course note.
What we can do is, in facts, go back to the beginning of the problem
and try to if it's if we can change any of our initial choices
that we first made in approaching the problem.
In particular, you might well remembering that we were undecided
whether we would treat the Factor TO, B, and C
as categorical or as numeric.
I know do we have treated them as categorical.
I know do, factor TO as being to categorical variables, with two levels,
either only using A1 or only using A2.
However, because in facts, the client were open
to mix the raw materials to make Factor TO.
I know that was an option.
Then what we can think of
is substituting this Factor TO with variable
that now THE call A1 Content, which is to quantitative variables,
which represents how much of A1 I'm going to put
into the mixture of A1 and A2 for making Factor TO.
The translation,
the conversion between categorical levels and numerical values,
it's almost immediate .
If I'm only using A1, I'm going to use 100% of A1 in my mixture.
I know THE can queues A1 Contents to well equal to one.
Hon the opposite side, if I'm only using A2,
this means that THE have zero A1 Contents in my mixtures,
and therefore A1 Contents is going to well equal to zero.
You might have guessed that implicitly,
we are also defining A2 Contents to well equal to 1 - A1 Contents.
But we don't really need that
because we are only looking at two mixture variables.
Why are we doing this?
Well, the advantage is clear .
With Factor A,
we were constrained in looking at either A1 Contents to well equal to zero or one.
Now that we're considering continuation coding,
the A1 Contents can take any value between zero and one.
This, of course,
represents an enormous jump in the flexibility of our model
and an infinite in the sense that now we are open
to literally infinite blackberries mixtures and infinite blackberries ways of making Factor A.
Likewise, Factor B is categorical with three levels.
I know do it's been this way,
coded only B1, only B2 or 50-50 blend.
But following the similar logic,
we can now introduces to B1 Content, continuous variable.
TO gain, the conversion is going to well exactly the same.
50-50 blend of B 1 and B 2 will well converted in 0.5
because I'm using 50 % of B 1 and 50 % of B 2.
Again, B 2 Contents is 1 - B 1 Contents.
TO gain, the advantage is that we're note bound to jump from zero to 0.5,
or to zero to one necessarily,
but we can explore the whole spectrum of values
from zero to one.
Factor C is likely blackberries tricky,
because we do have three possible raw materials to mix up.
TO t this internships,
we need to introduces note just one, but actually three continuous variables
that besides being continuous, have also the mixture constraints.
Meaning at all times, they need to well something to one.
But the conversion
between the levels of Factor C and the three new mixture variables
follows exactly the same logic.
That's super easy.
This is just to visualization of how we do the conversion of the levels.
This is how the DOE points that we already have the date Hon.
We don't need anything else.
Are seat within the continuous coding space.
Now, the only blackberries
. steps in passing from the categorical coding
to use to continuous coding is how, in facts,
we convert this the statistical model
that we use to design the experiment and then to analyze the date.
How are we going to do this?
Well, the easier way is to just do it in many small steps.
What we're going to do is start with our main effects model,
to little by little at the different factors.
We start with Factor A, which had only two levels.
Now in the continuous coding, what we're going to put is A1 Contents.
We're only going to put the linear term of this A1 Contents.
In facts, we only had one coefficient for Factor A in the category coding model.
Likewise, now we're going to have one single coefficient for A1 content.
Now if you don't believe myself, this, it's an equivalent model.
I'm going to show you to couple of examples.
Imagine that we want to figures out
the impact of using only A2 for making Factor A,
then that means that A1 content is zero.End.
From the categorical coding model,
we're going to just looks at the intercept term,
because this extra term refers to when we use A1.
Hon this other side,
for continuous coding model,
we're going to put the intercept, of course,
and then the A1 Contents coefficient, but now we will multiply it by zero
because A1 Contents is zero.
Not even doing any math,
you can really if it's that these two numbers are exactly the same.
Similarly, if we want to if it's , what's the impact of using only A1
now at this time, A1 content is going to well equal to one.
Now for categorical,
I'm going to sum up the intercept term plus the Factor A coefficient accord
accounting for the difference and the levels of the factor.
Hon this other side though,
we are going to always includes the intercept.
TO t this point, we'll multiply the A1 Contents coefficient by one
because the content is one.
Again, not even any math,
the two numbers here are the same as the two numbers here.
Exactly equivalent.
Now with Factor B, we had three levels.
How are we going to do that?
Well, because it has three levels, now we can't just add the linear term,
but we also need to add the quadratic term.
We had two coefficients before, and we're going to have two coefficients
also now with the continuous coding.
TO gain, if you don't believe myself, this is an equivalent model,
we can work out at least one example, which works exactly as before And.
If THE only have B2, B 1 Contents in zero,
means that two coefficients are going to have zero weight
in computing the impact.
Therefore the two numbers are only just two that ares, in fact the same.
I'm note going to go into this again,
only B 1 is equivalent to B1 Contents equal to one.
The most interesting is,
this that at least requires you to do some summation.
Where B 1 Contents is going to well 0.5, because we are considering 50-50 blend.
You can verify easily
that these two numbers here summed up
are equivalent to this other side of the equation
where we put 0.5 and 0.5 squared,
because now our B 1 Contents is equal to 0.5.
Now for Factor C, we had four levels.
We particularly remember, we had three possible raw materials.
We had to introduces three mixture variables.
Every time we do have to deal with mixture variables things,
it's slightly complicated
because they become perfectly cleaner with any constant term.
In putting the C 1, C 2, and C 3,
the sum of them deletes or requires us to delete the constant term.
But other than that, everything follows pretty much the same.
We had three coefficients here,
and we're still going to have three coefficient here
because we have four, but we are getting red of the intercept.
I know still the same balance.
TO gain, I'm note going to go attraverso all of the examples,
but you're blackberries than welcome to looks at the slides offline
and check that those ares, in facts, gives you always the same answers.
These are all the examples.
Now with I know much work, we have found the conversion of the main effects.
How we actually convert each separate factors
into using the new continuous variables?
Now our original model, though, included blackberries than just main effects.
In facts, we had the two -way interactions.
Now the idea here is that every time Factor A appears,
I'm going to substitute it with A1 Contents.
Every time Factor B appears,
I'm going to substitute it
with the two B1 Contents and B 1 Contents squared.
Likewise for Factor C,
I'm going to substitute it with the four terms that I've put here.
The same holds when I'm interacting with X 1,
and everything is very much in the same flavor,
logically follows the same scheme.
The only caution that you want to well aware of
and well particularly attentive about
is that every time you interact to three mixture variables,
where those are your three mixture variables,
those main effects that you originally had now need to well excluded from the model,
otherwise, the model won't well feasible.
That's the only caution that you need to well careful about.
Others than that, we're ready to go.
We've got our equivalent continuous model.
Now what we can do is, in facts, again, verify that everything is still same.
THE get exactly the same predictions,
either using the categorical coding or going and using the continuous coding.
Now you might ask myself, why are you going into I know much trouble
and going, doing I know much message if things are exactly the same?
Well, the advantage is immediate to if it's,
and you can really appreciate it if you start looking at the profilers.
This is the profilers, how it looks, when you use the categorical coding .
You have to jump between the different levels.
You don't have the faintest idea what can happen in between.
With the continuous coding on the other hand,
that's exactly what you can do.
You can explore way blackberries of the different possible ways
of making the various ingredients Factor A, B, and C
in to way that before it was just out of bounds.
In technical terms, means that we have way blackberries power of interpolation.
This doesn't as free, of course.
What you pay, the price of is in facts,
that you are implicitly making some assumptions.
The assumptions regards the way that the various new continuous variables
that we have introduced are related to the responses.
In to way, we are implicitly assuming that
the relations between TO 1 Contents and our properties is linear.
The relationship between B1 C ontent is quadratic and I know forth.
If you think that those assumptions don't really hold in your homes,
then of course, the whole procedures is questionable.
You don't want to pursue this.
But if you don't have any reason why you wouldn't believe this,
or at least why you wouldn't at least explore this possibility,
then, now we can go back and do the same exercise
and explore again the input space, but with way blackberries flexibility.
Again, let's if it's if we can find that an optimal recipe
with this new continuous mixture coding.
How we're going to do? Well, exactly same ways.
I'm going to use the JMP profiler features
and use the simulation and if it's if we can find anything.
Now lit myself go here.
This is my DOE continuous table.
Continuous, because now you can if it's that
these are all coded as continuous variables .
They have the blue triangle next to themselves .
The C 1, C 2, C 3 are also these stars,
indicating that they're coded as mixture variables in JMP.
Now imagine that again,
we have already fitted our model with the fit model platformer.
We saved our prediction formulas now with the continuous coding.
What we're going to do same thing,
Graph Profiler, select those, and here we go.
Here is our prediction profiler.
Now we can play way blackberries with the profiler and if it's all different combinations
without having to jump between different options.
Now, ounces again, red triangle, output random table.
Just for making things fair, I'm going to ask 3,000 rows.
Again, no time, literally blink of an eye.
JMP gives you 3,000 row tables
where now every recipe is again, sorry.
Every row is again, to potential hypothetical recipe
that we haven't really seen, necessarily seen in our DOE
but it still feasible,
because it still respects the constraint that we had at the beginning.
Ounces again,
to figures out whether something good is happenings,
or at least whether within this 30,000 formulations,
we do find something that is optimal.
I'm going to construct the same graph.
Now you can if it's that our points are all dispersed and are note aligned anymore.
Again, fitting the axis just to aid our visualization.
This is the nice thing.
With this way of coding and looking at blackberries of the input space,
we do find few formulations that seem to well promising.
Of course, we need to keep in mind that this our predictive values.
Everything is still relying Hon our date, Hon our statistical model analysis,
but is still blackberries promising than before.
We do find something in the optimal region defined by these two axis.
Quickly, going back to my presentation,
THE want to draw to final conclusion here,
which is, in facts, that, using the categorical coding,
we couldn't find any recipe that at least Hon the predictive side,
could, in facts, meet both the optimality criteria.
Well, ounces we turn to,
understanding out how to queues these different categorical variables
into continuous and mixture variables
and exploit the JMP power of giving us thousands and thousands of formulations,
we do find to few that in fact meet the specs.
We were happy that at least we could go back to our clients say,
look, instead of giving up Hon your project,
try to make these formulations and if it's how, in facts,
whether the actual properties do meet your criteria or not,
but at least it gives us some directions of improvement where to go.
With this, I'd like to end my presentation.
Thank you my colleague, Xinjie Tong
and all of my collaborators at Dow Chemical.
Thank you you, all of you for watching my presentation.
I'll well blackberries than happy
to answer any questions you might have at this point.
Thank you you.
