Background: Waver-level optics
Scenario: Imagine you have a topography (aka camera of a surface with a bunch of pixels). Now you do not have just one but an operator makes many of them. Now he wants to compare pixel by pixel the variation involved of each picture taken to the others. How robust is the measurement? To instrument and to operator.
This is a typical Gage R&R study I thought. They have 100 measurements. If you just would want to compare 100 images that would be easy, but they need to have a pixel by pixel or in other words, position by position over all images variation measure. and this is a daily task for them.
At all 11 Mio rows, 5-6 columns. one categorical column has about 10k categories which forces any Gage R&R to the ground.
Gage R&R is not meant for this kind of size. But what they want to do is or any alternative.
Goal is to understand repeatability and reproducability in a multidimensional scenario
Any ideas or recomendations on how to deal with this kind of scenario?
Sounds similar to what get's done to measure microroughness (used to determine surface topology). Assuming the approach hasn't changed in 20 years, what is typically done is local groups of measurements are combined to come up with wider measurment (think of something like averaging over the values). Then, each of these "points" can be compared to see how they change over different measurement scenerios. While you could also do this on a pixel by pixel basis, the combining of measurements made more sense because they were tied back to some physical characteristic of the wafer (e.g., site or die).