
Distinguished Research Fellow Bradley Jones will be retiring July 31 after an amazing 25-year career at JMP. In that time, Brad built a strong DOE development group, and probably the most prolific patent-awarded group at SAS. Below, you can read a historical tribute by John Sall on Brad's work, collaborations, and contributions to the world of design of experiments (DOE) and statistics.
But first, a few words from some of Brad's special JMP colleagues and statistically minded friends:
Mark Bailey (@Mark_Bailey): "I started working in SAS Education just a few months after Brad joined JMP Development. Custom Design was several years yet to come with the launch of JMP 4. We quickly became allies in helping scientists and engineers use designed experiments to learn by changing the design to suit their problem instead of the other way around. We met often to exchange experiences and ideas. It is hard to imagine now how strong an opinion was against the algorithmic or optimal design approach, especially among leading DOE thinkers. I attended a short course taught by Doug Montgomery at a Fall Technical Conference. Doug was disparaging toward such designs in general, and JMP in particular. I shared Doug's opinion with Brad after returning from the course, and he decided to meet Doug. The rest is DOE history. This example epitomizes Brad: always a principled approach, turning adversaries into colleagues and proponents while advancing a practical solution that benefits as many people as possible."
Peter Goos: "Bradley Jones was a highly influential researcher, with a large impact on the state-of-the-art and the state-of-practice in design of experiments, with more publications in highly regarded academic journals than many academics. I believe that the two papers with the biggest impact were one on Bayesian D-optimal designs and the one on definitive screening designs. Another influential publication is, of course, the Goos-Jones book “Optimal Design of Experiments: A Case Study Approach”. What I also observed on many occasions is that Brad was adored by the DOE users among the JMP customers. On a different note, during a joint run in Seattle (on the occasion of the Joint Statistical Meetings), Brad inspired me to start running more often. He is therefore also responsible for my becoming a marathoner."
Chris Gotwalt (@chris_gotwalt1): Brad Jones’s contributions to the design and analysis of experiments are huge. His invention of the Profiler is ‘interpretable AI’ at its very best, even though it preceded that term by three decades. His other great contribution is championing optimal design of experiments until it became widespread and mainstream. This is the idea that the design of and experiment should reflect both the goal of the experiment, as well as directly incorporating the various resource constraints like sample size, randomization restrictions, and combinations of factor settings that are physically possible. While this may seem like a very natural and obvious idea now, there was a long time when this notion languished and was actually even considered a risky, bad idea. So, in addition to overcoming the various computational and UI challenges, Brad worked strategically to win over both practitioners in the industry as well as other thought leaders to make optimal design accessible and an acceptable approach to problem solving in the industry. Every day we all use many products that have been made better with these tools that Bradley Jones developed and championed.
Caleb King (@calking): "Before coming to JMP, I had heard about Brad and met him a few times at conferences. But it wasn’t until I started at JMP that I realized just how amazing he was! And I’m not just talking about his accomplishments. Brad has been the best mentor one could ask for. He has always advocated for me and given me valuable advice and guidance on my career. I’ll be sad to see him go, but I know his retirement is well-earned. Though I wouldn’t be surprised if he was just as productive in retirement as he was in the workforce."
Ryan Lekivetz (@Ryan_Lekivetz): "Even prior to joining company JMP, I was truly impressed by Brad's prominence within both the academic community and among practitioners. This prominence is one of the main reasons I applied to JMP. However, it was only after becoming a part of his team that I realized the profound impact his message had on the way in which experiments are performed. His emphasis on generating experimental designs that align with the specific requirements of each experiment, rather than forcing experiments into pre-existing designs, has been nothing short of transformative. I take great pride in being a member of the team he has assembled, and I am determined to carry forward the spirit of innovation and curiosity that he has instilled. I eagerly await news of Brad's next ventures, and I sincerely hope for the opportunity to collaborate with him on future projects."
Douglas Montgomery: "I’ve been a friend and colleague of Brad Jones since the late 1980s. Everyone in the design of experiments community should acknowledge his enormous contributions to our field. These include response optimization (the Prediction Profiler in JMP), construction and analysis methods for non-regular fractional factorial designs, optimal designs, split-plot designs, optimal designs for multi-response experiments, and definitive screening designs. It has been my privilege to work with him in some of these areas, including co-authoring a textbook on a modern approach to teaching experimental design that is structured around an optimal design approach. He has also been generous with his time in working with several of my Ph.D. students on their research. We have all benefited from his knowledge and experience in the field."
Joseph Morgan (@Joseph_morgan2): In 2006, a year after I joined the JMP team, several of us were walking back to our offices in Building S from the Building T cafeteria after lunch. Brad and I were walking together and I brought up the topic of factor-covering designs, a name that Colin Mallows, the statistician, had proposed for covering arrays in a Technometrics paper. Brad was unaware of these designs but he was intrigued and so, to my surprise, we wound up spending several days investigating whether the coordinate exchange algorithm would be a reasonable general-purpose algorithm to construct such designs. We eventually concluded that coordinate exchange was not a promising approach. A few years later, having moved to SAS R&D from JMP, I got an email from Brad asking if I would be interested in implementing a JMP Pro DOE platform to construct covering arrays. I accepted without hesitation. To me, this arc of events captures who Brad is. Intellectually curious about all things DOE, willing to investigate radically different constructs and ideas that pertain to DOE, and singularly focused on making JMP DOE best in class. This is the environment that I now work in, with colleagues, Caleb, Ryan, and Peng, who all share this singular vision. Thanks, Brad.
Chris Nachtsheim: Brad Jones and I had a meeting of the minds 40 years ago in New Mexico (at the Rancho de Chimayo) when the Statistical Sciences group at Los Alamos attempted to hire him, and we’ve worked closely together ever since. Brad’s impact on the world of DOE and data science has been immense, if not unsurpassed! A few highlights:
· The invention of the prediction profiler, an amazing, interactive tool for studying the nature of response surfaces and interactions.
· Bayesian D-optimal designs. The widely-cited paper by Brad and Bill DuMouchel made the use of Bayesian D-optimality practical and accessible to experimenters while providing an easy way to make optimal designs robust to model misspecification. Among other things, this paper led to Brad’s later development of Bayesian supersaturated designs.
· The invention of the custom design facility in JMP. This brought the world of optimal design to practitioners in an easily understood way for the first time.
· The invention and development of Definitive Screening Designs (full disclosure: with me). DSDs have been adopted worldwide with enthusiasm by practitioners and are rapidly supplanting fractional factorial designs and the primary tool for exploratory
experiments.
· The invention of fast, flexible filling designs for computer experiments and their widespread adoption by the data science community.
· His innovative books on case studies in optimal design with Peter Goos and on modern experimental design with Doug Montgomery.
In sum, I would cite Brad’s evangelical advocacy for the implementation of the scientific method through the design of experiments.
Yeng Saanchi (@mysaan): Bradley Jones is a mentor and friend. Underneath the aloof exterior is a kindness and thoughtfulness that I’ve had the pleasure of experiencing firsthand. His extensive knowledge of DOE, as well as the impact he has made and continues to make on the field, are greatly inspiring. Brad, I would like to thank you sincerely for all your help, especially for taking the time to answer my questions during my time as a student. Your support and insights were truly invaluable. It’s hard to believe that I will no longer be able to run up to your office to ask a question or simply say hello, nor will I hear your unmistakable knock at my door to call me to lunch. As hard as it is for me, it must be even harder for you to leave the place where you have experienced so much growth, both personal and professional, for more than two decades. To borrow the words of J.R.R. Tolkien, “I will not say: do not weep; for not all tears are an evil”. I bid you a very fond farewell.
-------------------------------------------------------------------------------------------
Bradley Jones Retirement Tribute
by John Sall
Bradley Jones, now retiring after 25 years with JMP, has had a phenomenal career. Brad’s expertise has been in design of experiments (DOE), and he and his team have made JMP the best software in the world for DOE. No other software product in the world comes close.
Illustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittIllustration by Ryan DeWittExperimental design is the art of arranging factor settings across runs in an experiment to learn the most from a given number of runs. It has become a vital tool in product research, serving as the key to modernizing the trial-and-error process to make better products, better manufacturing techniques, and better processes.
Research career
In the 1980s, DOE was considered a sleepy discipline, one in which all the most valuable breakthroughs had already happened, with the expectation that any additional improvements would be incremental. That attitude was soon proven wrong, with many huge breakthroughs occurring over the next 30 years. The statistician that drove the most valuable research in DOE over that time has been our own Bradley Jones, with input from his many collaborators.
Brad had been working in experimental design for many years, beginning with BBN software, the leading industrial statistics software vendor in the 1980s. Then he co-founded a new company, Catalyst, which created innovative experimental design software, including the profiler. He then moved to MathWorks, a leading engineering math software product, where he authored the Statistics Toolbox.
In 1997 he came to JMP, where he saw its potential to become the leader in industrial statistical software. JMP had just begun improving its offerings for engineers, and DOE was one of the three key specialties to unlock that market, along with quality and reliability.
Brad’s initial contribution was the platform Custom Design. Computers are powerful, so why not harness that power to produce experimental designs that are custom optimized for a given situation – the field of optimal design? Previously, optimal design had been reserved for specialized problems handled by specialists, not for mainstream challenges, but Brad saw that every engineer could benefit from optimal design. Optimal design could also make the process easier and more direct. Before Custom Design, engineers would look over textbook design generators where you had to understand concepts like resolution number and confounding patterns, and you would be limited to designs that were sized to a power of two or selected from a catalog. After custom design, all you had to do would be to describe the factors, which effects you wanted to be able to estimate, and how many runs you could afford.
To make optimal designs practical, an optimization algorithm was needed. Most optimal design software at the time, such as PROC OPTEX from SAS, required the user to generate large numbers of candidate runs, from which the algorithm determined the best subset of runs to optimize the criterion. But that made the construction burdensome. The breakthrough, from Chris Nachtsheim and Ruth Meyer in 1995, was the coordinate exchange algorithm, which did not require candidate sets, and was, therefore, more direct, simple, and efficient. Brad harnessed it to produce the Custom Design platform, first in JMP 4.
That was the first in a long series of innovations.
An early innovation was the concept of tagging effects in the model with an “Estimability” attribute of either “Necessary” or “If Possible.” With a limited number of runs, it is rarely possible to be able to estimate all the desired effects – especially higher-order interactions. With the “If Possible” setting, the algorithm first makes the “Necessary” effects estimable, and then tries to make as many “If Possible” effects estimable as possible. This option was an implementation of Bayesian Optimal Design, which Brad invented with BBN collaborator Bill DuMouchel and published in Technometrics in 1994, the first of many DOE articles Brad co-authored in refereed journals.
Dennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradDennis Lin and BradSoon after implementing Bayesian D-Optimal, Brad began tinkering with an extreme kind of design called “supersaturated,” where the number of factors was greater than the number of runs, something that couldn’t normally be fit. But in a given experiment, it usually happens that some factors are much stronger than others, and the goal of a screening experiment is to find which factors are important. So why not use a supersaturated design, and then use a specialized method, like stepwise regression, to find the important factors? To make a supersaturated design, Brad realized that a good way was to use the Bayesian D-Optimal method, and just declare all your factors “If Possible.” This led to other papers, one of them with Dennis Lin, who was also a pioneer in supersaturated designs. It is a powerful advance to be able to screen many factors with only a few runs.
Another early challenge was handling split-plot designs. Many experiments have a kind of restriction where groups of runs must be at the same level of some factor. A classic example is heating runs in an oven, where all the runs need to be treated at the same temperature. The characteristic feature here is that some factors are hard to change, while others are easy to change. The goal is to create an experimental design where the hard-to-change factors are constant within a blocking group. Peter Goos, a statistician at the University of Antwerp, made some breakthroughs on optimal design for split plots and published his findings. Brad put those ideas to work with coordinate exchange to obtain a practical implementation in custom design. When Peter and Brad met at a Fall Technical Conference, Brad showed him how coordinate exchange could make split-plot designs practical, thus beginning a long collaboration between the two.
Brad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationBrad Jones' doctoral oral examinationSince Brad didn’t have a Ph.D. at the time, Peter suggested that Brad could earn one under him at the University of Antwerp, leading to many months of intermittent travel to Antwerp to further develop his ideas on DOE. For his dissertation, Brad put together four big ideas, which all but one were accepted for publication in refereed journals before Brad’s final oral exam. The last was later accepted by Biometrika, a top journal. Peter organized a DOE conference in Antwerp and invited many DOE experts from Europe and the U.S. The conference was much like a series of tribute sessions for the contributions from Brad and his collaborators. The highlight of the conference was Brad’s oral examination under scrutiny from his robed Ph.D. committee members, concluding with a successful verdict and a tribute speech by Peter.
Then Brad got even busier with research.
Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.Chris Nachtsheim and Brad.One of the problems with model fits is the “aliasing” of effects with other effects not in the model. For example, what if a design is fine at estimating main effects in a model, but there is a strong second-order interaction that is not in the model? In that case, it might be that the interaction is biasing the estimates of main effects. But it is often possible to construct the design in such a way that the main effects are orthogonal to the second-order interactions, and consequently there is no way for a strong second-order interaction to bias the main effect estimates. That situation began a line of research into “minimal-aliasing” designs that modified the optimization algorithm to make the main effects as uncorrelated as possible from interactions, while still maintaining their estimability and power. Brad collaborated on this work with Chris Nachtsheim from the University of Minnesota.
While playing with minimal-aliasing designs involving three-level factors, Brad noticed that some of the resulting designs had a curious fold-over structure. Fold-over runs are sign-reversed from other runs. The discovery led Brad and Chris to develop definitive screening designs (DSDs). The discovery of DSDs was very important for a variety of reasons:
- They were three-level designs, which allowed any curvature in the effects to be modeled.
- The main effects were orthogonal to the interactions, meaning any unmodeled interactions wouldn’t bias the main effect estimates.
- They were easy to construct without going through an optimization.
- They had very good projection properties so that if some factors were inactive, lots of interactions with the active effects were estimable.
- They allowed strong interactions to be found that would not be discoverable with other designs.
- And they were small, requiring a run budget no greater than the traditional fractional factorial designs that had none of these desirable attributes.
Dennis Lin later characterized these in terms of fold-overs of a conference matrix. DSDs became very popular in a short amount of time.
The next chapter in Brad’s career brought him back to supersaturated designs, where the number of factors is greater than the number of runs, and you hope that effect sparsity will allow you to find the big effects. Brad noticed that if you did a Kronecker matrix product of the Hadamard matrix with a subset of rows of another Hadamard matrix, you get a supersaturated design with desirable properties. These are the group-orthogonal supersaturated designs (GO-SSDs). Factors are assigned to groups, and the groups of effects are uncorrelated, but there are dependencies within each group. You can detect when groups are active and have a pretty good chance of detecting which factor within a group is significant. But the amazing thing about GO-SSDs is that you can get an independent estimate of the error by devoting some factors to be unassigned (fake factors) concentrated in one group, and the error for this group estimates the error variance. This work was done in collaboration with JMP Advanced Analytics R&D Manager Ryan Lekivetz, Chris Nachtsheim, and two others.
Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.Brad with Doug Montgomery.In addition to these major innovations in his career, Brad continues to work on many other projects. Currently, he is collaborating with others on mixed level designs, using some of the Kronecker-product experiences from earlier work. Under optimal design, Brad pursued several optimality criteria: I-Optimal design for better prediction with continuous response surfaces, and A-Optimal designs that allow weighting and have other desirable properties. Brad worked with Peter to coauthor a book, “Optional Design of Experiments: A Case Study Approach.” Brad coauthored several papers with popular statistics textbook author Doug Montgomery on various topics, as well as co-authoring “Modern Experimental Design Methods and How to Use Them.” He worked with Advanced Analytics R&D Senior Director Chris Gotwalt on optimal spherical designs and optimal nonlinear designs, and with Ryan on optimal space-filling designs.
A common theme of Brad’s research is that it was all in collaboration with other researchers, sharing and expanding the scope of the ideas. Having collaborators also helped greatly the completeness of vision and polish of the journal articles, which won many awards.
Brad was extremely well-regarded by veteran DOE researchers. Brad had a close working relationship with Stu Hunter and co-authored a paper with him when Stu was in his 90s. Brad cohosted a celebration in honor of Stu Hunter’s 100th birthday at the USCOTS conference. George Box also highly regarded Brad, honoring him by giving him a DOE cube that George had used many times in his teaching. Brad wrote a tribute article to George Box, which became the most-read blog we have ever hosted.
Software career
The important part for Brad was not just doing the research but putting the best technology in DOE into the hands of practitioners: the scientists and engineers who would use our software to design their experiments. First unveiled in JMP 4 around 2000, each release of JMP would implement further features and other improvements in DOE. Later, Brad started assembling a team to further advance our software. Ryan Lekivetz was hired away from the University of British Columbia. Principal Research Statistician Developer Joseph Morgan was hired away from SAS to work on covering arrays. Senior Research Statistician Developer Caleb King was hired from Sandia National Labs to work on reliability and other DOE aspects. Together, this team has accumulated more patents in a short time than any other team at SAS. The most recent release has brought out Easy DOE, wrapping the whole experimental process into one easy-to-use package.
Our DOE facilities are rich in diagnostic devices, such as the Fraction of the Design Space Plot, color maps on correlations, prediction variance profilers, power analysis, and various efficiency measures.
Brad was also instrumental in helping recruit other leaders to JMP, including former head of JMP Sales and Marketing John Leary and Sales Vice President Dave Richardson.
With the team that Brad has built, we will continue our leadership in the DOE field.
Professional organization work
Brad has often volunteered to do peer-review work for statistical journals. He served as Editor-in-Chief for the Journal of Quality Technology (JQT) and as an Associate Editor for Technometrics, JQT, and Quality Engineering.
Brad has been invited to speak at professional meetings, such as the Joint Statistical Meetings and the Fall Technical Conference, as well as at many JMP conferences. He has spoken at many university and corporate campuses.
Honors
Brad has acquired many honors, as can be viewed by the plaques on his office wall:
Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Brad shares many of his accomplishments and honors on the wall of his office at SAS world headquarters.Fellow of the American Statistical Association (ASA)
- Shewhart Medal (ASQ)
- Willian G Hunter Award (ASQ)
- W.J. Youden Memorial Address (ASQ, ASA)
- Senior Member of the American Society for Quality (ASQ)
- Ziegel Prize for the best-reviewed book in Technometrics of the previous year
- Youden Prize for the best expository paper in Technometrics
- ASQ Lloyd S. Nelson Award for the paper having the most immediate practical application (two times)
- American Statistical Association Statistics in Chemistry Award
- ASQ Brumbaugh Award for the paper making the largest contribution to industrial application of quality control (three times)
In his spare time
- Brad’s bachelor’s degree was not in statistics, it was in Music, at the University of Cincinnati. He majored in violin and did some professional gigs as a violinist, along with volunteer gigs and a few JMP events, and still practices regularly.
- Brad is a long-time Go player and has a fairly high amateur rating.
- For many years Brad was a professional dog breeder, specializing in Rhodesian Ridgebacks, that were highly rated. Brad often competed in dog shows.
- Brad has also competed in several marathons.
Brad plans to continue his research while in retirement, and we expect that he will visit JMP often and continue to collaborate with us. He leaves Ryan Lekivetz to continue in his role as the manager of the DOE and Reliability group.
Brad has brought tremendous value to our users – and to the whole profession of experimental design. DOE is a key technology for industry, and Brad, with his collaborators, has led the advances of the state of the art for a generation. Thank you, Brad, for all you have done and for being a great friend to us.