We've just published a new asset to our JMP Resource Center, an excerpt of David Hand's new book, Dark Data: Why What You Don't Know Matters. In the book, Dr. Hand explores the many ways we can be blind to missing or unseen data and how, in our rush to be a data-driven society, we might be missing things that matter, leading to dangerous decisions that can sometimes have disastrous consequences.
In this excerpt from Chapter Seven, Dark Data and the Big Picture, Hand discusses the effect of dark data in the scientific and medical communities. Building on professor of medicine and statistics at Stanford John Ioannidis', claim that “it can be proven that most claimed research findings are false,” Dr. Hand argues that the very nature of scientific discovery lends itself to dark data errors. Along the way, Dr. Hand introduces data phenomena like p-hacking, spurious measurement errors, and false discovery rates, and “HARKing.”
Please enjoy the chapter, share it with your customers, post to your contacts, and generally help us get the word out.
Dark Data Landing Page
Direct Link to the PDF
Give a shout if you have any questions.
Thanks everyone,
Larry
