Share with your friends










Submit

Analytics Magazine

Analyze This! A tale of two books on decision-making

September/October 2013

Vijay MehrotraBy Vijay Mehrotra

Daniel Kahneman is a psychologist who was awarded the 2002 Nobel Prize for his influence on the burgeoning field of behavioral economics. I recently read his bestselling 2011 book “Thinking Fast and Slow” [1]. The book begins with a set of chapters collectively entitled “Two Systems.” This is where the book’s title comes from: System 1 [the “Thinking Fast” from the book’s title] “operates automatically and quickly, with little or no effort and no sense of voluntary control,” while System 2 [“Thinking Slow”] is engaged in “the effortful mental activities that demand it, including complex computations …” [2].

Kahneman then proceeds to illustrate how these Systems interact. He presents several examples in which System 1’s assessment processes are simplistic and biased. System 2, while capable of making much better decisions, is shown to be “lazy” as a result of the volume and variety of demands that leave it in a busy and depleted state. The tendency toward lazy System 2 processes, it turns out, is also why so many people turn out to be quite unskilled at probabilistic reasoning and associated decision-making; it is simply much, much easier for System 1’s automatic (and often incorrect) heuristics to be deployed than for System 2 to break away from its many other demands.

My System 2 was exhausted by the time I finished “Thinking,” so I simply started reading the next book that was sitting on my nightstand, which was Eric Siegel’s “Predictive Analytics: The Power to Predict Who Will Click, Buy, Lie, or Die” [3]. Siegel is a former computer science professor, an experienced analyst and more recently the founder of the Predictive Analytics World conference series. As its title suggests, he has written a book that focuses on data-driven predictions, which he collectively labels as “predictive analytics” (PA).

The centerpiece, or rather centerfold, of the book is a list of more than 100 success stories that involve PA, grouped into categories ranging from “Financial Risk and Insurance” to “Family and Personal Life.” In turn, each chapter tells its own tale through these PA success stories. For example, in the chapter that explores the ethical and privacy implications of using data for prediction (“With Power Comes Responsibility”), Siegel illustrates the key ideas through the story of HP’s model for predicting the likelihood of employees leaving the company and Target’s algorithm and processes for predicting which customers were likely to be pregnant, while in the last chapter (“Persuasion by the Numbers”) he shines a bright light on U.S. Bank, Telenor (a Norwegian telecommunications company) and the Obama 2012 campaign.

When I started reading this book, I really did not know much about machine learning and so it was a nice window into its key ideas (Siegel views machine learning and predictive analytics as almost synonymous). Though this is a decidedly non-technical book, Siegel provides a clear illustration of the concepts behind machine learning, while also naturally introducing some of its terminology (“training sets,” “test sets,” “ensemble methods,” etc.).

Despite Siegel’s best efforts at levity – he routinely makes puns, includes pop culture references and even offers up his own tongue-in-cheek poetry to keep things light – my head began to hurt after reading a few chapters. At first, I could not figure out what my problem was, but eventually, it came to me: the juxtaposition of these two books was the source of the pain.

In the introduction to “Thinking,” Kahneman writes that “this book presents my current understanding of judgment and decision-making, which has been shaped by psychological discoveries of recent decades”; indeed, many of these discoveries were his own, and it appears that the desire for continuing to improve this understanding still drives him to this day. Siegel, on the other hand, describes the world of predictive analytics as ruthlessly pragmatic: “We usually don’t know about causation, and we often don’t necessarily care…prediction trumps explanation.”

Kahneman clearly relished the regular and frequent informal conversations through which he and the late Amos Tversky (with whom he published many seminal papers prior to Tversky’s death in 1995 and to whom “Thinking” is dedicated) evolved their thinking. For his part, Siegel writes with excitement of “one of the coolest things in science, the most audacious of human ambitions: the automation of learning.”

The theories and discoveries that Kahneman describes nearly always involved intricate and careful data collection to test specific hypotheses that were framed within a large body of previous research, while Siegel asserts that, “PA’s aim isn’t only to assess human hunches…but also to explore a boundless playing field of possible truths beyond the realms of intuition.”

When I finally finished Siegel’s book, there was no doubt in my mind that there is a bright and growing future for predictive analytics, and that Siegel is a capable and passionate spokesman with a compelling vision for this future. Indeed, his book illustrates that one virtue of PA in the business world is that it provides objective insights based on data, rather than simply leaving managers and executives free to make complex decisions by intuition alone. As it happens, several Kahneman and Tversky papers [4] have had a huge impact on exposing the very real limitations in the quality of intuitive decision-making, which has helped legitimize the practice of predictive analytics.

Yet if the future belongs to analytics professionals, as Siegel and many others are fond of suggesting these days, I do hope that they understand not only the power of the computer to make discoveries by relentlessly sifting through increasingly large piles of data but also the value of developing deep domain knowledge, participating in inspired discussions, and being both persistently curious and curiously persistent. These lessons, in addition to their many insights into the psychology of decision-making, are also a huge part of Kahneman’s (and Tversky’s) legacy.

Vijay Mehrotra (vmehrotra@usfca.edu) is an associate professor in the Department of Analytics and Technology at the University of San Francisco’s School of Management. He is also an experienced analytics consultant and entrepreneur, an angel investor in several successful analytics companies and a longtime member of INFORMS.

REFERENCES & NOTES

  1. http://www.amazon.com/Thinking-Fast-Slow-Daniel Kahneman/dp/0374533555/ref=sr_1_1?ie=UTF8&qid=1377194045&sr=8-1&keywords=thinking+fast+and+slow
  2. Kahneman credits Keith Stanovich and Richard West with developing the “System 1-System 2” terminology.
  3. http://www.amazon.com/Predictive-Analytics-Power-Predict-Click/dp/1118356853
  4. Most notable among these papers: Tversky, A. and Kahneman, D., 1974, “Judgment under Uncertainty: Heuristics and Biases,” Science, Vol. 185(4157), p. 1,124-1,131. This article is reprinted in full at the end of “Thinking Fast and Slow.”

business analytics news and articles

 

Analytics Blog

Electoral College put to the math test


With the campaign two months behind us and the inauguration of Donald Trump two days away, isn’t it time to put the 2016 U.S. presidential election to bed and focus on issues that have yet to be decided? Of course not.


Headlines

Three keys for organizations to gain value from information

In the current information-driven society and increasingly digitalized world, Gartner, Inc. says that sentiments are shifting from the economics of tangible assets to the economics of information – “infonomics” – and other intangible assets. Infonomics is the theory, study and discipline of asserting economic significance to information. It strives to apply both economic and asset management principles and practices to the valuation, handling and deployment of information assets.  Read more →

Burtch Works study on ‘Salaries of Predictive Analytics Professionals’

According to the recently released Burtch Works study on “Salaries of Predictive Analytics Professionals 2017,” senior-level executives saw the largest increase in salaries from 2016 to 2017, and industry diversification of employment has diluted the concentration of such professionals from financial services and marketing/advertising to consulting and technology. Read more →

New study asks, ‘Is your business AI-ready?’

Despite fears that robots will replace human labor, the majority of artificial intelligence (AI) leaders (79 percent) expect their employees will work comfortably with robots by 2020, according to a new Genpact survey of C-Suite and senior executives titled, “Is Your Business AI-Ready?” Read more →

UPCOMING ANALYTICS EVENTS

INFORMS-SPONSORED EVENTS

2017 Winter Simulation Conference (WSC 2017)
Dec. 3-6, 2017, Las Vegas

CAP® EXAM SCHEDULE

CAP® Exam computer-based testing sites are available in 700 locations worldwide. Take the exam close to home and on your schedule:


 
For more information, go to 
https://www.certifiedanalytics.org.