Share with your friends


Analytics Magazine

The trick to predictive analytics: How to bridge the quant/business culture gap

By Eric Siegel

Eric SiegelNote: This article is excerpted from Eric Siegel’s foreword to the recently released book, “Mining Your Own Business: A Primer for Executives on Understanding and Employing Data Mining and Predictive Analytics,” by Jeff Deal and Gerhard Pilcher.

For predictive analytics to work, two different species must cooperate in harmony: the business leader and the quant. In order to function together, they each have to adapt. On the one hand, the quant needs to attain a business-oriented vantage. And on the other, the business leader must navigate a very alien world indeed. Deal and Pilcher’s new book, “Mining Your Own Business,” helps with that second bit.

Bridging this gargantuan divide is worth the effort. Take for example a tax fraud detection story worth 10 digits (covered in the book’s Introduction). Elder Research, Inc. (ERI), the consultancy that spawned the book, delivered predictive models to the IRS that increased the agency’s identification of a certain type of tax fraud by a factor of 25. This saved the feds billions (with a “b”).

This success exemplifies a widely applicable paradigm. Across commercial and government sectors, predictive targeting achieves a multiplicative improvement to broad scale operations (albeit often a single-digit multiplier rather than that whopping 25-fold improvement). In addition to deciding which tax returns to audit, predictive models determine which customers to contact for marketing, which debtors to approve for increased credit limits, which patients to clinically screen, which employees to woo away from quitting, which persons of interest to investigate, and which equipment to inspect for impending failure.

Thus data science earns its status as hot, lucrative and sexy. This is the Information Age’s latest evolutionary step, technology that taps data to drive decisions more effectively. It’s the very act of scientifically optimizing resource allocation for …  just about all processes. Various outlets have dubbed data scientist as the best, most in-demand and even “sexiest” job. And if you haven’t heard, data is the new oil. Industry research forecasts that demand will continue to grow and estimates the global predictive analytics market could reach as high as $9 billion by 2020.

But to capture this value, you must construct a durable bridge across the quant/business culture gap. The core technology – which learns from data to predict – is only half of the trick. Deploying it is more than just a technical process – it’s an organizational process. Existing business operations must change by way of implementing analytics. It’s no longer business as usual; science now drives the enterprise’s primary decisions and actions en masse. In this sense, data science is intrinsically revolutionary.

As a result, the greatest pitfall that hinders analytics is to not properly plan for its deployment. For each analytics initiative, it’s critical to build a pathway from the get-go that will lead to integration. This requires bridging the cultural gap. It takes the socialization of buy-in: Line of business staff must agree to make big changes. To that end, they must learn what a predictive model does for them and they must be willing to put their faith in it.

That doesn’t always work out. With refreshing frankness, this book reveals an ERI study of their own early client projects that showed a full third of projects fail to attain business results, despite 90 percent attaining technical (analytical) success. The difference is often whether the organization actually implements the fruits of analysis.

No guts, no glory. With inertia, resistance to change, and a lack of confidence as primary impediments, there’s no more eye-catching antidote than Dr. John Elder’s legendary willingness to put his money where his mouth is. Before founding ERI, John once invested all his own personal assets into his own predictive stock market trading system, in response to hesitancy on the part of his client to move forward (I recount this story in detail in the book “Predictive Analytics”). And in a story from Chapter 6 of the book at hand, “Mining Your Own Business,” John doubled down against a major credit card company, betting ERI could beat their established analytical methods to model credit risk. If ERI failed, they’d cut their service fee in half; but if they won, the cost would double (yet, in the latter case, the company would gain enormously from the improved predictive model). This tactic served handily to move the project forward.

Don’t worry. When inertia hinders progress, you don’t necessarily need to take the dramatic approach of wagering your own money. There are other options among the established best practices for managing predictive analytics initiatives. It’s largely about educating the organization and opening discussions to understand the concerns of skeptics.

Unfortunately, convolution and the appearance of arcane complexity threaten to extinguish a newcomer’s excitement about the potential value. This might leave the person feeling compelled only by the pressure that comes from hype: “Everyone’s doing it!” Let’s nip that in the bud right now. Predictive analytics’ value is simple and concrete: It helps run operations more effectively by way of predicting behavior, i.e., the outcome for each individual consumer, employee, healthcare patient or suspect. These predictions are each just numbers, aka scores or probabilities. Since they directly drive decisions, they’re by definition the most actionable deliverable you can get from analytics. One need only learn a limited bit about the (fascinating) “rocket science” that generates these predictive scores to integrate them and realize their value.

Regrettably, today’s tremendous data hype does not always relay this value proposition or any specific value proposition at all. The pervasive buzzwords big data and data science enthusiastically remind us there is value to be had, but do not refer to any particular technology or approach. These terms are general catch-alls for “doing smart things with data.” They really have no agreed upon definition beyond that, although they do allude to a vital cultural movement lead by thoughtful data wonks. Big data is nothing more than a grammatically incorrect way to say “a lot of data” (like saying “big water” instead of “a lot of water”). Data science is a redundant term, since all science involves data; it’s like saying, “book librarian.” In one section, the authors of this book delve deeper with solid coverage of the extensive taxonomy of terms and technology.

In a field propelled largely by data nerds, it may come as no surprise that most books serve the hands-on quant. Those books dive into the technical practice. After all, for a quant, the technology and software tools are much more tangible and easy to define than the more elusive, “human” arena of organizational processes and project management. As a natural-born geek, I know from personal experience.

This book is different. Jeff Deal and Gerhard Pilcher wrote it to serve the much neglected other side of the coin: you, the business leader. It delivers the two ingredients you need for success: 1) an understanding of the technology so you can speak the quant’s language, and 2) a guide to analytics management best practices, including how to build your analytics team and avert the most costly pitfalls.

Eric Siegel, Ph.D., is the author of “Predictive Analytics: The Power to Predict Who Will Click, Buy, Lie, or Die, Revised and Updated Edition” (Wiley, January 2016), the founder of the Predictive Analytics World conference series, executive editor of The Predictive Analytics Times and a former computer science professor at Columbia University. © 2016 Eric Siegel. All rights reserved. Republished with permission.



Related Posts

  • 91
    Eric Siegel, founder of Predictive Analytics World (PAW, a series of conferences held throughout the year in major U.S. and European cites) and the author of the new book, “Predictive Analytics: The Power to Predict who will Click, Buy, Lie or Die,” is without question a key player in the…
    Tags: analytics, predictive, data, book
  • 83
    The CUNY School of Professional Studies is offering a new online master of science degree in data analytics. The program prepares its graduates for high-demand and fast-growing careers as data analysts, data specialists, business intelligence analysts, information analysts and data engineers in such fields as business, operations, marketing, social media,…
    Tags: data, analytics, business
  • 78
    Benjamin Franklin offered this sage advice in the 18th century, but he left one key question unanswered: How? How do you successfully drive a business? More specifically, how do you develop the business strategy drivers that incite a business to grow and thrive? The 21st-century solution has proven to be…
    Tags: data, analytics, business
  • 77
    “Drive thy business or it will drive thee.” Benjamin Franklin offered this sage advice in the 18th century, but he left one key question unanswered: How? How do you successfully drive a business? More specifically, how do you develop the business strategy drivers that incite a business to grow and…
    Tags: data, business, analytics
  • 76
    New research by Continuum Analytics finds that 96 percent of data science and analytics decision-makers agree that data science is critical to the success of their business, yet a whopping 22 percent are failing to make full use of the data available.
    Tags: data, science, analytics, business


Using machine learning and optimization to improve refugee integration

Andrew C. Trapp, a professor at the Foisie Business School at Worcester Polytechnic Institute (WPI), received a $320,000 National Science Foundation (NSF) grant to develop a computational tool to help humanitarian aid organizations significantly improve refugees’ chances of successfully resettling and integrating into a new country. Built upon ongoing work with an international team of computer scientists and economists, the tool integrates machine learning and optimization algorithms, along with complex computation of data, to match refugees to communities where they will find appropriate resources, including employment opportunities. Read more →

Gartner releases Healthcare Supply Chain Top 25 rankings

Gartner, Inc. has released its 10th annual Healthcare Supply Chain Top 25 ranking. The rankings recognize organizations across the healthcare value chain that demonstrate leadership in improving human life at sustainable costs. “Healthcare supply chains today face a multitude of challenges: increasing cost pressures and patient expectations, as well as the need to keep up with rapid technology advancement, to name just a few,” says Stephen Meyer, senior director at Gartner. Read more →

Meet CIMON, the first AI-powered astronaut assistant

CIMON, the world’s first artificial intelligence-enabled astronaut assistant, made its debut aboard the International Space Station. The ISS’s newest crew member, developed and built in Germany, was called into action on Nov. 15 with the command, “Wake up, CIMON!,” by German ESA astronaut Alexander Gerst, who has been living and working on the ISS since June 8. Read more →



INFORMS Computing Society Conference
Jan. 6-8, 2019; Knoxville, Tenn.

INFORMS Conference on Business Analytics & Operations Research
April 14-16, 2019; Austin, Texas

INFORMS International Conference
June 9-12, 2019; Cancun, Mexico

INFORMS Marketing Science Conference
June 20-22; Rome, Italy

INFORMS Applied Probability Conference
July 2-4, 2019; Brisbane, Australia

INFORMS Healthcare Conference
July 27-29, 2019; Boston, Mass.

2019 INFORMS Annual Meeting
Oct. 20-23, 2019; Seattle, Wash.

Winter Simulation Conference
Dec. 8-11, 2019: National Harbor, Md.


Advancing the Analytics-Driven Organization
Jan. 28–31, 2019, 1 p.m.– 5 p.m. (live online)


CAP® Exam computer-based testing sites are available in 700 locations worldwide. Take the exam close to home and on your schedule:

For more information, go to