Share with your friends


Analytics Magazine

Forum: Your data already knows what you don’t

November/December 2014

The marriage of two “natural resources” – hydrocarbons and data – will transform unconventional oil development.

Atanu BasuBy Atanu Basu (right), Daniel Mohan and Marc Marshall

Known-knowns, known-unknowns and unknown-unknowns. Donald Rumsfeld’s notable turn of phrase is an apt characterization of where we are with unconventional oil development today. Shale operators in Eagle Ford (South Texas), Permian (West Texas), Bakken (Upper Midwest) and other places have transformed the United States into an energy superpower by profitably extracting oil and gas from tight rocks that weren’t commercially viable even a few years ago. With that backdrop, unconventional oil development today is punctuated by significant performance variations among operators with contiguous acreage positions and meager estimated ultimate recovery (EUR) rates. Unless performance keeps improving, any fluctuation in commodity prices can send shockwaves through the oil patches around the country, as we have seen happen with natural gas. How do we gain ground on the vexing “unknowns” to tilt the inherent risks involved in shale oil development in our favor?

Standing on the shoulder of giants

Geoscience (geoscientists are the giants of the energy industry) is finally getting a shot in the arm from data science, especially from Google-like technologies that are already at work in the oil patch. Leading the charge is prescriptive analytics, which can “prescribe” optimum recipes for drilling, completing and producing wells to maximize an asset’s value at every point during its operational lifetime. The premise of prescriptive analytics is to take in all data – Figure 1 shows examples of shale data sets – and use the data to predict and prescribe how to make better wells using information from the past wells and subsurface characteristics of undrilled acreage.

Figure 1: Examples of shale data sets.

Figure 1: Examples of shale data sets.

While today’s sophisticated operators and energy services companies are adept at analyzing each of these data sets separately, prescriptive analytics technology is unique in that it processes these structured and unstructured data sets together, and does so continually. Since reservoir conditions are anything but static, the machine learns from new streams of data and updates its “prescriptions” when the data sets signal the need for a recalibration. This adaptive environment compresses learning curves, enabling better decisions faster, with less risk – and much less capital.

Questions worth answering

Let’s “begin with the end in mind” – as the late Dr. Steven Covey used to say – and understand the outcomes made possible by prescriptive analytics, using data sets most operators already have on hand and/or routinely collect in the course of normal operations. Some examples:


  • Which reservoir, drilling, completion and production variables have the greatest impact on production?
  • How closely should we space wells? Do we have stage overlap? Formation containment?
  • Does the order in which we treat and/or produce adjacent wells matter? Why?


  • Which stages and clusters were treated effectively? Treated as expected? Why?
  • Which stages are producing? Producing as expected? Which are not? Why?
  • How should a well be produced to maximize its lifetime value?

Secondary Recovery, EOR

  • When should artificial lift be introduced in the lifecycle of a well to maximize estimated ultimate recovery (EUR)?
  • When should enhanced oil recovery (EOR) be introduced in the lifecycle of a well in order to maximize EUR?
  • Does EOR result in higher recovery rates, or are recoveries simply accelerated?
  • What is the incremental return on investment of EOR? Where is the point of diminishing returns?

You don’t have to know as long as your data does

Operators can start using – and reaping benefits from – data-driven prescriptions immediately, even if the underlying causalities are not fully understood. Think about this for a minute. We use Google to find restaurants or plan a route that avoids traffic congestion without completely understanding how or why the engine’s algorithms produced the suggestions they did. Does that lack of understanding make the results less useful? Of course not.

The same holds true for prescriptive analytics. The technology makes an immediate impact while the geoscientists, in parallel, strive to understand the physics behind the predictions and prescriptions the software derived from an operators’ data – lots and lots of data of all types.

Atanu Basu ( is president and CEO of Ayata, a prescriptive analytics software company based in Houston, Texas, and a member of INFORMS. Daniel Mohan is senior vice president of sales & marketing, and Marc Marshall is the senior vice president of engineering SVP at Ayata. A version of this article appeared in Hart Energy’s blog site, E&P. Reprinted with permission.

business analytics news and articles


Analytics Blog

Electoral College put to the math test

With the campaign two months behind us and the inauguration of Donald Trump two days away, isn’t it time to put the 2016 U.S. presidential election to bed and focus on issues that have yet to be decided? Of course not.


Stereotypes hold back girls’ interest in STEM subjects

New research from Accenture reveals that young people in the United Kingdom and Ireland are most likely to associate a career in science and technology with “doing research” (52 percent), “working in a laboratory” (47 percent) and “wearing a white coat” (33 percent). The study found that girls are more likely to make these stereotypical associations than boys. Read more →

Gartner: Connected ‘things’ will jump 31 percent in 2017

Gartner, Inc. forecasts that 8.4 billion connected things will be in use worldwide in 2017, up 31 percent from 2016, and will reach 20.4 billion by 2020. Total spending on endpoints and services will reach almost $2 trillion in 2017. Regionally, China, North America and Western Europe are driving the use of connected things, and the three regions together will represent 67 percent of the overall Internet of Things (IoT) installed base in 2017. Read more →

U.S. News: Analytics jobs rank among the best

When it comes to the best business jobs, analytics- and operations research-oriented disciplines dominate the list, according to U.S. News & World Report’s rankings of the “2017 Best Jobs.” In order, the top five “best business jobs” listings include: 1. statistician
, 2. mathematician
, 3. financial advisor, 
4. actuary, and 
5. operations research analyst. Read more →




2017 INFORMS Business Analytics Conference
April 2-4, 2017, Las Vegas

2017 INFORMS Healthcare Conference
July 26-28, 2017, Rotterdam, the Netherlands


CAP® Exam computer-based testing sites are available in 700 locations worldwide. Take the exam close to home and on your schedule:

For more information, go to