Share with your friends


Analytics Magazine

How prescriptive analytics can reshape fracking in oil and gas fields

March/April 2014

Atanu BasuBy Atanu Basu

The United States is re-emerging as an energy superpower. According to the International Energy Agency, by 2016 the U.S. will surpass Saudi Arabia and become the world’s largest oil producer.

The domestic energy industry’s recent rise is the result of lower demand through energy efficiency and the rise in production of unconventional oil and gas discovered in underground shale formations. Horizontal drilling and hydraulic fracturing have made it possible to economically produce oil and gas from tight rocks. In October 2013, U.S. oil production reached its highest monthly total in the last 25 years. In Texas, with crude oil production of more than 2.7 million barrels per day, two shale oil fields alone – Eagle Ford and Permian Basin – are on target to produce nearly 2 million barrels of oil equivalent a day in 2013.

However, while abundant, shale oil and gas can be difficult to locate and extract. Horizontal drilling and hydraulic fracturing processes are expensive and, some say, potentially harmful to the environment. Another relatively unknown fact – especially to industry outsiders – is that fracking is quite inefficient today: 80 percent of the production comes from 20 percent of the fracking stages. Today, horizontal drilling and hydraulic fracturing recover about 20 percent, probably less, of the oil in the shale rocks. According to PacWest, drillers will spend $31 billion in 2013 on suboptimal frack stages across 26,100 wells in the United States. In response, some of the largest oil and gas companies are using big data analytics technologies to improve their exploration and production.

Big data analytics includes three categories: descriptive analytics, which tells you what happened and why; predictive analytics, which tells you what will happen; and prescriptive analytics, which tells you what will happen, when, why and how to improve this predicted future.

Marketers, operations experts, financial officers and other business leaders have already used prescriptive analytics to improve customer experience, reduce churn, increase up-selling and cross-selling revenue, streamline logistics and enhance other important applications. For the oil and gas industry, prescriptive analytics can help locate fields with the richest concentrations of oil and gas, make pipelines safer, and improve the fracking process for greater output and fewer threats to the environment.

Horizontal drilling and hydraulic fracturing have made it possible to economically produce oil and gas from tight rocks.

About 80 percent of the world’s data today is unstructured – videos, images, sounds and texts. Until recently, most big data analytics technologies looked only at numbers. The oil and gas industry looked at images and numbers, but in separate silos. However, the ability to analyze hybrid data – a combination unstructured and structured data – provides a much clearer and more complete picture of the current and future problems and opportunities, along with the best actions to achieve the desired outcomes. For example, to improve hydraulic fracturing performance, the following datasets must be analyzed together:
• images from well logs, mud logs, seismic reports,
• videos from down-hole cameras of fluid flow,
• sounds from fracking recorded by fiber optic sensors,
• texts from drillers’ and frack pumpers’ notes, and
• numbers from production and artificial lift data.

Taking hybrid data into account is critical because of the multi-billion dollar investment and drilling decisions that are being made by the energy companies regarding where to drill, where to frack and how to frack. It calls for combining disparate computational and scientific disciplines to be able to interpret different types of data together. For example, to algorithmically interpret images (such as well logs), machine learning needs to be combined with pattern recognition, computer vision and image processing. Mixing these different disciplines provides more holistic recommendations regarding where and how to drill and frack, while reducing the chances of problems that could emerge along the way.

For example, by developing detailed analytical signatures – using data from production, subsurface, completion and other sources – one can better predict performing and non-performing wells in a field. This process is supported by the prescriptive analytics technology’s ability to automatically digitize and interpret well logs to create depositional maps of the subsurface. With a better idea of where to drill, companies save invaluable resources by skipping wells that shouldn’t be drilled in the first place. At the same time, they minimize damage to that particular landscape.

Prescriptive analytics can be used in other areas of oil and gas production. In both traditional and unconventional wells, by using data from pumps, production, completion and subsurface characteristics, one can predict failures of electric submersible pumps and prescribe actions to mitigate production loss. Apache Corp., for example, is using analytics to predict failures in pumps that pull oil out from subsurface and preempt the associated production loss from these pump failures.

Another potential application of prescriptive analytics is that it can possibly predict corrosion development or cracks in pipelines and prescribe preventive and preemptive actions by analyzing video data from cameras along with other data from robotic devices called “smart pigs” inside these pipelines.

Smarter decisions equal fewer resources, lower environmental impact and greater yields. Successful companies will be the ones that know how to prioritize resources to extract, produce and transport oil and gas in the most efficient and safest manner. Look for big data and prescriptive analytics to play a much bigger role in this space over the coming years.

Atanu Basu is CEO of AYATA, a software company headquartered in Austin, Texas. AYATA’s prescriptive analytics software focuses on improving oil and gas exploration and production. Basu is a member of INFORMS. A version of this article appeared in DataInformed.

business analytics news and articles

Related Posts

  • 53
    November/December 2012 The advent of the “digital oil field” helps produce cost-effective energy while addressing safety and environmental concerns. Finding and producing hydrocarbons is technically challenging and economically risky. By Adam Farris Everyone needs it, few know how we get it, and many feel compelled to slow down efforts to…
    Tags: data, oil, gas, energy, big
  • 41
    November/December 2014 Big data needs advanced analytics, but analytics does not need big data. By Eric A. King Thanks big data! Now we’re even more data-rich … yet remain information-poor. After staggering investments motivated by an overabundance of buzz and hype, big data has yet to produce cases that reveal…
    Tags: data, big, analytics, will
  • 41
    July/August 2014 The story of how IBM not only survived but thrived by realizing business value from big data. By (l-r) Brenda Dietrich, Emily Plachy and Maureen Norton This is the story of how an iconic company founded more than a century ago, and once deemed a “dinosaur” that would…
    Tags: analytics, data, big
  • 37
    Use of the term “business analytics” is being used within the information technology industry to refer to the use of computing to gain insight from data. The data may be obtained from a company’s internal sources, such as its enterprise resource planning application, data warehouses/marts, from a third party data…
    Tags: analytics, data, prescriptive
  • 37
    September/October 2014 “From Twitter feeds to photo streams to RFID pings, the big data universe is rapidly expanding, providing unprecedented opportunities to understand the present and peer into the future. Tapping its potential while avoiding its pitfalls doesn’t take magic; it takes a roadmap.”  — Chris Berdik, author of “Mind…
    Tags: data, analytics, big

Analytics Blog

Electoral College put to the math test

With the campaign two months behind us and the inauguration of Donald Trump two days away, isn’t it time to put the 2016 U.S. presidential election to bed and focus on issues that have yet to be decided? Of course not.


Stereotypes hold back girls’ interest in STEM subjects

New research from Accenture reveals that young people in the United Kingdom and Ireland are most likely to associate a career in science and technology with “doing research” (52 percent), “working in a laboratory” (47 percent) and “wearing a white coat” (33 percent). The study found that girls are more likely to make these stereotypical associations than boys. Read more →

Gartner: Connected ‘things’ will jump 31 percent in 2017

Gartner, Inc. forecasts that 8.4 billion connected things will be in use worldwide in 2017, up 31 percent from 2016, and will reach 20.4 billion by 2020. Total spending on endpoints and services will reach almost $2 trillion in 2017. Regionally, China, North America and Western Europe are driving the use of connected things, and the three regions together will represent 67 percent of the overall Internet of Things (IoT) installed base in 2017. Read more →

U.S. News: Analytics jobs rank among the best

When it comes to the best business jobs, analytics- and operations research-oriented disciplines dominate the list, according to U.S. News & World Report’s rankings of the “2017 Best Jobs.” In order, the top five “best business jobs” listings include: 1. statistician
, 2. mathematician
, 3. financial advisor, 
4. actuary, and 
5. operations research analyst. Read more →




2017 INFORMS Business Analytics Conference
April 2-4, 2017, Las Vegas

2017 INFORMS Healthcare Conference
July 26-28, 2017, Rotterdam, the Netherlands


CAP® Exam computer-based testing sites are available in 700 locations worldwide. Take the exam close to home and on your schedule:

For more information, go to