Share with your friends


Analytics Magazine

Forum: The benefits of turning big data into fast data

November/December 2013


The benefits of turning big data into fast data

Mike HummelBy Mike Hummel

Big data is the new technology darling. There are several big data players emerging every day, each with their own unique angle on solving a specific gap, and some of the tech giants are honing their database platforms as well. The old question used to be one of scalability. How do we make big data work efficiently over terabytes of information and multiple data centers?

Big data allows companies to produce stronger, more relevant insights than ever before. But having vast quantities of data can be a double-edged sword. If queries run slower because of the database size, and if reporting takes longer because of slower queries, then big data almost becomes unusable. There still remains the problem of harnessing the power of big data, in real-time.

So what exactly are the benefits of real-time big data (“fast data”)? How do we generate actionable results in real-time, before the data gets “old” – which only takes a few seconds? To achieve this, organizations must be able to react to changes in data patterns in real-time. But what is real-time? And how does fast data translate to better business practices, stronger customer loyalty and, ultimately, reduced costs?

Fast data means customer loyalty

E-merchants say, “Sure, we do real-time campaigns, our customers can click on ads when they’re online.” However, what they fail to realize is that those real-time campaigns are running on old data, which results in losing out on significant business. What if a customer just bought a dress, and instead of showing her accessories, you’re still showing her more dresses?

If the data had been analyzed and reported in real-time, and was adapted to the customer’s dynamic clickstream, then the e-merchant would be able to serve ads for shoes, belts or other complementary products while the customer is still browsing the site. Fast big data helps e-commerce companies target their customers more effectively. Better targeting improves the customer shopping experience by allowing e-merchants to deliver personalized shopping experiences. Personalized shopping experiences create an atmosphere that is more likely to retain customer loyalty, and entice additional purchases.

As a second example, consider a customer browsing a travel website for vacation deals. If the results take even a few hundred milliseconds to load, the customer will likely leave the site to find other sources for travel deals. A travel website focusing on fast data, rather than just large quantities of big data, and delivering real-time page loads will enjoy a much better customer retention rate because customers will be more apt to stay and browse longer.

Fast big data will lead to more efficient, real-time report generation and analytics queries. Fast data allows organizations improve their response times to customers, which answers the ultimate question of improving the customer experience.

Reduce infrastructure, operating costs

Fast data can provide a telco operator OTT (Over The Top) revenues, through premium analytical services for business partners. For example, operators collect vast amounts of data at base stations. However, they currently pass it on to the central data warehouse. If operators turned this data into analytical insights faster, they could generate significant premium revenues. Analyzing data at each cell tower, or radio access controller, rather than sending it all to one data warehouse, will save operators time and generate additional incremental revenue.

In addition, many operators choose to analyze network data, such as performance and capacity. But focusing on customer data, correlated with network data, can enable imperative insights. Fast customer data also lets operators provide customer service in real-time. An operator that uses fast data to analyze customer behavior will have instantaneous information about network bandwidth spikes, downtime and dropped call information. If an operator receives and analyzes this data in real-time, it can also address these problems in real-time. Customers demand instant satisfaction; fast customer data can give operators the means to provide it.

What’s next?

Big data is beginning to become overhyped, if it is not already. The idea that having vast quantities of data is the only prerequisite for a strong data-driven infrastructure is inaccurate. Decision-makers must be able to see instantaneous reporting and query responses in order to address customer needs and infrastructure maintenance. It is clear that big data is not all that is necessary to maintain competitive advantages. Now, organizations must evolve, and to do so, they must turn their attention to fast data.

Mike Hummel is CEO of ParStream (, a provider of real-time big data business analytics technologies.

business analytics news and articles


Related Posts

  • 46
    International Data Corporation (IDC) recently released a worldwide Big Data technology and services forecast showing the market is expected to grow from $3.2 billion in 2010 to $16.9 billion in 2015. This represents a compound annual growth rate (CAGR) of 40 percent or about seven times that of the overall…
    Tags: data, big
  • 44
    Many organizations have noticed that the data they own and how they use it can make them different than others to innovate, to compete better and to stay in business. That’s why organizations try to collect and process as much data as possible, transform it into meaningful information with data-driven…
    Tags: data, big
  • 43
    September/October 2012 Opportunity to deliver real-time customer insights by harnessing the power of structured and unstructured data. By Rohit Tandon, Arnab Chakraborty and Ganga Ganapathi (left to right) The rise of the Internet has created terabytes of data or “Big Data” that is available to consumers and enterprises alike. This…
    Tags: data, customer, big
  • 40
    With its museums dedicated to master painters, canals that exude old-world charm and core city streets that date back to the 17th century, Amsterdam is a place very much in touch with its past. But the city, known for being progressive and open to new ideas, has also become a…
    Tags: data, real-time
  • 38
    In today’s world where data is collected at every interaction, be it over the phone, mobile, PC, sensors, with or without us knowing, it becomes important to have a strategy around data. Traditionally, data has been seen as something to “run the business,” but, in today’s context, it can actually…
    Tags: data, real-time, customer


Finalists for 2018 Syngenta Crop Challenge announced

Syngenta and the Analytics Society of INFORMS this week announced the finalists for the 2018 Syngenta Crop Challenge in Analytics. Now in its third year, the competition aims to address the challenge of achieving global food security by fostering cross-industry collaboration between agriculture and advanced analytics experts. Read more →

International Conference to spotlight O.R., analytics and AI

The 2018 INFORMS International Conference will be held in the world-class International Convention Center (TICC) and the Grand Hyatt Taipei in beautiful Taipei City, Taiwan, on June 17-20. The conference theme is “A Better World Through Operations Research, Analytics and Artificial Intelligence.” The conference offers excellent opportunities to learn about the emerging O.R. and A.I. technologies and applications from more than 40 invited, sponsored and contributed clusters featuring more than 600 talks. Read more →

How math education can catch up to the 21st century

Big data analytics is increasingly becoming a trending practice that society is adopting, and Daniel Kunin, a scholar at Stanford University and the creator of the online platform, Seeing Theory, is using creative and innovative ways to teach statistics and probability relevant to a changing world. In a recent interview with CMRubinWorld, Kunin discusses math education today and how he believes it can be improved in order to both foster curiosity and be more relevant now and going forward. Read more →



2018 INFORMS Conference on Business Analytics and Operations Research
April 15-17, 2018, Baltimore


CAP® Exam computer-based testing sites are available in 700 locations worldwide. Take the exam close to home and on your schedule:

For more information, go to