Share with your friends


Analytics Magazine

Forum: The benefits of turning big data into fast data

November/December 2013


The benefits of turning big data into fast data

Mike HummelBy Mike Hummel

Big data is the new technology darling. There are several big data players emerging every day, each with their own unique angle on solving a specific gap, and some of the tech giants are honing their database platforms as well. The old question used to be one of scalability. How do we make big data work efficiently over terabytes of information and multiple data centers?

Big data allows companies to produce stronger, more relevant insights than ever before. But having vast quantities of data can be a double-edged sword. If queries run slower because of the database size, and if reporting takes longer because of slower queries, then big data almost becomes unusable. There still remains the problem of harnessing the power of big data, in real-time.

So what exactly are the benefits of real-time big data (“fast data”)? How do we generate actionable results in real-time, before the data gets “old” – which only takes a few seconds? To achieve this, organizations must be able to react to changes in data patterns in real-time. But what is real-time? And how does fast data translate to better business practices, stronger customer loyalty and, ultimately, reduced costs?

Fast data means customer loyalty

E-merchants say, “Sure, we do real-time campaigns, our customers can click on ads when they’re online.” However, what they fail to realize is that those real-time campaigns are running on old data, which results in losing out on significant business. What if a customer just bought a dress, and instead of showing her accessories, you’re still showing her more dresses?

If the data had been analyzed and reported in real-time, and was adapted to the customer’s dynamic clickstream, then the e-merchant would be able to serve ads for shoes, belts or other complementary products while the customer is still browsing the site. Fast big data helps e-commerce companies target their customers more effectively. Better targeting improves the customer shopping experience by allowing e-merchants to deliver personalized shopping experiences. Personalized shopping experiences create an atmosphere that is more likely to retain customer loyalty, and entice additional purchases.

As a second example, consider a customer browsing a travel website for vacation deals. If the results take even a few hundred milliseconds to load, the customer will likely leave the site to find other sources for travel deals. A travel website focusing on fast data, rather than just large quantities of big data, and delivering real-time page loads will enjoy a much better customer retention rate because customers will be more apt to stay and browse longer.

Fast big data will lead to more efficient, real-time report generation and analytics queries. Fast data allows organizations improve their response times to customers, which answers the ultimate question of improving the customer experience.

Reduce infrastructure, operating costs

Fast data can provide a telco operator OTT (Over The Top) revenues, through premium analytical services for business partners. For example, operators collect vast amounts of data at base stations. However, they currently pass it on to the central data warehouse. If operators turned this data into analytical insights faster, they could generate significant premium revenues. Analyzing data at each cell tower, or radio access controller, rather than sending it all to one data warehouse, will save operators time and generate additional incremental revenue.

In addition, many operators choose to analyze network data, such as performance and capacity. But focusing on customer data, correlated with network data, can enable imperative insights. Fast customer data also lets operators provide customer service in real-time. An operator that uses fast data to analyze customer behavior will have instantaneous information about network bandwidth spikes, downtime and dropped call information. If an operator receives and analyzes this data in real-time, it can also address these problems in real-time. Customers demand instant satisfaction; fast customer data can give operators the means to provide it.

What’s next?

Big data is beginning to become overhyped, if it is not already. The idea that having vast quantities of data is the only prerequisite for a strong data-driven infrastructure is inaccurate. Decision-makers must be able to see instantaneous reporting and query responses in order to address customer needs and infrastructure maintenance. It is clear that big data is not all that is necessary to maintain competitive advantages. Now, organizations must evolve, and to do so, they must turn their attention to fast data.

Mike Hummel is CEO of ParStream (, a provider of real-time big data business analytics technologies.

business analytics news and articles


Related Posts

  • 46
    International Data Corporation (IDC) recently released a worldwide Big Data technology and services forecast showing the market is expected to grow from $3.2 billion in 2010 to $16.9 billion in 2015. This represents a compound annual growth rate (CAGR) of 40 percent or about seven times that of the overall…
    Tags: data, big
  • 46
    Big data investments in the automotive industry are expected to surpass $3.3 billion in 2018, according to a report by SNS Telecom & IT. Amid the proliferation of real-time and historical data from sources such as connected devices, web, social media, sensors, log files and transactional applications, big data is…
    Tags: data, big, real-time
  • 44
    Many organizations have noticed that the data they own and how they use it can make them different than others to innovate, to compete better and to stay in business. That’s why organizations try to collect and process as much data as possible, transform it into meaningful information with data-driven…
    Tags: data, big
  • 44
    Features The direction of smart automation By Joseph Byrum Key technologies: What humanity optimized by artificial intelligence might look like: combining AI, big data, advanced analytics and autonomous systems. Turbocharging AI and ML projects By Shashank Dubey Three critical mindsets – business case, entrepreneur’s and adoption – close the gap…
    Tags: data, big, customer, real-time
  • 43
    September/October 2012 Opportunity to deliver real-time customer insights by harnessing the power of structured and unstructured data. By Rohit Tandon, Arnab Chakraborty and Ganga Ganapathi (left to right) The rise of the Internet has created terabytes of data or “Big Data” that is available to consumers and enterprises alike. This…
    Tags: data, customer, big


Fighting terrorists online: Identifying extremists before they post content

New research has found a way to identify extremists, such as those associated with the terrorist group ISIS, by monitoring their social media accounts, and can identify them even before they post threatening content. The research, “Finding Extremists in Online Social Networks,” which was recently published in the INFORMS journal Operations Research, was conducted by Tauhid Zaman of the MIT, Lt. Col. Christopher E. Marks of the U.S. Army and Jytte Klausen of Brandeis University. Read more →

Syrian conflict yields model for attrition dynamics in multilateral war

Based on their study of the Syrian Civil War that’s been raging since 2011, three researchers created a predictive model for multilateral war called the Lanchester multiduel. Unless there is a player so strong it can guarantee a win regardless of what others do, the likely outcome of multilateral war is a gradual stalemate that culminates in the mutual annihilation of all players, according to the model. Read more →

SAS, Samford University team up to generate sports analytics talent

Sports teams try to squeeze out every last bit of talent to gain a competitive advantage on the field. That’s also true in college athletic departments and professional team offices, where entire departments devoted to analyzing data hunt for sports analytics experts that can give them an edge in a game, in the stands and beyond. To create this talent, analytics company SAS will collaborate with the Samford University Center for Sports Analytics to support teaching, learning and research in all areas where analytics affects sports, including fan engagement, sponsorship, player tracking, sports medicine, sports media and operations. Read more →



INFORMS Annual Meeting
Nov. 4-7, 2018, Phoenix

Winter Simulation Conference
Dec. 9-12, 2018, Gothenburg, Sweden


Applied AI & Machine Learning | Comprehensive
Starts Oct. 29, 2018 (live online)

The Analytics Clinic
Citizen Data Scientists | Why Not DIY AI?
Nov. 8, 2018, 11 a.m. – 12:30 p.m.

Advancing the Analytics-Driven Organization
Jan. 28–31, 2019, 1 p.m.– 5 p.m. (live online)


CAP® Exam computer-based testing sites are available in 700 locations worldwide. Take the exam close to home and on your schedule:

For more information, go to