Share with your friends










Submit

Analytics Magazine

Executive Edge: Why data science projects fail

Delivering brilliant ideas is the easy part; execution is often where things go awry.

David MamanBy David Maman

Thousands of companies all over the world are competing for a finite number of data scientists, paying them big bucks to join their organizations – and setting them up for failure.

For most organizations, data science is not the be all and end all. It cannot be the answer if company leadership has not formulated the strategy or questions that data science needs to answer or paved the route to production.

Even organizations that have already invested millions in integrating their complete corporate data infrastructure to create the ultimate data repository – data lakes, data pools, common data sources or whatever pleasant definition your organization has chosen – for integration and analysis will not be able to see results at the rate and accuracy they are demanding once the system is in production.

As with the long-term adoption and implementation of any business process or procedure, fully benefiting from data science takes time. You cannot just jump in head first.

At most companies, data science fails for very specific reasons:

1. Undefined business goals/processes. Just because your data science team can map and predict customer satisfaction rates for the next six months doesn’t mean that information is significant. If the results demonstrate broad-scale customer dissatisfaction, simply predicting the results is woefully inadequate without resolving the roots of that dissatisfaction. You can predict an untold number of data points, but without clearly defined goals accompanied with the will to fix your problems, those data points are meaningless. Many organizations keep following the misconception that data scientists (no matter how smart they are) can correctly define the business goals. Most of the time they can’t, because it’s not their job.

2. Inability to build and apply a uniform data set across the organization. While the politics in your organization may have inspired silos and fiefdoms, each department in your organization is ultimately driving toward the same goal – increasing ROI. To maximize the value of data science, you need to create a uniform data set that will deliver actionable results that every part of the organization can implement.

Just because your data science team can map and predict customer satisfaction rates for the next six months doesn’t mean that information is significant. Photo Courtesy of ThinkStock.com

Just because your data science team can map and predict customer satisfaction rates for the next six months doesn’t mean that information is significant. Photo Courtesy of ThinkStock.com

3. Investment in “sexy” algorithms instead of useful ones. You have just hired the data scientist who graduated in the top of her class. Having just joined your company, she’s extremely excited to get started. Because of her in-depth mathematical and academic background, she has some great algorithms that can get some really cool results. However, are those algorithms going to deliver the results that can focus your organization and drive it forward? Just because something is old, tired, tried and true doesn’t mean it won’t work.

Your team needs to examine the full range of algorithms you are using for your modeling and preprocessing with an objective eye. Is the information those algorithms are delivering actually useful? Do they deliver the actionable intelligence that will increase ROI? Often not.

In most cases, the challenge you are facing isn’t new. A simple Google search will lead you to some great research and case studies to see how others tackled the challenge and how they tailored the solution. Be open. Start thinking from a problem perspective and not just from a solution perspective.

4. Inappropriate data or infrastructure. Most organizations are built in silos. Large organizations have both an ERP system and a CRM system and many others, but those systems may not be in sync. They may not even be touching the inbound marketing and sales software. Until everyone in the organization can work with the same data and analyze the same data, siloed data science results aren’t as applicable or effective. Sometimes it takes much longer to determine whether specific data or the volume of data is sufficient for the specific task.

5. Failure to differentiate between academia or research and the real world. Data scientists generally go from the ivory tower directly into the data silos. They generally deliver great results in most properly defined challenges. Remember, though, at the end of the data scientist’s job, the hard work may only be beginning. The engineers need to implement it into production – many times from scratch. Don’t expect your data science team to learn how businesses actually work. It’s up to the engineers and systems analysts to determine your specific system requirements to get their work into production.

The most critical result of any data science activity is relevancy. Every “answer” generated by your data science team needs to answer specific questions derived from the overall corporate strategy. While investment in the “bells and whistles” of AI is fun and exciting, organizations need to make sure that they have a defined strategy, the right idea and a properly mapped roadmap before the first dollar of data science investment is spent.

David Maman is CEO, CTO and co-founder of Binah.ai, whose out-of-the-box data science solutions leverage signal processing combined with machine learning and AI to create models and accelerate delivery of the right answers to critical business questions.

Analytics data science news articles

Related Posts

  • 91
    With the rise of big data – and the processes and tools related to utilizing and managing large data sets – organizations are recognizing the value of data as a critical business asset to identify trends, patterns and preferences to drive improved customer experiences and competitive advantage. The problem is,…
    Tags: data
  • 90
    The Internet of Things (IoT) is considered to be the next revolution that touches every part of our daily life, from restocking ice cream to warning of pollutants. Analytics professionals understand the importance of data, especially in a complicated field such as healthcare. This article offers a framework on integrating…
    Tags: data
  • 87
    Data science has seen a dramatic rise in the last decade. The LinkedIn 2017 US Emerging Jobs Report revealed the two fastest growing jobs as “machine learning engineer” and “data scientist.” Universities are struggling to keep up with this trend, assembling new programs to address the growing need for data…
    Tags: data, science
  • 87
    Data science has seen a dramatic rise in the last decade. The LinkedIn 2017 U.S. Emerging Jobs Report revealed the two fastest growing jobs as “machine learning engineer” and “data scientist.” Universities are struggling to keep up with this trend, assembling new programs to address the growing need for data…
    Tags: data, science
  • 87
    Businesses are greatly expanding the autonomous capabilities of their products, services and manufacturing processes to better optimize their reliability and efficiency. The processing of big data is playing an integral role in developing these prescriptive analytics. As a result, data scientists and engineers should pay attention to the following aspects…
    Tags: data


Headlines

Meet CIMON, the first AI-powered astronaut assistant

CIMON, the world’s first artificial intelligence-enabled astronaut assistant, made its debut aboard the International Space Station. The ISS’s newest crew member, developed and built in Germany, was called into action on Nov. 15 with the command, “Wake up, CIMON!,” by German ESA astronaut Alexander Gerst, who has been living and working on the ISS since June 8. Read more →

Yale research on immigration, aging runners makes news

A recent study by Yale University professor and former INFORMS President Edward H. Kaplan (photo) and Yale colleague Jonathan Feinstein and Mohammad M. Fazel-Zarandi of MIT suggests that the number of undocumented immigrants in the United States is nearly twice as many as experts previously thought. Since its publication last month, the study, which estimates the number of such immigrants at 22.1 million instead of 11.3 million, has garnered worldwide attention from major media outlets including the Los Angeles Times, the Boston Globe, Fox News, Bloomberg News and the Daily Mail. Read more →

New salary survey paints optimistic picture for analytics professionals

Harnham, a global leader in data and analytics recruitment, recently released the 2018 editions of its salary guides for the United Kingdom, the United States and Europe. Having heard from thousands of data and analytics professionals across the globe, Harnham has gained an invaluable insight into key industry salaries and trends across a wide variety of analytics specialties and sectors. Read more →

UPCOMING ANALYTICS EVENTS

INFORMS-SPONSORED EVENTS

Winter Simulation Conference
Dec. 9-12, 2018, Gothenburg, Sweden

INFORMS Computing Society Conference
Jan. 6-8, 2019; Knoxville, Tenn.

INFORMS Conference on Business Analytics & Operations Research
April 14-16, 2019; Austin, Texas

INFORMS International Conference
June 9-12, 2019; Cancun, Mexico

INFORMS Marketing Science Conference
June 20-22; Rome, Italy

INFORMS Applied Probability Conference
July 2-4, 2019; Brisbane, Australia

INFORMS Healthcare Conference
July 27-29, 2019; Boston, Mass.

2019 INFORMS Annual Meeting
Oct. 20-23, 2019; Seattle, Wash.

Winter Simulation Conference
Dec. 8-11, 2019: National Harbor, Md.

OTHER EVENTS

Applied AI & Machine Learning | Comprehensive
Dec. 3, 2018 (live online)


Advancing the Analytics-Driven Organization
Jan. 28–31, 2019, 1 p.m.– 5 p.m. (live online)

CAP® EXAM SCHEDULE

CAP® Exam computer-based testing sites are available in 700 locations worldwide. Take the exam close to home and on your schedule:


 
For more information, go to 
https://www.certifiedanalytics.org.