Share with your friends


Analytics Magazine

Making analytics work through practical project management

Projects are the primary vehicles through which we deliver value, and consistently delivering value with analytics requires effective project management.

Erick Wikum delivering value with analytics requires effective project managementBy Erick Wikum

Where does your organization fit into the project management spectrum shown in Figure 1? On one end of the spectrum, labeled “Do Stuff,” organizations focus on action and take a rather laissez-faire approach to project management, with little documentation and only loosely defined deliverables, timelines and budgets. On the other end of the spectrum, labeled “Buttoned Up,” organizations take a disciplined approach to planning, monitoring and executing projects, with liberal documentation and carefully defined deliverables, schedules and budgets. This approach is common among external consulting groups by necessity, since clients insist on having answers to the three key questions of project management: what is to be delivered, when and at what cost? The former approach is more common among internal consulting groups, especially those with corporate funding, which provide internal clients with what appear to be “free” resources.

When it comes to delivering analytics, what matters is not only what you do, but also how you do it. Photo Courtesy of | alphaspirit

When it comes to delivering analytics, what matters is not only what you do, but also how you do it.
Photo Courtesy of | alphaspirit

Why should analytics professionals care about project management? After all, we are trained problem-solvers and when we “do stuff,” good things happen, right? On the contrary, projects are the primary vehicles through which we deliver value, and consistently delivering value with analytics requires effective project management. When it comes to delivering analytics, what matters is not only what you do, but also how you do it.

A project can be defined as “a piece of planned work or activity that is completed over a period of time and intended to achieve a particular aim” [1]. Analytics projects begin with a purpose or aim – for example to describe, to predict or to prescribe. Achieving that purpose requires activity or work, work that takes time and consumes scarce resources. The word “intended” is significant; projects fail to achieve desired aims more frequently than we would like to admit. Project management provides an important mitigation strategy to improve the odds for success. What is your level of familiarity with the following basic project management concepts?

  1. Project phases
  2. Work breakdown structure (WBS)
  3. Issue management
  4. Risk management
  5. Communication plan
Figure 1: Approach to project management spectrum.

Figure 1: Approach to project management spectrum.

Valuable Resources

In case your project management IQ could use a boost, take advantage of the valuable resources – reference materials, training, peer groups and conferences – available through the Project Management Institute (PMI), the world’s premiere project management organization [2]. In addition, befriend experienced project managers (PMs) who can provide valuable advice. One PM taught me to use discrete percentages when reporting progress against project activities: 0 percent if not started, 20 percent when started, 80 percent when complete except for “loose” ends, and 100 percent when completely finished. Another suggested that when planning a project, focus less on task duration and more on when tasks can be completed, treating completion dates as contractual and allowing individual team members to manage their own schedules and responsibilities.

Analytics projects are just that, projects, so general project management principles apply. And yet, analytics projects include unique aspects that require tailored approaches. For one, analytics projects involve specialized subject matter. Choosing an appropriate technique, defining corresponding tasks, estimating level of effort for those tasks and executing the project require analytics expertise. For another, analytics projects include particular types of uncertainty. Data availability and quality is frequently an issue.

Knowing what will happen when specific data meets math is unpredictable. Textbook techniques seldom apply directly to real-world problems, giving rise to the need for invention within analytics projects. Finally, change management can be especially challenging given the general level of discomfort among people with mathematics and math-based solutions.

A project management methodology provides a generic set of process steps that can be customized for a specific project. Leveraging a methodology eliminates the need to reinvent the wheel for each new project. Two methodologies are especially relevant for analytics projects – CRISP-DM and Scrum. While CRISP-DM or Cross Industry Standard Process-Data Mining was developed by an industry consortium to support data mining projects, the methodology readily translates to any analytics project. Scrum, a form of agile, was originally developed to support software development projects, but it also applies well to analytics projects.

Figure 2: CRISP-DM phases.

Figure 2: CRISP-DM phases.

As shown in Figure 2, CRISP-DM includes six phases – Business Understanding, Data Understanding, Data Preparation, Modeling, Evaluation and Deployment [3]. While these phases may be executed one after another in a linear manner, the intent of the methodology is to support iteration. For example, after evaluating a model, a modeler might conclude that additional data is needed, giving rise to the need for additional business understanding, data understanding and data preparation. Deployment can involve implementing a model and/or publishing findings and recommendations depending on the nature of the project. The outer ring of the figure represents the cyclical nature of the lifecycle of analytics models [3].

Data Mining Project

The author applied CRISP-DM in a data mining project to develop anomaly detection models for mining machine sensor data (i.e., data mining on mining data). With a staff of about 15 people, analytics was a relatively small part of the overall project, which included more than 100 people. While the analytics “swim lane” was planned using CRISP-DM, the overall project was planned using a software development methodology. The analytics swim lane was synchronized with other pertinent swim lanes (primarily data and system) according to what was required and when with respect to required inputs and model outputs.

CRISP-DM worked well as an approach within the analytics team. With its iterative nature, though, the methodology posed challenges to track and report progress within the overall project. For example, the project manager found it confusing to learn that the analytics team had looped back to data understanding. In retrospect, conducting an initial round of business understanding and data understanding would have made sense, followed by time-boxed modeling iterations which encompass business understanding, data understanding, data prep, modeling and evaluation as needed.

Scrum is a form of agile that addresses complexity and risk by creating a product (e.g., an analytics model) incrementally through a series of short iterations known as sprints and teasing out requirements based on feedback from concrete deliverables [4]. Requirements are captured as stories of the form “a user with a certain role wants to use the system to …” in a list known as the project backlog.

Figure 3: Scrum sprint cadence.

Figure 3: Scrum sprint cadence.

At the beginning of each sprint, the backlog is prepped and a sprint planning meeting conducted to select which stories will be pursued during the sprint based on priority, required level of effort and available development resources. During the sprint, the development team conducts a daily Scrum to review work completed the previous day and to be completed during the current day. At the tail end of each sprint, a tested, “shippable” version of the product is demonstrated during a sprint review meeting. The project backlog is updated based on feedback captured during the review meeting to initiate the next sprint (see Figure 3).

Analytics Project

The author applied Scrum to an analytics project to develop integrated simulation and optimization models for planning oil pipeline terminal infrastructure. A team of four executed four three-week sprints. Despite lack of experience with Scrum, the team caught on quickly. The value of Scrum emerged during the first two sprint review meetings. The team expected and received feedback on its partially complete models. Unexpectedly, the team witnessed sidebar conversations among client employees, an airing of disagreements that arose in response to the demonstration of tangible models.

Resolving these disagreements contributed both to better models and to customer buy-in. The team found that three weeks was long enough to deliver significant new capabilities but short enough to provide little room for delays. By reviewing required weekly progress at the beginning of each week, the team was able to stay on track during each sprint. Having ready access to subject matter experts was critical to avoid delays.

The team adapted Scrum to its needs, for example, by using only one simple metric (stories completed) to track progress. Being flexible with project management is critical to success. Adjust the approach based on the size and complexity of a project and the trade-off between the cost and benefit of various practices.

Monitoring and Controlling

In the realm of project management, project plans receive an outsize amount of attention. Planning a project is certainly important, but monitoring and controlling during execution is equally important for success. At sufficiently frequent (e.g., weekly) review intervals, the team reports progress as well as issues. Successful organizations create an environment in which issues can be raised without risk of judgment or sanction. The sooner an issue is surfaced, the sooner that issue can be addressed, often by tapping into higher-level powers through escalation. Adherence to schedule, scope and budget are tracked carefully during project execution, and non-minor adjustments are made through a formal project change process.

Accurately estimating the number of resources and length of time to accomplish tasks is critical to project success. Underestimating required level of effort may result in project delays or costly overruns. Overestimating may result in a plan being rejected by the client since the project takes too long or costs too much.

When it comes to estimation, experience matters, so shadowing a seasoned analytics professional is helpful. So, too, is iteratively breaking down tasks into more easily estimated tasks. For example, to estimate how long “business understanding” will take, ask how this phase will be accomplished. Suppose that one of the business understanding approaches is to conduct a workshop. Now, conducting a workshop involves preparation and follow-up in addition to the workshop itself. Preparation might require two days, the workshop one day and follow-up two days for a total of five. Accurately estimating the time to conduct a workshop is relatively easy, while estimating the time to conduct the high-level, intangible activity of Business Understanding is not. In some cases, conducting a small pilot to understand the level of effort required for a task makes sense. For example, if custom analytic models are to be created for each of 100 manufacturing plants globally, then the model might first be created for one or two (perhaps the most complex) in order to understand overall effort needed.

The INFORMS Analytics Maturity Model assesses an organization’s analytics maturity in terms of three groups of four factors in the areas of organization, analytics capability and data & infrastructure [5]. While project management is not specifically referenced in that model, a disciplined approach to project management is most certainly necessary for organizations to achieve analytics maturity, enabling the consistent delivery of quality work products. Adopting a more buttoned-up approach to project management rather than simply doing stuff can help your organization mature and achieve maximum return on its analytics investment.

Erick Wikum ( is treasurer of the Analytics Society of INFORMS. For nearly 25 years, he has planned, conducted, monitored and led analytics projects to improve decision-making as both an internal and external consultant.



Related Posts

  • 80
    FEATURES Putin vs. Western analysts Russia’s new approach to extending its influence necessitates new approaches to assessment. By Douglas Samuelson Making analytics work through practical project management Making analytics work: Why consistently delivering value requires effective project management. By Erick Wikum Crowdsourcing – Using the crowd: curated vs. unknown Using…
    Tags: analytics, data, management, project, business
  • 65
    By Vijay Mehrotra A couple of years ago, I read an article by Erick Wikum entitled “Making analytics work through practical project management” [1] that stuck with me for many months. I recently spent some time discussing the relationship between project management and analytics with Erick, the new president of…
    Tags: project, analytics, data, projects, management
  • 62
    In the current information-driven society and increasingly digitalized world, Gartner, Inc. says that sentiments are shifting from the economics of tangible assets to the economics of information – “infonomics” – and other intangible assets. Infonomics is the theory, study and discipline of asserting economic significance to information. It strives to apply…
    Tags: business, management, data, analytics
  • 61
    Analytics has gone mainstream in large enterprises. Walking around the office halls, you hear talk of tensor flow, DNN, artificial intelligence (AI) and machine learning (ML), but there is still a large gap between expected and realized ROI from analytics projects. While you might think technology is the hardest part…
    Tags: analytics, business, data, project, projects
  • 58
    Microsoft has awarded Accenture a seven-year contract extension to continue providing finance and accounting (F&A) and procurement business process services. Accenture will leverage artificial intelligence, automation and analytics capabilities to deliver better business insights and help Microsoft increase productivity and efficiency.
    Tags: business, analytics, intelligence, management


Using machine learning and optimization to improve refugee integration

Andrew C. Trapp, a professor at the Foisie Business School at Worcester Polytechnic Institute (WPI), received a $320,000 National Science Foundation (NSF) grant to develop a computational tool to help humanitarian aid organizations significantly improve refugees’ chances of successfully resettling and integrating into a new country. Built upon ongoing work with an international team of computer scientists and economists, the tool integrates machine learning and optimization algorithms, along with complex computation of data, to match refugees to communities where they will find appropriate resources, including employment opportunities. Read more →

Gartner releases Healthcare Supply Chain Top 25 rankings

Gartner, Inc. has released its 10th annual Healthcare Supply Chain Top 25 ranking. The rankings recognize organizations across the healthcare value chain that demonstrate leadership in improving human life at sustainable costs. “Healthcare supply chains today face a multitude of challenges: increasing cost pressures and patient expectations, as well as the need to keep up with rapid technology advancement, to name just a few,” says Stephen Meyer, senior director at Gartner. Read more →

Meet CIMON, the first AI-powered astronaut assistant

CIMON, the world’s first artificial intelligence-enabled astronaut assistant, made its debut aboard the International Space Station. The ISS’s newest crew member, developed and built in Germany, was called into action on Nov. 15 with the command, “Wake up, CIMON!,” by German ESA astronaut Alexander Gerst, who has been living and working on the ISS since June 8. Read more →



INFORMS Computing Society Conference
Jan. 6-8, 2019; Knoxville, Tenn.

INFORMS Conference on Business Analytics & Operations Research
April 14-16, 2019; Austin, Texas

INFORMS International Conference
June 9-12, 2019; Cancun, Mexico

INFORMS Marketing Science Conference
June 20-22; Rome, Italy

INFORMS Applied Probability Conference
July 2-4, 2019; Brisbane, Australia

INFORMS Healthcare Conference
July 27-29, 2019; Boston, Mass.

2019 INFORMS Annual Meeting
Oct. 20-23, 2019; Seattle, Wash.

Winter Simulation Conference
Dec. 8-11, 2019: National Harbor, Md.


Advancing the Analytics-Driven Organization
Jan. 28–31, 2019, 1 p.m.– 5 p.m. (live online)


CAP® Exam computer-based testing sites are available in 700 locations worldwide. Take the exam close to home and on your schedule:

For more information, go to