Share with your friends


Analytics Magazine

Executive Edge: Prediction in the public sector

Why the government needs predictive analytics

Eric SiegelBy Eric Siegel

Data can appear lifeless and dull on the surface – especially government data – but the thought of it should actually get you excited. Data is a very interesting and powerful thing. First off, data is exactly the stuff we bother to write down – and for good reason. But its potential far transcends functions such as tracking and bookkeeping: Data encodes great quantities of experience, and computers can learn from that experience to make everything work better.

For example, take agriculture – and the federal studies that advance it. A farmer jots down crop rotations as needed to manage operations. And later this data also serves to track crop productivity. But for the real payoff, the farm boosts productivity rather than only tracking it. By number-crunching its records, it discovers ways to optimize operations: which crop schedule, seeds, treatments, irrigation options, fertilizers and other process decisions best increase crop yield. By learning from the data, the farmer notes that notes are more notable than previously noted.

The need for optimization is palpable. By the end of the century, agriculture will have to deal with a population of 11 digits – a vast number of mouths to feed – in combination with a diminishing supply of available land. This era of exploding magnitudes decidedly demands data science. Yet the growth in scale is actually good news for predictive analytics. It presents a greater opportunity than ever, for two reasons. First, it means more “fuel for intelligence,” i.e., more data from which to learn. And second, larger-scale operations themselves stand to benefit that much more when optimized – the returns are commensurate.

This principle applies far beyond agriculture, manufacturing and even the industrial sector as a whole. Data science drives growth and efficiency across verticals, including financial services, insurance, retail, e-commerce, energy and healthcare, while bolstering business functions such as sales, marketing, advertising, customer service, human resources, risk management and supply chain management.

In government, data science’s vital impact extends just as far and wide, empowering agencies to more effectively serve and safeguard citizen fundamentals such as health, safety, housing, economic stability, education, equality and justice. Here are some more specific areas where predictive analytics bolsters the effectiveness of government:

Health and safety: Government agencies target what buildings, restaurants and manholes to inspect by predictively modeling which have the greatest risk of fire, health code violations, lead paint poisoning or other safety incidents. The EPA plans to use predictive analytics to regulate air emissions, monitor water quality and avert environmental catastrophes. And the CDC applies predictive modeling to improve population health.

Law enforcement: As is well known, police analytically predict crime, and judges and parole boards pay heed to recidivism risk scores. But a range of other agencies also employ data science to enforce laws and regulations. New York City analytically flags for possible illegal apartments, misused business licenses and other ducked regulations. And the pertinent departments predictively target fraud auditing of tax returns, government invoices, government contracts, workers’ comp, and Medicaid and Medicare claims. Florida’s Department of Juvenile Justice determines rehabilitation assignments based on the predictions of future repeat offenses. And other analytical efforts target internal investigations of potential police misconduct and other forms of injustice.

Defense and homeland security: Military agencies analytically predict threats and civil unrest, while the NSA and FBI predict terrorism. Detecting possible hacker or virus footprints toughens cyber security. The U.S. Department of Defense applies data science to target critical internal operations such as special forces recruitment (predictive hiring decisions), proactive veteran suicide intervention, and the maintenance of those Army vehicles at a higher risk of impending failure.

Predictive analytics is the Information Age’s latest evolutionary step. We have moved beyond engineering infrastructure that stores and manages big data to implementing science that makes actionable use of the data, tapping its contents to optimize most every large-scale activity. The breadth of examples listed above signals that predictive analytics’ role is well established, a status that is further upheld by the many other application areas we see covered at the Predictive Analytics World for Government conference (an offshoot of the PAW event series).

But the fortification of government with data science has only just begun. The pressure mounts as citizen needs intensify, international competition escalates, and infrastructure and security risks grow. Critical measures for alleviating these pressures include reducing waste and abuse, increasing the effectiveness of both targeting and triaging, and optimizing operations for efficiency. Data-driven optimization is a key method for achieving these improvements.

To more fully broaden the role of data science in government – and thereby seize the tremendous opportunity of today’s data eruption – agencies must collaborate. Given the complexity of both managing and analyzing big data, the “use your data!” rallying cry must not only mobilize analytics internally, but also call for sharing technological resources and best practices, for coordinating efforts and for investing in data interoperability. If a small farm has limited data, it relies on cooperation that pulls together data across many farms.

To aptly serve the needs of citizens, government agencies must advance and expand the deployment of data science. If you’ll allow a mixing of metaphors, you can bet the farm on tools that harvest insights from data and cultivate prosperity. And as you take your next steps in contributing to this historic development, the book for which this is the foreword, “Federal Data Science: Transforming Government and Agricultural Policy Using Artificial Intelligence,” guides the way; it has been ideally crafted for that very purpose by a select, international group of experts who come from a diverse range of government and industry backgrounds.

Eric Siegel, Ph.D., is the founder of the Predictive Analytics World conference series –which includes PAW Government – and executive editor of The Predictive Analytics Times. He is the author of the award-winning book, “Predictive Analytics: The Power to Predict Who Will Click, Buy, Lie, or Die,” a former Columbia University professor and a renowned speaker, educator and leader in the field.

This article is excerpted from Siegel’s foreword to the recently released book, “Federal Data Science: Transforming Government and Agricultural Policy Using Artificial Intelligence,” edited by Feras A. Batarseh and Ruixin Yang. Republished with permission.

Analytics data science news articles

Related Posts

  • 89
    Eric Siegel, founder of Predictive Analytics World (PAW, a series of conferences held throughout the year in major U.S. and European cites) and the author of the new book, “Predictive Analytics: The Power to Predict who will Click, Buy, Lie or Die,” is without question a key player in the…
    Tags: analytics, predictive, data
  • 84
    The CUNY School of Professional Studies is offering a new online master of science degree in data analytics. The program prepares its graduates for high-demand and fast-growing careers as data analysts, data specialists, business intelligence analysts, information analysts and data engineers in such fields as business, operations, marketing, social media,…
    Tags: data, analytics
  • 82
    September/October 2018 Analytics revolutionizing healthcare Values that should guide AI revolution The future role of AI in fact checking Data science at Monsanto Strengthening global supply chains July/August 2018 Why optimization models fail AI: Path to an intelligent enterprise How to truly listen to customers Close the deal: marketing &…
    Tags: analytics, data
  • 77
    Benjamin Franklin offered this sage advice in the 18th century, but he left one key question unanswered: How? How do you successfully drive a business? More specifically, how do you develop the business strategy drivers that incite a business to grow and thrive? The 21st-century solution has proven to be…
    Tags: data, analytics
  • 73
    With the rise of big data – and the processes and tools related to utilizing and managing large data sets – organizations are recognizing the value of data as a critical business asset to identify trends, patterns and preferences to drive improved customer experiences and competitive advantage. The problem is,…
    Tags: data


Using machine learning and optimization to improve refugee integration

Andrew C. Trapp, a professor at the Foisie Business School at Worcester Polytechnic Institute (WPI), received a $320,000 National Science Foundation (NSF) grant to develop a computational tool to help humanitarian aid organizations significantly improve refugees’ chances of successfully resettling and integrating into a new country. Built upon ongoing work with an international team of computer scientists and economists, the tool integrates machine learning and optimization algorithms, along with complex computation of data, to match refugees to communities where they will find appropriate resources, including employment opportunities. Read more →

Gartner releases Healthcare Supply Chain Top 25 rankings

Gartner, Inc. has released its 10th annual Healthcare Supply Chain Top 25 ranking. The rankings recognize organizations across the healthcare value chain that demonstrate leadership in improving human life at sustainable costs. “Healthcare supply chains today face a multitude of challenges: increasing cost pressures and patient expectations, as well as the need to keep up with rapid technology advancement, to name just a few,” says Stephen Meyer, senior director at Gartner. Read more →

Meet CIMON, the first AI-powered astronaut assistant

CIMON, the world’s first artificial intelligence-enabled astronaut assistant, made its debut aboard the International Space Station. The ISS’s newest crew member, developed and built in Germany, was called into action on Nov. 15 with the command, “Wake up, CIMON!,” by German ESA astronaut Alexander Gerst, who has been living and working on the ISS since June 8. Read more →



INFORMS Computing Society Conference
Jan. 6-8, 2019; Knoxville, Tenn.

INFORMS Conference on Business Analytics & Operations Research
April 14-16, 2019; Austin, Texas

INFORMS International Conference
June 9-12, 2019; Cancun, Mexico

INFORMS Marketing Science Conference
June 20-22; Rome, Italy

INFORMS Applied Probability Conference
July 2-4, 2019; Brisbane, Australia

INFORMS Healthcare Conference
July 27-29, 2019; Boston, Mass.

2019 INFORMS Annual Meeting
Oct. 20-23, 2019; Seattle, Wash.

Winter Simulation Conference
Dec. 8-11, 2019: National Harbor, Md.


Advancing the Analytics-Driven Organization
Jan. 28–31, 2019, 1 p.m.– 5 p.m. (live online)


CAP® Exam computer-based testing sites are available in 700 locations worldwide. Take the exam close to home and on your schedule:

For more information, go to