Share with your friends










Submit

Analytics Magazine

ANALYZE THIS! Carefully considering some uncomfortable scenarios

Analytics data science news articles

Throughout history, data sets have been constructed and utilized for many different purposes, not all of them positive.

Vijay MehrotraBy Vijay Mehrotra

I’ve spent the last few months working with the Human Rights Data Analysis Group. HRDAG has historically focused on unstable regions around the world, scientifically examining data captured by local institutions and grassroots activists to try to discern the truth about the volume and patterns of human rights violations [1]. My work there has been focused on data from Colombia. Over the past several years, HRDAG has done several projects on Colombia, examining deaths, disappearances, torture, sexual violence and violence against union members during the longstanding conflict between armed rebels, criminal organizations and the Colombian government.

My primary project has been to look at output from a previous HRDAG analysis of homicides in Colombia in order to develop insightful visualizations and explanations about the pattern of killings. My results are intended for a relatively non-technical audience, and that is where I have bumped into a major communications challenge: Because HRDAG’s predictions are based on fairly sophisticated Bayesian Models [2], the results that I am describing are probability distributions rather than point estimates.

As it happens, this is the same problem recently faced by Nate Silver. Like virtually everyone else in the punditry, Silver had predicted that Hillary Clinton was likely to win the election (the final models at fivethirtyeight.com gave her roughly a 70 percent chance of victory). However, as Silver described in a blog post [3]  just after the election, Clinton was leading in the vast majority of national and swing state polls going into Nov. 9 but by very slim margins. As such, Silver’s pre-election commentary on fivethirtyeight.com described a variety of possible outcomes, ranging from a Clinton landslide to a narrow Trump victory, citing both the variability inherent in his group’s models as well as potential biases in the polling data [4]. In particular, the scenario in which Clinton captured the popular vote while losing the Electoral College vote was mentioned repeatedly prior to Election Day. In the probabilistic sense, the Donald Trump victory that we observed was clearly “predicted.”

Back here at HRDAG, I keep busy prepping and merging tables in Python, using Hadley Wickham’s ggplot2 package to graph multiple time series in R, and working to understand and explain what is driving the variability in the model estimates. I am intellectually engaged and am learning a great deal. But I am always aware that each of these data sources is a dehumanized digital catalog containing information about thousands of people’s lives.

Throughout history, these types of data sets, euphemistically referred to as “administrative lists” in the statistics literature, have been constructed and utilized for many different purposes, not all of them positive.

As such, President-Elect Trump’s call for a registry of Muslims disturbs me greatly, and not only because this has already been shown to be an ineffective strategy for fighting terrorism [5]. In the digital world that we live in, so much personal data about so many people is captured and stored across so many databases large and small. The social network data in Facebook and LinkedIn is, literally, a roadmap of how we are organized and connected. Organizations that host public or private clouds have extraordinary troves of intelligence about individual citizens living on their servers. The idea of any U.S. president with an army of data scientists seizing control of all of this data and using it against his or her perceived enemies is truly frightening – and is also contrary to everything this country stands for.

As technology journalist Salvador Rodriguez has noted, “The establishment of such a registry would require engineering prowess and troves of data – both the sort of thing big Silicon Valley companies boast in quantity” [6]. Given this context, I cringe when I see photos of tech industry CEOs assembled in a conference room at Trump Tower. I cheer at the growing list of companies who publicly state that they will not participate in the creation of such a database (as of this writing, this list has grown to include Apple, Google, Facebook, Salesforce.com, and many more). And I shudder when it is reported that Oracle CEO Safra Catz has joined the Trump transition team.

At the individual level, many professionals in the technology industry have also responded by taking a personal stand. To date, several thousand have signed a public online pledge committing “to stand in solidarity with Muslim Americans, immigrants, and all people whose lives and livelihoods are threatened by the incoming administration’s proposed data collection policies. We refuse to build a database of people based on their constitutionally protected religious beliefs. We refuse to facilitate mass deportations of people the government believes to be undesirable. We have educated ourselves on the history of threats like these, and on the roles that technology and technologists played in carrying them out.” You can learn more about this pledge at http://neveragain.tech.

History suggests that in the days and years ahead, we may be called upon to use our analytics skills in ways that may be unconstitutional, immoral or both. These invitations will often come with opportunities for intellectual challenges, financial rewards and/or personal glory, and there will almost surely be other pressures to acquiesce. But we must all be aware that there are real people behind the abstract digital representations in our data sets, that both our data and our models are almost always imperfect, and that our work can reveal information and insights that can have serious human consequences . In a turbulent context, analytics are rarely ethically neutral.

I do not pretend to know what the future holds. But it seems appropriate to develop a probabilistic forecast with significant variability, and to carefully consider some uncomfortable scenarios. Don’t fool yourself: It could indeed happen here. And our individual choices will definitely matter. History does not write itself.

Vijay Mehrotra (vmehrotra@usfca.edu) is a professor in the Department of Business Analytics and Information Systems at the University of San Francisco’s School of Management and a longtime member of INFORMS.

Editor’s note:

The views expressed in this column are those of the author and do not necessarily reflect the views of INFORMS or Analytics magazine.

References & Notes

  1. http://analytics-magazine.org/analyze-this-human-rights-group-confronts-abuses-with-data-driven-evidence/
  2. For more on HRDAG’s estimation methodology, see https://hrdag.org/coreconcepts/.
  3. http://fivethirtyeight.com/features/why-fivethirtyeight-gave-trump-a-better-chance-than-almost-anyone-else/
  4. See for example http://fivethirtyeight.com/features/pollsters-probably-didnt-talk-to-enough-white-voters-without-college-degrees/.
  5. For more on the ineffectiveness of a similar Bush-era registry, see http://www.cnn.com/2016/11/18/politics/nseers-muslim-database-qa-trnd/.
  6. http://www.inc.com/salvador-rodriguez/tech-muslim-registry-pledge.html

Analytics data science news articles

Save

Related Posts

  • 59
    Many organizations have noticed that the data they own and how they use it can make them different than others to innovate, to compete better and to stay in business. That’s why organizations try to collect and process as much data as possible, transform it into meaningful information with data-driven…
    Tags: data, science
  • 57
    Once upon a time, in a kingdom far, far away, a blue-blooded girl was born with one of the most well-known family names in history. Her mother hated her father so much that her mother decided to nurture this little girl as everything opposite to what her father stood for:…
    Tags: science, people, data
  • 54
    A brand new INFORMS competition provides real-world workplace experience for undergraduate and master’s level students. Student teams will be given the same business problem, data sets and access to software to solve a challenging problem using an O.R./analytics approach. A panel of industry and academic experts will judge written submissions…
    Tags: data, sets
  • 54
    By Eric Siegel Note: This article is excerpted from Eric Siegel’s foreword to the recently released book, “Mining Your Own Business: A Primer for Executives on Understanding and Employing Data Mining and Predictive Analytics,” by Jeff Deal and Gerhard Pilcher. For predictive analytics to work, two different species must cooperate…
    Tags: data, science
  • 51
    New research by Continuum Analytics finds that 96 percent of data science and analytics decision-makers agree that data science is critical to the success of their business, yet a whopping 22 percent are failing to make full use of the data available.
    Tags: data, science

Analytics Blog

Electoral College put to the math test


With the campaign two months behind us and the inauguration of Donald Trump two days away, isn’t it time to put the 2016 U.S. presidential election to bed and focus on issues that have yet to be decided? Of course not.

Headlines

Holiday Retirement earns Edelman Award

Holiday Retirement won the 2017 Franz Edelman Award for Achievement in Operations Research and the Management Sciences from INFORMS for its use of operations research (O.R.) to improve the pricing model for its more than 300 senior living communities across the United States. Read more →

U.S. Air Force and Disney receive the 2017 INFORMS Prize

The U.S. Air Force and The Walt Disney Company both received the 2017 INFORMS Prize for their pioneering and enduring integration of operations research (O.R.) and analytics programs into their organizations. The prizes were presented at the INFORMS Conference on Business Analytics & Operations Research in April in Las Vegas. Read more →

Air Force Academy’s O.R. program saluted

The U.S. Air Force Academy won the 2017 UPS George D. Smith Prize for its operations research (O.R.) program, which prepares graduates to become frontline O.R. practitioners as analysts in the Air Force. The program exposes more than 50 percent of cadets to at least one O.R. course and provides cadets the opportunity to graduate with a Bachelor of Science degree in O.R. Read more →

UPCOMING ANALYTICS EVENTS

INFORMS-SPONSORED EVENTS

CONFERENCES

2017 INFORMS Healthcare Conference
July 26-28, 2017, Rotterdam, the Netherlands

CAP® EXAM SCHEDULE

CAP® Exam computer-based testing sites are available in 700 locations worldwide. Take the exam close to home and on your schedule:


 
For more information, go to 
https://www.certifiedanalytics.org.