Share with your friends










Submit

Analytics Magazine

ANALYZE THIS! Carefully considering some uncomfortable scenarios

Analytics data science news articles

Throughout history, data sets have been constructed and utilized for many different purposes, not all of them positive.

Vijay MehrotraBy Vijay Mehrotra

I’ve spent the last few months working with the Human Rights Data Analysis Group. HRDAG has historically focused on unstable regions around the world, scientifically examining data captured by local institutions and grassroots activists to try to discern the truth about the volume and patterns of human rights violations [1]. My work there has been focused on data from Colombia. Over the past several years, HRDAG has done several projects on Colombia, examining deaths, disappearances, torture, sexual violence and violence against union members during the longstanding conflict between armed rebels, criminal organizations and the Colombian government.

My primary project has been to look at output from a previous HRDAG analysis of homicides in Colombia in order to develop insightful visualizations and explanations about the pattern of killings. My results are intended for a relatively non-technical audience, and that is where I have bumped into a major communications challenge: Because HRDAG’s predictions are based on fairly sophisticated Bayesian Models [2], the results that I am describing are probability distributions rather than point estimates.

As it happens, this is the same problem recently faced by Nate Silver. Like virtually everyone else in the punditry, Silver had predicted that Hillary Clinton was likely to win the election (the final models at fivethirtyeight.com gave her roughly a 70 percent chance of victory). However, as Silver described in a blog post [3]  just after the election, Clinton was leading in the vast majority of national and swing state polls going into Nov. 9 but by very slim margins. As such, Silver’s pre-election commentary on fivethirtyeight.com described a variety of possible outcomes, ranging from a Clinton landslide to a narrow Trump victory, citing both the variability inherent in his group’s models as well as potential biases in the polling data [4]. In particular, the scenario in which Clinton captured the popular vote while losing the Electoral College vote was mentioned repeatedly prior to Election Day. In the probabilistic sense, the Donald Trump victory that we observed was clearly “predicted.”

Back here at HRDAG, I keep busy prepping and merging tables in Python, using Hadley Wickham’s ggplot2 package to graph multiple time series in R, and working to understand and explain what is driving the variability in the model estimates. I am intellectually engaged and am learning a great deal. But I am always aware that each of these data sources is a dehumanized digital catalog containing information about thousands of people’s lives.

Throughout history, these types of data sets, euphemistically referred to as “administrative lists” in the statistics literature, have been constructed and utilized for many different purposes, not all of them positive.

As such, President-Elect Trump’s call for a registry of Muslims disturbs me greatly, and not only because this has already been shown to be an ineffective strategy for fighting terrorism [5]. In the digital world that we live in, so much personal data about so many people is captured and stored across so many databases large and small. The social network data in Facebook and LinkedIn is, literally, a roadmap of how we are organized and connected. Organizations that host public or private clouds have extraordinary troves of intelligence about individual citizens living on their servers. The idea of any U.S. president with an army of data scientists seizing control of all of this data and using it against his or her perceived enemies is truly frightening – and is also contrary to everything this country stands for.

As technology journalist Salvador Rodriguez has noted, “The establishment of such a registry would require engineering prowess and troves of data – both the sort of thing big Silicon Valley companies boast in quantity” [6]. Given this context, I cringe when I see photos of tech industry CEOs assembled in a conference room at Trump Tower. I cheer at the growing list of companies who publicly state that they will not participate in the creation of such a database (as of this writing, this list has grown to include Apple, Google, Facebook, Salesforce.com, and many more). And I shudder when it is reported that Oracle CEO Safra Catz has joined the Trump transition team.

At the individual level, many professionals in the technology industry have also responded by taking a personal stand. To date, several thousand have signed a public online pledge committing “to stand in solidarity with Muslim Americans, immigrants, and all people whose lives and livelihoods are threatened by the incoming administration’s proposed data collection policies. We refuse to build a database of people based on their constitutionally protected religious beliefs. We refuse to facilitate mass deportations of people the government believes to be undesirable. We have educated ourselves on the history of threats like these, and on the roles that technology and technologists played in carrying them out.” You can learn more about this pledge at http://neveragain.tech.

History suggests that in the days and years ahead, we may be called upon to use our analytics skills in ways that may be unconstitutional, immoral or both. These invitations will often come with opportunities for intellectual challenges, financial rewards and/or personal glory, and there will almost surely be other pressures to acquiesce. But we must all be aware that there are real people behind the abstract digital representations in our data sets, that both our data and our models are almost always imperfect, and that our work can reveal information and insights that can have serious human consequences . In a turbulent context, analytics are rarely ethically neutral.

I do not pretend to know what the future holds. But it seems appropriate to develop a probabilistic forecast with significant variability, and to carefully consider some uncomfortable scenarios. Don’t fool yourself: It could indeed happen here. And our individual choices will definitely matter. History does not write itself.

Vijay Mehrotra (vmehrotra@usfca.edu) is a professor in the Department of Business Analytics and Information Systems at the University of San Francisco’s School of Management and a longtime member of INFORMS.

Editor’s note:

The views expressed in this column are those of the author and do not necessarily reflect the views of INFORMS or Analytics magazine.

References & Notes

  1. http://analytics-magazine.org/analyze-this-human-rights-group-confronts-abuses-with-data-driven-evidence/
  2. For more on HRDAG’s estimation methodology, see https://hrdag.org/coreconcepts/.
  3. http://fivethirtyeight.com/features/why-fivethirtyeight-gave-trump-a-better-chance-than-almost-anyone-else/
  4. See for example http://fivethirtyeight.com/features/pollsters-probably-didnt-talk-to-enough-white-voters-without-college-degrees/.
  5. For more on the ineffectiveness of a similar Bush-era registry, see http://www.cnn.com/2016/11/18/politics/nseers-muslim-database-qa-trnd/.
  6. http://www.inc.com/salvador-rodriguez/tech-muslim-registry-pledge.html

Analytics data science news articles

Save

Related Posts

  • 66
    Thousands of companies all over the world are competing for a finite number of data scientists, paying them big bucks to join their organizations – and setting them up for failure.
    Tags: data, science
  • 60
    Data can appear lifeless and dull on the surface – especially government data – but the thought of it should actually get you excited. Data is a very interesting and powerful thing. First off, data is exactly the stuff we bother to write down – and for good reason. But…
    Tags: data, science
  • 59
    Many organizations have noticed that the data they own and how they use it can make them different than others to innovate, to compete better and to stay in business. That’s why organizations try to collect and process as much data as possible, transform it into meaningful information with data-driven…
    Tags: data, science
  • 57
    Once upon a time, in a kingdom far, far away, a blue-blooded girl was born with one of the most well-known family names in history. Her mother hated her father so much that her mother decided to nurture this little girl as everything opposite to what her father stood for:…
    Tags: science, people, data
  • 54
    A brand new INFORMS competition provides real-world workplace experience for undergraduate and master’s level students. Student teams will be given the same business problem, data sets and access to software to solve a challenging problem using an O.R./analytics approach. A panel of industry and academic experts will judge written submissions…
    Tags: data, sets


Headlines

FCC wins 2018 INFORMS Edelman Award

The Federal Communications Commission (FCC) won the 2018 Franz Edelman Award for its use of operations research (O.R.) as part of a revolutionary approach to address the rapidly growing need for additional wireless spectrum in the United States and Canada. The prestigious award, which recognizes outstanding achievement in advanced analytics, O.R. and management science, was presented by INFORMS at the Edelman Gala held April 16 in Baltimore in conjunction with the 2018 INFORMS Conference on Business Analytics and Operations Research. Read more →

BNSF Railway receives 2018 INFORMS Prize

BNSF Railway was awarded the 2018 INFORMS Prize for its pioneering and enduring integration of operations research (O.R.) and analytics programs throughout the organization. The prize was presented at the Edelman Gala held April 16 in Baltimore in conjunction with the 2018 INFORMS Conference on Business Analytics and Operations Research. Read more →

Ethics article earns Mission Award from Notre Dame

An article co-authored by Scott Nestler and David Hunt, both longtime and active members of INFORMS, was named a winner of the Mission Award from the Mendoza College of Business at the University of Notre Dame. The article, “Using INFORMS ethics guidelines in the classroom,” appeared in the February 2017 issue of OR/MS Today (the INFORMS membership magazine). The Mission Award recognizes one or more Notre Dame faculty members for a specific research work that contributes to the common good. Read more →

UPCOMING ANALYTICS EVENTS

INFORMS-SPONSORED EVENTS

INFORMS International Conference
June 17-20, 2018, Taipei, Taiwan

INFORMS Annual Meeting
Nov. 4-7, 2018, Phoenix

CAP® EXAM SCHEDULE

CAP® Exam computer-based testing sites are available in 700 locations worldwide. Take the exam close to home and on your schedule:


 
For more information, go to 
https://www.certifiedanalytics.org.