Share with your friends










Submit

Analytics Magazine

ANALYZE THIS! Carefully considering some uncomfortable scenarios

Analytics data science news articles

Throughout history, data sets have been constructed and utilized for many different purposes, not all of them positive.

Vijay MehrotraBy Vijay Mehrotra

I’ve spent the last few months working with the Human Rights Data Analysis Group. HRDAG has historically focused on unstable regions around the world, scientifically examining data captured by local institutions and grassroots activists to try to discern the truth about the volume and patterns of human rights violations [1]. My work there has been focused on data from Colombia. Over the past several years, HRDAG has done several projects on Colombia, examining deaths, disappearances, torture, sexual violence and violence against union members during the longstanding conflict between armed rebels, criminal organizations and the Colombian government.

My primary project has been to look at output from a previous HRDAG analysis of homicides in Colombia in order to develop insightful visualizations and explanations about the pattern of killings. My results are intended for a relatively non-technical audience, and that is where I have bumped into a major communications challenge: Because HRDAG’s predictions are based on fairly sophisticated Bayesian Models [2], the results that I am describing are probability distributions rather than point estimates.

As it happens, this is the same problem recently faced by Nate Silver. Like virtually everyone else in the punditry, Silver had predicted that Hillary Clinton was likely to win the election (the final models at fivethirtyeight.com gave her roughly a 70 percent chance of victory). However, as Silver described in a blog post [3]  just after the election, Clinton was leading in the vast majority of national and swing state polls going into Nov. 9 but by very slim margins. As such, Silver’s pre-election commentary on fivethirtyeight.com described a variety of possible outcomes, ranging from a Clinton landslide to a narrow Trump victory, citing both the variability inherent in his group’s models as well as potential biases in the polling data [4]. In particular, the scenario in which Clinton captured the popular vote while losing the Electoral College vote was mentioned repeatedly prior to Election Day. In the probabilistic sense, the Donald Trump victory that we observed was clearly “predicted.”

Back here at HRDAG, I keep busy prepping and merging tables in Python, using Hadley Wickham’s ggplot2 package to graph multiple time series in R, and working to understand and explain what is driving the variability in the model estimates. I am intellectually engaged and am learning a great deal. But I am always aware that each of these data sources is a dehumanized digital catalog containing information about thousands of people’s lives.

Throughout history, these types of data sets, euphemistically referred to as “administrative lists” in the statistics literature, have been constructed and utilized for many different purposes, not all of them positive.

As such, President-Elect Trump’s call for a registry of Muslims disturbs me greatly, and not only because this has already been shown to be an ineffective strategy for fighting terrorism [5]. In the digital world that we live in, so much personal data about so many people is captured and stored across so many databases large and small. The social network data in Facebook and LinkedIn is, literally, a roadmap of how we are organized and connected. Organizations that host public or private clouds have extraordinary troves of intelligence about individual citizens living on their servers. The idea of any U.S. president with an army of data scientists seizing control of all of this data and using it against his or her perceived enemies is truly frightening – and is also contrary to everything this country stands for.

As technology journalist Salvador Rodriguez has noted, “The establishment of such a registry would require engineering prowess and troves of data – both the sort of thing big Silicon Valley companies boast in quantity” [6]. Given this context, I cringe when I see photos of tech industry CEOs assembled in a conference room at Trump Tower. I cheer at the growing list of companies who publicly state that they will not participate in the creation of such a database (as of this writing, this list has grown to include Apple, Google, Facebook, Salesforce.com, and many more). And I shudder when it is reported that Oracle CEO Safra Catz has joined the Trump transition team.

At the individual level, many professionals in the technology industry have also responded by taking a personal stand. To date, several thousand have signed a public online pledge committing “to stand in solidarity with Muslim Americans, immigrants, and all people whose lives and livelihoods are threatened by the incoming administration’s proposed data collection policies. We refuse to build a database of people based on their constitutionally protected religious beliefs. We refuse to facilitate mass deportations of people the government believes to be undesirable. We have educated ourselves on the history of threats like these, and on the roles that technology and technologists played in carrying them out.” You can learn more about this pledge at http://neveragain.tech.

History suggests that in the days and years ahead, we may be called upon to use our analytics skills in ways that may be unconstitutional, immoral or both. These invitations will often come with opportunities for intellectual challenges, financial rewards and/or personal glory, and there will almost surely be other pressures to acquiesce. But we must all be aware that there are real people behind the abstract digital representations in our data sets, that both our data and our models are almost always imperfect, and that our work can reveal information and insights that can have serious human consequences . In a turbulent context, analytics are rarely ethically neutral.

I do not pretend to know what the future holds. But it seems appropriate to develop a probabilistic forecast with significant variability, and to carefully consider some uncomfortable scenarios. Don’t fool yourself: It could indeed happen here. And our individual choices will definitely matter. History does not write itself.

Vijay Mehrotra (vmehrotra@usfca.edu) is a professor in the Department of Business Analytics and Information Systems at the University of San Francisco’s School of Management and a longtime member of INFORMS.

Editor’s note:

The views expressed in this column are those of the author and do not necessarily reflect the views of INFORMS or Analytics magazine.

References & Notes

  1. http://analytics-magazine.org/analyze-this-human-rights-group-confronts-abuses-with-data-driven-evidence/
  2. For more on HRDAG’s estimation methodology, see https://hrdag.org/coreconcepts/.
  3. http://fivethirtyeight.com/features/why-fivethirtyeight-gave-trump-a-better-chance-than-almost-anyone-else/
  4. See for example http://fivethirtyeight.com/features/pollsters-probably-didnt-talk-to-enough-white-voters-without-college-degrees/.
  5. For more on the ineffectiveness of a similar Bush-era registry, see http://www.cnn.com/2016/11/18/politics/nseers-muslim-database-qa-trnd/.
  6. http://www.inc.com/salvador-rodriguez/tech-muslim-registry-pledge.html

Analytics data science news articles

Save

Related Posts

  • 60
    Data can appear lifeless and dull on the surface – especially government data – but the thought of it should actually get you excited. Data is a very interesting and powerful thing. First off, data is exactly the stuff we bother to write down – and for good reason. But…
    Tags: data, science
  • 59
    Many organizations have noticed that the data they own and how they use it can make them different than others to innovate, to compete better and to stay in business. That’s why organizations try to collect and process as much data as possible, transform it into meaningful information with data-driven…
    Tags: data, science
  • 57
    Once upon a time, in a kingdom far, far away, a blue-blooded girl was born with one of the most well-known family names in history. Her mother hated her father so much that her mother decided to nurture this little girl as everything opposite to what her father stood for:…
    Tags: science, people, data
  • 54
    By Eric Siegel Note: This article is excerpted from Eric Siegel’s foreword to the recently released book, “Mining Your Own Business: A Primer for Executives on Understanding and Employing Data Mining and Predictive Analytics,” by Jeff Deal and Gerhard Pilcher. For predictive analytics to work, two different species must cooperate…
    Tags: data, science
  • 54
    A brand new INFORMS competition provides real-world workplace experience for undergraduate and master’s level students. Student teams will be given the same business problem, data sets and access to software to solve a challenging problem using an O.R./analytics approach. A panel of industry and academic experts will judge written submissions…
    Tags: data, sets

Analytics Blog

Electoral College put to the math test


With the campaign two months behind us and the inauguration of Donald Trump two days away, isn’t it time to put the 2016 U.S. presidential election to bed and focus on issues that have yet to be decided? Of course not.


Headlines

Three keys for organizations to gain value from information

In the current information-driven society and increasingly digitalized world, Gartner, Inc. says that sentiments are shifting from the economics of tangible assets to the economics of information – “infonomics” – and other intangible assets. Infonomics is the theory, study and discipline of asserting economic significance to information. It strives to apply both economic and asset management principles and practices to the valuation, handling and deployment of information assets.  Read more →

Burtch Works study on ‘Salaries of Predictive Analytics Professionals’

According to the recently released Burtch Works study on “Salaries of Predictive Analytics Professionals 2017,” senior-level executives saw the largest increase in salaries from 2016 to 2017, and industry diversification of employment has diluted the concentration of such professionals from financial services and marketing/advertising to consulting and technology. Read more →

New study asks, ‘Is your business AI-ready?’

Despite fears that robots will replace human labor, the majority of artificial intelligence (AI) leaders (79 percent) expect their employees will work comfortably with robots by 2020, according to a new Genpact survey of C-Suite and senior executives titled, “Is Your Business AI-Ready?” Read more →

UPCOMING ANALYTICS EVENTS

INFORMS-SPONSORED EVENTS

2017 Winter Simulation Conference (WSC 2017)
Dec. 3-6, 2017, Las Vegas

CAP® EXAM SCHEDULE

CAP® Exam computer-based testing sites are available in 700 locations worldwide. Take the exam close to home and on your schedule:


 
For more information, go to 
https://www.certifiedanalytics.org.