{"id":776,"date":"2016-06-29T22:19:46","date_gmt":"2016-06-29T22:19:46","guid":{"rendered":"http:\/\/www.alisonpowell.ca\/?p=776"},"modified":"2016-06-29T22:19:46","modified_gmt":"2016-06-29T22:19:46","slug":"algorithms-accountability-and-political-emotion","status":"publish","type":"post","link":"https:\/\/www.alisonpowell.ca\/?p=776","title":{"rendered":"Algorithms, Accountability, and Political Emotion"},"content":{"rendered":"

\"Screen<\/a><\/p>\n

Last week (it seems a century ago) I was at the Big Boulder social data conference<\/a> discussing the use of algorithms in managing social data. Then, since I live in the UK, Brexit Events intervened. Sadness and shock for many have since morphed into uncertainty for all. Online media, driven by the social analytics I heard about in Boulder, shape and intensify these feelings as we use them to get our news and connect with people we care about. This raises some really important issues about accountability, especially as more news and information about politics gets transmitted through social media. It also stirs up some interesting questions about the relation between industry focus on sentiment analysis of social media in relation to brands, and the rise of emotion-driven politics.<\/p>\n

So in this post I\u2019ll talk about why algorithms matter in moments of uncertainty, what it might mean to make them accountable or ethical, and what mechanisms might help to do this.<\/p>\n

    \n
  1. Algorithms present the world to you \u2013 and that\u2019s sometimes based on how you emote about it<\/strong><\/li>\n<\/ol>\n

    Algorithmic processes underpin the presentation of news stories, posts and other elements of social media. An algorithm is a recipe that specifies how a number of elements are supposed to be combined. It usually has a defined outcome \u2013 like a relative ranking of a post in a social media newsfeed. Many different data will be introduced, and an algorithm\u2019s function is to integrate them together in a way that delivers the defined outcome. Many algorithms can work together in the kinds of systems we encounter daily.<\/p>\n

    One element of algorithmic systems that find interesting at this moment in time, and that\u2019s sentiment. Measuring how people say they feel about particular brands in order to better target them has been a key pillar of the advertising industry for decades. With the expansion of social analytics, it\u2019s now also the backbone of political analysis aimed at seeing which leaders, parties and approaches to issues acquire more positive responses. But could too much of a focus on sentiment also intensify emotional appeals from politicians, to the detriment of our political life? What responsibility do social media companies bear?<\/p>\n

    Social Media Companies Filter Politics Emotionally<\/em><\/strong><\/p>\n

    Increasingly, media companies are sensitive to the political and emotional characteristics of responses to the kinds of elements that are presented and shared. Sentiment analysis algorithms, trained on data that categorizes words into \u2018positive\u2019 and \u2018negative, are widely employed in the online advertising sphere to try to ascertain how people respond to brands. Sentiment analysis also underpinned the infamous \u2018Facebook emotion study\u2019 which sought to investigate whether people spent more time using the platform when they had more \u2018positive\u2019 or \u2018negative\u2019 posts and stories in their feeds.<\/p>\n

    With the expansion of the emotional response buttons on Facebook, more precise sentiment analysis is now possible, and it is certain that emotional responses of some type are factored in to subsequent presentation of online content along with other things like clicking on links.<\/p>\n

    Sentiment analysis is based on categorizations of particular words as \u2018postive\u2019 or negative. Algorithms based on presenting media in response to such emotional words have to be \u2018trained\u2019 on this data. For sentiment analysis in particular, there are many issues with training data, because the procedure depends on the assumption that words are most often associated with particular feelings. Sentiment analysis algorithms can have difficulty identifying when a word is used sarcastically, for example.<\/p>\n

    Similarly, other algorithms used to sort or present information are also trained on particular sets of data. As Louise Amoore\u2019s research investigates, algorithm developers will place computational elements into systems that they build, often without much attention to the purposes for which they were first designed.<\/p>\n

    In the case of sentiment analysis, I am curious as to the consequences of long term investments in this method by analytics companies and the online media industry. Especially, I\u2019m wondering about whether focusing on sentiment or optimizing presentation of content with relation to sentiment is in any way connected to the rise of ‘fact-free\u2019 politics<\/a> and the ascendancy of emotional arguments in campaigns like the Brexit referendum and the American presidential primaries.
    \n<\/strong><\/p>\n

      \n
    1. Algorithms have to be trained: training data establish what\u2019s \u2018normal\u2019 or \u2018good\u2019<\/strong><\/li>\n<\/ol>\n

      The way that sentiment analysis depends on whether words are understood as positive or negative gives an example of how training data establishes baselines for how algorithms work.<\/p>\n

      Before algorithms can run \u2018in the wild\u2019 they have to be trained to ensure that the outcome occurs in the way that\u2019s expected. This means that designers use \u2018training data\u2019 during the design process. This is data that helps to normalize the algorithm. For face recognition training data will be faces, for chatbots it might be conversations, or for decision-making software it might be correlations.<\/p>\n

      But the data that\u2019s put in to \u2018train\u2019 algorithms has an impact – it shapes the function of the system in one way or another. A series of high profile examples<\/a> illustrate what kinds of discrimination can be built into algorithms through their training data: facial recognition algorithms that categorize black faces as gorillas, or Asian faces as blinking. Systems that use financial risk data to train algorithms that underpin border control. Historical data on crime is used to train \u2018predictive policing\u2019 systems that direct police patrols to places where crimes have occurred in the past, focusing attention on populations who are already marginalized.<\/p>\n

      These data make assumptions about what is \u2018normal\u2019 in the world, from faces to risk taking behavior. At Big Boulder a member of the IBM Watson<\/a> team described how Watson\u2019s artificial intelligence system uses the internet\u2019s unstructured data as \u2018training data\u2019 for its learning algorithms, particularly in relation to human speech. In a year where the web\u2019s discourse created GamerGate and the viral spread of fake news stories, it\u2019s a little worrying not to know exactly what assumptions about the world Watson might be picking up.<\/p>\n

      So what shall we do?<\/strong><\/p>\n

        \n
      1. You can\u2019t make algorithms transparent as such<\/strong><\/li>\n<\/ol>\n

        There\u2019s much discussion currently about \u2018opening black boxes\u2019 and trying to make algorithms transparent, but this is not really possible as such. In recent work, Mike Annany and Kate Crawford have created a long list of reasons for this, noting that transparency is disconnected from power, can be harmful, can create false binaries between the \u2018invisible\u2019 and the \u2018visible\u2019 algorithms, and that transparency doesn\u2019t necessarily create trust. Instead, it simply creates more opportunities for professionals and platform owners to police the boundaries of their systems. Finally, Annany and Crawford note that looking inside systems is not enough, because it\u2019s important to see how they are actual able to be manipulated.<\/p>\n

          \n
        1. Maybe training data can be reckoned and valued as such<\/strong><\/li>\n<\/ol>\n

          If it\u2019s not desirable (or even really possible) to make algorithmic systems transparent, what mechanisms might make them accountable? One strategy worth thinking about might be to identify or even register the training data that are used to set up the frameworks that key algorithms employ. This doesn\u2019t mean making the algorithms transparent, for all the reasons specified above, but it might create a means for establishing more accountability about the cultural assumptions underpinning the function of these mechanisms. It might be desirable, in the public interest, to establish a register of training data employed in key algorithmic processes judged to be significant for public life (access to information, access to finance, access to employment, etc). Such a register could even be encrypted if required, so that training data would not be leaked as a trade secret, but held such that anyone seeking to investigate a potential breach of rights could have the register opened at request.<\/p>\n

          This may not be enough, as Annany and Crawford intimate, and it may not yet have adequate industry support, but given the failures of transparency itself it may be the kind of concrete step needed to begin firmer thinking about algorithmic accountability.<\/p>\n","protected":false},"excerpt":{"rendered":"

          Last week (it seems a century ago) I was at the Big Boulder social data conference discussing the use of algorithms in managing social data. Then, since I live in the UK, Brexit Events intervened. Sadness and shock for many have since morphed into uncertainty for all. Online media, driven by the social analytics I […]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_newsletter_tier_id":0,"footnotes":"","jetpack_publicize_message":"","jetpack_is_tweetstorm":false,"jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","enabled":false}}},"categories":[1],"tags":[],"class_list":["post-776","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/pUfdR-cw","_links":{"self":[{"href":"https:\/\/www.alisonpowell.ca\/index.php?rest_route=\/wp\/v2\/posts\/776","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.alisonpowell.ca\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.alisonpowell.ca\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.alisonpowell.ca\/index.php?rest_route=\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.alisonpowell.ca\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=776"}],"version-history":[{"count":2,"href":"https:\/\/www.alisonpowell.ca\/index.php?rest_route=\/wp\/v2\/posts\/776\/revisions"}],"predecessor-version":[{"id":781,"href":"https:\/\/www.alisonpowell.ca\/index.php?rest_route=\/wp\/v2\/posts\/776\/revisions\/781"}],"wp:attachment":[{"href":"https:\/\/www.alisonpowell.ca\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=776"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.alisonpowell.ca\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=776"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.alisonpowell.ca\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=776"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}