{"id":3496836,"date":"2023-05-02T10:09:29","date_gmt":"2023-05-02T10:09:29","guid":{"rendered":"https:\/\/www.resilience.org\/?p=3496836"},"modified":"2023-05-02T10:09:29","modified_gmt":"2023-05-02T10:09:29","slug":"democracy-rising-28-ai-gossip-and-our-epistemological-crisis","status":"publish","type":"post","link":"https:\/\/www.resilience.org\/stories\/2023-05-02\/democracy-rising-28-ai-gossip-and-our-epistemological-crisis\/","title":{"rendered":"Democracy Rising 28: AI, Gossip, and Our Epistemological Crisis"},"content":{"rendered":"<p><strong><em>Democracy Rising\u00a0<\/em><\/strong><em>is a\u00a0<\/em><a href=\"https:\/\/www.resilience.org\/democracy_rising\/\"><em>series of blog posts<\/em><\/a><em>\u00a0on deliberative democracy: what it is, why it\u2019s powerful, why the time is right for it, how it works, and how to get it going in your community. The series originates in the United States but will discuss principles and draw upon examples from around the world.<\/em><\/p>\n<p>The other day I joined the rush to explore ChatGPT, signing up at the <a href=\"https:\/\/openai.com\/\">OpenAI website<\/a>. I gave it my full legal name and correct birth date, and asked it to pretend I had died and to write my obituary. The result was 300 words describing a somewhat boring paragon of a man.<\/p>\n<p>Except maybe for the boring part, I am not that man, much less that paragon.<\/p>\n<p>The obit wasn\u2019t completely wrong, but it did nothing to undermine ChatGPT\u2019s reputation for <a href=\"https:\/\/en.wikipedia.org\/wiki\/ChatGPT\">\u201cuneven factual accuracy.\u201d<\/a> It said I was born in Ohio (true), but in Cleveland (false) in 1957 (false). It said I was a \u201ccommitted environmentalist\u201d (true; I worked for the late lamented Worldwatch Institute for the best part of my career), and that I was an active member of \u201cseveral environmental organizations\u201d (somewhat true, off and on). It described me as an \u201cavid cyclist\u201d (kind of true, but the last time I did a century ride was 1987).<\/p>\n<p>So much for the hits. The misses include accounts of me as:<\/p>\n<ul>\n<li>A \u201cdevoted husband\u201d to my wife of 40 years, Mary (my marriage, to a fine woman not named Mary, lasted 26 years) and a \u201cloving father\u201d to two children (one, in fact)<\/li>\n<li>A \u201cbrilliant engineer\u201d with a degree in electrical engineering from Ohio State University who worked for Boeing, General Electric, and SpaceX (wrong on all counts)<\/li>\n<li>Someone who \u201cwas instrumental in the development of several renewable energy projects\u201d (my wife and I put a few solar panels on our garage roof, but that\u2019s it)<\/li>\n<li>An \u201cactive member\u201d of a church who spent \u201cmany hours volunteering at the food bank\u201d (I am neither very religious nor, it shames me to admit, very generous with my personal time)<\/li>\n<\/ul>\n<p>The obituary proclaimed that my \u201cdeath\u201d had \u201cleft a deep void in the lives of his family, friends, and colleagues\u201d and that I would be \u201cdeeply missed by all who knew him.\u201d Well, that would be gratifying\u2014if there is a me to be gratified\u2014but I\u2019ll settle for a drunken wake where somebody plays <a href=\"https:\/\/www.youtube.com\/watch?v=UDfAdHBtK_Q\">\u201cWon\u2019t Get Fooled Again.\u201d<\/a><\/p>\n<p>Maybe everyone should try this. You too might be amused and\/or appalled by the plausible distortions and lies a quasi-intelligent computer program can gin up by accessing the petabytes of data (\u201cdata\u201d?) on the Internet\u2014accounts of people and events that are bogus but increasingly, and seamlessly, hard to tell \u00a0from reality.<\/p>\n<p>I am not a tech nerd and my grasp of what ChatGPT does is rudimentary. But I find it disturbing that this expression of artificial intelligence will instantly fabricate a profile and populate it with\u2014not questions, or blanks to be filled in\u2014but invented factoids tailored to fit a particular format. And this reservation isn\u2019t just me being PO\u2019d about my obit (I\u2019m actually grateful my Internet footprint isn\u2019t bigger); prominent tech geeks also have misgivings. Here\u2019s <a href=\"https:\/\/www.nytimes.com\/2023\/04\/21\/opinion\/chatgpt-journalism.html\">Farhad Manjoo<\/a>, for instance:<\/p>\n<blockquote><p>ChatGPT and other chatbots are known to make stuff up or otherwise spew out incorrect information. They\u2019re also black boxes. Not even ChatGPT\u2019s creators fully know why it suggests some ideas over others, or which way its biases run, or the myriad other ways it may screw up.\u00a0 \u2026[T]hink of ChatGPT as a <em>semi-<\/em>reliable source.<\/p><\/blockquote>\n<p>Likewise Twitter and other social media, whose flaws and dangers are well known by now, and feared by some of the experts who know them best. The most recent book from revered tech guru and virtual reality pioneer Jaron Lanier is called <a href=\"https:\/\/www.amazon.com\/Arguments-Deleting-Social-Media-Accounts\/dp\/1250239087\/ref=sr_1_1?crid=1DU3V7RY2VAQM&amp;keywords=jaron+lanier&amp;qid=1682195481&amp;s=books&amp;sprefix=jaron+lanier%2Cstripbooks-intl-ship%2C165&amp;sr=1-1\"><em>Ten Arguments for Deleting Your Social Media Accounts Right Now<\/em><\/a><em>.<\/em> Chapter titles include \u201cQuitting Social Media Is the Most Finely Targeted Way to Resist the Insanity of Our Time,\u201d \u201cSocial Media Is Making You into an Asshole,\u201d \u201cSocial Media Is Undermining Truth,\u201d and \u201cSocial Media Is Making Politics Impossible.\u201d<\/p>\n<p>About those politics: ChatGPT and its successors and rivals, whatever their virtues, are the latest agents in the corruption of the public sphere by digital technology, threatening to extend and deepen the misinformation, fabulism, and division stoked by Twitter and other digital media. Once again, a powerful new technology is out the door and running wild while society and regulators struggle to understand and tame it.<\/p>\n<p>It&#8217;s hard to see how this can end well.<\/p>\n<p>An earlier post in this series (<a href=\"https:\/\/www.resilience.org\/stories\/2021-12-21\/democracy-rising-5-get-back-deliberations-long-and-winding-road\/\">DR5<\/a>) looked at recent archaeological evidence suggesting that humans have explored lots of different means of governing ourselves over the last several thousand years. Eventually, for several reasons, we seem to have ended up with large, top-down, hierarchical organizations. These have lots of problems that won\u2019t be reviewed here, but neuroscientist and philosopher <a href=\"https:\/\/erikhoel.substack.com\/p\/the-gossip-trap\">Eric Hoel argues<\/a> that at least they freed us from the \u201cgossip trap.\u201d<\/p>\n<p>Hoel thinks the main reason small prehistoric human groups didn\u2019t evolve hierarchical governing systems is because of \u201craw social power,\u201d i.e., gossip:<\/p>\n<blockquote><p>[Y]ou don\u2019t need a formal chief, nor an official council, nor laws or judges. You just need popular people and unpopular people.<\/p>\n<p>After all, who sits with who is something that comes incredibly naturally to humans\u2014it is our point of greatest anxiety and subject to our constant management. This is extremely similar to the grooming hierarchies of primates, and, presumably, our hominid ancestors.<\/p>\n<p>\u201cSo,\u201d Hoel says, \u201c50,000 BC might be a little more like a high school than anything else.\u201d<\/p><\/blockquote>\n<p>Hoel believes that raw social power was a major obstacle to cultural development for tens of thousands of years. When civilization did finally arise, it created \u201ca superstructure that levels leveling mechanisms, freeing us from the gossip trap.\u201d<\/p>\n<p>But now, Hoel says, the explosion of digital media and their functions have resurrected it:<\/p>\n<blockquote><p>[I]f we lived in a gossip trap for the majority of our existence as humans, then what would it be, mentally, to atavistically return to that gossip trap?<\/p>\n<p>Well, it sure would look a lot like Twitter.<\/p>\n<p>I\u2019m serious. It would look a <em>lot<\/em> like Twitter. For it\u2019s on social media that gossip and social manipulation are unbounded, infinitely transmittable.<\/p>\n<p>\u2026Of course we gravitate to cancel culture\u2014<em>it\u2019s our innate evolved form of government<\/em>.<\/p><\/blockquote>\n<p>Allowing the gossip trap to resume its influence on human affairs\u2014and turbocharging it the way digital media are doing\u2014seems like a terrible way to run a PTA or a garden club, let alone a community or a nation.<\/p>\n<p>The industrialization of made-to-order opinions, \u201cfacts,\u201d and \u201cdata\u201d via AI and social media, despite efforts to harness them for <a href=\"https:\/\/texttalkact.com\/\">constructive ends<\/a>, is plunging us into an epistemological crisis: \u201cHow do you know?\u201d is becoming the most fraught question of our time. T.S. Eliot said that \u201chumankind cannot bear very much reality,\u201d but now we are well into an era when we can\u2019t even tell what it is\u2014or in which <a href=\"https:\/\/gaianism.org\/deliberative-democracy-and-gaianism-natural-complements\/\">we simply make it up<\/a> to please ourselves. The more convincing these applications become, the less anchored we are to the \u201cfact-based\u201d world.<\/p>\n<p>We\u2019ve struggled with this for centuries. Deception is built into nature as an evolutionary strategy, and humans are pretty good at it, both individually and at scale by means of propaganda, advertising, public relations, and spin. These all prey on human social and cognitive vulnerabilities (see <a href=\"https:\/\/www.resilience.org\/stories\/2021-12-08\/democracy-rising-4-this-is-your-brain-on-deliberation\/\">DR4<\/a>).<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3496898 size-full\" src=\"https:\/\/www.resilience.org\/wp-content\/uploads\/2023\/05\/Picture1.jpg\" alt=\"moth\" width=\"518\" height=\"389\" srcset=\"https:\/\/www.resilience.org\/wp-content\/uploads\/2023\/05\/Picture1.jpg 518w, https:\/\/www.resilience.org\/wp-content\/uploads\/2023\/05\/Picture1-266x200.jpg 266w\" sizes=\"auto, (max-width: 518px) 100vw, 518px\" \/><\/p>\n<p style=\"text-align: center;\"><em><a href=\"https:\/\/commons.wikimedia.org\/wiki\/File:Polyphemus_Moth_Antheraea_polyphemus.JPG\">https:\/\/commons.wikimedia.org\/wiki\/File:Polyphemus_Moth_Antheraea_polyphemus.JPG<\/a> Author: [User:Kadoka1]Template:Stephen Lody Photography. This file is licensed under the\u00a0<a class=\"extiw\" title=\"w:en:Creative Commons\" href=\"https:\/\/en.wikipedia.org\/wiki\/en:Creative_Commons\">Creative Commons<\/a>\u00a0<a class=\"external text\" href=\"https:\/\/creativecommons.org\/licenses\/by-sa\/3.0\/deed.en\" rel=\"nofollow\">Attribution-Share Alike 3.0 Unported<\/a>\u00a0license.<\/em><\/p>\n<p style=\"text-align: center;\"><em>Hungry birds beware: is this dinner, or an owl?<\/em><\/p>\n<p>Humans can only perceive the world partially and indirectly. It starts with our senses, which ignore all but a tiny fraction of the vast amount of data that\u2019s out there. (Sight, for instance, captures only a sliver of the electromagnetic spectrum.) In addition, we\u2019re social creatures and our perceptions of what\u2019s real are powerfully shaped by other people. And now comes the digital mediation of inputs, in which information and data come from the ether via often faceless and anonymous sources and are cloaked or manipulated in ways we may never detect or suspect.<\/p>\n<p>Digital media curate our information about reality, like all media do. But things have changed in the last few decades, and especially in the last few years. It\u2019s been only a generation or so since the old days when <a href=\"https:\/\/en.wikipedia.org\/wiki\/Walter_Cronkite\">Walter<\/a>, or <a href=\"https:\/\/en.wikipedia.org\/wiki\/The_Huntley%E2%80%93Brinkley_Report\">Chet and David<\/a>, or any of hundreds of daily newspapers told us what was going on in the world. In those days the curation was handled by a relatively small number of individuals with high profiles. We knew, or could learn, something about who they were and where their biases lay. They were professionals, which also counted for something. There\u2019s no perfect system and this one wasn\u2019t either, but its chain of information custody was a far cry from the distant, anonymized, chat-botted, and algorithm-driven inputs flooding the public sphere now.<\/p>\n<p><a href=\"https:\/\/www.nytimes.com\/2023\/04\/13\/opinion\/tucker-carlson-murdoch-fox.html\">One liberal pundit<\/a> recently noted that the increasing ideological specialization of media outlets \u201ccompels customers who care about getting a full and nuanced picture not to buy from just one merchant \u2026 .\u201d That\u2019s good advice. But you don\u2019t have to force yourself, teeth clenched, to watch Fox News or MSNBC to get a different point of view; just sit down with your neighbors for a civil chat. In fact, getting away from our TVs and into a room with other people now and then would be good for all of us.<\/p>\n<p>This being a blog about deliberative democracy, I default to deliberation in response to many of our political ills. Deliberation can\u2019t fix everything, and no doubt we <em>will<\/em> get fooled again\u2014but the tools of democratic deliberation can be used to mitigate the seemingly ubiquitous attempts at manipulation and deceit that surround us. Humans have struggled for a long time to build institutions to check our worst tendencies and have had some success. Digitally mediated information poses a fresh threat and we need institutions to meet these new circumstances.<\/p>\n<p>Deliberative settings built for shaping community action should be among those new institutions. At the very least, they will outperform the social processes seen in high school cafeterias. The methods and structures of deliberative democracy can shorten the chain of information custody as well as restore and nurture the direct human presence of neighbors and fellow citizens: they\u2019re sitting around the same table, and you will see them later at the local school or grocery store. Like them or not (or vice versa), they remain a potent element of our daily lives\u2014a source of influence that can work for good or ill. Deliberation channels normal human interactions in ways that can benefit the community, help check the kinds of fantasist catastrophes so prevalent in digital media, and ground our perceptions of reality in the shared concerns of a community of people who may be less than friends but far more than strangers.<\/p>\n<p>&nbsp;<\/p>\n<p><em>Teaser photo credit: This file is from\u00a0<a class=\"external text\" href=\"https:\/\/pixabay.com\/\" rel=\"nofollow\">Pixabay<\/a>, where the creator has released it explicitly under the license\u00a0<b><a class=\"extiw\" title=\"en:Creative Commons license\" href=\"https:\/\/en.wikipedia.org\/wiki\/Creative_Commons_license#Zero_\/_public_domain\">Creative Commons Zero<\/a><\/b>\u00a0(<a class=\"external text\" href=\"https:\/\/web.archive.org\/web\/20170810120752\/https:\/\/pixabay.com\/en\/service\/terms\/\" rel=\"nofollow\">see here<\/a>).\u00a0<small>File ID:\u00a0<a class=\"external text\" href=\"https:\/\/pixabay.com\/p-3382507\" rel=\"nofollow\">3382507<\/a><\/small> This file is made available under the\u00a0<a class=\"extiw\" title=\"w:en:Creative Commons\" href=\"https:\/\/en.wikipedia.org\/wiki\/en:Creative_Commons\">Creative Commons<\/a>\u00a0<a class=\"external text\" href=\"https:\/\/creativecommons.org\/publicdomain\/zero\/1.0\/deed.en\" rel=\"nofollow\">CC0 1.0 Universal Public Domain Dedication<\/a>.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>ChatGPT and its successors and rivals, whatever their virtues, are the latest agents in the corruption of the public sphere by digital technology, threatening to extend and deepen the misinformation, fabulism, and division stoked by Twitter and other digital media.<\/p>\n","protected":false},"author":128238,"featured_media":3496899,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[251208,79720,213535],"tags":[213802,118114,131239],"class_list":["post-3496836","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-democracy_rising","category-society","category-society-featured","tag-ai","tag-deliberativedemocracy","tag-socialmedia"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.resilience.org\/wp-json\/wp\/v2\/posts\/3496836","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.resilience.org\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.resilience.org\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.resilience.org\/wp-json\/wp\/v2\/users\/128238"}],"replies":[{"embeddable":true,"href":"https:\/\/www.resilience.org\/wp-json\/wp\/v2\/comments?post=3496836"}],"version-history":[{"count":0,"href":"https:\/\/www.resilience.org\/wp-json\/wp\/v2\/posts\/3496836\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.resilience.org\/wp-json\/wp\/v2\/media\/3496899"}],"wp:attachment":[{"href":"https:\/\/www.resilience.org\/wp-json\/wp\/v2\/media?parent=3496836"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.resilience.org\/wp-json\/wp\/v2\/categories?post=3496836"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.resilience.org\/wp-json\/wp\/v2\/tags?post=3496836"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}