Latest / Uncomfortable Conversations with Josh Szeps / "Big Tech & Free Speech" with Jordan Guiao
Transcript
- 0:00Good day, you guys. This is your safe space for dangerous ideas. Do you ever think that
- 0:07social media is getting a little out of control? Do you ever find yourself just scrolling?
- 0:13Oh, just I'll just quickly check Instagram while I'm sitting on the toilet and then you
- 0:17realize, oh, eight minutes has gone by. I guess I didn't really need to sit on the toilet
- 0:21for that long, but something hooked me. Something got its little anchors into the tendrils of
- 0:27my brain and kept me there. Today, Jordan Gowr, who is a, he's written a book called Disconnect
- 0:34why we get pushed to extremes online and how to stop it. He's a former digital strategist,
- 0:40so he knows his stuff. He worked at the ABC, the Australian Broadcasting Corporation, and
- 0:44he was the head of social media for SBS, the special broadcasting service, which is another
- 0:49public broadcaster in Australia. So he's actually run social media platforms. He has, well,
- 0:55not the platform, social media accounts, and he's been the digital strategist for Australia's
- 1:01main public broadcaster. He's worked in Silicon Valley. He gained a lot of insights there into
- 1:07technology there in the tech capital of the world. He's now a research fellow at the Australia
- 1:12Institute's Centre for Responsible Technology. All of the profits from this book will be
- 1:17plowed back into the Australia Institute, which is a think tank to try to address some of the
- 1:22issues that he raises in the book. It's an interesting structure to the book. He basically goes
- 1:27through these archetypes of humans who are being negatively impacted by big tech. Firstly,
- 1:35the online conspiracy theorist, then the COVID-19 anti-lockdown freedom fighter, then the social
- 1:42media narcissist, then the hateful troll, then the dating app pest, then the screen addict,
- 1:49and then the naive futurist. We jump around all of these archetypes, well, not all of them,
- 1:56but as many ones as we could fit into this conversation. I hope you find it as stimulating as I did.
- 2:02Enjoy it. The one and only Jordan Gown.
- 2:04Every time that goes, when you're talking to people who are techno optimists.
- 2:20I think they secretly agree, but they're just not allowed to say so, out loud,
- 2:28and so people like me are fortunate to be able to say those things out loud for them.
- 2:34Right. What's that line about? It's very hard to convince someone of something when their livelihood
- 2:39depends on them not believing it. Exactly. I don't begrudge anybody for that. I've been in that
- 2:45position before too. I can completely understand, but I think we do need a shift in that attitude,
- 2:52and there's certainly enough evidence to be able to publicly talk about these things.
- 2:59And when you say you think that they basically do agree, what is it that you're saying that you
- 3:03think they agree with? I think there's an increased recognition of the harms facilitated by digital
- 3:10platforms, and that in particular, it's a handful of small companies, and I call that out a lot.
- 3:18It's basically Facebook and YouTube. If your job deals with them anyway, it's obviously very
- 3:27difficult to point the finger so explicitly, but whether it's a professional capacity or personal
- 3:35capacity, I think people are acknowledging that, yes, there are a lot of harms in those environments,
- 3:40and we need to have a chat about what to do about them. It's kind of an overwhelming subject to
- 3:46even start to get our hands around in a conversation because those harms can be so scattered,
- 3:51and sometimes people can be a bit vague about what harms they're talking about. So some people
- 3:54will talk about extremism at hate speech. Some people will talk about the impact that it has on
- 4:00bullying amongst young people. Some people will talk about the impact it has on privacy and data
- 4:06collection. Some people will talk about the impact of screens, choir screens, as if there's
- 4:11something magically bad about a digital device that is not bad about a book, where do you begin?
- 4:18I think that's a really great point, and so the way I structured the book is around these personas,
- 4:24and the personas encapsulate a specific issue facilitated by digital platforms. For example,
- 4:32we have conspiracy theorists online, we have freedom fighters who protest lockdown mandates,
- 4:39we have hateful trolls, social media narcissists, screen addicts, and so on. I think, as you pointed
- 4:47out, the issues are so broad and diverse that they can get quite overwhelming, but if you frame it
- 4:54through a person that you might know, a cousin who's all of a sudden an anti-vaxxer and a tenant
- 5:00lockdown protest, a friend who's become a bit of a troll, all of a sudden those issues start to
- 5:05feel very real and very tangible, and people can start to understand them a little bit better,
- 5:11which is why the book is structured around those characters. And there's, of course, overlap between
- 5:16these characters, the conspiracy theorists and say the anti-lockdown freedom fighter, and to give
- 5:21them their due, the counter critique to your critique could be, we've lived for a long time
- 5:32under a regime in which very small handful of so-called experts were able to disseminate
- 5:39information to all of us, mostly old white men who would police and gatekeep the information
- 5:45that we were able to have, and now we have a more democratic consumption of information,
- 5:51and sometimes that will get things wrong in the case of science misinformation, for example,
- 5:56but sometimes it will perform a useful role in pushing back against some stodgy narrative that
- 6:02is backed by big farmer and big drug companies and governments and so on, that, for example, maybe
- 6:07there were concerns about myocarditis and young men that were overlooked or downplayed by
- 6:15traditional media and by governments and drug companies in their zeal to get everybody vaccinated,
- 6:20and maybe there was too little criticism of the human rights impacts of some of the more
- 6:27extreme lockdown measures like curfews or things that may not have been, have had epidemiology
- 6:34behind them, and that these mechanisms that Facebook and YouTube have platforms on which people
- 6:39can dissent, and that dissent is a powerful thing in a democracy. Yeah, it certainly is.
- 6:46I think what I would challenge is the idea that that plurality actually holds. So, you know,
- 6:52the utopian vision we had for the internet is that it would indeed do that and democratise all
- 6:58these voices, but what's happened, particularly over the last, I'd say, 10 years, is that plurality
- 7:05has actually shrunk, and the internet is now dominated by a very small handful of particular
- 7:11companies, in particular Alphabet, slash Google and Meta, slash Facebook. So, what we're seeing now
- 7:18is the shrinking of that plurality, and those companies that now dominate have a very particular
- 7:25set of objectives that aren't necessarily aligned to that utopian vision. So, what I mean by that
- 7:32is that their full-profit companies, they decide that, you know, the value that they want from
- 7:39people is to keep them on their platforms, so engagement at all costs, and what that results in
- 7:44is a particular set of outcomes for people using that environment and for people transacting
- 7:51in those platforms. And so, that's what we're seeing the harms come through is that, you know,
- 7:57yes, it's okay to be on YouTube for, you know, fun little cat videos, but, you know, it's not
- 8:04just that that we use it for now. We use it for everything, like a big part of our information
- 8:08ecosystem, so that all of a sudden takes into account a lot of other harms, and through these
- 8:14platforms, those harms are being magnified. So, I guess the overall theme is I would challenge that
- 8:20the tech neutrality idea, and those platforms constantly use that as an excuse, you know,
- 8:28we're just the foundation, you know, we're not the ones doing all these things, but actually,
- 8:34the way they build their platforms, the way they build their algorithms are very deliberate,
- 8:38and none of those things are neutral because they actually insert values into those software
- 8:45services. Right. I mean, let's be clear then about what we mean by neutral and what we mean by values,
- 8:50because when you say there's a shrinking of diversity because you've got these two gigantic
- 8:55companies, you know, Alphabet, which owns Google, which owns YouTube, and Meta, which owns Facebook
- 9:00and Instagram, and WhatsApp, the, there may be a shrinking of corporate diversity, but the very
- 9:08people who champion social media misinformation and who applaud the greater diversity of voices,
- 9:16even if that means there are conspiracy theories and misinformation, they would be the ones who
- 9:20are the most keen to say that there shouldn't be any deep platforming for people for ideological
- 9:24reasons, that they may be a shrinking of corporate diversity, but not of ideological diversity,
- 9:30and to the extent that there is a thumb on the scale by these social media companies,
- 9:36they're generally doing it in a woke or politically correct direction by, you know,
- 9:42banning Donald Trump, or, and so on. I mean, this is one of the reasons why Elon Musk has been
- 9:46successful, and so committed to taking over Twitter, right, a kind of a free speech crusade where
- 9:51you should tolerate a higher level of hate speech and misinformation on these platforms in the
- 9:56interests of free speech. So when you're talking about neutrality and you're talking about values,
- 10:02you're not talking about the companies proactively deciding what kinds of ideas and posts should
- 10:09be prioritized or not. You're talking about something deeper or more sinister, which is the mindless
- 10:15wearing algorithms that favor some types of content over others. Yes, that's right. So it's,
- 10:21it's all in the design of the software, and what I'd add to that is, you know, you mentioned earlier
- 10:28about the previous media ecosystem, if you like, the gatekeepers, you know, and they will also run
- 10:36and continue to be run by a particular set of people, and that the idea that the social platforms
- 10:43kind of provide an alternative to that. However, that ecosystem still has, while it's very imperfect,
- 10:51still has an environment of regulation of policies and rulemaking around it that
- 11:00constrain it in some ways. And like I said, quite imperfect, but the difference with these
- 11:05platforms is there are no rules around them, or very, very few rules. So, you know, there's
- 11:11general copyright rules, but other than that, it's a bit of a free for all, and that the preferred
- 11:19modus operandi are the platforms, particularly when it comes to what they choose to put on there.
- 11:24So editorializing, if you like, or moderation, if you like, it's to be completely hands off.
- 11:30And so what we have is an environment basically free of any type of constraints or rules. So
- 11:37naturally, it's going to be chaos. So yeah, like I said, while a previous media ecosystem
- 11:44is, has a lot of issues, at least we retain a degree of control, and there were active forces
- 11:50that sought to moderate that. But just to clarify, I mean, the criticism of the libertarian right
- 11:56of the social media companies is precisely that they don't have the Wild West that you're saying
- 12:01there is. You know, Kanye was banned. Donald Trump was banned. Right. So they are, they are doing
- 12:08a bit of that. They've started to, that's right. They've started to, after a great degree of
- 12:14public pressure, I guess, from, from tech critics. And they've started to do that.
- 12:18Is that a good thing? Should they be doing more of it, more editorializing, more treating
- 12:22themselves like their publications rather than platforms? Yeah, I think the overall
- 12:31idea is whether these platforms should moderate content or not. And so really tricky question
- 12:38to try and unpack. And the other layer I would add to that is, you know, like the Elon Musk's
- 12:47of the world and the Kanye's of the world, you know, they're, they're sort of buying these platforms
- 12:54as fees for political influence. And they sort of exist, but they're not elected, so they're not
- 13:02government officials. So I guess what I'm saying is, you know, it's a, it's a, it's a tricky
- 13:10environment to try and place rules around, but we have to start to try and do that. I don't have
- 13:16a clean answer about whether they should editorialize or not. Other than to say that, you know, the
- 13:23platforms have gotten to the scale and the size where, you know, maybe it's even impossible to do
- 13:30that. So, you know, I mean, just in terms of the manpower that you would need to be
- 13:35learning. I always find that that's a little bit cute when I hear Zuckerberg say it, you know,
- 13:41they're, we have a billion more users on how many they've got now. You know, how many posts are
- 13:46going up? How many YouTube videos there are? We couldn't possibly make sure that they're all,
- 13:51you know, kosher before they got, well, hang on a second. Imagine if, you know, McDonald's, for
- 13:57example, said, do you have any idea how many burgers we produce? We can't make sure that every single
- 14:02burger doesn't make somebody sick and doesn't have salmonella in it. You would say, that's a ridiculous
- 14:08cop out. It's, you know, it's got your big gold marches on it. If I go and eat a burger, even if
- 14:13it, even if you don't own it, if it's a franchisee, then I should have an expectation that I'm not
- 14:17going to get sick. And you know what? You don't, you don't get sick from salmonella as a rule going
- 14:23to McDonald's. They manage to, they employ however many people they need to employ and they
- 14:28impose the quality management standards that are necessary to make sure that if you eat a McDonald's
- 14:33burger, it may not be good for you, but it's not contaminated and it's not poisoned. And similarly,
- 14:38if Facebook needs to multiply by 10,000, the number of employees that it's got in order to make sure
- 14:43that posts don't go up, that shouldn't go up, then it could. Now, then we come to the question,
- 14:48which you're, you're being, you know, diplomatic and ambivalent about, which is, would it be a good
- 14:54idea to do that? And do you want, you know, from where does Zuckerberg get the right, you know,
- 15:00since he's not democratically elected to determine the rules and the content of the speech that
- 15:06all of us are making to each other? That's right. And I think part of the issue is that we've
- 15:13let these platforms get so big and so pervasive to the point that that moderation issue is tricky,
- 15:19as you said, when, you know, like we perhaps we should, you know, think about alternative platforms
- 15:28that aren't so big or that, you know, the idea that there's a single online experience for the
- 15:34entire world, homogenizing everybody's culture, everybody's way of communicating into one platform
- 15:40online. It's just ridiculous. And so, you know, that's what platforms like Facebook and Google are
- 15:46trying to do. And it's obviously not working. And so, you know, thinking about how do we control
- 15:52that situation is, has become really tricky because it's gotten to the point where their size is
- 15:58so big. So perhaps the first issue is that we need to get those platforms back into a manageable
- 16:07size. And there are live, you know, antitrust cases against them, where, you know,
- 16:13legislators are thinking about how to do that properly. That's a very least, do you mean splitting
- 16:17apart some of the apps from the parent company like White as WhatsApp have to be owned by the same
- 16:22company that owns Facebook? Precisely. That's right. So that our entire information ecosystem isn't
- 16:28reliant on just one or two things. And if we start to break them down into more manageable chunks,
- 16:33maybe the moderation conversation all of a sudden is viable because they're not so huge and
- 16:39all pervasive. I mean, Zuckerberg says it's kind of a, it's always a fiction to think that big
- 16:44goliaths remain big goliaths. You know, my space was the goliath and then all of a sudden it wasn't,
- 16:50history is littered with the corpses of big companies that weren't agile enough to keep up with
- 16:54with their competitors. He points to Snapchat, he points to TikTok, he points to all of these,
- 16:59you know, and even Instagram, which of course now he owns as well. But nonetheless, you know,
- 17:05the way things look in 2035, you know, we may be looking back on this conversation going,
- 17:10it was ridiculous that we thought that Facebook would be the universal sort of wet mode of communication
- 17:16that was so passe. Yeah, that's right. And we see platforms like TikTok emerging very quickly
- 17:22and being popular. And obviously Facebook and others are nervous about it. But, you know,
- 17:28should we wait for that decline point to happen before we start to address these things? I think,
- 17:34I think that's the sort of challenges. And part of the intention of the book is to surface these
- 17:41voices that aren't necessarily being heard. So, you know, we can talk about these things in the
- 17:46abstract, like through antitrust or surveillance capitalism. But there are real people being heard
- 17:52by these platforms. And so, you know, we shouldn't have to wait for market forces to correct itself
- 17:59or for a platform to all of a sudden, you know, not be so popular anymore to address some of these
- 18:04harms. And particularly when, you know, these companies are starting to talk about the next phase
- 18:10of the internet, which is, you know, things like the Metaverse and Web3. And they're already
- 18:15staking their claim on that future when we haven't even resolved the issues from this version.
- 18:21You know, we can't keep letting these sort of powerful, two powerful companies shift the
- 18:27goalposts and keep building, you know, ahead of us. And they're just leaving all the issues for us
- 18:33to deal with ourselves. You dropped a piece of jargon in there, Jordan Surveillance Capitalism,
- 18:38which is a good one. We're coined by Shishana Zuboff, I think, who wrote a book called Surveillance
- 18:44Capitalism. What is it? What's Surveillance Capitalism? So, it's essentially about harvesting all
- 18:50our data and profiting from that. So, YouTube and Facebook are free. That means the transaction
- 18:58cost is actually you us and our data. So, you know, habits, preferences, movements, what we do
- 19:06every day, all that is then packaged up to sell to advertisers against those preferences. So,
- 19:13because the product is free, we are essentially the product. And so, it marries the surveillance of
- 19:20our data and our habits into a capitalist transaction. And when we talk about data, I can just hear
- 19:28the audience's eyes glazing over a little bit because there have been so many data hacks. And,
- 19:33you know, like, I don't really know why I should care, per se. So, what is data? When we talk about
- 19:42my data, I mean, so the best I understand it, data is just the digital exhaust fumes of me going
- 19:50about my life, right? I leave a trail, I leave ripples, I leave a wake. And there are little bits of
- 19:56information about my shopping habits, about places that I've called, about, you know,
- 20:01insurance that I may or may not have applied for, you know, in addition to my private information.
- 20:06But I mean, all of that, all of those, that behavioral matrix, that network of data points about
- 20:12my life, that was just going unobserved. I mean, I've always been doing, Adam, we've always been
- 20:20been, if someone had wanted to spy on us before the digital age, they could have pieced together
- 20:25all of these things. Oh, he went to Woolworth's at this particular time. You know, he,
- 20:28if you had a private eye tracking you, they could have put all of that together. So, what's so bad or
- 20:34so insidious about big companies noticing that basically in order to deliver me more accurate ads?
- 20:41Yeah. So, I think the, the, what's, what's different now is the scale and the pervasiveness of
- 20:49that data capture. So, you know, in your earlier example, if somebody wanted to spy on you,
- 20:55pre internet that had to follow you around, that's quite laborious. But now that's just happening
- 21:01by default. So, there are digital spies, if you like, everywhere all the time happening. And you
- 21:08know, if, if it's, you know, if it serves the purpose of serving you the toothpaste that you want,
- 21:14that's a fairly benign kind of an outcome. However, if it starts to get into the kinds of data points
- 21:21that sensitive and things you may not want to be revealed, like you may have a health condition
- 21:27or you may be, you know, pregnant if, if you're a woman or you may have, you know,
- 21:34something else that you actually don't want someone to know about, there's often no choice
- 21:40in that data harvesting if it's ubiquitous. And so, that starts to become a problem and it starts
- 21:45to become an incursion of our privacy in our data agency when those things are being used and
- 21:50targeted against us. And the other side of it is at scale, like, you know, we humans are very
- 21:57bad at scale and imagining scale and because we're little and we have limited capacities. And so,
- 22:04you know, big data, if you like, can sort of discern patterns of behavior and trends that we have
- 22:13no conception of but is essentially profiting from us. And so, what I mean by that is, you know,
- 22:19for example, Google, let's say, knows where you like to go to the gym, knows where you
- 22:28your preferred restaurant and individually that feels quite benign. But what if, you know, they start
- 22:35selling or they get sponsored by a restaurant that is a competitor to the one that you like,
- 22:41you know, will they start serving that competitors restaurant every time you log on to your
- 22:46preferred one. And where is your data agency in that? So, it starts to enter into behavioral
- 22:53manipulation rather than just behavioral targeting. And that's where it becomes really problematic.
- 23:00Let's talk about another thing you said, which is engagement at all cost. So, when we were talking
- 23:04about the shrinking of diversity in these big companies and I was making the point that, you know,
- 23:11there may be only a few companies, but nonetheless, in an ideal world or what some people's vision of
- 23:17an ideal world, they're not putting their thumb on the scale of what I can say. Nonetheless,
- 23:23their algorithms are reliably favoring information and posts that generate the largest
- 23:29amount of engagement. They want us on the site for one second longer than we would otherwise be.
- 23:35They want us commenting. They want us clicking like. They want us either getting outraged or
- 23:40feeling satisfied. They want us sharing content. They basically just want us staying.
- 23:46So, what does that do? How does that exert a bias even in the absence of anyone trying to exert a bias?
- 23:54Yeah, I mean, that can lead to a whole host of issues. So, you know, there are studies that
- 23:59found that obviously, you know, negative or sensational content is more engaging than
- 24:06mutual ones. And so, we therefore get a bias against that type of a content. And at scale, if that's
- 24:18all we see, we start to go down these rabbit holes. So, for example, if Facebook decided that you
- 24:25were slightly into conspiracy theories, even if it's a benign one, it'll keep feeding you
- 24:32conspiracy-like content. Until, you know, you get to the point where every time you log on,
- 24:38that's all you see. And it feeds you that same sort of content buffet style. And so, obviously,
- 24:43those things start to become a problem. And the way that relates to engagement at all costs is
- 24:48because that's what the algorithm is trained to do. So, it thinks you like this thing. Therefore,
- 24:54it'll keep giving you an even, and it doesn't differentiate between the point at which that
- 25:00becomes harmful to you. It's just doing its job, essentially. So, you know, that's an example
- 25:05of the kind of values we attribute to those algorithms. And, you know, obviously, it doesn't judge
- 25:12for itself. But that's, you know, if your favorite engagement at a lot costs, those sorts of harms
- 25:17start to exert itself. Right. And I mean, you don't even have to have started out by demonstrating
- 25:24an interest in conspiracy theories. If you just type into YouTube, what happened on 9-11,
- 25:29some of that, and usually the, the videos that get the most engagement will be
- 25:34slightly conspiratorial about things not adding up. And then once you've watched that one,
- 25:40because you liked that one, they're going to deliver you something in their suggested videos
- 25:45column that is a little bit more extreme and a little bit more extreme. I mean, I remember reading
- 25:50this study about anorexia videos on YouTube. Do you know about that? I think it was on TikTok.
- 25:56So it was actually there was a four corners investigation where this, this younger who she was
- 26:02generally health conscious. And so she started out watching just fitness videos. And then all of
- 26:08a sudden, in a very short period of time, I think it was weeks, she started getting anorexia videos.
- 26:14Like from people who are pro anorexia, who think that it's a, that the medical establishment is
- 26:20taking an unnecessarily negative view of self-starving. Exactly. Yeah. So there is a very quick
- 26:28escalation from that initial interest because of the way these systems are set up. And
- 26:35on the chapter on trolling, you know, there was a point in sort of the early notice where trolling
- 26:41was a bit, you know, just for lulls is the term. So it's, you know, just having a joke at some
- 26:46of these expense. But now, you know, the environment is very radicalizing. So I actually spoke to a guy
- 26:56who was a reform neo Nazi. And he started out as a bit of a troll. And he was reflecting on, there
- 27:04was a grooming process, both formal and informal online where, you know, they were able to test
- 27:14these young men's, usually young men's receptivity to some of these ideas. And so you might start
- 27:19off with a page on, you know, patriotism or just, I love Australia. And then if you keep liking
- 27:26those things, all of a sudden, weeks later, you're in a group with fully fledged neo Nazis. So
- 27:33because of these engagement or costs, sort of algorithms, you know, like an escalation in a
- 27:40radicalization is taking place kind of all around us. And it's because of how these things are
- 27:46designed. This sort of brings us to the chapter after the chapter on conspiracy theorists and
- 27:52anti lockdown freedom fighters, which is social media narcissists. You know, there is something,
- 27:57isn't there about the way that we're using the platform? The, I don't know, I mean, I sometimes
- 28:04think that that one of the aspects of social media that we don't tend to talk about that much,
- 28:10because it's difficult to put your finger on is the ineffable way in which it's sort of corrosive
- 28:17to your experience of being in the present to constantly have another avatar of yourself standing
- 28:25on your shoulder, watching what you're doing and trying to curate your own existence for the benefit
- 28:28of other people to look at. And that does encourage a kind of reflective narcissism. You know, the girl
- 28:39who wants to get skinny and ends up watching anorexia videos. And the guy who just thinks that
- 28:45he's a patriotic Australian and ends up consorting with neo Nazis. In some way, there is a grandiosity
- 28:53to that that seems like it's encouraged by social media.
- 28:58Yeah, there's a huge performative aspect of our Instagram profiles and, you know, our Facebook
- 29:04profiles. And it encouraged that kind of showboding. And, you know, those things aren't you, like
- 29:12in the book I talk about, you know, in the 1600s, Dutch merchants would commission paintings
- 29:19of themselves with, you know, like peacocks and things like that. So in a way, we've been doing it
- 29:24for a very long time. That's what I want to change my Instagram avatar. My profile pictures are just
- 29:31like an Elizabethan painting of me surrounded by peacocks shirtless, obviously.
- 29:36Yeah, obviously. But what's different is the scale at which this is happening. So because
- 29:44those systems are always on because they reach, you know, global audiences, that
- 29:50performativity and the things that result from it, including, you know, the insecurity that
- 29:55results from it, the pressure to feel like what you have to present is constantly perfect,
- 30:00is heightened and starts to become really problematic. And I also call out social media
- 30:08influences. And there, there are a bit of a pet hate of mine. And I differentiate, by the way,
- 30:13between people who just happen to be influential and are on social media and people who primarily
- 30:19identify as influences. So basically people who, you know, pose shirtless and just kind of showbode
- 30:26and don't really have any qualifications other than they may be semi-good-looking and, you know,
- 30:32pose online. And so that social media influence, I think, is a symptom of where that's gone wrong,
- 30:39where, you know, rather than a platform to inspire, it's become commoditized grandiosity,
- 30:47as you say. And it's resulting in all sorts of things like, you know, people wanting facelifts so
- 30:56that they look like they're filtered version of themselves and, you know, just body issues left
- 31:02right in the center. So like with a lot of the other things, it's the scale and the ubiquity of it
- 31:09that becomes problematic. I know a lot of influencers who don't call themselves influences anymore,
- 31:13but call themselves content creators. So there's this middle ground, I suppose, between the
- 31:20fatuous shirtless, like beach picture influencer on the one hand. And at the other hand, on the
- 31:27other end, you have people who are legitimately famous for doing things that have made them
- 31:33justifiably successful and just happen to have a lot of followers. But in between, there's a class
- 31:37of health bloggers, Instagram mommies with tips on parenting, Abby Chatfields and Flex mommies and
- 31:46people who have like, who are producing content that people actually want and might find
- 31:51intellectually stimulating, but never had a platform until these apps came into existence. What do
- 31:57you make of that field? I find that group very, very problematic. So there's two things I want to
- 32:03say on that. Q and on's, which is the mega conspiracy theory that kind of ushered in the world
- 32:11where we are now actually found a really great partner in those influences during the pandemic,
- 32:17because these conspiracies became so amorphous that it started to absorb all these random theories
- 32:24around it. And so the wellness influences in particular are kind of natural science skeptics and
- 32:30natural vaccine skeptics. So they preach wellness and natural therapies and all those things.
- 32:36And so they, during the pandemic, they tended to absorb Q and on or Q adjacent, they call
- 32:43theories without really thinking about where they come from or whether this is scientifically
- 32:48sound. And so, you know, if those people start talking about advice that should really be left
- 32:57to somebody with qualifications like doctors and nurses and that's when it starts to become
- 33:03a huge issue. And, you know, it's that blurring of the personal and the professional
- 33:09and, you know, that blurring of expertise that is a challenge. So they, they're called pastel
- 33:19Q and on. I can't remember. There was a journalist who dubbed that term, but basically that group was,
- 33:26was a huge super spreader of conspiracies. And they gave a really attractive new face to the
- 33:33conspiracies that we're seeing online. So I think that that group is actually one of the groups
- 33:38that really need to be moderated because they are, they do provide content that are
- 33:43this sea as valuable, but there should be a line from benign or passive content, if you like,
- 33:52all to active advice that should really be left to medical professionals with qualifications.
- 34:00Yeah, I'm not crazy about the term pastel Q and on or invoking Q and on because I'm just a
- 34:05allergic to smearing people by association. I think if you don't, if you don't believe that Q
- 34:12is an oracle who is a legitimate source of information, then we probably shouldn't be calling
- 34:17you Q and on or Q and on adjacent, but I take your point that there's a universe of conspiracy theories
- 34:23where I mean, hasn't there been legislation about health advice on social media within the
- 34:30past couple of years in Australia? Yeah, so the latest one was from the TGA, the therapeutic
- 34:35goods administration. I think it was earlier this year where they actually said you, you can't be paid
- 34:42to endorse health products. And so that only came about this year. So before that, we saw problems
- 34:48with people like Pete Evans selling like light therapy things to sell in pseudo-scientific
- 34:56mumbo jumbo. So there's definitely a more attention being paid to that group, but they can still
- 35:04air their rumors about vaccines causing having side effects or something like that. That's right.
- 35:11And what's what's tricky as well is sort of that middle group where they have maybe tens of
- 35:16thousands of followers. I'm not the really big ones because regulators can only really pay attention
- 35:21to the bigger fish, if you like. And so there's this middle group of influences that can still kind
- 35:30of get away with whatever they want. I mean, I'm torn Jordan because when I hear you say stuff like,
- 35:34you know, they can get away with whatever they want and regulators can't catch them. Look,
- 35:40we live in a democracy man. I mean, we live in a society that is supposed to be extremely
- 35:47cautious. Like if you look over the grand sweep of human history in all cultures and political
- 35:53situations throughout most of time, like the greatest threat to human flourishing has not been
- 36:01the fact that some, you know, your neighbor was full of shit. It's been the fact that the church
- 36:06or the government, people in positions of power and authority were enforcing what they regarded
- 36:11as being the correct way of thinking on everybody. So regulators coming in and insisting that
- 36:17only medical professionals, the people who they deemed to be medical professionals who are advised
- 36:22by drug companies are allowed to, you know, control the narrative and that anyone who spouts the
- 36:29incorrect worldview and misspeaks should be banned from the platform or punished or fined or
- 36:35something. Like if it's total bullshit, you're saying 100 percent bullshit, maybe I kind of
- 36:41understand it. But there's a lot of shifting sands in all of this. You know, remember there was a
- 36:47time, there was a long period of time when we were being encouraged not to wear masks at the beginning
- 36:51of the pandemic by the official health authorities. And I knew doctors who were saying I'm wearing a
- 36:55mask in the shopping center because I'm assuming that a respiratory illness is airborne. And we
- 37:01will encourage not to. It turned out the reason that it was too is because they wanted extra masks
- 37:05for frontline, you know, for people in hospitals and so on. So what room is there for the
- 37:11boisterous, you know, town hall of ideas where people are allowed to be rolled?
- 37:16Yeah. And we definitely want to be careful about where that balance is at. And, you know,
- 37:23we definitely don't want to discourage dissenting voices and diverse ideas because that's very
- 37:29important for our information ecosystem. But I think what's different in our current environment
- 37:37is that the balance between recognized official and credible information, if you like,
- 37:47can be drowned out by the opposite. And so there's a huge world, there's a huge gray area in
- 37:54between that. But overall, we, you know, we should want that most of the information that we consume
- 38:01is from official sources that we trust in and that's credible. And again, we don't live in a perfect
- 38:09society, but as a group for us to function, we need to trust in the institutions that we've built.
- 38:16We need to trust that the government will generally, particularly in a democratic government,
- 38:21will generally do right by us. And so if that trust is corroded away, then it's kind of just chaos
- 38:28and it becomes a bit of a free for all. And so I think the point I want to make is that these
- 38:35platforms have started to corrode that trust in those institutions. So it's less about my
- 38:42neighbor who's full of shit and they're right to say that it's more about at scale. There's
- 38:47something happening that is, you know, decreasing our trust in institutions and it's facilitated
- 38:55through this digital platform. Right. And it's not just my neighbor who's full of shit anymore. It's
- 38:59that my neighbor, I suppose, is a part of a tidal wave of some kind of viral meme about, for
- 39:06example, vaccines where it's wrong to sort of think of it as a problem with my neighbor talking
- 39:11shit because everyone in the town, there's a mob stampede towards some piece of misinformation
- 39:16that's gaining virally precisely because of the algorithms, exactly towards what we like to
- 39:23click on. Exactly. And in the physical world, there would be circuit breakers to that neighbor.
- 39:29You know, nobody would really listen to them. But online, that neighbor can connect with all the
- 39:35other neighbors from all around the world together and make it feel like there's a movement behind
- 39:42it. So those social and physical and real circuit breakers that we employ in the real world don't
- 39:47exist online. Right. I mean, I do think part of the problem of the corrosion of trust is not just
- 39:52that we now have social media as an alternative, but that the institutions have hardly covered
- 39:57themselves in glory in the past few decades either. Like, there is a problem, there's a problem
- 40:03of group thinking journalism, I think. There's a problem of aloofness in government and bad
- 40:09communication from bureaucracy. There's a problem of rigidity and a lack of openness to other ideas
- 40:17in the medical establishment. You know, these are also reasons that leave people primed to be
- 40:24susceptible to the bullshit that's online. Yeah, absolutely. And I am not at all excusing
- 40:31you know, current institutions and particularly if, if you know, they're part of the problem of
- 40:36that corrosion of trust. I think though what's happening is that that balance has been recast.
- 40:46And so again, that point I made earlier about even though the media ecosystem has issues,
- 40:54we, you know, there are lots of rules to try and correct that imbalance. And you know, it's obvious
- 41:02when people abuse that. Whereas online, we just don't have that same facility to course correct
- 41:10because it's a complete free role. What would the course creation look like?
- 41:15I think there's a number of things. So the book looks at two types of recommendations for each chapter.
- 41:23What we can do as individuals is one and then what we can do as a group. So, you know, as governments,
- 41:29as institutions, as civic society. And for the most part, I definitely think it has to happen
- 41:36in at the group level because it shouldn't be up to us as individuals to try and navigate all
- 41:41these issues. However, I included the first part because I wanted people to feel like they had
- 41:47some sort of agency over the situation. If your loved one is a conspiracy theorist, are you going
- 41:53to wait until the next version of the online CFD Act is enacted and the regulators get the act
- 41:59together and try and sort something out? Of course not. So I think there's individual actions that
- 42:05we can take and group actions we can take as well. There's a lot to do and there is no perfect
- 42:12answer, but, you know, I tend to focus on the role of technology because I do think that the
- 42:20digital platforms are what sort of escalated a lot of these issues. And so if we start from that
- 42:26place where we look at how we rebalance the power, a symmetry between digital platforms and
- 42:34everything else, how we regulate their ability to spread information that isn't correct, how we
- 42:43basically make sure that they admit their culpability for the online harms that they produce
- 42:51and do something about it, we can start to shift that balance. So one radical, very radical idea
- 42:59in the book was, you know, what if we charge digital platforms for the harms that they call.
- 43:06So for example, if an oil company, you know, has a massive oil spill, you know, we'd want them
- 43:11to clean that up, right? But for these digital platforms, we sort of just go, you know, you can
- 43:17just carry on doing what you're doing. And so what the book tries to do is highlight the fact that
- 43:23these harms are real. They're all around us and they're people that we know and care about that are
- 43:31being hurt by these platforms. And so they really need to take responsibility for it.
- 43:38What's the oil spill in the analogy? I guess all the, you know, the characters that I've spoken
- 43:48about could be, you know, all the poor, you know, like birds covered in oil. It's the freedom
- 43:55fighter that, you know, because their lives blew up during the pandemic, they were looking for
- 44:00answers. And so YouTube fed them all these conspiracy theories to the point that they became
- 44:04anti-vexes. Or it's, you know, the the troll who is a little bit of an angry nerd gamer who found
- 44:13neonaties, you know, it's the screen addict who, you know, ignores life because they're addicted
- 44:21to the screen. So all the personas could be like little oil spills sort of happening everywhere.
- 44:27And there's just a lot of them and it's creeping and growing. I mean, it's tricky, isn't it,
- 44:32because with an oil spill, you've got the tanker with the name of the company emblazoned on it. And
- 44:37there's no upside to an oil spill, whereas you can imagine the tech companies saying it's less
- 44:43like an oil spill. And it maybe it's a bit more like, I don't know, a car manufacturer where,
- 44:48you know, some people are going to drive really fast and they're going to crash their cars and kill
- 44:51people or, you know, or a, I don't know, a lolly manufacturer or a chocolate, a chocolate year,
- 44:58whereas some people are going to just eat way too much and their lives are going to be
- 45:01deranged by their addiction to chocolate. But the vast majority of people are using these things
- 45:05in healthy ways and they're not becoming neonaties and they're not becoming trolls and so on.
- 45:10A, what do you say to that? And B, is there a sense in which a lot of this is closing a lot of
- 45:16barn doors after the horse has, has bolted? I mean, this, I'm, I keep coming back to what you
- 45:21said earlier, engagement at all costs. If you could change the profit, if you could change the way
- 45:27they make money, if you could say, like, I don't know, you know, I'll have to make money from ad revenue
- 45:32anymore. You have to charge users of fee and you can't, you can't use how long they're spending on
- 45:37the site as a way of determining what you deliver them. Wouldn't all of this just evaporate in the
- 45:43sense that they might as well just go back to a reverse chronological feed without having the
- 45:47algorithms that encourage engagement in the first place. Yeah, you wouldn't have to go around
- 45:52mopping up all of these negative externalities from their behavior. I, I do like the, the, the
- 45:58car analogy. So, you know, we, we give out licenses so people know how to drive properly. We mandate
- 46:05seat belts so people are protected and we have speed limits and road rules. I think that's a really
- 46:10useful one to think about digital platforms. If we have, if we build these protections in place,
- 46:16then people are for the most part able to navigate them safely. The other one is kind of pharmaceuticals
- 46:23where, you know, we, there's a lot of regulation around what's helpful, what's healthy and what's not.
- 46:29So, I think that system level thinking is exactly what we need to do is like, how do we make sure
- 46:35that we can operate these platforms as safely and as competitively and as democratically as possible.
- 46:44And to your point about the business model, I think there's a really important one.
- 46:50And so, one of the people I interviewed was this great technologist, her name is Michaela. And she
- 46:57has been, you know, tinkering with the web for since the very, very early days. And she remarked
- 47:03upon when it switched from the purely researched based not-for-profit model of the internet to
- 47:12the commoditized version that we see now, that was a really huge leap. So, I think there's a lot
- 47:17to be said about the business models of the big platforms and what to do. You know, we don't, I mean,
- 47:25I've worked for media organizations before and I see the value of advertising. So, I'm not gonna
- 47:32sort of wholesale say we changed that overnight. But, you know, the more extreme ends of that feature,
- 47:41for example, we can regulate. So, for example, micro targeting. So, you know, do we really need to
- 47:46know, you know, how often you go to the gym versus you happen to like going to the gym? You know,
- 47:53you know, it's like what part of our data and our behavior is safe to include versus, you know,
- 48:02like all the sort of hidden parts of it that really shouldn't be targeted and capitalized on.
- 48:10I mean, I just think if you start going around saying you're allowed to look at this, but you're
- 48:13not allowed to look at that. You're allowed to look at whether I like gyms, but you're not allowed
- 48:16to look at how many times I go to the gym, then it's just gonna become an endless game of whack-a-mall
- 48:21where regulators are just wasting a huge amount of time on a subject that they will never understand
- 48:27as well as the software engineers understand it and they will always get around it a little bit
- 48:31like finance like Wall Street's always gonna get around regulations because they understand the
- 48:36system better than any regulator does. And so, you have to sort of reform the underlying incentives
- 48:42so that the companies just no longer have an interest in doing it, but I don't know what that looks
- 48:46like other than as I say having a monthly subscription where the user pays and that's the way that
- 48:50they get their revenue. But I don't even know how you structure that. Yeah, like different models
- 48:54will certainly help. And you know, the other idea is should we build alternative types of digital
- 49:01platforms? And so one of the projects we had was called the Public Square Project where, you know,
- 49:08rather than relying on Facebook and YouTube, et cetera, for our everyday communications, could
- 49:14we have a digital platform that it doesn't have a profit imperative? So, you know, when we're talking
- 49:21about the more civic side of our information ecosystem, it's not subject to that same level of
- 49:27commercially. And we have broadcasters like the ABC who are for that, but more and more,
- 49:34the digital platforms and social media sort of usurping a lot of those functions. And so it should
- 49:40be built online versions of that, but that are not actually privately owned. So like, what might a
- 49:48public Facebook look like, for example? Interesting. What do you think of Elon buying Twitter?
- 49:57I think it's quite problematic. And I mean, the thing about Elon is he's just so volatile.
- 50:07And so, you know, I'm loath to predict what will actually happen, but, you know, Twitter has become
- 50:13really important for our information ecosystem. It has a lot of faults. I actually wrote a piece
- 50:19a couple of weeks ago kind of saying, maybe it's for the best because we've gotten so
- 50:24reliant on Twitter for our daily news and information, even though it's not actually that great.
- 50:32You know, it's like Twitter facilitates this kind of hostile back and forth. It facilitates
- 50:38snarkiness. You know, it's pretty hard to have a new ones conversation in tweet form in general.
- 50:44And so maybe it'll force us to look at an environment that's a little bit healthier than that.
- 50:50But in general, I'm obviously not a fan of billionaires buying public square platforms because they
- 50:59want that power and influence. I think it's very problematic.
- 51:04You end the book with a chapter about the naive futurists. I guess you were talking about the very
- 51:10beginning of the podcast as well. If you cast, if you put on your prognosticators hat and think
- 51:16about the future, when my preschool age children are middle aged, what will the internet look
- 51:26like? I mean, it even sounds silly to say the internet. Of course, there's not going to be an
- 51:30internet. It's just everything will be networked. Yeah. I think what it looks, what it could look like
- 51:36is being decided today. I actually think we're in a really important and quite scary milestone
- 51:43about that tech future. And so if we allow the current tech barons to define what that future
- 51:51looks like, I think we're going to get more of the same times 10 of the harms because the
- 51:57incentives will be the same. The harms will be magnified. The inequality will be more stark,
- 52:05which is in the chapter, you know, I sort of call out that we should really, you know, be worried
- 52:12when the medicine staked a claim on the metaverse. And you know, Jack Dorsey has staked a claim on
- 52:18cryptocurrency and Google has staked a claim on hyper advanced AI. So, you know, it's like where,
- 52:25what is what will it mean for every day person to be in that world where it's controlled by just a
- 52:32small handful of people? I think we need to make sure that that power imbalance and the harms that
- 52:39highlighted in the book are addressed now so that those future versions, whatever it looks like,
- 52:45doesn't carry over the problems that we're seeing today. The book is disconnect while we get pushed
- 52:52to extremes online and how to stop it. Jordan, thanks so much for being here. Thank you very much for
- 53:01uncomfortable conversations is produced by Stefan Postumer. Follow me, Josh Zeps on Twitter and
- 53:06Instagram for all the latest, may your day be fruitful, your mind humble, your enemies generous
- 53:13and your conversations perfectly, sparklingly, delectably, uncomfortable.