I feel scared. Very scared.
Internet-wide surveillance and censorship, enabled by the unimaginably vast computational power of artificial intelligence (AI), is here.
This is not a futuristic dystopia. It’s happening now.
Government agencies are working with universities and nonprofits to use AI tools to surveil and censor content on the internet.
This is not political or partisan. This is not about any particular opinion or idea.
What’s happening is that a tool powerful enough to surveil everything that’s said and done on the internet (or large portions of it) is becoming available to the government to monitor all of us, all the time. And, based on that monitoring, the government—and any organization or company the government partners with—can then use the same tool to suppress, silence, and shut down whatever speech it doesn’t like.
But that’s not all. Using the same tool, the government and its public-private, “nongovernmental” partners (think, for example: the World Health Organization or Monsanto) can also shut down any activity that is linked to the internet. Banking, buying, selling, teaching, learning, entertaining, connecting to each other—if the government-controlled AI does not like what you (or your kids!) say in a tweet or an email, it can shut down all of that for you.
New Documents Show Government-Funded AI Intended for Online Censorship
The U.S. House Select Subcommittee on the Weaponization of the Federal Government was formed in January 2023 “to investigate matters related to the collection, analysis, dissemination, and use of information on U.S. citizens by executive branch agencies, including whether such efforts are illegal, unconstitutional, or otherwise unethical.”Unfortunately, the work of the committee is viewed, even by its own members, as largely political: Conservative lawmakers are investigating what they perceive to be the silencing of conservative voices by liberal-leaning government agencies.
Nevertheless, in its investigations, this committee has uncovered some astonishing documents related to government attempts to censor the speech of American citizens.
These documents have crucial and terrifying all-of-society implications.
Specifically, the University of Michigan is explaining to the National Science Foundation that the AI-powered tools funded by the foundation can be used to help social media platforms perform censorship activities without having to actually make the decisions on what should be censored.
Here’s how the relationship is visualized in the subcommittee’s report:
Here’s a specific quote presented in the subcommittee’s report. It comes from “Speaker’s notes from the University of Michigan’s first pitch to the National Science Foundation (NSF) about its NSF-funded, AI-powered WiseDex tool.” The notes are on file with the committee.
“Our misinformation service helps policy makers at platforms who want to ... push responsibility for difficult judgments to someone outside the company ... by externalizing the difficult responsibility of censorship,” the report reads.
This is an extraordinary statement on so many levels:
What Happens When AI Censorship Is Fully Implemented?
Knowing that the government is already paying for AI censorship tools, we have to wrap our minds around what this entails.No Manpower Limits
As the subcommittee report points out, the limits to government online censorship have, up to now, involved the large numbers of humans required to go through endless files and make censorship decisions. With AI, barely any humans need to be involved, and the amount of data that can be surveilled can be as vast as everything anyone says on a particular platform. That amount of data is incomprehensible to an individual human brain.No One Is Responsible
One of the most frightening aspects of AI censorship is that when AI does it, there is no human being or organization—be it the government, the platforms, or the universities/nonprofits—who is actually responsible for the censorship. Initially, humans feed the AI tool instructions for what categories or types of language to censor, but then the machine goes ahead and makes the case-by-case decisions all by itself.No Recourse for Grievances
Once AI is unleashed with a set of censorship instructions, it will sweep up gazillions of online data points and apply censorship actions. If you want to contest an AI censorship action, you will have to talk to the machine. Maybe the platforms will employ humans to respond to appeals. But why would they do that, when they have AI that can automate those responses?No Protection for Young People
One of the claims made by government censors is that we need to protect our children from harmful online information, such as content that makes them anorexic, encourages them to commit suicide, turns them into ISIS terrorists, and so on. Also from sexual exploitation. These are all serious issues that deserve attention. But they are not nearly as dangerous to vast numbers of young people as AI censorship is.The danger posed by AI censorship applies to all young people who spend a lot of time online, because it means that their online activities and language can be monitored and used against them—maybe not now but whenever the government decides to go after a particular type of language or behavior. This is a much greater danger to a much greater number of children than the danger posed by any specific content because it encompasses all the activity they conduct online, touching on nearly every aspect of their lives.
Here’s an example to illustrate this danger: Let’s say your teenager plays lots of interactive video games online. Let’s say he happens to favor games designed by Chinese companies. Maybe he also watches others play those games and participates in chats and discussion groups about those games, in which a lot of Chinese nationals also participate.
The government may decide next month or next year that anyone heavily engaged in Chinese-designed video games is a danger to democracy. This might result in shutting down your son’s social media accounts or denying him access to financial tools, such as college loans. It might also involve flagging him on employment or dating websites as dangerous or undesirable. It might mean that he is denied a passport or put on a watchlist.
Monetizable Censorship Services
An AI tool owned by the government can theoretically be used by a nongovernmental entity with the government’s permission and with the blessing of the platforms that want to “externalize” the “responsibility” for censorship. So while the government might be using AI to monitor and suppress, let’s say as an example, anti-war sentiment, a company could use it to monitor and suppress, let’s say as an example, anti-fast food sentiment. The government could make a lot of money selling the services of the AI tools to third parties. The platforms could also conceivably ask for a cut. Thus, AI censorship tools can potentially benefit the government, tech platforms, and private corporations. The incentives are so powerful, it’s almost impossible to imagine that they will not be exploited.Can We Reverse Course?
I do not know how many government agencies and how many platforms are using AI censorship tools. I do not know how quickly they can scale up.I do not know what tools we have at our disposal—other than raising awareness and trying to lobby politicians and file lawsuits to prevent government censorship and regulate the use of AI tools on the internet.
If anyone has any other ideas, now would be the time to implement them.
