💾 Archived View for schinkel.bevuta.com › rants › tech-and-power.txt captured on 2023-11-04 at 11:40:25.
-=-=-=-=-=-=-
RANT - by Maciej Cegłowski (taken from "Our Comrade The Electron" http://idlewords.com/talks/our_comrade_the_electron.htm) Technology concentrates power. In the 90's, it looked like the Internet might be an exception, that it could be a decentralizing, democratizing force. No one controlled it, no one designed it, it was just kind of assembling itself in an appealing, anarchic way. The companies that first tried to centralize the Internet, like AOL and Microsoft, failed risibly. And open source looked ready to slay any dragon. But those days are gone. We've centralized the bejesus out of the Internet now. There's one search engine (plus the one no one uses), one social network (plus the one no one uses), one Twitter. We use one ad network, one analytics suite. Anywhere you look online, one or two giant American companies utterly dominate the field. And there's the cloud. What a brilliant name! The cloud is the future of online computing, a friendly, fluffy abstraction that we will all ascend into, swaddled in light. But really the cloud is just a large mess of servers somewhere, the property of one American company (plus the clouds no one uses). Orwell imagined a world with a telescreen in every room, always on, always connected, always monitored. An Xbox One vision of dystopia. But we've done him one better. Nearly everyone here carries in their pocket a tracking device that knows where you are, who you talk to, what you look at, all these intimate details of your life, and sedulously reports them to private servers where the data is stored in perpetuity. I know I sound like a conspiracy nut framing it like this. I'm not saying we live in an Orwellian nightmare. I love New Zealand! But we have the technology. When I was in grade school, they used to scare us with something called the permanent record. If you threw a spitball at your friend, it would go in your permanent record, and prevent you getting a good job, or marrying well, until eventually you'd die young and friendless and be buried outside the churchyard wall. What a relief when we found out that the permanent record was a fiction. Except now we've gone and implemented the damned thing. Each of us leaves an indelible, comet-like trail across the Internet that cannot be erased and that we're not even allowed to see. The things we really care about seem to disappear from the Internet immediately, but post a stupid YouTube comment (now linked to your real identity) and it will live forever. And we have to track all this stuff, because the economic basis of today's web is advertising, or the promise of future advertising. The only way we can convince investors to keep the money flowing is by keeping the most detailed records possible, tied to people's real identities. Apart from a few corners of anonymity, which not by accident are the most culturally vibrant parts of the Internet, everything is tracked and has to be tracked or the edifice collapses. What upsets me isn't that we created this centralized version of the Internet based on permanent surveillance. What upsets me, what really gets my goat, is that we did it because it was the easiest thing to do. There was no design, forethought, or analysis involved. No one said "hey, this sounds like a great world to live in, let's make it". It happened because we couldn't be bothered. Making things ephemeral is hard. Making things distributed is hard. Making things anonymous is hard. Coming up with a sane business model is really hard—I get tired just thinking about it. So let's take people's data, throw it on a server, link it to their Facebook profiles, keep it forever, and if we can't raise another round of venture funding we'll just slap Google ads on the thing. "High five, Chad!" "High five, bro!" That is the design process that went into building the Internet of 2014. And of course now we are shocked—shocked!—when, for example, the Ukrainian government uses cell tower data to send scary text messages to protesters in Kiev, in order to try to keep them off the streets. Bad people are using the global surveillance system we built to do something mean! Holy crap! Who could have imagined this? Or when we learn that the American government is reading the email that you send unencrypted to the ad-supported mail service in another country where it gets archived forever. Inconceivable! I'm not saying these abuses aren't serious. But they're the opposite of surprising. People will always abuse power. That's not a new insight. There are cuneiform tablets complaining about it. Yet here we are in 2014, startled because unscrupulous people have started to use the powerful tools we created for them. We put so much care into making the Internet resilient to technical failures, but make no effort to make it resilient to political failure. We treat freedom and the rule of law like inexhaustible natural resources, rather than the fragile and precious treasures that they are. And now, of course, it's time to make the Internet of Things, where we will connect everything to everything else, and build cool apps on top, and nothing can possibly go wrong. Not long ago before I flew here, Google announced it was acquiring Nest, a luxury thermostat maker. I never thought I would use those two words together. Nest has sensors that detect who is in a room and when, so naturally there was concern that Google would now learn all this extra information about you, and know how hot your house is. Google quickly deployed the Nest CEO, who promised that there would be safeguards and a privacy policy, and all kinds of limits to make sure everything stayed kosher. And I have no reason to disbelieve the guy. But I shouldn't need his word, or Google's corporate motto, or Magna Carta, or the Treaty of Waitangi to protect me from my thermostat. My old thermostat wasn't that scary! It was too dumb to snitch. And no one could hear it scream. This new thermostat, on the other hand, has lawyers, PR people, a privacy policy, it's off writing blog posts somewhere, possibly eating my leftover pizza. It more like a sketchy roommate than a thermostat. Let me make it clear what I'm worried about here. I'm not afraid of my appliances. I'm not afraid that Google is going to send me to the Googlag to mine bitcoins. Nor am I afraid of a Greater New Zealand, grown drunk with electronic surveillance, aggressively expanding to control the Pacific Rim. That might be a nice change! If it happens, I will be waiting on the docks of San Francisco, bearing a basket of avocados, ready to welcome our Kiwi overlords. What I'm afraid of is the society we already live in. Where people like you and me, if we stay inside the lines, can enjoy lives of comfort and relative ease, but God help anyone who is declared out of bounds. Those people will feel the full might of the high-tech modern state. Consider your neighbors across the Tasman, stewards of an empty continent, who have set up internment camps in the remotest parts of the Pacific for fear that a few thousand indigent people might come in on boats, take low-wage jobs, and thereby destroy their society. Or the country I live in, where we have a bipartisan consensus that the only way to preserve our freedom is to fly remote controlled planes that occasionally drop bombs on children. It's straight out of Dostoevski. Except Dostoevski needed a doorstop of a book to grapple with the question: “Is it ever acceptable for innocents to suffer for the greater good?” And the Americans, a more practical people, have answered that in two words: “Of course!” Erika Hall in her talk yesterday wondered what Mao or Stalin could have done with the resources of the modern Internet. It's a good question. If you look at the history of the KGB or Stasi, they consumed enormous resources just maintaining and cross-referencing their mountains of paperwork. There's a throwaway line in Huxley's Brave New World where he mentions "800 cubic meters of card catalogs" in the eugenic baby factory. Imagine what Stalin could have done with a decent MySQL server. We haven't seen yet what a truly bad government is capable of doing with modern information technology. What the good ones get up to is terrifying enough. I'm not saying we can't have the fun next-generation Internet, where everyone wears stupid goggles and has profound conversations with their refrigerator. I'm just saying we can't slap it together like we've been doing so far and expect everything to work itself out. The good news is, it's a design problem! You're all designers here - we can make it fun! We can build an Internet that's distributed, resilient, irritating to governments everywhere, and free in the best sense of the word, like we dreamed of in the 90's. But it will take effort and determination. It will mean scrapping permanent mass surveillance as a business model, which is going to hurt. It will mean pushing laws through a sclerotic legal system. There will have to be some nagging. But if we don't design this Internet, if we just continue to build it out, then eventually it will attract some remarkable, visionary people. And we're not going to like them, and it's not going to matter.