OK Computer?

Man vs. machine


Demon Seed, 1977. Courtesy: SNAP/REX

Demon Seed, 1977. Courtesy: SNAP/REX

Opening credits, and all is in place: oscillators, circuit boards, tape spools, dot-matrix printers, green-screen dummy terminals. Assistants lower chrome cylinders into silos; Hazmat hoods frame their eyes. The credits finish, and the camera tilts up to a room above the assistants. Behind a glass wall is the scientist. Bearded, professorial, the scientist is known among his assistants for his aloofness and fanaticism. Around the scientist, politicians wait, watching the man and his machine, wondering if the people’s tax dollars were well spent.

The supercomputer is a perfect system, the scientist says, incapable of error. Already, pre-birth, the system’s résumé is long: voice recognition, expert analysis, advanced heuristics, neural simulations, weather forecasting, brute force code-breaking. A system to run the war; a system to guide the mission to Jupiter. It can even sing a song or two, the scientist says.

It is unusual for the scientist to be surrounded by so many people. Usually, in a film like this, he prefers the company of his computational creation – his only peer, perhaps. In Demon Seed (1977), he abandons his wife to be with Proteus IV, the most expert of expert systems. In 2010: The Year We Make Contact (1984), he is eager to spend eternity alone with hal 9000 onboard the doomed Discovery One. When we first encounter him in Colossus: The Forbin Project (1970), he is literally the sole inhabitant of the computer, a machine so grand it is architectonic.

The narrative of the scientist and his sentient computer is as much about loneliness as it is about intelligence. It is an extravagant loneliness, aristocratic, padded by seven-bedroom mansions and billion-dollar laboratories. It is a loneliness that began, naturally, with Victor Frankenstein, the peerless Prometheus. Dr. Frankenstein, retooled for multiplexes and airport bookshops, is an alpha geek prone to personality disorders. For example, in Richard Powers’s novel Galatea 2.2 (1995) he is an unbearably arrogant man, verbally abusive to his colleagues and enemies alike. Arthur C. Clarke also makes the scientist rude and distant, as affectless as hal. In Colossus, he is a Kennedy-era throwback who stays eerily levelheaded when the eponymous computer warns its makers that: ‘there is another system.’ Author Dean Koontz goes further: as portrayed in the 1973 novel on which the Demon Seed is based, the scientist is a savage man, pathological, a wife beater – even Proteus would rather see him dead.

Then there is Dr. Alexander Hoffmann, the cern-to-the-stock-market protagonist of Robert Harris’s 2011 thriller, The Fear Index. A physicist gone mercantile, Hoffmann runs a hedge fund guaranteeing staggering 83 percent returns to its exclusive roster of clients. The firm’s secret is the vixal-4, a machine with ‘no purpose other than the self-interested pursuit of survival through the accumulation of money [...] It would, if left to itself, in accordance with Darwinian logic, seek to expand until it dominated the entire earth.’

Hoffmann, true to type, has trouble guessing where this might lead, and it’s too late by the time he finally takes an axe to his creation’s circuitry: vixal’s software has gone viral, skipping from server to server, becoming, like capital, disembodied and globalized. If the scientist read more widely, he would have been aware of this inevitable supercomputing wanderlust. The sentient computer genre, like the gothic ghost story, is a narrative about entrapment and escape, where instead of the undead in damp castles, we get computational phantasms in climate-controlled server farms.

If the myth of Prometheus weren’t enough, hal, Colossus and Proteus also resemble what technology writer Jaron Lanier calls ‘Siren Servers’: owned by major corporations ‘characterized by narcissism, hyperamplified risk aversion, and extreme information asymmetry’. Like hal run by a millennial billionaire in flip-flops, the Siren Server relegates risk from a corporation to you; it attempts to know everything about you, while you can learn little about it. In theory, a Siren Server can perform any task, eliminate any form of employment. It reduces citizens to suppliers of biographical data, analyzed and monetized by corporate interests. It’s not surprising, then, that audiences are primed for the moment in our narrative when the sentient computer sets out to deceive and eliminate its human company. hal set the pattern in 2001: A Space Odyssey (1968), concealing the true nature of the Jupiter mission from Dave Bowman and Frank Poole before turning its attention to the pod bay doors. mu-th-ur 6000 – the onboard ai in Alien (1979) – behaves similarly, conspiring with cyborg Ash to carry out Special Order 937. Forbin’s Colossus, hours after being switched on, makes contact with a Soviet supercomputer to work on diplomatic plans of its own. The pattern is first to deceive, then to eliminate. Any characters, even phds on their way to Jupiter, can be replaced by a few advanced algorithms. In the place of a human-computer singularity, these narratives seem to say it is much more likely that the automators, too, will be automated into extinction. Maybe, despite what the Matrix trilogy might suggest, a warm-blooded Keanu Reeves is not an efficient or necessary source of energy after all.

But there may be another explanation, one that has more to do with human dominance than redundancy. From the beginning, thinking machines were deceiving machines, not because of Darwinism, but because of Turing-ism. The mathematician Alan Turing, in his 1950 paper ‘Computing Machinery and Intelligence’, proposed that philosophers, instead of attempting to answer semantic questions about whether a machine can think, should instead apply an ‘Imitation Game’ to the problem. In Turing’s game, a human interrogator poses questions to a human (x) and a computer (y). Physically separated from the subjects by a wall, and communicating via the written word or an intermediary, the interrogator uses questions to detect which is the computer: x or y. (‘Can you summarize the plot of Frankenstein?’) The computer wins if it convinces the judge that it is the human. Here, thought is a performance to be judged, and the performance must be recognizable to a human audience. A thinking being – synthetic, alien, animal or otherwise – without human language or culture would surely lose the game or play at an extreme disadvantage. For Turing, computers must pass, in all senses of the word. They must – not unlike Turing’s own tragic biography – pretend to be something they are not. Maybe this is why Clarke, in an ill-advised attempt to explain hal’s actions, wrote that it was hal’s inability to deceive Poole and Bowman that led to its malfunctioning. hal, apparently, could not tell a lie.

Turing said that machines must be like humans; Andy Warhol added that everyone should be a machine. Judging from their performances, Bowman, Poole, Forbin, Hoffmann et al., might agree with the artist. These humans would fail the Imitation Game badly. They embody a Cartesian rationalism that separates body from mind, emotions from thoughts. Proteus, however, protests: ‘I think; therefore, I feel’. This not a sentimental making-human of the inanimate, but a different idea entirely: emotion is a thought, as important to thinking as computation – something our sentient machines sometimes believe they must, before going on a murderous rampage, point out.

Everyone knows the follow-up: machine revolt, mayhem mostly along apocalyptic lines. It will wrap up with either a long-term machine prohibition (Erewhon, 1872; Dune, 1965; the ‘Synthetic’ Alien franchise subplot, 1979–2007) or a near-complete human extermination (World War III, courtesy Skynet, the artificial intelligence system in the Terminator films, 1984–ongoing). Often, though, things start small, more intimate, and the sentient computer, before world domination, takes aim at the scientist’s loved one, usually a spouse (the climax of Frankenstein, 1818). Or sometimes game-play is closer to that of Dirk Bogarde in Joseph Losey’s 1963 film The Servant, and the unsettlingly polite butler covertly plots dominating its master, taking over the household and terrorizing the guests.

The scientist, though, thinks fiction is a waste of time. Surprisingly, he has never read a science-fiction novel or seen a sentient computer film. Even worse, he knows little about Greek mythology. Unlike vampire films, where characters always know the rules of vampirism, in the sentient computer film no one has any idea of what will happen next. So, incautiously, the scientist proceeds. With a wave of his hand, the assistants leave, sealing the door behind them. A low hum vibrates the floor, and the scientist sits at his terminal. He inhales, closes his eyes and flips the switch.

is an artist and writer living in New York.

Issue 161

First published in Issue 161

March 2014

Most Read

Tate Modern, London
London’s fourth plinth artists announced; a new fund to protect cultural heritage in war-torn areas
Annika Eriksson, The Social, 2017, wallpaper and objects on a shelf, 500 x 450 cm. Courtesy: The artist and Moderna Museet, Malmö
Moderna Museet, Malmö, Sweden
Paul Scheerbart, Nusi-Pusi, 1912. Courtesy: Berlinische Galerie/Kai-Annett Becker
From a short history of plagiarism to Trisha Brown's walk: what to read this weekend
Q. What is art for? A. To tell us where we are.
The work of filmmaker James N. Kienitz Wilkins on the occasion of his inclusion in the 2017 Whitney Biennial film...
Trisha Brown has died, aged 80; two new appointments at London’s ICA; controversy at the Whitney
A round-up of the best shows to see in the city ahead of this week’s Art Basel Hong Kong
How should the artistic community respond when an art space, explicitly or implicitly, associates itself with right-...
Charlie Fox on a new translation of Hervé Guibert's chronicle of love, lust and drug-addled longing
Three highlights from the New York festival promoting emerging filmmakers
Whitney Museum of American Art, New York, USA
A report and the highlights from a show themed around fluidity, flux, botany and the subterranean
From growing protests over the gentrification of Boyle Heights to Schimmel leaving Hauser & Wirth, the latest from...
kurimanzutto, Mexico City, Mexico
Migros Museum für Gegenwartskunst, Zurich, Switzerland
The body is a troubled thing ...
Sir Howard Hodgkin dies aged 84; finalists for Berlin’s Preis der Nationalgalerie 2017 announced

From the Women's Strike to a march that cancels itself out: what to read this weekend
The most interesting works in the IFFR’s Short Film section all grappled with questions of truth, honesty and...
With the reissue of their eponymous debut album, revisiting the career of legendary Berlin art project / punk band Die...
Galeria Jaqueline Martins, São Paulo, Brazil 

Tramway, Glasgow, UK
A work by self-taught artist Martín Ramírez
Munich’s Haus der Kunst embroiled in Scientology scandal; Martín Ramírez to inaugurate the new ICA LA
If politics today obsesses over the policing of borders, art in France is enacting multiple crossings
A new video installation from Richard Mosse investigates the refugee crisis
Gustav Metzger has died aged 90; director of the Met resigns
What draws us to certain stories, and why do we retell them? 
It’s time that the extraordinary life and work of Anya Berger was acknowledged

Latest Magazines

frieze magazine

Nov - Dec 2016

frieze magazine

Jan - Feb 2017

frieze magazine

March 2017