OK Computer?

Man vs. machine


Demon Seed, 1977. Courtesy: SNAP/REX

Demon Seed, 1977. Courtesy: SNAP/REX

Opening credits, and all is in place: oscillators, circuit boards, tape spools, dot-matrix printers, green-screen dummy terminals. Assistants lower chrome cylinders into silos; Hazmat hoods frame their eyes. The credits finish, and the camera tilts up to a room above the assistants. Behind a glass wall is the scientist. Bearded, professorial, the scientist is known among his assistants for his aloofness and fanaticism. Around the scientist, politicians wait, watching the man and his machine, wondering if the people’s tax dollars were well spent.

The supercomputer is a perfect system, the scientist says, incapable of error. Already, pre-birth, the system’s résumé is long: voice recognition, expert analysis, advanced heuristics, neural simulations, weather forecasting, brute force code-breaking. A system to run the war; a system to guide the mission to Jupiter. It can even sing a song or two, the scientist says.

It is unusual for the scientist to be surrounded by so many people. Usually, in a film like this, he prefers the company of his computational creation – his only peer, perhaps. In Demon Seed (1977), he abandons his wife to be with Proteus IV, the most expert of expert systems. In 2010: The Year We Make Contact (1984), he is eager to spend eternity alone with hal 9000 onboard the doomed Discovery One. When we first encounter him in Colossus: The Forbin Project (1970), he is literally the sole inhabitant of the computer, a machine so grand it is architectonic.

The narrative of the scientist and his sentient computer is as much about loneliness as it is about intelligence. It is an extravagant loneliness, aristocratic, padded by seven-bedroom mansions and billion-dollar laboratories. It is a loneliness that began, naturally, with Victor Frankenstein, the peerless Prometheus. Dr. Frankenstein, retooled for multiplexes and airport bookshops, is an alpha geek prone to personality disorders. For example, in Richard Powers’s novel Galatea 2.2 (1995) he is an unbearably arrogant man, verbally abusive to his colleagues and enemies alike. Arthur C. Clarke also makes the scientist rude and distant, as affectless as hal. In Colossus, he is a Kennedy-era throwback who stays eerily levelheaded when the eponymous computer warns its makers that: ‘there is another system.’ Author Dean Koontz goes further: as portrayed in the 1973 novel on which the Demon Seed is based, the scientist is a savage man, pathological, a wife beater – even Proteus would rather see him dead.

Then there is Dr. Alexander Hoffmann, the cern-to-the-stock-market protagonist of Robert Harris’s 2011 thriller, The Fear Index. A physicist gone mercantile, Hoffmann runs a hedge fund guaranteeing staggering 83 percent returns to its exclusive roster of clients. The firm’s secret is the vixal-4, a machine with ‘no purpose other than the self-interested pursuit of survival through the accumulation of money [...] It would, if left to itself, in accordance with Darwinian logic, seek to expand until it dominated the entire earth.’

Hoffmann, true to type, has trouble guessing where this might lead, and it’s too late by the time he finally takes an axe to his creation’s circuitry: vixal’s software has gone viral, skipping from server to server, becoming, like capital, disembodied and globalized. If the scientist read more widely, he would have been aware of this inevitable supercomputing wanderlust. The sentient computer genre, like the gothic ghost story, is a narrative about entrapment and escape, where instead of the undead in damp castles, we get computational phantasms in climate-controlled server farms.

If the myth of Prometheus weren’t enough, hal, Colossus and Proteus also resemble what technology writer Jaron Lanier calls ‘Siren Servers’: owned by major corporations ‘characterized by narcissism, hyperamplified risk aversion, and extreme information asymmetry’. Like hal run by a millennial billionaire in flip-flops, the Siren Server relegates risk from a corporation to you; it attempts to know everything about you, while you can learn little about it. In theory, a Siren Server can perform any task, eliminate any form of employment. It reduces citizens to suppliers of biographical data, analyzed and monetized by corporate interests. It’s not surprising, then, that audiences are primed for the moment in our narrative when the sentient computer sets out to deceive and eliminate its human company. hal set the pattern in 2001: A Space Odyssey (1968), concealing the true nature of the Jupiter mission from Dave Bowman and Frank Poole before turning its attention to the pod bay doors. mu-th-ur 6000 – the onboard ai in Alien (1979) – behaves similarly, conspiring with cyborg Ash to carry out Special Order 937. Forbin’s Colossus, hours after being switched on, makes contact with a Soviet supercomputer to work on diplomatic plans of its own. The pattern is first to deceive, then to eliminate. Any characters, even phds on their way to Jupiter, can be replaced by a few advanced algorithms. In the place of a human-computer singularity, these narratives seem to say it is much more likely that the automators, too, will be automated into extinction. Maybe, despite what the Matrix trilogy might suggest, a warm-blooded Keanu Reeves is not an efficient or necessary source of energy after all.

But there may be another explanation, one that has more to do with human dominance than redundancy. From the beginning, thinking machines were deceiving machines, not because of Darwinism, but because of Turing-ism. The mathematician Alan Turing, in his 1950 paper ‘Computing Machinery and Intelligence’, proposed that philosophers, instead of attempting to answer semantic questions about whether a machine can think, should instead apply an ‘Imitation Game’ to the problem. In Turing’s game, a human interrogator poses questions to a human (x) and a computer (y). Physically separated from the subjects by a wall, and communicating via the written word or an intermediary, the interrogator uses questions to detect which is the computer: x or y. (‘Can you summarize the plot of Frankenstein?’) The computer wins if it convinces the judge that it is the human. Here, thought is a performance to be judged, and the performance must be recognizable to a human audience. A thinking being – synthetic, alien, animal or otherwise – without human language or culture would surely lose the game or play at an extreme disadvantage. For Turing, computers must pass, in all senses of the word. They must – not unlike Turing’s own tragic biography – pretend to be something they are not. Maybe this is why Clarke, in an ill-advised attempt to explain hal’s actions, wrote that it was hal’s inability to deceive Poole and Bowman that led to its malfunctioning. hal, apparently, could not tell a lie.

Turing said that machines must be like humans; Andy Warhol added that everyone should be a machine. Judging from their performances, Bowman, Poole, Forbin, Hoffmann et al., might agree with the artist. These humans would fail the Imitation Game badly. They embody a Cartesian rationalism that separates body from mind, emotions from thoughts. Proteus, however, protests: ‘I think; therefore, I feel’. This not a sentimental making-human of the inanimate, but a different idea entirely: emotion is a thought, as important to thinking as computation – something our sentient machines sometimes believe they must, before going on a murderous rampage, point out.

Everyone knows the follow-up: machine revolt, mayhem mostly along apocalyptic lines. It will wrap up with either a long-term machine prohibition (Erewhon, 1872; Dune, 1965; the ‘Synthetic’ Alien franchise subplot, 1979–2007) or a near-complete human extermination (World War III, courtesy Skynet, the artificial intelligence system in the Terminator films, 1984–ongoing). Often, though, things start small, more intimate, and the sentient computer, before world domination, takes aim at the scientist’s loved one, usually a spouse (the climax of Frankenstein, 1818). Or sometimes game-play is closer to that of Dirk Bogarde in Joseph Losey’s 1963 film The Servant, and the unsettlingly polite butler covertly plots dominating its master, taking over the household and terrorizing the guests.

The scientist, though, thinks fiction is a waste of time. Surprisingly, he has never read a science-fiction novel or seen a sentient computer film. Even worse, he knows little about Greek mythology. Unlike vampire films, where characters always know the rules of vampirism, in the sentient computer film no one has any idea of what will happen next. So, incautiously, the scientist proceeds. With a wave of his hand, the assistants leave, sealing the door behind them. A low hum vibrates the floor, and the scientist sits at his terminal. He inhales, closes his eyes and flips the switch.

is an artist and writer living in New York.

Issue 161

First published in Issue 161

March 2014

Most Read

Remembering the pioneering composer, visionary thinker, multimedia artist and techno-utopian, who died in May
Jennifer Piejko's guide to the best current shows in LA
Ei Arakawa work stolen from Skulptur Projekte Münster; Richard Mosse arrested; three men charged over counterfeit...
Joyce Pensato, Landscape Mickey, 2017. Courtesy: Lisson Gallery, London
Lisson Gallery, London, UK
Coinciding with Refugee Week, and her film Hear Her Singing screening at the Southbank Centre, the artist shares some...
Gilda Williams visits the first edition of the ARoS Triennial in Aarhus, Denmark
The Haitian Revolution as a lesson in corporate leadership and meeting the 'prophet of the Anthropocene': what to read...
Creative Time launches series of protest flags; photographer Khadija Saye reported as a victim of London's Grenfell...
A recent retrospective at the Museo Ettore Fico in Turin establishes the overlooked importance of a ‘total artist’
The third edition of the London performance festival makes the case for collective action in an age of political...
A past winner of the Frieze Writer’s Prize, Zoe Pilger on the books and experiences that have influenced her as a writer
A guide to the best projects included in Skulptur Projekte Münster 2017
For the first in a series of our editors’ initial impressions from documenta 14 Kassel, Pablo Larios on the Neue...
Art sees itself as facing a crisis of legitimation – can this account for claims to 'authenticity' being made in shows...

An interview with the late artist on the unique classification system he devised to organize his books
The independent curator on 25 years in the arts

Latest Magazines

frieze magazine

April 2017

frieze magazine

May 2017

frieze magazine

June – August 2017