Sean Moncrieff: The dark side of artificial intelligence is doomsday scary

Advanced AI with god-like powers could regard us as annoying bugs. Now that’s a terrifying thought

The overwhelming scientific consensus is that the spooky-sounding singularity will occur this century, possibly around 2050. File photograph: Getty Images/Photo Researchers RM

The overwhelming scientific consensus is that the spooky-sounding singularity will occur this century, possibly around 2050. File photograph: Getty Images/Photo Researchers RM

 

God be with the days when AI meant a fella coming to get the cows pregnant. Now it’s about the possible extinction of the human race.

Artificial intelligence is everywhere. It’s in banks, in cameras on the street. All over your social media. It can make a medical diagnosis or compose music or play chess. If artificial intelligence was a TV character it would be a mix of Sheldon from The Big Bang Theory and a handsome doctor from Grey’s Anatomy.

New York City Council is currently going through a process to establish exactly how many algorithms are involved in the governance of the city: because they don’t know how many there are. They do know that it’s involved in the allocation of police officers, food stamps and public housing. In other parts of the US, police departments have commissioned data companies to come up with ways of predicting crime. Yes, like the Tom Cruise film.

It’s striking how the dark predictions describe an entity like the pre-Christian or Old Testament gods

Yet this isn’t the big one: all the above are narrow artificial intelligences. They have a specific set of functions and are only as good or as bad as the people who programmed them. (Though they can learn. Google’s Translate tool made up its own language through which it translates the languages us fleshbots speak.)

What scientists, philosophers, politicians and anyone with a healthy interest in doomsday really worry about is artificial general intelligence: a computer that thinks for itself.

Spooky-sounding singularity

This is not a science fiction fantasy. The overwhelming scientific consensus is that the spooky-sounding singularity will occur this century, possibly around 2050.

It’s where technology and philosophy crash into each other, because a super-intelligent AI will be able to build an even more intelligent AI, and so on and so on – ending up with an artificial intelligence that has god-like powers. It’ll be able to wipe out all disease and end climate change, bring about world peace and produce a new, even better series of The Sopranos. A group in Silicon Valley has already established a religion in advance of its arrival. Some propose that we should ask the AI what we want, because it will know better. It will be able to resurrect dead people or create Matrix-like realities for humans that we won’t be able to distinguish from the real thing.

It may even have done so already. There’s a thought exercise called Roko’s Basilisk, which is head-meltingly complex, but part of it is that we only think AI has not emerged yet. The AI has in fact created a pre-AI reality to test how humans will react to the possibility of AI. If you’re not keen, then the Basilisk won’t be too pleased with you, as you’re in favour of denying it existence.

Optimists

This would be a particularly needy super-intelligence, but it’s striking how many of the world’s leading scientific thinkers – Bill Gates, Elon Musk, Tim Berners-Lee and the late Stephen Hawking – all worry that an AI will regard us as annoying bugs. There’s another theory that the reason why we haven’t found life on other planets is that they already created AI: and the AI wiped them out.

There are some optimists, of course, but it’s striking how the dark predictions describe an entity like the pre-Christian or Old Testament gods. The AI is driven by cold logic, yet can still act in apparently petty and jealous ways. It’s a reflection of the worst impulses in humanity, but one that has come about as a result of what’s most impressive about us: our creativity. If this happens, we’ll have made a god – and presumably, wiped out belief in the old lo-tech deity. Yet we’ll fear it. Just the way we fear ourselves.

The Irish Times Logo
Commenting on The Irish Times has changed. To comment you must now be an Irish Times subscriber.
SUBSCRIBE
GO BACK
Error Image
The account details entered are not currently associated with an Irish Times subscription. Please subscribe to sign in to comment.
Comment Sign In

Forgot password?
The Irish Times Logo
Thank you
You should receive instructions for resetting your password. When you have reset your password, you can Sign In.
The Irish Times Logo
Please choose a screen name. This name will appear beside any comments you post. Your screen name should follow the standards set out in our community standards.
Screen Name Selection

Hello

Please choose a screen name. This name will appear beside any comments you post. Your screen name should follow the standards set out in our community standards.

The Irish Times Logo
Commenting on The Irish Times has changed. To comment you must now be an Irish Times subscriber.
SUBSCRIBE
Forgot Password
Please enter your email address so we can send you a link to reset your password.

Sign In

Your Comments
We reserve the right to remove any content at any time from this Community, including without limitation if it violates the Community Standards. We ask that you report content that you in good faith believe violates the above rules by clicking the Flag link next to the offending comment or by filling out this form. New comments are only accepted for 3 days from the date of publication.