AI Risks and Human Safety Concerns

Do you believe there is a greater than ten percent chance

that AI could kill all

humans, potentially within a decade?

So this is the kind of thing that is very hard to estimate because we've

never

had anything like this before. We've never created beings

that may soon be

smarter than us. We don't know what's gonna happen.

We should obviously be cautious. It would be very foolish to say there

was like a

one percent chance. Um, nobody knows how to estimate it.

A ten percent chance seems not a, not an unreasonable estimate to me, but

nobody really knows how to give a sensible estimate.

Right. But you just said ten percent

doesn't seem an unreasonable estimate that AI could-

Yes

... kill all humans.

Yes.

Wow.

Oh my God.

Yes.

How? How could it kill us all?

Um,

if it's much smarter than us, um, there's so many ways it could do it,

I don't

think it's much worth speculating.

And you don't actually-

Oh, oh, actually, I do want to know that. I, I, like how? Give me...

Could you give me one example?

Well, the first thing to realize is it doesn't even have to be able to act

in the

real world to cause devastation. So it would be able to

cause complete chaos just by talking to people.

But it will also be able to design very nasty viruses,

biological viruses, as well as computer viruses.

It could do devastating cyber attacks, um,

and there's just countless other ways it could get rid of us if it wanted

to. We have to figure out how to design it so

that it won't want

to.