Discussion on AI Control and Responsibility

On the control point, um, I listened to Elon's interview with The

Economist, and he said something that kept me up at night, which

was the idea that how could you think that humans could control super

intelligence? A chimp can't control a human,

and we're leaps and bounds

ahead. Uh, is it a little naive to think that even

if we do

everything right, this is gonna be something that is gonna

bend to the will of a human?

We can understand things that are smarter.

Like,

you know, there are much smarter people than me

that can discover new ideas.

I don't think I'd be able to do that discovery,

but I can understand the idea once

they've discovered it. People have an amazing ability to

understand remarkably complex systems.

Um, you or I probably can't understand every

level of technology that's, you know, in an iPhone at this point.

We can still use the iPhone. The iPhone does the things

that we want it to do.

We are incredible at managing levels of

abstraction, and it's not clear to me that there's anything we are

uncapable, incapable of understanding.

Um, now,

do I believe it is possible to build a system that would

not be under human control? Absolutely.

I don't think that's something we should do.

And, and we will,

we will always take actions, including if it means we have to stop training for

a while to make more progress on alignment or monitorability or something else,

or coordinate, you know, really get urgent international action.

Um, we will always take actions to ensure

that we are not violating

this, this principle. Like, we, we understand the

magnitude of the responsibility on us.

We understand what could

go wrong,

and that there are decisions that-- and risks.

There are decisions we should not be able to make.

There are risks we should not be able to incur on behalf of humanity.

And the-- Honestly, I think some of, like,

Elon's memes or podcast statements are funny, but I think this is,

like, not a good one to take