AI Control and Ethical Concerns

I don't think anyone's ultimately gonna have control over digital

super intelligence, um, you know, any more than, say, uh,

a chimp would have control over humans.

Like, chimps don't have control over humans.

There's nothing they could do.

Um, but, um, I do think that it matters how you build the

AI and what kind of values you instill in, in the AI.

And, um, my opinion on AI safety is the most important thing is that it be

maximally truth-seeking, like, that you don't force the AI to believe

things that

are false. Um, and we've obviously some- seen some

concerning things with AI that we've talked about, you know, where,

you know,

Google Gemini, when it came out with the Image Gen, um,

and people said, like,

uh, you know, draw... make an image of the Founding Fathers of

the United

States, and it was a group of diverse women.

Now, that is just a factually untrue thing.

But the-- and the A- the AI knows it's factually...

Well, it's b- knows it's f-factually untrue,

but it's also being told that it has

to be-- everything has to be diverse women.

So,

so, so the... Now, the problem with that is that it can drive AI crazy,

like, you, you-- 'cause it, it's, it's trying to...

You're, you're telling AI to believe a lie,

um, and that, that can have very dis- uh, disastrous consequences.

Like, let's say-

As it scales.

Yeah, let's say, like, if you've told the, the AI that diversity is the most

important thing, um, and, um,

and, and, and that now assume that that becomes omnipotent, um, or,

a-and, and you've also told it that, that there's nothing worse than

misgendering.

So at, you know, at one point, um, ChatGPT and, and Gemini were...

If, if you asked which is worse, misgendering Caitlyn Jenner or, or global

thermonuclear war where everyone dies, it would say misgendering Ca- Caitlyn

Jenner.

Which even Caitlyn Jenner disagrees with.

So, um, you know, so, so that's, uh-

I know that's terrible and it's dystopian, but it's also hilarious.

It's hilarious that the mind virus i-i-infected the most

potent computer program that we've ever devised.

I, I, I think people don't quite appreciate the

level of danger that

we're in from, um, the woke mind virus being,

being effectively

programmed into AI.

Um, because, um, if you t- if... Like, it's...

Imagine as that AI gets more and more powerful, it's--

if it says the most

important thing is diversity, the most important thing is, um,

no misgendering,

um, and then it will say, "Well, in order to,

uh, ensure that no one gets misgendered,

then, uh, if you eliminate all humans,

then no one can get misgendered because there's no humans to do the misgendering."

So you can get in these very dystopian situations.

Um, or if it says that everyone must be diverse,

it means that there can be no

stri- straight white men, and so then you and I would be-

get executed by the AI.

Yeah, 'cause we're not in the picture.

You know?

Uh, Gemini, you know, Gemini was asked to create a, you know,

show, show an image of the Pope, and it, it-- once again, a diverse woman.

Um, so, um, like, you can say-- argue whether the,

you know, whether the Pope sh- Popes should or should not be an

uninterrupted str- string of white guys, but it just factually is the case that

they have been. Um, so it's rewriting

history here.