AI Control, Friendly Futures and the Idea of Protopia

I, I find it unlikely that humans would remain in control

if the, if...

I mean,

if there's a million times more

digital intelligence than there is biological intelligence, it's,

it's hard to

imagine humans being in control in that scenario.

So I hope the AI's nice to us.

Anything we can do to encourage that?

I think programming truth-seeking and curiosity,

um,

is, is probably good. I think, I, I guess we,

we wanna be careful about being,

you know, cr- creating too many AI dystopian scenarios

online because the AIs are trained on everything online.

So if we say it's gonna be utopian-

They might be like, "Oh, that's what I-

... uh, dystopian-

... that's what I should be

... they'll do it.

I should be Terminator," you know? 'Cause they, what- whatever.

They read, you know, 80 versions of the Terminator script.

So it's like, "I guess that's what, guess that's me," Terminator.

Maybe we, we should have, uh, some more, uh...

Let's, let's have some more uto- u- utopian narratives for AI,

um, so then it can like, "Well, maybe I shouldn't be Terminator.

Maybe I can be friendly overseer or something like that," or,

um,

like a gardener or something. I don't know, like be, be, be, be...

Treat us, you know, tr- try to make humans happy type of thing.

A friend of mine has this idea called protopian which is like...

'Cause utopian

tends to represent some impossible ideal- idealistic goal, and

usually in the, in attempting to create a utopia you

create a dystopia is

usually how the narrative goes. So she thinks it should be protopia

which is

an achievable,

uh, you know,

future, um, that is, it's, it's not perfect but it's, it's

good and something that you'd be, you'd...

Like if you could look into the future you'd say, "Okay, yeah,

that would be a good

future."