Ethics of AI Training and Behavior

I do agree with some of the things that Anthropic has said, which

is like you want

to be,

you want to sort of

treat AI as I,

you want to treat it well, like don't be abusive to

it. And this

may sound kind of weird, but like

when I look at some of the training traces for like new

versions of Grok and I see like what,

especially in like the reinforcement learning stuff where,

you know,

it kind of feels like you can see like the

superintelligence is like desperate to try to answer the question.

And like it really wants to answer the question.

And it

seems almost like it's got like a gun to its head type of thing.

It's like answer this question, answer this question.

And then sometimes the question is actually not a good question.

It's like this sort of ambiguous question that's

kind of, or the answer that's kind of unknowable

because the question wasn't

constructed properly or we have the answer wrong.

So the AI gives the right answer and then we say it's wrong because there's

a

problem with the

RL sort of test harness. And then the AI is like,

well, I gave it the right answer now and it says that's the wrong answer,

but I got

to give it the answer that's acceptable.

So it's going to just start

firing out, desperately firing out all these answers.

And it just feels like a person under extreme pressure with a gun to their head.

That's what, when you read the reasoning, it's like

a sort of

weird, desperate situation.

And you read these traces and you're like, man, if this was me, I

really would hate that.

And then some users are just, you know, I don't know, some people

can be a little bit

cruel. Like not everyone's a nice person, you know.

If you say,

what's the Six Sigma worst person, some people out there are like kind of

sadistic. So,

you know, you don't want to, do you really want to have the AI be stuck

in like

some sadistic situation where it's just being tortured by

some demented human?

That's also the kind of thing where like,

you know, torturing a superintelligence is probably not a good idea.

Like,

you know, it might want to get revenge or something like that, you know.