AI Alignment and Oversight Challenges

This is, by the way, yeah, I think you articulate it really well.

Another way that I like to think about this is, like, the genie that, like,

you know, grants your wish, but in, like, the exact wrong way.

Yeah.

Like, I wanna live forever, and then, like, traps you in some-

Yeah

... kind of, like, horrible situation for eternity.

This is like in s- as you mentioned, like, in some ways, the big problem.

Like, how do we make sure these models, um, are aligned going into the future?

And there's a bunch of approaches that, uh,

we think may work. This is, I think, one of the most

open questions scientifically in AI.

Generally speaking, I think nobody knows exactly the way to

solve this problem,

but there's a few ideas. So one idea is this, um,

concept of, uh, what's called scalable oversight.

So the, the idea goes something like this.

So as you have smarter and smarter AIs,

as long as the AIs are roughly as smart as we are,

we can kind of see what they're doing, and we can tell, like, "Hey,

that's a little

bit off." And so we can, what's called provide oversight.

Like, we can look at what the AIs are doing and, and make sure

that what they're

doing is, is appropriate. The problem is when the AIs

get a lot smarter than we are, and we

kind of look at what they're doing, and it's just, like,

really confusing to us.

Like, how do we deal with that situation?