AI Safety and Future Perspectives

Is AI gonna kill us?

It's just that this is the place you have to start this week.

Well, I think if we all do a good job and, um, and act

responsibly, then no. I mean, I'm quite optimistic about the fact

that this

is gonna be a very positive future for everyone.

Look, I mean, I think that there's a lot of, uh, rhetoric

that is filled with

doom, and I mean, my view on this is that

there are a number of labs that are working on building, um,

advanced AI, and

I don't think that we need some kind of, like, industry-wide

coordination to not,

to not necessarily mess this up. I think that just each lab needs

to

take the time, and when it sees that there are issues, you

just take the time that you need internally to, uh,

make sure that you're

proceeding safely. You know, with the Muse launch that we just did,

we had a

version of it that was quite good a few months ago, and we

wanted to make sure that we really nailed all the privacy

and security parts of it

because part of this is that if you're building a product,

like, people aren't gonna wanna use it if it doesn't do what they want.

You know, we wanna get to a world where, you know, everyone can, can benefit from

this and-

Yeah

... um, it's, it's just not gonna happen.

People aren't gonna adopt it if they, if they don't trust it.

Yeah.

So my, my own view on this is that we're entering a phase

where trust and alignment is actually going to be

the most important next set of capabilities, right?

I think we're getting to a point where it may not matter that much how much

better it gets at math, right? It's already pretty good at math.

Um, you know, that's useful-

Yeah

... for a bunch of things.

Yeah.

I think at this point, like, the, the things that we talk about internally

are,

you know, instruction following, does it do what you want?

Intent understanding, does it, does it kind of understand your intent?

Does it understand your values alignment?

And I think nailing those things are gonna be the most important next

things to

align with what people actually want in the world. So I don't know.

Yeah. No, I, I think, and it's-

I, I happen to think that there's, like, plenty of commercial incentive to get this

right