1
00:00:01,599 --> 00:00:05,000
If that's the case for AI and we only put in
regulations after something terrible has

2
00:00:05,039 --> 00:00:08,239
happened, it may be too late to actually put the
regulations in place.

3
00:00:08,239 --> 00:00:10,039
The AI may be in control at that point.

4
00:00:10,359 --> 00:00:13,399
It has the potential of civilizational
destruction.

5
00:00:13,460 --> 00:00:18,379
And then furthermore, there are concerns around if
an AGI ever

6
00:00:18,420 --> 00:00:23,039
becomes very, very powerful, which is possible,
maybe it will want to go rogue being that

7
00:00:23,039 --> 00:00:23,659
it is an agent.

8
00:00:24,039 --> 00:00:24,979
Eliezer Yudkowsky,

9
00:00:25,840 --> 00:00:28,299
he warns that AI will likely kill all humans.

10
00:00:29,239 --> 00:00:30,619
So first of all, I will say I think that

11
00:00:31,679 --> 00:00:34,219
there's some chance of that. That's a great
question. What's your P-doom?

12
00:00:34,219 --> 00:00:36,020
Probability that human civilization destroys
itself.

13
00:00:36,020 --> 00:00:39,840
Um, what I would say is it's definitely non-zero
and it's probably non-ne- negligible.

14
00:00:40,200 --> 00:00:42,180
I think it could do that. I think it could be a
threat to- to all- to, you know, to- to-

15
00:00:42,299 --> 00:00:43,440
to kind of all of humanity and us all.

16
00:00:44,059 --> 00:00:47,939
There's still a chance that we can figure out how
to develop AI that won't want to take

17
00:00:47,939 --> 00:00:48,880
over from us, and

18
00:00:49,739 --> 00:00:52,380
we have to face the possibility that unless we do
something

19
00:00:53,059 --> 00:00:53,399
soon,

20
00:00:54,059 --> 00:00:54,759
we're near the end.

21
00:00:55,799 --> 00:00:59,920
What's the worst case scenario? Well, the worst
case scenario is, uh, human extinction.