So, if we all move deliberately together, mapping the ice as we go, then we all safely get to the other side of aligned AGI. But if somebody thought that, okay, I’ll just sprint to get there, then it breaks the ice and everybody drowns. And if somebody thinks, “okay, I will sprint, but carefully; since if I don’t, somebody else will surely sprint carelessly and break the ice” and then rush forward, that also disrupts the dynamic.

Keyboard shortcuts

j previous speech k next speech