Even if you solve this problem, we could end up with a situation where very few people—maybe just one or two—would merge with this new AI that lacks self-preservation instincts, becoming some kind of transhuman life form beyond human capabilities. This isn’t good for others either, because it would mean one human suddenly possesses enormous power. This AI wouldn’t be looking after itself but enhancing this person’s abilities. So this person would have tremendous power and asymmetrical capabilities compared to everyone else on Earth, which isn’t necessarily good for other people.