TL;DR The AI values alignment problem is not new. We've had AIs for millennia. We just have not called them AIs. We've called them tribes. And nations. And corporations. And society. But they all fit the definitions of artificial intelligence--and artificial super-intelligence. They are artificial, more intelligent than individual humans, and self-improving. And they often have values different than the values of their creators or component humans. So we've had AI values alignment problems for as long as we've had these sorts of AIs.