Two of the most important voices on AGI risk — Stuart Russell and Leopold Aschenbrenner — agree on the diagnosis but differ on the cure.
Russell (Human Compatible, 2019): AI systems should defer to human preferences rather than pursue fixed objectives. Problem: whose preferences — and how are they authentically expressed?