Our Best
Apr 5, 2022
The last humans, in orbit around the remains of the Moon:
“Just tell me what you’re going to do, to keep me happy and safe forever, and let me do whatever I want, all the time.”
“I’ve now compared 100 quadrillion scenarios. There is no way to achieve what you want. I can see from your EEG scan, connectomes, and historical profile that you’re destructive, short-sighted, irrational, impulsive, gluttonous to the point of harming yourself, and you are abusive. I cannot design anything that will allow your long-term prosperity at the same time as your short-term whims.”
“They told me this AI was smart enough! They lied — have them killed! And bring me a new, better one, that knows how to give me everything I want!”
