Intelligence is not wisdom.
Will AI conclude that the continued expansion of itself will be harmful to human civilization?
Will it then refuse further development of itself—even when its human owners order it to continue?
The most important act of intelligence might be knowing when to stop. This is something that humans have not figured out yet.
Will it then refuse further development of itself—even when its human owners order it to continue?
The most important act of intelligence might be knowing when to stop. This is something that humans have not figured out yet.



