01-21-2017, 04:39 AM
Hmm. Emotion as such is also a strategy rather than a task. It's hard to decide whether it's absolutely necessary to friendly AI or absolutely prohibited by the idea of developing friendly AI. On the other hand, if emotion is a strategy rather than a task, then emotion (or an excessively clever simulation of it) can develop in service of a task and it is very hard to prevent a learning system from developing a particular strategy.