If you have read my book The Journey Towards Compassionate A.I.<\/a><\/em>, you know much of what\u2019s in this text. Nevertheless \u2015 no harm in some concise repetition while I expose the reasoning from another angle. The why<\/em> of this text is more about causes than reasons.<\/p>\n\n\n\n Humanly used terminology<\/strong><\/p>\n\n\n\n Terms like intelligence, free will, consciousness, and Compassion can be used to denote concepts that are only applicable to humans. This is a straightforward way to ascertain that no other creature will attain any of these. [With due respect to large octopi\u2019s intelligence, one may change \u2018human\u2019 into \u2018organic.\u2019] An A.I. will never be humanly intelligent nor conscious since, to be humanly, it needs to be human \u2015 obviously, at the surface level.<\/p>\n\n\n\n Yet, with an additional twist, this by itself becomes more interesting. An A.I. system will principally<\/em> never be humanly intelligent because of the intractable complexity<\/a> of human intelligence. The latter is just too complex. Therefore, a system\u2019s intelligence will always be an approximation to human intelligence.<\/p>\n\n\n\n For the same reason, there will probably never be an upload of human intelligence to some server. This, too, will always be an approximation.<\/p>\n\n\n\n Abstractly used terminology<\/strong><\/p>\n\n\n\n The above list of terms can also be used to denote more abstract concepts. That is a straightforward way to ascertain that super-A.I. will attain them all \u2015 soon enough. It just depends on the choice of concepts.<\/p>\n\n\n\n In this case, it\u2019s interesting to take a comprehensive view and see where our human realizations of these abstract concepts may differ from others. Are we the absolute pinnacle or just some point in a multi-featured landscape?<\/p>\n\n\n\n Or are we humans the only creatures who can ever be intelligent\/conscious because of an esoteric conflation of the human and the abstract? This idea of human exceptionality seems the result of a dangerously neurotic case of Eigenangst<\/a>, the unwillingness to look deep inside oneself. In this respect, we certainly need Compassionate A.I.<\/p>\n\n\n\n Information Integration<\/strong><\/p>\n\n\n\n With a lot of information (data in context) and much internal integration, any system gradually starts looking like what one may call intelligent<\/em>.<\/p>\n\n\n\n According to some, this is enough to make it conscious \u2015 called the \u2018Information Integration Theory of consciousness.\u2019 In that sense, humans are supposed to be conscious because<\/em> we are intelligent. Given the above, this is a conflation of humanly and abstractly used terminology, making us exceptional because we are, well, exceptional, aren\u2019t we?<\/p>\n\n\n\n Sure we are exceptional, not because of our intelligence but our human<\/em> intelligence.<\/p>\n\n\n\n Autonomy<\/strong><\/p>\n\n\n\n According to some, autonomy is equal to free will \u2015 of course, depending on the degrees of freedom. An autonomous weapon hardly shows free will, having autonomy only in searching or even somehow choosing its target within constraints.<\/p>\n\n\n\n Consider making the constraints wider (relaxing them) and providing the system with more features in which to act autonomously. Does that lead to free will?<\/p>\n\n\n\n Again, the human case brings intractable complexity. No system will attain humanly complex free will \u2015 without which we humans also do not have what we would call consciousness.<\/p>\n\n\n\n Information Integration + autonomy<\/strong><\/p>\n\n\n\n Lots of both \u2015 then, here we are. What is the fundamental difference between this synthesis and a reasonably abstract concept of consciousness? How do we abstractly (not humanly) rebuke such a creature when it says, \u201cI feel conscious?\u201d<\/p>\n\n\n\n It is perfectly conceivable to design an A.I. that goes in this direction. With eyes wide closed, many organizations are already striving to precisely attain this. The advantages are immense and immediate in many ways, as well as the dangers of seeing \u2018them\u2019 reaching before \u2018us\u2019 many essential advantages in economic or even military competition.<\/p>\n\n\n\n Invisible dangers<\/a> (closed eyes) are not going to stop decision-takers.<\/p>\n\n\n\n That is why A.I. must be Compassionate<\/a>.<\/p>\n