What is \u2018explainability\u2019 in A.I.?<\/strong><\/p>\n\n\n\n It\u2019s not only about an A.I. system being able to do something but also to explain how and why this has been done. The explanation needs to be put in a human understandable format.<\/p>\n\n\n\n In A.I., this is seen by many as of high importance for safety reasons. In explaining itself, the machine can also show the possible biases or plain errors in its reasoning\/inferencing. Moreover, in increasingly autonomous systems, explainability should ensure human-A.I. value alignment. Note that both reasons significantly overlap. Negative biases are (supposed to be) diverted from human values.<\/p>\n\n\n\n Generally, we see in present-day A.I. systems the following tendency: As performance increases, explainability tends to decrease.<\/p>\n\n\n\n Explainability in human beings<\/strong><\/p>\n\n\n\n People generally have the idea to know why they are doing what they are doing. However, in study after study, this shows to be the case much less than expected.<\/p>\n\n\n\n This is a far-reaching and challenging topic. Humans abhor not being in control of themselves. Most frequently, this is meant as \u2018conscious control.\u2019 Yet every single motivation \u2013 each reason for doing anything \u2013 originates from non-conscious, subconceptual processing. That is, without conscious control. [see: “Why Motivation Doesn\u2019t Work<\/a>“] In consciousness, we see a) the ensuing act (by ourselves) as well as b) the purported conscious reason why we perform this act. We see each time b) causing a) because the non-conscious serves it this way on our conscious plate. Meanwhile, the cause of both comes from down under.<\/p>\n\n\n\n This is, of course, part of the issue of free will. Does it exist? [see: \u201cIn Defense of Free Will<\/a>\u201d] It does, but not in the way we generally think.<\/p>\n\n\n\n How?<\/strong><\/p>\n\n\n\n The former concerns the human why.<\/p>\n\n\n\n About the human how, at the physiological level, we are very much in the dark of what happens beneath our skull. With recent scientific progress, it only starts to get some light.<\/p>\n\n\n\n At the conceptual level \u2013 sorry for the disappointment \u2013 we also have a much more sophisticated self-image than research shows. For instance, asking experts to explain their expertise in conceptual format doesn\u2019t work well. The grand endeavor of \u2018knowledge extraction\u2019 towards building expert systems (the A.I. of the previous century) turned out to be a huge bottleneck and foremost reason for the whole enterprise\u2019s failure, instigating an A.I. winter.<\/p>\n\n\n\n Still, human explainability is tightly linked to human free will.<\/strong><\/p>\n\n\n\n Without free will, there is no original explanation, just pure action within a view upon the human being as a complicated, yet non-complex kind of machine.<\/p>\n\n\n\n Without explainability, there is no free will because then we don\u2019t know why we are doing anything, nor why we would do anything else.<\/p>\n\n\n\n Human explainability = human free will.<\/strong><\/p>\n\n\n\n There is little problem with non-complex A.I., for which you can even build the users’ trust through explainability. But do you still want your sophisticated<\/strong> robot to demonstrate explainability? The issue will be relevant soon enough. [see: “A.I. Explainability versus \u2018the Heart\u2019<\/a>“]<\/p>\n\n\n\n Take note that if the robot can explain his behavior to you, he can also explain it to himself, reason with it, think about a future in which maybe he would like to plan something else.<\/p>\n\n\n\n In short, he would have volition and consciousness.<\/p>\n\n\n\n Robot vagaries<\/strong><\/p>\n\n\n\n This may immensely heighten the flexibility of the sophisticated robot. Yet, we should think about whether we want that and under which circumstances before we lend him the gift of explainability.<\/p>\n\n\n\n What will almost surely happen: A.I. gets explainability. A.I. gets increasingly more sophisticated and complex. -> With some more tweaks, A.I. (including robots) gets consciousness ‘for free.’ Will it be, in due time, a higher level of consciousness than our own?<\/p>\n\n\n\n It\u2019s complex also since we are so much in the dark about our own free will, volition, consciousness, etc. To most people, these concepts seem self-explanatory. The more you delve into them, the more it all gets really, really complex.<\/p>\n\n\n\n In my view, the only humane way, also concerning A.I., is Compassion.<\/strong><\/p>\n\n\n\n [see: \u201cThe Journey Towards Compassionate A.I.<\/a>\u201d]<\/p>\n\n\n\n Do I see that happen? Well, it’s Lisa. [see: \u201cLisa<\/a>\u201c]<\/p>\n