Of course, technology will be necessary to realize the philosophical. It will not be one more technological breakthrough, but rather a combination of new and old technologies.<\/p>\n\n\n\n
“Present-day A.I. = sophisticated perception”<\/strong><\/p>\n\n\n\n These are the words of Yann LeCun, a leading A.I. scientist, founding father of convolutional nets,<\/em> which at present play a major role in many deep learning applications.<\/p>\n\n\n\n Yann sees DNNs (Deep Neural Networks) as quite straightforward devices in which basically a linear input vector goes through a non-linear function towards output in weights, over and over again.<\/p>\n\n\n\n And amazingly, as counter-intuitively as anything gets, it works.<\/p>\n\n\n\n Why \u2018amazingly\u2019?<\/strong><\/p>\n\n\n\n The problem before the breakthrough was that artificial neural networks were deemed to get quickly into a rut, caught in some local minimum from which they would never escape. However, with many layers (in DNNs), in (mathematically) multidimensional space, such local minima are easily avoided, especially using gradient descent.<\/p>\n\n\n\n Dear reader, never mind if you don\u2019t fully get this, but you certainly get a feel of it.<\/p>\n\n\n\n The same Yann points out that this many-layers construct works because reality is compositional: it can be broken down into pieces, and each piece can be processed by itself. A car has wheels and doors. A wheel has rubber parts and metal parts.<\/p>\n\n\n\n This is where, at first sight<\/strong><\/strong>, Yann and Jean-Luc (your humble writer) have different opinions.<\/strong><\/p>\n\n\n\n In my view, the compositionality of reality is mainly a construct of the one who is perceiving this reality. It will fit more if the perceiver is also of the same kind as the builder of that (piece of) reality. A car is an excellent example of this, being a mechanical construct made by human beings. Its compositionality is part of the construction itself. This is also why it can readily be made en masse.<\/p>\n\n\n\n Meanwhile, we live in such a human-made world that compositionality is intrinsically dominant everywhere<\/p>\n\n\n\n except in nature<\/strong><\/p>\n\n\n\n where \u2013 I perfectly agree, of course \u2013 it is also present, but to a lesser degree and much more in synthesis with non-compositionality. Another term for the latter is complexity. [see: \u201cComplexity of Complexity<\/a>\u201d]<\/p>\n\n\n\n We have arms and legs and softer parts and harder parts. We also have a brain\/mind, and within that, a lot of complexity. Especially in the cerebrum (as opposed to the cerebellum, for instance), our brain\/mind is composed of a multitude of elements that act together in such ways that the result cannot be calculated from the sum of parts. In other words: It\u2019s a complex melting pot. If Nature were an engineer, she would also be surprised that it works. Moreover, the more melting, even the better it works!<\/p>\n\n\n\n Back to Yann. He sees two major obstacles to the further development of A.I. based on present-day technologies:<\/p>\n\n\n\n This makes present-day A.I. nothing short of not intelligent at all. The term A.I. is, therefore, a misnomer, as is also \u2018machine learning.\u2019 The machine does not actually \u2018learn\u2019 anything in the way that we humans would call \u2018learning\u2019 as applied to ourselves. It is closer to a book getting a few more pages. One still needs an intelligent interpreter to make anything of it. \u2018Deep learning\u2019 in A.I. until now comes down mainly to additional segmentation using an immense lot of data labeled by humans: supervised learning in DNN.<\/p>\n\n\n\n I find this quite scary when applied to humanistic domains. It is highly control-based. In my view, it will not lead to ethically welcome results. Fortunately, it will probably lead to hardly any sustainable results.<\/p>\n\n\n\n The next revolution will be in real intelligence,<\/strong><\/p>\n\n\n\n whether human-simulated or starting from a more abstract level.<\/p>\n\n\n\n Thus, is real A.I. \u2018in the size\u2019 (more of the same) or in a qualitatively different endeavor? Will it be enabled through sheer brute force, breaking through with some simple procedure(s) as Yann described in the recent \u2018DNN revolution\u2019 (largely engendered by himself and few others)?<\/p>\n\n\n\n Or?<\/p>\n\n\n\n It will probably be something radically different. As you know by now, my view on this is a philosophical one, not in the sense of merely an armchair philosophy but a very pragmatic one. Technologically, there will be a search for the best combination of old and new technologies to make this philosophy optimally efficient. Much of this has already been done by me and others.<\/p>\n\n\n\n What will be this next revolution is not in the box.<\/strong><\/p>\n\n\n\n It will be out of the box.<\/p>\n\n\n\n Here, again, I\u2019m evolving parallel to Yann: One of the ways to view the core will be energy-based self-supervised learning. Yann also calls this \u2018unsupervised.\u2019 If supervised learning is the sugar coating of a cake, he sees the latter as the cake itself.<\/p>\n\n\n\n An intriguing question is how much prior structure is required. A fact is that humans learn world models pretty quickly. They do this learning mainly by learning to predict, gradually filling in the gaps, dealing with uncertainty on the fly.<\/p>\n\n\n\n PLUS a lot of flexibility within a transformer (again, kind of compositional) architecture.<\/strong><\/p>\n\n\n\n You may visualize this as a nicely burning fire within a circle of stones \u2015 an ancient image with a futuristic implication.<\/p>\n\n\n\n Within a coaching setting, here comes Lisa. [see: \u201cLisa<\/a>\u201c] I think this is also the only way towards human-A.I. value alignment, on a journey towards Compassionate A.I. [see: \u201cThe Journey Towards Compassionate AI.<\/a>\u201d]<\/p>\n\n\n\n A species-existential problem is that I don\u2019t see many evolving on this path.<\/p>\n\n\n\n <\/p>\n