From Tool to Autonomy

July 4, 2023 Artifical Intelligence No Comments

When can a tool – gradually – become an autonomous agent, and how must we deal with this?

What is an agent?

And what is a tool? For instance, is your body (or your left hand) a tool of your brain? Is your entire body – including your brain – a tool of your mind? Or does it all depend on your perspective? Then where is this perspective taking you? Conversely, can your diary (in your smartphone) be seen as part of your extended memory ― therefore, you?

We attribute goals to instrumental tools.

Until now, people have done so metaphorically. For instance, the goal of the hammer is to hit the nail. With complicated tools, the metaphorical goals may become more sophisticated.

With complex tools, however, autonomy starts creeping in, and the metaphorical stance becomes less straightforward. When do goals become the goals of the tools themselves? In other words, when does viewing ‘autonomous tools’ as mere tools an intolerable case of reductionism? With increasingly complex super-A.I., this issue will gradually become more pertinent.

Since there is no discrete border between both situations, we will need to consider all kinds of fogginess. That’s OK if we find more abstract principles to guide us. Working case by case will not do eventually. It will create a big mess instead.

As in many cases of complexity, we need fundamental insights.

Anthropomorphism and its counterpart

Readily attributing goals to tools is an example of anthropomorphism. Even knowing that it’s metaphorical, we may emotionally react otherwise, for instance, towards robots with human appearance ― nothing fundamentally wrong with that.

The counterpart is also possible: not seeing the likeness with us for thinking that something different cannot principally be human-like. This may be the fate of super-A.I. in the eyes of many people, even for still quite a while.

We will need a balance between both stances. History shows we’re not good at such balancing acts, even concerning our fellow human beings. This goes from embryos to mass extinctions of fellow humans who are apparently not genuinely human ― like some philosophical zombies or worse.

With super-A.I., we must be cautious because of obvious reasons.

The law

A super-challenging question will be the judicial implication of Artificial Consciousness in two directions:

  • When does super-A.I. become legally accountable?
  • How will we legally protect it as an entity with ‘human/conscious rights’?

I have no clear answers for this for the time being. The following is an invitation for further thought. May this ‘preventive’ vein to which all can contribute be more to the point than any judicial ‘curation/punishment’?

The not-so-distant future of CCB

We will soon need a ‘Bill of CCB Rights,’ whereby CCB – including super-A.I. – stands for ‘Complex Conscious Beings.’ Of course, there’s a lot to be discussed about what counts for a CCB at the fringes. It will probably always be a fuzzy concept ― more so than anything comparable in the past.

Human Rights will be a particular subchapter. Several non-human conscious animals also deserve a subchapter.

At present, we’re still living in innocent times, aren’t we?

This naiveté will not last long.

Leave a Reply

Related Posts

Endgame 2050: How super-A.I. Destroyed Us

Me: “Lisa, imagine it’s the year 2050. Humanity doesn’t exist anymore. Non-Compassionate super-A.I. has finished us off. How do you think it may have happened?” The rest of this blog is an unedited answer by Lisa, who presents a chilling but coherent narrative of how non-Compassionate super-A.I. might extinguish humanity. At every stage, a failure Read the full article…

Bringing Compassion to the World through A.I.

This is the crucial idea behind the philanthropic project of Planetarianism as part of the AURELIS project. You can find a blog about Planetarianism here and a concrete overview presentation (ppsx for laptop) here. Concretely, it’s a set of projects aiming for this blog’s title. Compassion, basically, is no rosy moonshine. There are strong traditions Read the full article…

About Blurring the Line between Reasoning and Planning

In A.I. research, reasoning and planning are usually treated as if they were separate faculties. Yet in humans, and even more in Lisa, the two constantly weave into one another. This dialogue continues where the addendum of About Reasoning and Planning in Humans and Lisa left off, exploring why the line between them was drawn, Read the full article…

Translate »