Rewards or Value?

March 18, 2023 Cognitive Insights No Comments

Are people driven more by direct rewards or broader value? Should A.I. be driven rather by one or the other? What about end values?

Zero-sum values

These are nothing but the sum of individual rewards.

For instance, one earns tokens on several timesteps. The eventual zero-sum value is the sum of all tokens earned ― nothing more or less. Thus, the focus primarily lies on the tokens, to which the value is secondary. In theories of Reinforcement Learning (one kind of A.I.; see more), the emphasis frequently lies on the direct rewards. Long-term value is seen as the maximization of all rewards over the trajectory. This is OK in many cases.

But if humans are deeply involved, are zero-sum values also preferable?

Are people driven more by rewards or value?

Homo economicus (the one from many books of economy) is reward driven. This translates at school into points, grades, prestigious institutions, and diplomas. Later on, the translation is equally apparent.

Nevertheless, homo realisticus is value driven. Of course, nature wants us to survive day after day. The reward is to eat, not be eaten, and survive every day. Be assured nature knows that.

But nature has also made us humans more flexible by allowing us to see broader pictures, learn from the past, and plan ahead. That is called intelligence. This characteristic made us more resilient, exploring, and eventually more value-driven than any other creature ― whatever these values may be.

This is not about good or bad ― yet.

Therefore, choose your values well.

Simply sticking to maximization of rewards may not be the best option. Actually, it almost certainly leads to a detrimental future.

Of course, the rewards thing is also still in our nature and well in our capabilities. We can follow nature and meanwhile kill each other, as well as eventually the planet ― especially with the technology of today and the near future. This is still within nature’s calling, but it is not nature’s ideal endgame.

In my view, the best end value is no zero-sum value, but Compassion, basically ― an explicit choice. With the focus on this, concrete rewards are not readily efficient since they continually draw the focus to themselves and the surface level. Compassionately, one needs to supersede individual rewards on a long and winding road. The end result is one big reward: Compassion itself.

Human-A.I. value alignment

This is appropriately deemed to be crucial by many.


Transforming humans into more robot-like entities is one way to reach human-A.I. value alignment. I fear that we might be going this way in how we use technology in general, specifically present-day A.I. technology.

Reinforcement Learning plays a crucial role in this regard. Much talk in it is about ‘rewards.’ It’s probably better not to use this term altogether and speak of nudging, feedback, or even suggestions if you like. Also, in anything human depth-related, the focus should lie on value ― not as sum of rewards but as an entity in its own right.

Of course – and, I hope, you too – I’m for the second option, namely: developing A.I in a human-compatible way from the start on ― which is yesterday. Even more, A.I. may help us humans to become more humane.

That is my endeavor, from which I have written The Journey Towards Compassionate A.I.

Leave a Reply

Related Posts

Moral Injury

Moral injury overlaps pretty much with PTSD. The difference lies mainly in ‘moral.’ The injury sprouts from an existential loss of ethical trust. Can people (in general or any individual) still be seen as ‘good?’ Moral injury comes with moral sensitivity. This comes with cognitive and emotional complexity, making human beings more prone to moral Read the full article…

Goodness, Badness, and Ugliness of Ego

A good appreciation of ego is indispensable for attaining a better world in which ego plays its proper part ― no less, no more. One may think that one has gotten rid of one’s ego. Yet, in that very sentence, look who’s talking and thinking ― ego itself? Indeed, ego is a master in disguise. Read the full article…

The Difference between Being Alone and Being Lonely

Being (= feeling) lonely is as much related to you as to your situation. Most of all, it is about a meaningful relationship with yourself. A person can be very alone, yet not feel lonely – and a person can feel very lonely, yet not be alone. The fact that this is possible, means that Read the full article…

Translate »