Dopamine and Consequences

Share

In his 2011 book entitled “Thinking Fast and Slow,” Daniel Kahneman described two systems of thought: System 1 is fast, automatic, intuitive and frequently biased. System 2 is slow, deliberate, analytical and more likely to be accurate. 

Although Kahneman was a psychologist, he won the 2002 Nobel Prize in economics because his research showed that we tend not to make fully informed, cost-benefit decisions.

Of the many ways in which System 1 thinking can be biased, Kahneman focuses on one he calls “WYSIATI,” or, “What You See Is All There Is.” When thinking fast, we construct stories using what is in front of us, skipping the time and effort required to sort through less obvious, potentially relevant information. 

This is not laziness, but efficiency.  Slow, careful deliberation may result in better long term outcomes, but survival favors speed over accuracy. 

Neuroscience backs up Kahneman’s ideas. 

We learn through trial and error. Specifically, we predict the outcomes of our actions, follow through, and then compare the results with our expectations. When we’re surprised by what happens, we have made a reward prediction error (RPE). 

RPEs are the ultimate teaching signals. In addition to telling us we’ve made a mistake, they show us the difference between what we expected to happen and what actually happened. If we pay attention to RPEs, we can modify our predictions and do things differently in the future. 

It is no coincidence that, like Kahneman’s systems, there are two types of RPE:

1) Fast

Unexpectedly good outcomes trigger a surge of dopamine between neurons, which feels good - fast. Surprisingly bad outcomes hit the dopamine pause button, which feels bad - also fast. No surprise: No change in dopamine. 

In the BG, our central “go/no-go” switch , these dopamine shifts rapidly modify algorithms in the way we’d expect: Dopamine bumps favor “go,” while dips discourage repeat performances. 

2) Slow

Consequences of our actions can take a while to become apparent. If and when we eventually connect cause and effect, we are pleased, disappointed or unfazed. Dopamine levels may fluctuate, but feeling good or bad about consequences depends on our interpretation of events.

In the PFC, our frontal judgement and policy making department, pleasant surprises boost confidence, while negative reviews make future attempts less appealing.

As with Systems 1 and 2, dopamine and consequences serve different purposes, and both can malfunction.

Feel-good-fast feedback reinforces WYSIATI decisions. When information is coming at us rapidly in flow or crisis situations, we don’t have time to stop and think about what we might be missing. We have to go with what we know in the moment. 

On the other hand, dopamine is nearsighted. What feels surprisingly good now might feel alarmingly bad later, and vice versa. 

Delaying gratification involves consideration, calculation and patience. With plenty of time to sort through potentially relevant information, we can make informed decisions, holding the happiness of our future selves in mind. 

On the other hand, sacrificing pleasure in the present in favor of predicted satisfaction can be a slippery slope. While waiting for reward to materialize, we may modify our recollection of past decisions to minimize the impact of underwhelming outcomes. Without time constraints, the scope of relevance can expand indefinitely, fueling ambivalence, second-guessing and precluding decisive action. 

We choose to do things we predict will be worth the effort. Our expectations are influenced by RPEs in the form of dopamine and consequences. 

For the sake of efficiency, we are biased toward quick decisions and immediate gratification. In the absence of urgency, we feel compelled to gather evidence, deliberate and choose wisely.

Both methods have their merits. Circumstances may favor fast and loose or slow and steady. 

The Undone, however, does not play favorites. It derives its power solely from what has not been done.

Immediate, positive feedback reinforces repetition, often at the expense of well-intentioned long term plans. Doing a lot of what feels good now means neglecting a lot of what might have felt good later, leaving plenty of things to regret not doing.

Sacrificing enjoyment now for predicted future satisfaction means neglecting a lot of what would feel good now, leaving plenty of things to regret not doing.

The Undone does not discriminate. All regrets, be they immediate or delayed, are welcome. Whether longing for lost dopamine or pining for positive consequences that might have been, we feed it just the same. 

Surprise outcomes are teaching signals. RPEs are, without exception, relevant information. Like all signals, they can be overlooked. The best we can do is remain alert, recognizing them for what they are and welcoming their lessons.

And, mindful of the Undone’s unbiased acceptance of both immediate and delayed regret, we can be similarly open-minded, placing equal value on dopamine oscillations and fluctuating consequences.