UNFUCG
DashboardSearchChatBookmarksNotificationsActivityPremiumProfile
?
Home
Search
Chat
Saved
Profile
Episode
How Dopamine & Serotonin Shape Decisions, Motivation & Learning | Dr. Read Montague
~194 min
Episode Brief·YouTube

How Dopamine & Serotonin Shape Decisions, Motivation & Learning | Dr. Read Montague

Andrew Huberman
Watch on YouTube Add to chat My bookmarks← All sources

TL;DR

The four things you'd lose by not watching

4 items

TL;DR

The four things you'd lose by not watching

4 items
1

Dopamine is primarily a learning signal, not just a pleasure or reward molecule. It encodes continuous updates in expectations, not just the final outcome, driving motivation and learning in all mobile creatures.

2

Serotonin often acts in opposition to dopamine, particularly in learning about negative events or unwanted outcomes. SSRIs, by increasing serotonin, can push it into dopamine terminals, potentially reducing the rewarding properties of dopamine.

3

The algorithms used by AI, particularly in reinforcement learning, are based on the same principles of dopamine-driven learning found in biological brains, from honeybees to humans.

4

Effortful, slower activities, like reading a book or playing a sport, are crucial for strengthening neural circuits and fostering long-term learning and resilience, contrasting with the rapid, low-effort stimulation of short-form media.

Protocols

Concrete recipes — what, when, how much, and why

4 items

Structured Breathing for Neurotransmitter Regulation

WhatEngaging in structured breathing exercises (e.g., inhale for 4, hold, exhale) can influence the cycling of norepinephrine and dopamine in the brain.
WhenDuring meditation or as a deliberate practice to engage cognitive control.
DoseSpecific inhale/hold/exhale counts (e.g., 1-2-3-4 inhale, hold, exhale) as instructed.
For whomIndividuals interested in influencing their brain states and neurotransmitter dynamics through conscious control.
WhyBreathing cycles are closely linked to neurotransmitter fluctuations, particularly norepinephrine and dopamine. Deliberately controlling breathing engages cognitive control and can influence these cycles, potentially stabilizing brain states.

Dr. Montague's lab is conducting experiments on how structured breathing impacts neurotransmitter release. Initial findings from deep brain recordings and nasal probes suggest that norepinephrine and dopamine cycle with the breathing rhythm. While free-form breathing shows a clear, metronome-like correlation with neurotransmitter fluctuations, instructed breathing (e.g., specific inhale/hold/exhale counts) engages cognitive control and can make these fluctuations 'wiggle and wobble' more, indicating a more active engagement of the brain. This suggests that conscious control over breathing is not just a physical act but a way to actively modulate brain chemistry, potentially influencing focus, calm, or other desired states.

Norepinephrine and dopamine cycle with the breathing cycle. The most interesting on inhale, exhale or overall they change as you that kind of granular detail is waiting on numbers.

Also said
“Easy breathing you can just see the co you it it it is like a metronome the amplitude of the neurotransmitter fluctuations follows the inhale exhale cycles it's right with it it's very easy you feel like you're watching the brain stem work.”— Describes the baseline correlation between breathing and neurotransmitter activity.
“So when I tell you breathe in two, three, four, hold, you know, da da. And now exhale. Okay, all hell doesn't break loose, but it becomes hard for them to follow and the transmitters are kind of wiggling and wobbling, too.”— Illustrates the impact of cognitive control on these cycles during structured breathing.

Engaging in Competitive Sports for Life Skills

WhatEncouraging children to participate in competitive sports.
For whomParents and educators for children and adolescents.
WhySports provide a unique environment for learning crucial life lessons about effort, reward contingencies, managing losses, and developing resilience and mental fortitude.

Dr. Montague strongly advocates for competitive sports for children, not necessarily to create champions, but because they offer invaluable training for life. Sports teach children about the direct relationship between effort and potential reward, but also how to cope with disappointment and loss, even when they've given their absolute best. He uses wrestling as an example, where learning to stay calm under physical duress (like having one's air cut off) translates to managing panic in other life situations. The public nature of wins and losses in sports, like track and field, forces individuals to confront and manage their emotions. This experience builds resilience, teaches self-management, and provides a template for navigating challenges that are often absent in the modern, less physically demanding world. The 'no-cut' policy in his children's school's tennis team further emphasizes the value of participation and learning these lessons, regardless of skill level.

This is why I like sports for kids. Okay? So, I've made all my kids do sports and one of them did competitive dance. So sports as a means to understand effort, reward, contingency, and learning how to lose even though you've brought everything you could do that day.

Also said
“The best you could possibly do. Yeah, somebody's better than you. You know what are you going to do now? You know that that is a template for a lot of lessons.”— Highlights the learning from losing despite maximum effort.
“You know, I think of wrestling and you get your air cut off and the main thing you learn when you're a wrestler is how to manage your rising sense of panic. Don't panic. You know, think about where you are.”— Provides a specific example of mental fortitude developed through sports.

Deliberate Delay and Slower Foraging

WhatConsciously slowing down the process of collecting information and making decisions, especially in areas like dating or social interactions, rather than seeking rapid updates or immediate gratification.
For whomAnyone navigating complex social or personal decisions, particularly those prone to rapid shifts in interest or expectation.
WhyThe brain's dopamine system is constantly updating expectations. Rapid, frequent updates (like in short-form media or fast-paced dating) can train the brain for quick shifts, potentially undermining the ability to engage in long-term, effortful pursuits. Slower foraging allows for more deliberate data collection and integration.

Dr. Montague's discussion on dopamine's role in continuously updating expectations, rather than just final outcomes, provides a framework for understanding the impact of 'slower foraging.' In real-world scenarios like dating, constantly receiving new, rapidly changing information can lead to a 'sawtooth' pattern of dopamine fluctuations, where expectations are quickly raised and then potentially dashed. This rapid updating, akin to scrolling short-form media, might train the brain to seek constant novelty and quick shifts, potentially making it harder to sustain focus on long-term goals that require sustained effort and slower integration of information. By deliberately slowing down the information intake and decision-making process, individuals can potentially foster a more stable and resilient dopamine system, allowing for a more nuanced evaluation of situations and a greater capacity for sustained engagement.

Personal experience

Andrew Huberman shares an anecdote about advising a friend on dating, suggesting she collect data more slowly or engage in more frequent, but shorter, interactions to avoid rapid cycles of excitement and disappointment.

So, one thing that uh this speaks to then is I've wondered whether activities that require effort that may or may not include reward but that include effort and that are a little bit slower and effort and slower tend to go hand in hand um not always. Uh whether or not that is part of the mechanism that strengthens a circuit.

Also said
“I said, listen, I've noticed this pattern over time. You discount people early or you get very excited and then it always kind of kind of ends up in the same place where you're like, uh, why did I do that? And I was like, well, let's, you know, so maybe run a different algorithm, maybe start to collect data a little bit more slowly or maybe, you know, see them more frequently for like two weeks and then make a decision so it's not you didn't waste so much time.”— Illustrates the practical application of 'slower foraging' in dating.

Physical Distance from Distracting Devices

WhatMaintaining physical distance from smartphones and other distracting devices, such as placing them in another room or a locked box.
For whomAnyone seeking to improve focus, reduce distraction, and enhance cognitive performance.
WhyEven the mere presence of a smartphone, even if unused, can lower cognitive performance by pulling mental resources. Creating physical distance helps to mitigate this effect and improve focus.

Andrew Huberman shares a personal protocol inspired by research indicating that the mere presence of a smartphone, even if face down or in a bag, can reduce cognitive performance. This is because the brain expends resources to suppress the urge to check the phone or to process its potential presence. By physically removing the phone to another room, or even locking it away, these cognitive resources are freed up, allowing for improved focus and higher cognitive function. This practice is a deliberate effort to manage the 'dopamine foraging' impulse that phones can trigger, creating an environment conducive to deeper work and less distraction. It's a strategy to prevent the brain from being constantly pulled into a mode of rapid, low-effort information seeking.

Personal experience

Andrew Huberman describes his personal practice of putting his social media phone in a 'supermax prison lockbox' for 22 hours a day, and keeping his main phone in another room, after reading research on the cognitive impact of phone proximity.

I personally put social media on an old phone and it goes in a supermax prison uh lockbox that you can't code out of for 22 hours a day.

Also said
“I'd read this paper that was published recently that said that if your phone is upside down on a table or in your bag in the same room, it lowers cognitive performance. Even if you're not aware of the phone, then you it's it's pulling resources.”— Provides the scientific rationale for the practice.
“If it's in another room, it seems that your cognitive performance returns to its previously higher levels.”— Highlights the positive outcome of physical separation.

What's new

Personal practice updates, fresh positions, predictions

5 items

Dopamine as a Learning Signal

0:04:40

Dopamine's primary role is as a learning signal, constantly updating expectations and driving behavior, rather than solely being a 'pleasure' or 'reward' molecule.

Why this matters: This reframes the common understanding of dopamine, emphasizing its role in continuous learning and adaptation, which is crucial for understanding motivation and decision-making beyond simple reward-seeking.

Background

Historically, dopamine was largely equated with pleasure and reward. More recent research, particularly from the artificial intelligence world, has highlighted its function in learning.

Dr. Montague explains that the traditional view of dopamine as simply signaling pleasure or the final reward is an oversimplification. Instead, dopamine fluctuations are central to how the brain learns by encoding 'temporal difference errors.' This means dopamine signals the difference between successive predictions, not just the difference between an expectation and a final outcome. This continuous updating of expectations is a more accurate model of how animals, including humans, learn and adapt in complex, dynamic environments where immediate rewards are rare. This mechanism allows for 'chaining events,' where an animal can learn associations across multiple steps leading to a reward, even if the reward itself is distant.

It's very clearly a learning signal number one. So dopamine fluctuations high and low control learning.

Also said
“The reward prediction error that people talk about dopamine representing is the prediction error that you get for every single step whether or not you've received reward.”— Clarifies that dopamine signals continuous prediction errors, not just final reward errors.
“It's the ongoing difference between your expectation and your next expectation. So it's fluctuations in your expectation as you move through the world.”— Emphasizes the dynamic, continuous nature of dopamine signaling in learning.

Dopamine and Serotonin Opponency

0:50:00

Dopamine and serotonin often operate in an opponent fashion, with dopamine signaling positive events and serotonin signaling negative events or unwanted outcomes.

Why this matters: This challenges the idea of these neuromodulators acting independently and suggests a more integrated, push-pull system for evaluating experiences and guiding behavior.

Dr. Montague highlights that his lab's human studies, and some rodent data, consistently show an opponent relationship between dopamine and serotonin. When dopamine levels rise in anticipation or experience of positive events, serotonin levels tend to fall, and vice-versa. This 'seesaw' dynamic suggests that the brain uses these two systems to evaluate the world along a positive-negative axis. Dopamine is associated with learning about positive things or the absence of negative things, driving approach behaviors. Serotonin, conversely, appears to be involved in learning about negative things, potentially promoting avoidance or cautious waiting. This opponency is a recurring theme in the nervous system, similar to color or light/dark opponency in the retina, indicating a fundamental organizational principle for processing information.

The theme that emerges from that is dopamine and serotonin are opponent to one another. When dopamine goes up, serotonin goes down. When serotonin goes up, dopamine goes down.

Also said
“Dopamine has now inherited the positive part of that and serotonin the negative part of that.”— Summarizes the functional assignment of each neuromodulator in this opponent system.
“The first time we were able to measure dopamine and serotonin concurrently, they look opponent and they look opponent all over the place.”— Highlights the empirical observation of this opponency in human measurements.

SSRIs and Dopamine Terminals

0:51:50

SSRIs, while increasing serotonin, can also push serotonin into dopamine terminals, potentially reducing the rewarding properties of dopamine and impacting motivation.

Why this matters: This offers a novel and potentially concerning mechanism for some of the side effects of SSRIs, such as anhedonia, by directly interfering with dopamine's function.

Background

SSRIs are commonly prescribed antidepressants that work by blocking the reuptake of serotonin, thereby increasing its levels in the synapse.

Dr. Montague discusses a significant finding from a 2005 paper by John Danny, which showed that when SSRIs are administered, the increased serotonin doesn't just stay in serotonin terminals. A substantial amount of it gets transported into dopamine terminals via dopamine transporters. If serotonin is the 'negative juice' and dopamine is the 'positive juice,' having serotonin in dopamine terminals could lead to a situation where the brain's reward system is effectively dampened. This could explain why some individuals on SSRIs experience side effects like anhedonia (inability to feel pleasure) or reduced motivation, as the signals for positive reinforcement are blunted. The brain might misinterpret positive events as less rewarding or even negative, leading to a 'depression' of the reward system. This mechanism suggests a more complex interaction between these neuromodulators than previously understood, with implications for how SSRIs impact overall brain function and emotional states.

But it pushes serotonin into the dopamine terminals, too. This is less well understood, but you know, if you were a system and you thought that the positive juice was dopamine and the negative juice was serotonin and you put the negative juice in the positive terminals, then the cells that control the release of that are going to chatter for positive things. You might start negatively conditioning on things that you should actually pursue and learn about.

Also said
“When you increase serotonin in your brain because you won't let it be vacuumed out by the normal mechanisms that clear it from your brain, then it has the opportunity to be there longer and it has the opportunity to go into the dopamine terminals.”— Explains the initial step of serotonin accumulation due to SSRIs.
“This paper by John Danny in 2005 showed it goes into the dopamine system. And he knows that because he could block the dopamine reuptake. And you and it was a 40% difference.”— Provides empirical evidence and magnitude of serotonin entering dopamine terminals.

AI Algorithms and Biological Learning

0:19:00

The algorithms used in advanced AI, particularly reinforcement learning, are based on the same fundamental learning rules and dopamine-driven mechanisms found in biological brains.

Why this matters: This highlights a profound convergence between artificial and biological intelligence, suggesting that nature discovered highly effective learning algorithms that are now being replicated and even surpassed by AI.

Dr. Montague emphasizes that the breakthroughs in AI, such as DeepMind's AlphaGo, which beat the world champion in Go, are built upon algorithms that mirror the dopamine-driven learning rules in biological brains. Specifically, the 'temporal difference reinforcement learning' algorithm, developed by Sutton and Barto, is central to these AI systems. This algorithm allows for continuous learning by updating predictions at each step, rather than just at the final outcome. This is precisely how dopamine functions in the brain, encoding successive predictions and their errors. The fact that these algorithms, once externalized into code, can achieve superhuman performance (like AlphaGo Zero mastering Go and chess from scratch) and also explain learning in diverse creatures from honeybees to humans, points to a universal and highly effective computational strategy for navigating and learning from the world. This convergence suggests that AI is not just mimicking intelligence but has stumbled upon the core computational principles of biological learning.

The Deep Mind guys in London who beat the world go playing champion and made Alpha Fold and won Nobel prizes and I mean they're starting in 2015 they just had this unbelievable series of hits. They used the Sutton and Barto algorithm.

Also said
“But that same algorithm is installed in your head. It's installed in the head of a song bird.”— Directly links AI algorithms to biological brains.
“The fact that we took biological learning rules and gave them to a computer essentially um and the computer then can beat our own use of the biological learning rules um is pretty spectacular and I think it's a little scary but I want to shove that for for it is a little scary.”— Reflects on the significance and implications of this convergence.

Dopamine as a 'Currency' for Motivation and Value

1:15:00

Dopamine acts as a fundamental 'currency' in the brain, assigning common value to dissimilar objects and actions, driving motivation, and influencing our perception of the world's worth.

Why this matters: This metaphor provides an intuitive way to understand how dopamine integrates diverse experiences into a unified motivational system, explaining why we pursue goals and how our perception of value can be altered.

Dr. Montague likens dopamine to a currency because it provides a common valuation scheme for disparate experiences and goals. Just as money allows us to compare the value of a cup to a windshield, dopamine allows the brain to compare the 'worth' of different actions, rewards, or even thoughts. This currency is not just about pleasure but about driving us forward, pushing us to seek new goals once old ones are achieved. He explains that the brain's dopamine system is designed to keep us tracking and moving, preventing habituation to a single outcome. This 'push forward drive' is essential for survival and adaptation. Furthermore, dopamine is directly linked to mitochondrial function, acting as a signal to make ATP available, thus literally providing the energy for life and action. This deep connection between valuation, motivation, and cellular energy underscores dopamine's role as a fundamental currency for biological action and learning.

Is this why you refer to dopamine as a currency? Yes, I refer to it as a currency mainly for the reason that a currency is used. It's a way to take dissimilar objects and assign a common value scheme to them.

Also said
“If any goal that you achieved, whatever it is, taking a drug, eating a food, u getting a a partner or whatnot, um if that was enough for you, right, then you wouldn't keep living. You want that system to keep tracking and once it gets to one place, you want it to have another place to which it could go. Otherwise, you wouldn't live.”— Explains the evolutionary imperative for dopamine to drive continuous pursuit.
“Dopamine is turns on mitochondria. I mean, gives you life. It's probably the literally it literally turns on mitochondria. It binds to the outside mitochondria to monomine oxidase and it initiate it jens up electron transport. I mean, it makes it's a signal to make ATP available.”— Reveals the direct physiological mechanism by which dopamine provides energy for action.

Recommendations

Products, supplements, and tools mentioned in the episode

3 items

Nebula Neuro Probe

Tool

A commercialized version of the nasal probe technology developed in Dr. Montague's lab, designed for personal use to measure neurotransmitter release.

Dr. Montague mentions that a postdoc from his lab, Seth Batten, is developing a company called Nebula Neuro to commercialize the nasal probe technology. The goal is to create an easy-to-use device, similar to squishy earplugs, that individuals can use to get real-time readouts of their dopamine and serotonin levels. This would allow people to 'hack' their own neurochemistry, observing how their neurotransmitter release changes in response to various activities, thoughts, or tasks. For example, one could monitor their dopamine and serotonin while reading a passage, meditating, or engaging in decision-making games, and then use that real-time feedback to learn how to better concentrate or manage their brain states. This represents a significant step towards personalized neurofeedback and self-optimization.

I have a posttock that's making a company that's going to commercialize these things up people's noses. um when it goes from skunk works to kinder and gentler. Um and you could you could hack your own serotonin onto your cell phone, you could put it up there and you could go do a thing and you could watch it on your cell phone.

Find Nebula

Claude AI

Product

An AI language model used by Andrew Huberman for research, summarization, and comparison of scientific literature.

Andrew Huberman expresses his enthusiasm for Claude AI, highlighting its utility for research purposes. He uses it to summarize complex topics, direct him to relevant literature, and, notably, to compare and contrast different scientific perspectives or theories in ways that traditional search engines like PubMed cannot. He appreciates its clean interface and aesthetic. Dr. Montague also shares a personal anecdote of using an AI to explore the relationship between the subjunctive mood in language and complex numbers in quantum mechanics, demonstrating its capacity for generating insightful, interdisciplinary essays. Both acknowledge the impressive capabilities of these large language models, particularly their ability to process and synthesize information across vast domains and languages.

I use Claude. I love Claude AI. I you know I love the interface. I think the answers it I use it for research from time to time.

Also said
“I ask it to direct me to literatures. I guess I've asked it for some summaries here and there, but I've asked it to compare and contrast things, which is really cool because I can't do that in PubMed.”— Highlights specific research applications beyond simple search.
“I asked it what's the relationship between the subjunctive mood and the use of complex numbers and quant and non-relativistic quantum mechanics I asked it that recently just for fun.”— Illustrates the AI's ability to generate complex, interdisciplinary insights.
Find Claude

The Anxious Generation

Book

A book by Jonathan Haidt, discussed in the context of concerns about social media's impact on youth.

I've just read this book the anxious generation. Oh yeah. Jonathan was on this podcast and I was on a MacArthur network um neuroscience and law with him for a while and he he's just a extremely clearheaded person really um always made me think about things on the other hand I don't know um other than the comparison to others and the speed at which social media lets you do that and I have you know I have girls mainly four girls and one boy.

Find The

Notable quotes

Lines worth pulling out — contrarian, specific, or perfectly phrased

5 items
If any goal that you achieved, whatever it is, taking a drug, eating a food, u getting a a partner or whatnot, um if that was enough for you, right, then you wouldn't keep living. You want that system to keep tracking and once it gets to one place, you want it to have another place to which it could go. Otherwise, you wouldn't live.
This quote encapsulates the fundamental, evolutionary drive of the dopamine system: it's designed for continuous pursuit and adaptation, not for static contentment, which is essential for survival.
The fact that we took biological learning rules and gave them to a computer essentially um and the computer then can beat our own use of the biological learning rules um is pretty spectacular and I think it's a little scary but I want to shove that for for it is a little scary.
Highlights the profound and somewhat unsettling convergence between biological and artificial intelligence, where human-derived algorithms are now outperforming human capabilities.
I've always thought about Parkinson's as an active freezing disease that the nervous system is doing exactly what it would do if because it takes energy to transition from where you are to doing the next thing. Why do that if it's there's nothing more valuable there.
Offers a unique and insightful perspective on Parkinson's disease, reframing its symptoms not as a lack of ability but as a rational response to a 'flat value function' caused by dopamine depletion.
When you increase serotonin in your brain because you won't let it be vacuumed out by the normal mechanisms that clear it from your brain, then it has the opportunity to be there longer and it has the opportunity to go into the dopamine terminals.
Reveals a critical, less-known mechanism by which SSRIs might impact the dopamine system, potentially explaining some of their side effects like anhedonia.
Dopamine is turns on mitochondria. I mean, gives you life. It's probably the literally it literally turns on mitochondria. It binds to the outside mitochondria to monomine oxidase and it initiate it jens up electron transport. I mean, it makes it's a signal to make ATP available.
Provides a direct, physiological link between dopamine and cellular energy production, underscoring its fundamental role in driving biological processes beyond just psychological motivation.

Sign in to share feedback

Tell us if this brief hit the mark or missed it — feedback feeds back into the next iteration of the prompt.

Topics covered

dopamine functionmotivation sciencedecision-makinglearning mechanismsneuromodulatorsdopamine and learningreinforcement learningtemporal difference errorforaging behaviorexpectation updatingdopamine and AIserotonin functiondopamine serotonin opponencySSRIs mechanismanhedoniaParkinson's diseaseADHD and dopaminehoneybee learningsocial media impacteffort and learning
Free account

Make this library yours

Reading is free for everyone. A free account adds the personal layer: save protocols, follow experts, and see how the other experts weigh in on this same topic.

Create a free accountSign in

Where the experts disagree — weekly

One email a week: the sharpest new disagreements and protocols from the library. No spam, unsubscribe anytime.

Educational summary of the cited expert source — not medical advice. Open the source recording linked above and consult a qualified physician before acting on any protocol.