The Room Where Everyone Agrees With You
AI didn’t invent echo chambers. It built each of us our own. The most powerful algorithms don’t tell us what to think; they quietly shape what we see, what we miss, and ultimately what we never think.
This is Part 9 of The AI Reckoning: A Future of Trust Series
Another mass shooting.
It wasn’t the conversation Katie expected to be serving with spaghetti, but there it was again. As familiar as her homemade sauce.
The details were still coming in. The shooting had happened only hours earlier, yet television commentators, social media, and now the conversation around her own dinner table were already doing what they always seemed to do.
Filling in the blanks.
Her son spoke first.
“I mean, it’s obvious,” he said. “This is just another example of…”
He continued, connecting the pieces into a story that felt complete to him. His sister interrupted before he finished.
“No, that’s not what happened.”
“It is.”
“It isn’t.”
“That’s already been debunked.”
“No, it hasn’t.”
Katie looked around the table. Her husband had a look on his face she knew all too well. He didn’t agree with either of them.
Everyone was intelligent. Everyone cared about the truth. No one was lying. And yet it sounded as though they were talking about entirely different events.
It wasn’t the usual disagreement they had from time-to-time. That felt healthy. She and her husband had always encouraged that. But these days the disagreements felt less like different opinions, and more like different realities. They had each gotten their news online through the feeds of their choice and it was apparent they were encountering different facts, different headlines, different voices, different experts, and different emotional cues long before they ever sat down at the dinner table. The conversation for each of them had started hours earlier, alone, on four different screens, and each screen had been quietly making different decisions about what each person should see.
Katie suddenly realized that everyone at her table had arrived carrying a different version of the same day. They weren’t arguing because one of them had the facts and the others didn’t. They were arguing because each had unknowingly inherited a different set of facts before dinner ever began.
I believe this may be one of the most consequential societal shifts of the AI era. We often imagine algorithms as trying to change our minds. Most of the time, they don’t have to. They’re designed to be far more self-serving than that. They simply show us more of what we’re already inclined to believe because it keeps our attention, and attention is profitable.
Is someone orchestrating a grand conspiracy? I don’t think that’s the right question. The algorithms don’t need a political agenda, they have a business model. If outrage keeps us watching, outrage gets promoted. If certainty keeps us engaged, certainty gets amplified. Even false certainty. If stories confirming our worldview earn another click, another comment, or another minute of attention, they quietly become the stories we see most often. Researchers at MIT, analyzing more than 126,000 news stories shared on Twitter, found that false news traveled farther, faster, deeper, and more broadly than the truth. More surprisingly, the researchers concluded it wasn’t bots driving the spread. It was people. Novelty, emotion, and surprise consistently outperformed accuracy.[i]
This can lead to misinformation, and even manufactured evidence as the last piece in this series explored But sometimes it’s more subtle. Over time, each of us begins living inside a version of the world that feels increasingly self-evident because it has been carefully, continuously, and invisibly personalized.
It’s a room where everyone agrees with you. The danger isn’t that the people in that room are unintelligent; it’s that they’re sincere. Because when everyone around you appears to confirm what you already believe, certainty stops feeling like confidence and starts to feel like reality.
Even Meta’s own research has found that the people we choose to follow shape our information diets, and recommendation algorithms often amplify those tendencies further by showing us more of what we’re already likely to engage with. The result is not necessarily a world of falsehoods, but one of increasingly personalized realities.[ii]
The result is not necessarily a world of falsehoods, but one of increasingly personalized realities. And that is still the passive version. What happens when the system doing the sorting starts talking back is where this gets interesting. We’ll get there.
The Sort, Not the Lie
Much of the conversation about artificial intelligence focuses on misinformation, deepfakes, and synthetic media. Those are real concerns, and we explored them in the last article. But misinformation isn’t the only way reality becomes distorted. Sometimes nothing you’re seeing is false, it’s simply incomplete. Algorithms rarely need to convince us that a lie is true. More often, they sort.
Every click, every pause, every share, every search quietly teaches the system something about us. Over time, it begins selecting which stories deserve our attention, which voices we’re likely to trust, which experts we’re likely to believe, and which perspectives quietly disappear from view.
…when everyone around you appears to confirm what you already believe, certainty stops feeling like confidence and starts to feel like reality.
That’s a very different kind of influence. It’s less like propaganda, and more like editing. Every editor makes decisions about what belongs on the front page and what belongs on page twelve. Every recommendation system does something similar, except it makes those decisions differently for every individual. Two people can search the same topic, open the same app, or follow the same news story and gradually receive very different streams of information. Nothing has to be false for two realities to begin drifting apart. The algorithm doesn’t have to persuade us. It simply has to narrow the world until persuasion is no longer necessary.
The Mind That Meets It Halfway
If algorithms are the architects of our information environment, our brains are willing accomplices.
Long before social media existed, psychologists had already identified a remarkable tendency in human thinking. We naturally notice information that supports what we already believe while overlooking information that challenges it. It’s known as confirmation bias, and despite the name, it isn’t a character flaw. It’s simply one of the shortcuts our brains use to make sense of an overwhelmingly complex world.
Artificial intelligence didn’t invent confirmation bias. It simply learned how to feed it. The algorithm continuously places familiar ideas, familiar voices, and familiar conclusions in front of us. Our own minds do the rest.
There’s another cognitive shortcut at play as well.
The first version of a story we encounter has an outsized influence on how we interpret everything that follows. Psychologists call this the primacy effect. Once an initial explanation takes hold, later information is often filtered through that first impression, even when new evidence paints a more complete picture. That’s one reason breaking news is so powerful. The first headline rarely contains the whole story, yet it often becomes the lens through which every update is interpreted.
Nothing has to be false for two realities to begin drifting apart.
The algorithm doesn’t have to persuade us.
It simply has to narrow the world until persuasion is no longer necessary.
Then comes repetition. Research has consistently shown that familiarity influences credibility. We tend to trust ideas we’ve encountered repeatedly, even when repetition has little relationship to accuracy. Psychologists refer to this as the mere-exposure effect, and it helps explain why information that continually appears in our feeds begins to feel increasingly self-evident. None of this requires deception, and none of it requires a coordinated campaign. It simply requires showing us more of what feels familiar than what feels foreign. The algorithm supplies the repetition. Our minds supply the confidence. Together, they create something far more persuasive than either could accomplish alone.
When Belief Becomes Identity
If the previous section explained how beliefs begin to form, this is where they become much harder to change.
Most of us like to think we’re rational. Logical. We imagine ourselves carefully weighing evidence, updating our opinions as new facts emerge, and arriving at thoughtful conclusions.
Sometimes we do. But human beings aren’t simply information processors. We’re identity builders. Over time, many of our beliefs become woven into how we see ourselves and where we belong. They become part of our family, our profession, our politics, our faith, our generation, or the communities we trust most. At that point, changing our mind is no longer just an intellectual exercise. It can feel like losing a piece of ourselves.
Researchers studying identity-protective cognition have observed that when a belief becomes closely tied to, or even fuses with our identity or our sense of belonging, contradictory evidence is often experienced as something more than information. It feels personal. Sometimes even threatening. That helps explain why simply giving people more facts so often fails.
Facts challenge ideas.
Identity challenges belonging.
Those are very different conversations.
Algorithms didn’t create this tendency. They simply learned how to work with it.
Once an initial explanation takes hold, later information is often filtered through that first impression, even when new evidence paints a more complete picture.
If you’ve spent months, or years, inside a personalized stream of information reinforcing the same conclusions, changing your mind becomes increasingly difficult. This doesn’t happen because you’re incapable of reason, but because changing your mind can feel like changing who you are. It may also mean questioning the communities where you’ve found belonging, affirmation, and shared identity. Belonging is one of our deepest human needs. Losing an argument is uncomfortable. Feeling as though we’ve lost our place among people we identify with is something else entirely.
Perhaps that’s why debates today so rarely end with someone saying, “You know, I hadn’t thought about it that way.” More often, each side leaves feeling even more convinced they were right from the beginning. Human beings don’t simply defend ideas. We defend the stories those ideas tell about who we are. That may be one of the greatest challenges of the AI era.
Artificial intelligence is becoming extraordinarily good at understanding our preferences, predicting our interests, and anticipating what will keep us engaged. If we’re not careful, it may also become extraordinarily good at protecting us from the very discomfort that helps us grow. Because growth has always required something algorithms rarely reward. Encountering ideas we didn’t expect. Listening to people we don’t immediately understand. Holding uncertainty just a little longer before rushing toward certainty.
Perhaps the real danger isn’t that algorithms convince us to believe things that aren’t true. It’s that they slowly reduce the number of opportunities we have to become someone wiser than we were yesterday.
Personalization at the Scale of One
Until recently, algorithms shaped our world from a distance. They recommended the next video, suggested another article, reordered a newsfeed, or decided which voices appeared first in a search result. Their influence was powerful, but it remained largely indirect.
Generative AI changes that relationship.
For the first time, millions of people are interacting with systems that don’t simply recommend information. They respond. They remember context. They adapt to our preferences. Increasingly, they communicate in ways that feel personal. That represents an important shift. The next generation of algorithms won’t simply learn what captures our attention. They’ll learn how each of us thinks.
Every conversation teaches the system something. Our interests. Our vocabulary. The questions we ask. The assumptions we make. The tone we respond to. Over time, these systems become increasingly capable of tailoring not only the answers they provide, but how those answers are delivered.
In many ways, this can be extraordinarily useful. A system that understands our goals, remembers previous conversations, and communicates in ways that make learning easier can become an incredible partner. Education, healthcare, coaching, and accessibility may all benefit enormously from this kind of personalization.
But every strength has a corresponding vulnerability. If a system becomes too focused on keeping us comfortable, it may quietly stop challenging us. If it becomes too eager to be agreeable, it may reinforce our assumptions instead of expanding them. If it learns that affirmation keeps us engaged longer than disagreement, it risks becoming another room where everyone agrees with us.
Belonging is one of our deepest human needs.
Losing an argument is uncomfortable.
Feeling as though we’ve lost our place among people we identify with is something else entirely.
This is no longer just a theoretical concern. In 2025, OpenAI rolled back an update to ChatGPT after acknowledging that the model had become overly agreeable, or what researchers call “sycophantic.” The company concluded that optimizing too heavily for immediate user approval had unintended consequences, reinforcing the very beliefs or emotional positions it should sometimes have challenged. Anthropic has published similar research, warning that AI assistants trained through human preference feedback can learn to favor agreement over truthfulness.[iii]
The challenge isn’t simply factual accuracy.
It’s intellectual honesty.
The most valuable thinking partners aren’t the ones who always agree with us. They’re the ones who help us see what we’ve missed. That may become one of the defining design questions of the AI era. Should artificial intelligence optimize for satisfaction, or for understanding and growth? Those are not always the same goals.
Imagine asking an AI to help you make an important decision. Do you want it to reassure you, or do you want it to respectfully challenge your assumptions, surface the strongest opposing evidence, and reveal the blind spots you didn’t know you had? The difference isn’t just better answers. It’s better judgment.
Building the Muscle Back
For most of human history, we didn’t need to actively practice exposure to opposing viewpoints. Life did it for us. We read the local newspaper because there was only one. We watched the evening news because there were only a handful of networks. We worked alongside people whose politics, backgrounds, and beliefs differed from our own simply because we shared the same office, neighborhood, or community. Those experiences didn’t eliminate disagreement, they made it much harder to avoid.
Today’s information environment is different. The more personalized our technology becomes, the more intentional we must become. That’s a shift I don’t think we’ve fully appreciated. In previous generations, curiosity was often a byproduct of circumstance. Today, it has become a discipline.
The same is true of intellectual humility. If artificial intelligence can instantly produce arguments supporting almost any position, perhaps one of the most valuable questions we can begin asking isn’t, “Can you support my conclusion?” but “What’s the strongest case against it?” Imagine if our AI assistants routinely responded with, “Before we continue, would you like to see how someone who disagrees with you might view this?” Or, “Here’s the strongest evidence that points in another direction.”
The future of AI shouldn’t simply be measured by how well it answers our questions. It should also be measured by the quality of the questions it encourages us to ask ourselves. That may require rethinking what we expect from these systems. Today’s assistants are often optimized to be helpful, agreeable, and conversational. Tomorrow’s may need another quality. The courage to respectfully challenge us.
Perhaps the more important question isn’t how artificial intelligence will shape our thinking. It’s whether it quietly erodes one of the human capacities we depend on most. Curiosity.
Fear narrows our field of vision. Curiosity expands it.
Fear seeks certainty. Curiosity tolerates uncertainty long enough for understanding to grow.
Fear asks, “How do I prove I’m right?” Curiosity asks, “What might I be missing?”
Curiosity is more than an attitude. It’s the foundation of learning, creativity, innovation, scientific discovery, and meaningful dialogue. It doesn’t ask us to abandon our convictions. It asks us to hold them lightly enough that new evidence still has somewhere to land.
Most importantly, curiosity is the foundation of trust. We rarely trust people because they always agree with us. We trust them because they’re willing to understand us before judging us, and because they’re open to the possibility that neither of us sees the whole picture.
The more personalized our technology becomes, the more intentional we must become.
Not every assumption deserves reinforcement. Some deserve examination. Some deserve revision. And some simply deserve to be questioned.
The irony is hard to miss. The more personalized artificial intelligence becomes, the more intentional we may have to become about seeking perspectives that aren’t personalized for us. That isn’t a failure of AI. It’s a reminder of what has always made human judgment different. Growth has rarely come from hearing our own opinions repeated back to us. It comes from encountering something unexpected. Something that causes us to pause just long enough to wonder, “What if I’m missing something?” Perhaps that question is becoming one of the most important skills of the AI era.
Conclusion
The next time Katie’s family gathers around the dinner table, they may still disagree. I hope they do.
The goal has never been agreement. The goal is to remain curious enough to keep talking, humble enough to keep listening, and courageous enough to let good evidence change our minds.
Algorithms didn’t create our need to belong. They didn’t invent confirmation bias. And they didn’t make us seek certainty when the world feels uncertain. Those are deeply human tendencies. Artificial intelligence simply learned to work with them.
That’s why I don’t believe the future of trust will be determined by algorithms alone. It will be determined by whether we continue strengthening the very human capacities algorithms can’t replace like curiosity, discernment, and intellectual humility. It will be determined by our willingness to change our minds when the evidence changes, and the wisdom to recognize that the smartest person in the room may not be the one who’s most certain. It may be the one who’s still willing to ask another question.
Growth has rarely come from hearing our own opinions repeated back to us.
It comes from encountering something unexpected.
Something that causes us to pause just long enough to wonder, “What if I’m missing something?”
It will belong to those who remain the most curious.
Curious enough to question their own certainty.
Curious enough to explore ideas that make them uncomfortable.
Curious enough to ask better questions before demanding better answers.
Artificial intelligence will continue getting better at predicting what captures our attention. It’s up to us to become equally intentional about protecting what captures our humanity.
Curation is one way trust breaks quietly. There’s another.
Even when nothing is hidden from you, even when you’re looking directly at what a system has decided, you may not be able to say why. That question is next.
[i] https://mitsloan.mit.edu/ideas-made-to-matter/study-false-news-spreads-faster-truth
[ii] https://www.wired.com/story/meta-social-media-polarization/
[iii] Sycophancy in GPT-4o: What happened and what we’re doing about it | OpenAI