Over-reliance on chatbots can diminish critical-thinking skills, study finds

The MIT Study's Findings

A new study from the Massachusetts Institute of Technology is the latest research to find that relying too much on chatbots can diminish critical-thinking skills, and potentially decrease our ability to discern misinformation for ourselves.

The Impact of AI on Critical Thinking

During the four-week study, researchers tracked 67 participants and quizzed them on whether pairs of news-related headlines and images were real. They found that AI assistants like Claude and ChatGPT would be useful for detecting fake news – but when participants relied on them too much, they became worse at spotting misinformation.

The Data Analysis

Researchers found that when it came to deciding which news headlines and images were real, AI often prioritized an accurate response, rather than cultivating an ability to think. This dependency could actually worsen judgment in the long-term, according to the study. Participants in the month-long study were asked to respond to questions about fake news and images with and without the help of an AI assistant that runs on GPT-4o and is integrated with Google search.

The Impact Analysis

The study authors evaluated how helpful AI was in guiding participants to make an accurate decision, as well as how their independent judgment changed over time. They found a trade-off: AI helped participants better discern what’s real – and resulted in a 21% higher chance they would make the right call. But their unassisted performance, when reviewing new images without AI’s help, grew 15.3% worse in the experiment’s fourth week.

The Prediction

Concerns about the effects of depending too much on AI, and even other forms of technology, aren’t new. Calculators and GPS devices have dulled the ability to do mental math and navigate neighborhoods without assistance. The study’s observations are also relevant for the broader public, given an inundation of dubious online information, from news and viral images to medical claims and political rumors. “As AI becomes increasingly sophisticated, ensuring these tools build critical thinking skills rather than cognitive dependency becomes essential for maintaining public resilience to misinformation,” the study notes.