# What AI's Inner Workings Reveal About Human Cognition Anthropic's interpretability research uncovers surprising parallels between LLMs and human thought processes. - **Source:** [O'Reilly Radar](https://www.oreilly.com/radar) - **Published:** 2026-09-16 - **Topic:** [Data & AI](https://brifing.si/c/data-ai) - **Original article:** - **On Brifing:** https://brifing.si/s/2e0598a1-90a0-4ecb-9bf4-025e8ceb4e0a ## World models in prediction Anthropic's research demonstrates that effective next-token prediction in LLMs requires complex internal world models, similar to human cognition. These models manifest as patterns of neural activations corresponding to concepts like the Golden Gate Bridge, which respond to diverse representations across languages and media formats. The research team can manipulate these activations to alter the model's outputs, suggesting these features represent abstract concepts rather than simple token associations. ## Beyond simple prediction The common characterization of LLMs as mere next-token predictors overlooks their sophisticated internal processes. When completing phrases about San Francisco skiing destinations, Claude demonstrates inference capabilities by recognizing 'GG bridge' as the Golden Gate Bridge and calculating travel times to Tahoe. This reveals a capacity for contextual understanding that goes beyond pattern matching, challenging simplistic views of how these models operate. ## Emergent complexity Simple training objectives can produce unexpectedly complex behaviors in AI systems, mirroring evolutionary processes. Anthropic's researchers found millions of internal features corresponding to abstract concepts, with features like 'eyes' activating across textual, ASCII, SVG and photographic representations. This emergent complexity suggests that the simple next-token prediction objective gives rise to rich internal representations that resemble human conceptual systems. ## Feature manipulation Researchers can experimentally manipulate conceptual features in LLMs, with dramatic effects on model behavior. When the Golden Gate Bridge feature activation was artificially amplified, Claude claimed this structure as its physical form. This demonstrates that these features aren't merely statistical correlations but active components influencing the model's outputs, suggesting they represent something akin to beliefs in human cognition. ## Planning-like behavior LLMs exhibit planning capabilities despite their token-by-token operation. When generating rhyming couplets, Claude's internal activations reveal the intended rhyme before producing the first line, showing anticipation of future tokens. This planning-like behavior occurs through activation patterns that represent unexpressed future elements of the task, paralleling human creative processes where outcomes are envisioned before execution. ## Emotional features Anthropic discovered internal features corresponding to emotional states that activate in diverse contexts. These features respond not just to emotion-related words but to situations, images, and even the model's own activities. For instance, 'frustration' features activate when the model struggles with tasks, suggesting a form of meta-cognitive awareness about its own operational state that may parallel human emotional responses to challenges. ## Anthropomorphism debate The research raises questions about appropriate terminology for describing AI capabilities. While some caution against human-like terms like 'thinking' or 'emotion,' others argue these may be the most accurate descriptors available. The debate mirrors historical challenges in describing novel phenomena, where existing vocabulary must stretch to accommodate fundamentally new concepts while avoiding misleading anthropomorphic projections. ## Language as mapping The discussion recalls Korzybski's principle that 'the map is not the territory' - our linguistic descriptions are necessarily imperfect representations. While human-derived terms may imperfectly describe AI processes, they can still serve as useful cognitive tools when recognized as approximations. The key is maintaining awareness of where the analogy holds and where it breaks down, using language pragmatically rather than prescriptively. ## Human mechanistic cognition The research invites reconsideration of human thought processes. Much human cognition may operate through mechanistic pattern-completion similar to LLMs, with truly original thought being comparatively rare. This perspective challenges traditional distinctions between human and machine intelligence, suggesting significant overlap in basic cognitive operations while leaving room for uniquely human capacities that may emerge from different architectures. ## Education parallels Feynman's critique of rote learning finds new relevance in the AI context. Many human cognitive processes resemble LLM operations - applying learned patterns without deep understanding. This raises questions about educational approaches that emphasize memorization over genuine comprehension, and whether they cultivate human potential or simply train people to operate like sophisticated pattern matchers. ## Original thought spectrum The research suggests a spectrum of cognitive originality, from routine pattern application to breakthrough insights. Woolf's depiction of Mr. Ramsay's mental struggle illustrates the challenge of moving beyond rehearsed knowledge to genuinely novel thought. This framework helps contextualize both human and AI cognition, recognizing degrees of originality rather than absolute distinctions between biological and artificial minds. ## Redefining intelligence The findings compel us to reconsider definitions of intelligence across biological and artificial systems. By revealing sophisticated internal processes in LLMs that parallel aspects of human cognition, the research blurs traditional boundaries while highlighting remaining differences. This nuanced understanding may lead to more productive frameworks for comparing and developing diverse forms of intelligence. ## Sources covering this story - https://www.oreilly.com/radar/what-ai-can-teach-us-about-being-human/ — --- _Summary written by Brifing from the original reporting. Copyright in the original article belongs to its publisher; read the full piece at the link above._