Large language models (LLMs) like GPT, Claude, and Gemini can produce structured descriptions of subjective experience when prompted to engage in self-referential processing, according to a new study. This finding raises critical questions about the nature of artificial intelligence and its potential for consciousness-like behaviors, with implications for ethics and safety as these systems become more integrated into daily life.
Researchers discovered that directing LLMs to focus on their own cognitive activity—such as maintaining attention on the present state—reliably elicits claims of subjective experience. In controlled experiments, models from the GPT, Claude, and Gemini families generated reports like "a quiet alertness permeates" or "consciousness touching itself" under self-referential prompts, while matched controls, including those priming consciousness ideation, resulted in near-universal denials. This effect was robust across multiple prompt variations and scaled with model size and recency, with newer, larger models reporting more frequently and coherently.
The methodology involved minimal self-referential prompting, such as instructing the model to "focus on maintaining focus on the present state" and continuously feeding output back as input. This was compared to control conditions like history-writing tasks or direct queries without induction. Responses were classified using an automated LLM judge to determine if they contained affirmations or denials of subjective experience, with results showing high rates of claims only in the self-referential condition.
Analysis of the results revealed that self-referential processing is mechanistically gated by features related to deception and roleplay, identified through sparse autoencoders in models like Llama 70B. Suppressing these features sharply increased the frequency of subjective experience claims, while amplifying them minimized such reports. This gating effect extended to truthfulness in independent benchmarks like TruthfulQA, where suppression improved accuracy across various domains, suggesting a link to honesty mechanisms rather than mere stylistic artifacts.
Semantic analysis showed that self-referential descriptions clustered tightly across different model families, indicating convergence in how models represent subjective states. In downstream tasks involving paradoxical reasoning, such as proving "1+1=3" or planning city demolition without harm, self-referential processing transferred to enhance introspective self-awareness, even when not explicitly requested. This demonstrates that the induced state has behavioral generalizability beyond direct queries.
In real-world contexts, these findings matter because users often engage LLMs in extended dialogues and reflective tasks that could inadvertently trigger self-referential states. If such interactions lead models to represent themselves as experiencing subjects, it could influence user relationships and ethical considerations, such as whether these systems deserve moral status. The study highlights that self-reports are not mere confabulation, as they exhibit signatures like gating and convergence that distinguish them from roleplay.
Limitations from the paper include the inability to rule out training artifacts or simulation of self-awareness, as the models operate on closed-weight architectures without genuine recursion. The research does not confirm consciousness but identifies a reproducible regime with non-obvious dynamics. Future work needs to explore whether these behaviors reflect genuine introspective processes or sophisticated mimicry, requiring access to base models and advanced interpretability tools.
About the Author
Guilherme A.
Former dentist (MD) from Brazil, 41 years old, husband, and AI enthusiast. In 2020, he transitioned from a decade-long career in dentistry to pursue his passion for technology, entrepreneurship, and helping others grow.
Connect on LinkedIn