method · first seen 7 Oct 2026
attention head ablation
Disabling specific attention heads in a transformer to measure their causal contribution to a model behavior.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Bridge Routing Heads: Where Multilingual Multi-hop Reasoning Lives in LLMsPapers · 7 Oct 2026 · Seunghan Kim, Minyeong Choe, Hyunil Kim, Haehyun Cho
- From Relation-Specific Heads to Shared Interventions: Contextual Entrainment in Language ModelsPapers · 13 Oct 2026 · Jinghan Zheng, Jiajun Shi
- Can Capability Enhancement be Localized?Papers · 15 Oct 2026 · Anh Tuan Nguyen, Anna Bair, Zico Kolter
- One Head Away from Language Confusion: Single Attention Heads Across Model FamiliesPapers · 18 Oct 2026 · Jiwon Jeong, Anjelo Jann Laroza, Chaewoon Yoon, Arjun Pillai, Pranav Kokati, Chr…
- Causal Localization of Evidence Effects in TransformersPapers · 27 Oct 2026 · Jipeng Li, Pramod Khargonekar, Yanning Shen
- When Bigger Becomes Brittle: Why Compression Hurts More as Language Models ScalePapers · 5 Nov 2026 · Gautam Gupta, Dikshant Kukreja, Unique Kumar, Avni Mittal, Deepanshu Dabas, Kshi…
Latest sources
- When Bigger Becomes Brittle: Why Compression Hurts More as Language Models ScalePapers · 5 Nov 2026 · Gautam Gupta, Dikshant Kukreja, Unique Kumar, Avni Mittal, Deepanshu Dabas, Kshi…
- Causal Localization of Evidence Effects in TransformersPapers · 27 Oct 2026 · Jipeng Li, Pramod Khargonekar, Yanning Shen
- One Head Away from Language Confusion: Single Attention Heads Across Model FamiliesPapers · 18 Oct 2026 · Jiwon Jeong, Anjelo Jann Laroza, Chaewoon Yoon, Arjun Pillai, Pranav Kokati, Chr…
- Can Capability Enhancement be Localized?Papers · 15 Oct 2026 · Anh Tuan Nguyen, Anna Bair, Zico Kolter
- From Relation-Specific Heads to Shared Interventions: Contextual Entrainment in Language ModelsPapers · 13 Oct 2026 · Jinghan Zheng, Jiajun Shi
- Bridge Routing Heads: Where Multilingual Multi-hop Reasoning Lives in LLMsPapers · 7 Oct 2026 · Seunghan Kim, Minyeong Choe, Hyunil Kim, Haehyun Cho