blog
-
Where does information actually flow in a transformer?
Transfer entropy as a directional lens on layers, tokens, and attention heads in VLMs and LLMs, and how it turns into a pruning recipe. A walkthrough of our NeurIPS 2026 paper.
Transfer entropy as a directional lens on layers, tokens, and attention heads in VLMs and LLMs, and how it turns into a pruning recipe. A walkthrough of our NeurIPS 2026 paper.