Blog博客

October 20262026 年 10 月

Recursive Generalization and Superposition Are Both Right递归泛化与重叠都是对的

We tracked 240 neurons of Pythia-160M during training and found that generalization and superposition happen together, along with replacement and sporadic features.

我们在训练过程中追踪了 Pythia-160M 的 240 个神经元，发现泛化与重叠同时发生，此外还有替换和零散特征。

Lang Gao, Jinghui Zhang, Xiuying Chen (MBZUAI) Read the post阅读全文