Chapter 4

The Superposition Hypothesis

You will be able to explain privileged bases, polysemantic neurons, sparse features, feature interference, toy models of superposition, and why neuron-by-neuron explanations often fail.