This is a mechanistic analysis of transformer internals using post-hoc interpretability methods; it raises questions about component interactions and causal roles rather than testing clinical or practical hypotheses with controlled comparisons.
Hypothesis-GeneratingMark Oskin
Reported
Median ratio, mass away to mass t…7
Components carrying 90% of predic…53
Components prediction cannot surv…13