An uncontrolled, exploratory computational study investigating a mechanistic hypothesis about weight initialization; results on a surrogate endpoint (loss) do not translate to downstream performance, limiting actionability.
Study details
DesignExploratory computational experiment
InterventionPre-training on non-language symbolic data…
ComparatorRandom initialization and transfer from add…