Notes

• Jan 16, 2026 10,924x: The Instability Bomb at 1.7B Scale — Part 2 of the mHC reproduction series. I scaled from 10M to 1.7B parameters and watched Hyper-Connections hit 10,924x signal amplification. That's not a typo.
• Jan 11, 2026 DeepSeek's mHC: When Residual Connections Explode — DeepSeek replaced standard residuals with massive Hyper-Connections, and then watched them explode. I reproduced the 9x signal amplification to understand their fix: the Sinkhorn-Knopp algorithm. Part 1 of 2.