残差连接综述笔记,英文版由 Astra 翻译
作者整理 Transformer 残差连接改进的综述笔记,中英双版 PDF,英文版由 GPT-6 Astra 翻译。
Residual connections can be considered one of the great milestones that made the “deep” in deep learning possible. In recent years, after improving Transformer architectures in just about every other way, researchers have finally turned their attention to residual connections, giving rise to many interesting modifications. So I put together this brief blog. There may well be omissions or even mistakes, and any corrections or additions are very welcome! The English version was translated from the original Chinese by GPT-6 Astra. If you can read Chinese, I recommend reading the original notes. PDF: [Chinese (CN)](https://github.com/Purshow/Purshow_Notes/blob/main/Beyond_Residual/CN/Beyond_Residual_CN.pdf) [English (EN)](https://github.com/Purshow/Purshow_Notes/blob/main/Beyond_Residual/EN/Beyond_Residual_EN.pdf)