Jev 的 RLCD 训练法与 BERT 分类器路线对比
一条短评:Jev 用 RLCD 训练做决策系统,作者把它和双向 BERT、mmBERT、CPU 上的 Julia 这类廉价耐用架构放在一起看。
great to see that, people are getting back to core Machine Learning by working on systems like classifers. Decision making systems like Jev by @typesafeai is trained through a methodology called RLCD, but every without it there were architectures like using bidirectional BERT for the same task. I think Laya does smthg same im not sure coz havnt read it yet, but Julia -1 works on similar principles of mmBERT. mmBERT demonstrates that low-resource languages can be effectively learned during the decay phase of training and Julia works on CPU so yup.. good to see good durable and cheap systems again.
这条是引用着另一条写的:x.com/supersonicai/status/2103922653585162248