Sophia: A Scalable Second-Order Optimizer for Language Model Pre-Training

 (arxiv.org)

3 points | by Anon84 3 hours ago

0 comments