AIbase
Product LibraryTool Navigation

sophia-jax

Public

JAX implementation of 'Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training'

Creat2024-05-23T23:14:09
Update2024-11-07T07:05:54
2
Stars
0
Stars Increase

Related projects