Introducing the Sophia optimizer, a faster alternative to AdamW 3 years agoCode: https://github.com/Liuhong99/Sophia 0ThreadHN