Why Transformers Need Adam: A Hessian Perspective
Paper
•
2402.16788
•
Published
•
2
Tian Ding
tianding100
AI & ML interests
LLM, L2O
Organizations
None yet
authored
a
paper
over 1 year ago