@mrm8488 on Hugging Face: "Working on a concept `GPT-2 (small)` that uses `KANs` instead of `MLPs`. The…"

Join the conversation

Join the community of Machine Learners and AI enthusiasts.

posted an update May 8, 2024

Post

9158

Working on a concept GPT-2 (small) that uses KANs instead of MLPs.
The ckpt and training code will be soon on the hub.

very interested in this

Can you share what the training speeds look like ?

·

Sure

Im curious how this will turn out!

Still not yet out?

In this post