AI & ML interests

Staging repository for kernels-community.

Recent Activity

kernels-bot  updated a model about 9 hours ago
kernels-staging/finegrained-fp8
kernels-bot  updated a model 1 day ago
kernels-staging/flash-attn3
kernels-bot  published a model 1 day ago
kernels-staging/finegrained-fp8
View all activity

danieldk 
posted an update about 13 hours ago
view post
Post
36
We have recently added Torch Stable ABI support to kernels and kernel-builder. This allows kernel developers to target a particular Torch version and the kernel will be supported on that Torch version and later Torch versions (up to ~2 years).

This makes it much easier to write kernels with long-term support and not just the last two Torch releases.

We have also started rolling out Stable ABI support to kernels in kernels-community, starting with Flash Attention 3, supporting Torch 2.9 and later as well as CUDA versions starting at 12.6:

https://huggingface.co/kernels/kernels-community/flash-attn3/tree/v1/build
  • 1 reply
·