Hugging Face's logo
Lucas Silva 's picture
24 1 31

Lucas Silva PRO

YuLexuan30
rooox's profile picture Fataj's profile picture webxos's profile picture
·

AI & ML interests

None yet

Recent Activity

reacted to SeanLee97's post with 🚀 3 days ago
Our lab recently released a paper where we introduce ShadowPEFT, a new Parameter-Efficient Fine-Tuning (PEFT) paradigm tailored for edge computing scenarios. Unlike traditional approaches such as LoRA and its variants, which inject trainable parameters directly into the weights of Transformer, requiring tight coupling with the backbone. ShadowPEFT instead enhances the frozen large base model by adding a lightweight, centralized, pretrainable, and detachable Shadow network. This shadow network operates in parallel with the base model, delivering learned corrections to each decoder layer. Because the shadow module is architecturally decoupled from the backbone, it can be independently trained, stored, and deployed, benefiting edge computing scenarios and edge-cloud collaboration computing. - HF Paper: https://huggingface.co/papers/2604.19254 - GitHub: https://github.com/ShadowLLM/shadow-peft - HF Collection: https://huggingface.co/collections/shadow-llm/shadow-peft-models
reacted to SKT-SUPPORT's post with 🚀 6 days ago
Open Source just got a lot bigger. 🚀 ​SKT-SURYA-H (2.544T) is officially out! ✅ Heterogeneous MoE ✅ 131K Context ✅ 3.76TB Weights (898 shards) ​Massive respect to the team for keeping it open for the community! 🤝🇮🇳 ​Link: https://huggingface.co/sKT-Ai-Labs/SKT-SURYA-H ​#OpenSource #MachineLearning #AITools #Bharat
liked a Space 24 days ago
Lightricks/sap-flux-klein
View all activity

Organizations

lorafrenzi's profile picture