NPU LLM - a EmbeddedLLM Collection

EmbeddedLLM 's Collections

Onnxruntime DirectML GenAI

Onnxruntime CPU GenAI

NPU LLM

OpenVINO Model Server (OVMS)

NPU LLM

updated Sep 3, 2024

microsoft/Phi-3-mini-4k-instruct

Text Generation • 4B • Updated 16 days ago • 2.11M • 1.36k
microsoft/Phi-3-mini-128k-instruct

Text Generation • 4B • Updated 16 days ago • 86k • 1.69k
microsoft/Phi-3-medium-4k-instruct

Text Generation • 14B • Updated 16 days ago • 12.7k • 223
microsoft/Phi-3-medium-128k-instruct

Text Generation • 14B • Updated 16 days ago • 4.06k • 385