ZHANGYUXUAN-zR commited on
Commit
4f96cc5
ยท
verified ยท
1 Parent(s): c0a80ae

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +22 -42
README.md CHANGED
@@ -5,7 +5,6 @@ language:
5
  library_name: transformers
6
  license: mit
7
  pipeline_tag: text-generation
8
- arxiv: 2602.15763
9
  ---
10
 
11
  # GLM-5-FP8
@@ -16,17 +15,18 @@ arxiv: 2602.15763
16
  <p align="center">
17
  ๐Ÿ‘‹ Join our <a href="https://raw.githubusercontent.com/zai-org/GLM-5/refs/heads/main/resources/wechat.png" target="_blank">WeChat</a> or <a href="https://discord.gg/QR7SARHRxK" target="_blank">Discord</a> community.
18
  <br>
19
- ๐Ÿ“– Check out the GLM-5 <a href="https://z.ai/blog/glm-5" target="_blank">technical blog</a>.
20
- <br>
21
- ๐Ÿ“„ Read the paper: <a href="https://huggingface.co/papers/2602.15763" target="_blank">GLM-5: from Vibe Coding to Agentic Engineering</a>.
22
- <br>
23
- ๐Ÿ’ป Official code: <a href="https://github.com/zai-org/GLM-5" target="_blank">zai-org/GLM-5</a>.
24
  <br>
25
  ๐Ÿ“ Use GLM-5 API services on <a href="https://docs.z.ai/guides/llm/glm-5">Z.ai API Platform. </a>
26
  <br>
27
  ๐Ÿ‘‰ One click to <a href="https://chat.z.ai">GLM-5</a>.
28
  </p>
29
 
 
 
 
 
 
30
  ## Introduction
31
 
32
  We are launching GLM-5, targeting complex systems engineering and long-horizon agentic tasks. Scaling is still one of the most important ways to improve the intelligence efficiency of Artificial General Intelligence (AGI). Compared to GLM-4.5, GLM-5 scales from 355B parameters (32B active) to 744B parameters (40B active), and increases pre-training data from 23T to 28.5T tokens. GLM-5 also integrates DeepSeek Sparse Attention (DSA), largely reducing deployment cost while preserving long-context capacity.
@@ -78,35 +78,13 @@ See footnote for more evaluation details.
78
 
79
  ### Prepare environment
80
 
81
- vLLM, SGLang, KTransformers, and xLLM all support local deployment of GLM-5. A simple deployment guide is provided here.
82
-
83
- + vLLM
84
-
85
- Using Docker as:
86
-
87
- ```shell
88
- docker pull vllm/vllm-openai:nightly
89
- ```
90
 
91
- or using pip:
92
-
93
- ```shell
94
- pip install -U vllm --pre --index-url https://pypi.org/simple --extra-index-url https://wheels.vllm.ai/nightly
95
- ```
96
-
97
- then upgrade transformers:
98
-
99
- ```
100
- pip install git+https://github.com/huggingface/transformers.git
101
- ```
102
-
103
- + SGLang
104
-
105
- Using Docker as:
106
- ```bash
107
- docker pull lmsysorg/sglang:glm5-hopper # For Hopper GPU
108
- docker pull lmsysorg/sglang:glm5-blackwell # For Blackwell GPU
109
- ```
110
 
111
  ### Deploy
112
 
@@ -117,7 +95,7 @@ vLLM, SGLang, KTransformers, and xLLM all support local deployment of GLM-5. A s
117
  --tensor-parallel-size 8 \
118
  --gpu-memory-utilization 0.85 \
119
  --speculative-config.method mtp \
120
- --speculative-config.num_speculative_tokens 1 \
121
  --tool-call-parser glm47 \
122
  --reasoning-parser glm45 \
123
  --enable-auto-tool-choice \
@@ -129,7 +107,7 @@ vLLM, SGLang, KTransformers, and xLLM all support local deployment of GLM-5. A s
129
  + SGLang
130
 
131
  ```shell
132
- python3 -m sglang.launch_server \
133
  --model-path zai-org/GLM-5-FP8 \
134
  --tp-size 8 \
135
  --tool-call-parser glm47 \
@@ -141,7 +119,7 @@ vLLM, SGLang, KTransformers, and xLLM all support local deployment of GLM-5. A s
141
  --mem-fraction-static 0.85 \
142
  --served-model-name glm-5-fp8
143
  ```
144
-
145
  Check the [sglang cookbook](https://cookbook.sglang.io/autoregressive/GLM/GLM-5) for more details.
146
 
147
  + xLLM and other Ascend NPU
@@ -154,14 +132,16 @@ vLLM, SGLang, KTransformers, and xLLM all support local deployment of GLM-5. A s
154
 
155
  ## Citation
156
 
 
 
157
  ```bibtex
158
- @misc{team2026glm5vibecodingagentic,
159
- title={GLM-5: from Vibe Coding to Agentic Engineering},
160
- author={GLM-5 Team and Aohan Zeng and Xin Lv and Zhenyu Hou and Zhengxiao Du and Qinkai Zheng and Bin Chen and Da Yin and Chendi Ge and Chengxing Xie and others},
161
  year={2026},
162
  eprint={2602.15763},
163
  archivePrefix={arXiv},
164
- primaryClass={cs.CL},
165
- url={https://arxiv.org/abs/2602.15763},
166
  }
167
  ```
 
5
  library_name: transformers
6
  license: mit
7
  pipeline_tag: text-generation
 
8
  ---
9
 
10
  # GLM-5-FP8
 
15
  <p align="center">
16
  ๐Ÿ‘‹ Join our <a href="https://raw.githubusercontent.com/zai-org/GLM-5/refs/heads/main/resources/wechat.png" target="_blank">WeChat</a> or <a href="https://discord.gg/QR7SARHRxK" target="_blank">Discord</a> community.
17
  <br>
18
+ ๐Ÿ“– Check out the GLM-5 <a href="https://arxiv.org/abs/2602.15763" target="_blank">Technical report</a>.
 
 
 
 
19
  <br>
20
  ๐Ÿ“ Use GLM-5 API services on <a href="https://docs.z.ai/guides/llm/glm-5">Z.ai API Platform. </a>
21
  <br>
22
  ๐Ÿ‘‰ One click to <a href="https://chat.z.ai">GLM-5</a>.
23
  </p>
24
 
25
+ <p align="center">
26
+ [<a href="https://huggingface.co/papers/2602.15763" target="_blank">Paper</a>]
27
+ [<a href="https://github.com/zai-org/GLM-5" target="_blank">GitHub</a>]
28
+ </p>
29
+
30
  ## Introduction
31
 
32
  We are launching GLM-5, targeting complex systems engineering and long-horizon agentic tasks. Scaling is still one of the most important ways to improve the intelligence efficiency of Artificial General Intelligence (AGI). Compared to GLM-4.5, GLM-5 scales from 355B parameters (32B active) to 744B parameters (40B active), and increases pre-training data from 23T to 28.5T tokens. GLM-5 also integrates DeepSeek Sparse Attention (DSA), largely reducing deployment cost while preserving long-context capacity.
 
78
 
79
  ### Prepare environment
80
 
81
+ The following open-source frameworks support local deployment of GLM-5:
 
 
 
 
 
 
 
 
82
 
83
+ - [vLLM](https://github.com/vllm-project/vllm) (v0.19.0+)
84
+ - [SGLang](https://github.com/sgl-project/sglang) (v0.5.10+)
85
+ - [KTransformers](https://github.com/kvcache-ai/ktransformers) (v0.5.3+)
86
+ - [Transformers](https://github.com/huggingface/transformers) (v0.5.4+)
87
+ - [xLLM](https://github.com/jd-opensource/xllm) (v0.8.0+)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
88
 
89
  ### Deploy
90
 
 
95
  --tensor-parallel-size 8 \
96
  --gpu-memory-utilization 0.85 \
97
  --speculative-config.method mtp \
98
+ --speculative-config.num_speculative_tokens 3 \
99
  --tool-call-parser glm47 \
100
  --reasoning-parser glm45 \
101
  --enable-auto-tool-choice \
 
107
  + SGLang
108
 
109
  ```shell
110
+ sglang serve \
111
  --model-path zai-org/GLM-5-FP8 \
112
  --tp-size 8 \
113
  --tool-call-parser glm47 \
 
119
  --mem-fraction-static 0.85 \
120
  --served-model-name glm-5-fp8
121
  ```
122
+
123
  Check the [sglang cookbook](https://cookbook.sglang.io/autoregressive/GLM/GLM-5) for more details.
124
 
125
  + xLLM and other Ascend NPU
 
132
 
133
  ## Citation
134
 
135
+ If you find GLM-5 useful in your research, please cite our technical report:
136
+
137
  ```bibtex
138
+ @misc{glm5team2026glm5vibecodingagentic,
139
+ title={GLM-5: from Vibe Coding to Agentic Engineering},
140
+ author={GLM-5-Team and : and Aohan Zeng and Xin Lv and Zhenyu Hou and Zhengxiao Du and Qinkai Zheng and Bin Chen and Da Yin and Chendi Ge and Chenghua Huang and Chengxing Xie and Chenzheng Zhu and Congfeng Yin and Cunxiang Wang and Gengzheng Pan and Hao Zeng and Haoke Zhang and Haoran Wang and Huilong Chen and Jiajie Zhang and Jian Jiao and Jiaqi Guo and Jingsen Wang and Jingzhao Du and Jinzhu Wu and Kedong Wang and Lei Li and Lin Fan and Lucen Zhong and Mingdao Liu and Mingming Zhao and Pengfan Du and Qian Dong and Rui Lu and Shuang-Li and Shulin Cao and Song Liu and Ting Jiang and Xiaodong Chen and Xiaohan Zhang and Xuancheng Huang and Xuezhen Dong and Yabo Xu and Yao Wei and Yifan An and Yilin Niu and Yitong Zhu and Yuanhao Wen and Yukuo Cen and Yushi Bai and Zhongpei Qiao and Zihan Wang and Zikang Wang and Zilin Zhu and Ziqiang Liu and Zixuan Li and Bojie Wang and Bosi Wen and Can Huang and Changpeng Cai and Chao Yu and Chen Li and Chengwei Hu and Chenhui Zhang and Dan Zhang and Daoyan Lin and Dayong Yang and Di Wang and Ding Ai and Erle Zhu and Fangzhou Yi and Feiyu Chen and Guohong Wen and Hailong Sun and Haisha Zhao and Haiyi Hu and Hanchen Zhang and Hanrui Liu and Hanyu Zhang and Hao Peng and Hao Tai and Haobo Zhang and He Liu and Hongwei Wang and Hongxi Yan and Hongyu Ge and Huan Liu and Huanpeng Chu and Jia'ni Zhao and Jiachen Wang and Jiajing Zhao and Jiamin Ren and Jiapeng Wang and Jiaxin Zhang and Jiayi Gui and Jiayue Zhao and Jijie Li and Jing An and Jing Li and Jingwei Yuan and Jinhua Du and Jinxin Liu and Junkai Zhi and Junwen Duan and Kaiyue Zhou and Kangjian Wei and Ke Wang and Keyun Luo and Laiqiang Zhang and Leigang Sha and Liang Xu and Lindong Wu and Lintao Ding and Lu Chen and Minghao Li and Nianyi Lin and Pan Ta and Qiang Zou and Rongjun Song and Ruiqi Yang and Shangqing Tu and Shangtong Yang and Shaoxiang Wu and Shengyan Zhang and Shijie Li and Shuang Li and Shuyi Fan and Wei Qin and Wei Tian and Weining Zhang and Wenbo Yu and Wenjie Liang and Xiang Kuang and Xiangmeng Cheng and Xiangyang Li and Xiaoquan Yan and Xiaowei Hu and Xiaoying Ling and Xing Fan and Xingye Xia and Xinyuan Zhang and Xinze Zhang and Xirui Pan and Xu Zou and Xunkai Zhang and Yadi Liu and Yandong Wu and Yanfu Li and Yidong Wang and Yifan Zhu and Yijun Tan and Yilin Zhou and Yiming Pan and Ying Zhang and Yinpei Su and Yipeng Geng and Yong Yan and Yonglin Tan and Yuean Bi and Yuhan Shen and Yuhao Yang and Yujiang Li and Yunan Liu and Yunqing Wang and Yuntao Li and Yurong Wu and Yutao Zhang and Yuxi Duan and Yuxuan Zhang and Zezhen Liu and Zhengtao Jiang and Zhenhe Yan and Zheyu Zhang and Zhixiang Wei and Zhuo Chen and Zhuoer Feng and Zijun Yao and Ziwei Chai and Ziyuan Wang and Zuzhou Zhang and Bin Xu and Minlie Huang and Hongning Wang and Juanzi Li and Yuxiao Dong and Jie Tang},
141
  year={2026},
142
  eprint={2602.15763},
143
  archivePrefix={arXiv},
144
+ primaryClass={cs.LG},
145
+ url={https://arxiv.org/abs/2602.15763},
146
  }
147
  ```