zai-org

/

GLM-4.6V

like 280

Follow

Z.ai 5.84k

Copying this discussion from the FP8 version.

AttributeError: 'Glm4vMoeConfig' object has no attribute 'rope_scaling'

4.6v

    "rope_parameters": {
      "mrope_section": [
        8,
        12,
        12
      ],
      "partial_rotary_factor": 0.5,
      "rope_theta": 500000,
      "rope_type": "default"
    },

4.5 Air

  "rope_scaling": null,
  "rope_theta": 1000000,