即将离开叶斌兵,请注意账号财产安全

https://docs.vllm.ai/en/latest/features/quantization/quantized_kvcache.html