Vector Quantization

VQ-LLM: High-performance Code Generation for Vector Quantization Augmented LLM Inference