Transformers

You are viewing main version, which requires installation from source. If you'd like regular pip install, checkout the latest stable version (v5.22.2).

Join the Hugging Face community

and get access to the augmented documentation experience

Collaborate on models, datasets and Spaces

Faster examples with accelerated inference

Switch between documentation themes

to get started

Optimum

Optimum 是一个优化库，支持针对 Intel、Furiosa、ONNX Runtime、GPTQ 以及底层 PyTorch 量化函数的量化。它旨在提升特定硬件（如 Intel CPU/HPU、AMD GPU、Furiosa NPU 等）以及 ONNX Runtime 等模型加速器的性能。

Update on GitHub

←VPTQ 贡献量化方法→