torchao release compatibility table

[vkuzo]

This issue describes the compatibility matrix between torchao releases and its dependencies. If you are seeing an error when importing torchao that looks like this,

(pytorch_nightly) [vasiliy@devgpu007.eag6 ~/local]$ python -c "import torchao"
Fatal Python error: Aborted

then most likely you can resolve this error by ensuring that the torch version in your environment is compatible with the torch version used to build your torchao version.

torch

torchao version	torch version	torch version, torchao's Python API only
0.18.0dev (nightly)	2.12.0dev (nightly)	2.11.0, 2.10.0, 2.9.0
0.17.0	2.11.0+	2.11.0, 2.10.0, 2.9.0
0.16.0	2.10.0	2.10.0, 2.9.0, 2.8.0
0.15.0	2.9.1	2.9.1, 2.8.0, 2.7.1
0.14.1	2.9.0	2.9.0, 2.8.0, 2.7.1
0.13.0	2.8.0	2.8.0, 2.7.1, 2.6.0
0.12.0	2.7.1, 2.6.0, 2.5.0	n/a

fbgemm_gpu

torchao has an optional runtime dependency on fbgemm_gpu. Please see https://docs.pytorch.org/FBGEMM/general/Releases.html for the compatibility matrix for fbgemm_gpu. Note that while torchao's Python API supports multiple torch versions, each fbgemm_gpu version only supports a single torch version. Therefore, if you are using torchao together with fbgemm_gpu, you should use the torch version corresponding to your fbgemm_gpu version.

[jerryzh168]

any ideas when we can fix the compatibility of torchao nightly with torch? currently it's blocking tests in vllm: https://github.com/vllm-project/vllm/pull/21982/files#diff-2fe466060a88bb6a57175df8ca7175849db82a2cf2ba082295d481ab57e58868R512

[yushangdi]

I'm also having the same issue here. Blocking testing executorch with torch nightly.

I have torch on latest master (with some python-only local changes) '2.9.0a0+git3564a8a', and torchao torchao-0.14.0.dev20250909+cu126.

[yushangdi]

I'm also having the same issue here. Blocking testing executorch with torch nightly.

I have torch on latest master (with some python-only local changes) '2.9.0a0+git3564a8a', and torchao torchao-0.14.0.dev20250909+cu126.

I have it resolved by installing pip install fbgemm-gpu-nightly to override fbgemm-gpu. So far importing torchao doesn't error anymore. Not sure if there're any other issues if I actually run anything.

[jerryzh168]

executorch doesn't need fbgem-gpu I think? if you use torchao nightly, can you also use torch nightly in ET?

[vkuzo]

we also need to update the following check https://github.com/pytorch/ao/blob/ea8c00fc90c99f0bf19fe87d22eb186c3dd19bf6/torchao/__init__.py#L38C45-L38C76 for PyTorch 2.10.x, as str(torch.__version__) >= "2.9" will not work properly for PyTorch 2.10

[vkuzo]

@liangel-02 , https://github.com/facebookresearch/FBGEMM/pull/1900/files might be relevant here - this is fbgemm fixing the same issue in their repo

[steveepreston]

Getting the error on all versions:
Skipping import of cpp extensions due to incompatible torch version 2.9.0+cu128 for torchao version 0.14.0
Skipping import of cpp extensions due to incompatible torch version 2.8.0+cu129 for torchao version 0.14.0
Skipping import of cpp extensions due to incompatible torch version 2.8.0+cu128 for torchao version 0.14.0

[NeonSludge]

This makes it very hard to use torchao with latest versions of Ray Serve/vLLM:
Skipping import of cpp extensions due to incompatible torch version 2.8.0+cu128 for torchao version 0.14.0

[vkuzo]

Hi folks, thank you for reporting, we are looking into this and will provide an update soon. Note that unless you actually need c++ or CUDA kernels that ship with torchao, you can ignore the warning and use the Python-only APIs without issues.

[atalman]

PyTorch release 2.9.0 eta date is today : https://dev-discuss.pytorch.org/t/pytorch-2-9-final-rc-available/3245