Skip to content

Drop CUDA 12.6 support - #24740

Open
Gasoonjia wants to merge 2 commits into
mainfrom
gasoonjia/drop-cuda-12.6
Open

Gasoonjia wants to merge 2 commits into
mainfrom
gasoonjia/drop-cuda-12.6

Conversation

@Gasoonjia

@Gasoonjia Gasoonjia commented Nov 6, 2026 •

Copy link
Copy Markdown
Contributor

Summary

PyTorch no longer publishes cu126 nightlies. The torchao cu126 channel stops at 0.19.0.dev20260907, so the 12.6 CI rows can't install the current pins. This removes CUDA 12.6 support.

Support

  • install_utils.py: remove (12, 6) from SUPPORTED_CUDA_VERSIONS. Supported versions are now 13.0, 13.2, 13.4.

CI

  • .github/workflows/vulkan.yml: move test-vulkan-nvidia and the Vulkan LLM e2e job from the cuda12.6 image to cuda13.2. The pytorch/almalinux-builder:cuda13.2 image exists and is current.
  • .github/workflows/cuda.yml: drop 12.6 from the test-cuda-builds matrix. Coverage that remains:
    • build matrix rows for 13.0 and 13.4
    • 13.0 on every model e2e / benchmark job (10+ jobs)
    • 13.2 on the Windows e2e jobs (cuda-windows.yml) and the published wheel rows (filter_cuda_matrix.py: cu132 / cu134)
  • .ci/scripts/wheel/cuda_arch_list.sh: remove the cu126 GPU arch lists. A cu126 row now fails as an unknown train.
  • .ci/docker/common/install_cuda_windows_cross_compile.sh: remove the 12.6 entry.
  • .ci/scripts/tests/test_cuda_workflow.py, .ci/scripts/tests/test_cu134_dependencies.py: drop the 12.6 cases.

Docs / comments

  • docs/source/backends/cuda/cuda-overview.md: the source build now lists CUDA 13.0 instead of 12.6.
  • Update the 12.6 / cu126 examples in install_utils.py, setup.py, filter_cuda_matrix.py, test_shared_libraries.py, cuda_benchmark.py.

Intentionally unchanged

  • backends/cuda/cuda_backend.py _setup_cuda_environment_for_fatbin: the CUDA 12 ptxas branch handles any user torch build on CUDA 12.x below 12.9, not just a 12.6 support row.
  • setup.py / test_shared_libraries.py CUDA 12 runtime package mapping (nvidia-cuda-runtime-cu12): this is keyed by CUDA major, not 12.6.
  • Windows cross-compile entries for 12.8 / 12.9.

Test plan

  • pytest .ci/scripts/tests/test_cu134_dependencies.py .ci/scripts/tests/test_cuda_workflow.py .ci/scripts/tests/test_filter_cuda_matrix.py: 49 passed
  • executorch_cuda_arch_list: cu130/cu132/cu134 still resolve, cu126 now returns 64 (unknown train)
  • Both workflow YAMLs parse; flake8 clean
  • Repo-wide grep for 12.6 / cu126 / (12, 6): two hits left, both kept on purpose: the nvidia-cuda-runtime-cu12==12.6.77 example in a parsing comment, and the CUDA 12.6+ comment on the unchanged ptxas branch in cuda_backend.py
  • CI (Vulkan real-GPU jobs on the 13.2 image)

PyTorch no longer publishes cu126 nightlies (torchao's cu126 channel stops at
dev20260907), so the 12.6 CI rows can no longer install their pinned deps.

- install_utils: remove (12, 6) from SUPPORTED_CUDA_VERSIONS.
- cuda.yml: drop 12.6 from the build matrix (13.0 and 13.4 remain, and
  13.0 is used by every model e2e job).
- vulkan.yml: move both real-GPU jobs from the 12.6 image to 13.2.
- Remove the cu126 GPU arch lists, the 12.6 Windows cross-compile mapping,
  and 12.6 cases in CI unit tests.
- Docs/comments: drop 12.6 mentions.
@pytorch-bot

pytorch-bot Bot commented Nov 6, 2026 •

Copy link
Copy Markdown

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/24740

Note: Links to docs will display an error until the docs builds have been completed.

❌ 2 Cancelled Jobs, 4 Unrelated Failures, 2 Unclassified Failures

As of commit 0cc0ce7 with merge base 97971ca (image):

UNCLASSIFIED FAILURES - DrCI could not classify the following jobs because the workflow did not run on the merge base. The failures may be pre-existing on trunk or introduced by this PR:

CANCELLED JOBS - The following jobs were cancelled. Please retry:

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Nov 6, 2026
@github-actions github-actions Bot added the ciflow/docker Trigger docker-builds to rebuild and push the CI images for this PR label Nov 6, 2026
@github-actions

github-actions Bot commented Nov 6, 2026

Copy link
Copy Markdown

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

@Gasoonjia
Gasoonjia deployed to upload-benchmark-results November 6, 2026 20:50 — with GitHub Actions Active

This branch was successfully deployed

1 active and 1 inactive deployments
upload-benchmark-results — 0cc0ce77 Deployed Nov 6, 2026 by Gasoonjia
cadence — 0cc0ce77 Deployed Nov 6, 2026 by Gasoonjia
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ciflow/docker Trigger docker-builds to rebuild and push the CI images for this PR CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants