PyTorch 2.5.0 Release, SDPA CuDNN backend, Flex Attention

PyTorch 2.5.0 Release, SDPA CuDNN backend, Flex Attention pytorch / pytorch Public Notifications You must be signed in to change notification settings Fork 30.5k Star 103k PyTorch 2.5.0 Release, SDPA CuDNN backend, Flex Attention jainapurva released this 17 Oct 16:26 v2.5.0 32f585d This commit was created on GitHub.com and signed with GitHub’s verified signature . GPG key ID: B5690EEEBB952194 Verified Learn about vigilant mode .

This Funding is relevant to the technology intelligence record because it involves GitHub, Intel, Google, NVIDIA. The source article should remain the factual reference for follow-up coverage.

• pytorch / pytorch Public Notifications You must be signed in to change notification settings Fork 30.5k Star 103k PyTorch 2.5.0 Release, SDPA CuDNN backend, Flex Attention jainapurva released this 17 Oct 16:26 v2.5.0 32f585d This commit was created on GitHub.com and signed with GitHub’s verified signature .
• GPG key ID: B5690EEEBB952194 Verified Learn about vigilant mode .
• PyTorch 2.5 Release Notes Highlights Backwards Incompatible Change Deprecations New Features Improvements Bug fixes Performance Documentation Developers Security Highlights We are excited to announce the release of PyTorch® 2.5!
• This release features a new CuDNN backend for SDPA, enabling speedups by default for users of SDPA on H100s or newer GPUs.
• As well, regional compilation of torch.compile offers a way to reduce the cold start up time for torch.compile by allowing users to compile a repeated nn.Module (e.g.
• a transformer layer in LLM) without recompilations.