💾 trunk/83f6fbf6c5b6e044f9477e7288008f52bd41a75f: [FSDP2] Fix unused DTensor param reduce-scatter (#183040)
Nachrichtenbereich: 💾 Downloads
🔗 Quelle: github.com
fix #170667 (comment) pytorch/torchtitan#2747 (comment)
For DTensor parameters, torch.zeros_like(unsharded_param) returns a DTensor, leading to fsdp.chunk_cat.default: got mixed torch.Tensor and... [Weiterlesen]
🔧 Unused Imports - The Hidden Performance Tax
📈 221.6 Punkte
🔧 Programmierung
🔧 Everything about ESM and treeshaking
📈 77.86 Punkte
🔧 Programmierung