Metal kernels already support gqa but we were materializing the KV tensor due to mps graph not supporting strided KV. This fixes it for those kernels while leaving the original implementation for general mps graph path
Pull Request resolved: #183280
Approved by: https://github.com/malfet
Intelligence View
SOCIAL SHARE CARD GENERATOR