trunk/23bf65ea94e74ea85517a408202b524a451dff73: [MPS] Fix fast::tanh overflow to nan (#186286)
🔒
https://github.com
«Fixes #186278
fast::tanh uses expression (exp(2x)-1)/(exp(2x)+1) as the approximation. For gelu the expression for x scales cubically and will overflow the internal fp32 when abs(input) > 10.0. At this point the tanh ...»
Automatische Weiterleitung...
1.5s