2026-04-07 02:03 UTC
@dankwraith@monads.online I'd love to be able to say that I developed, based on developed reason and empirical evidence, my position,
but nah I just learned about the mathematical derivation of backpropagation and how it depends fundamentally on the activation function being differentiable everywhere and then being told immediately ".. but actually we just use ReLU" and it RADICALIZED me.
Replies (1)
-
@gaditb@icosahedron.website 2026-04-07 02:23
@dankwraith@monads.online (Now to be.. fair?, this move only prevents it from being mathematically, scientifically, and philosophically well-grounded -- to the extent that it is an engineering process/product, this move in particular I don't think is disqualifying. OTHER moves yes of course, but this one--. But like for personal emotional context I also was vocally shocked and betrayed by the Small Angle Approximation when doing the dpuble-slit experiment, which DOES have justification.)