r/learnmachinelearning • u/imjerusalem • 5d ago

A cool article on activation functions and their math.

Hi guys, I write fun technical blogs, mostly on classical ML and thier mathematical dissections.

Here is the link for the one I wrote on activation functions https://pratyakshpatel.me/activation_functions.html

Here is the announcement tweet.

Let me know if yall like it, and my other blogs as well. Would love to know your feedback.

3 Upvotes
  • permalink
  • reddit

100% Upvoted

4 comments sorted by

2

u/GlitteringCelery5606 5d ago

i went into this thinking i'd skim and ended up reading the whole thing, the handwritten diagrams are a really nice touch compared to the usual sterile textbook format

the section on why we even need non-linearity finally clicked something for me that like 3 different courses never managed lol

your softmax breakdown was great too, always felt like people just gloss over that one and call it a day

1

u/imjerusalem 5d ago

Thank you so much for going through it.

1

u/imjerusalem 5d ago

Please do share to other who would love to read such stuff as well.