Implement and benchmark Softmax algorithms in Mojo
I gave my first try at Mojo, and really love its design.
Did a weekend project on implementing online normalizer calculation of softmax, and made a vlog:
https://youtu.be/5JdP_YAH-iE?si=q7oJgu4ZZ87kv26J
Did a weekend project on implementing online normalizer calculation of softmax, and made a vlog:
https://youtu.be/5JdP_YAH-iE?si=q7oJgu4ZZ87kv26J
YouTubeMachine Minds
This video about online normalizer calculation for softmax (https://arxiv.org/abs/1806.02867).
We use Mojo lang to implement two softmax algorithms: safe softmax and safe softmax with online normalizer calculation.
Along the way, we will learn about some intersting aspects of the Mojo lang, such as
We use Mojo lang to implement two softmax algorithms: safe softmax and safe softmax with online normalizer calculation.
Along the way, we will learn about some intersting aspects of the Mojo lang, such as
- How to implement constructor with move sema...