Implement and benchmark Softmax algorithms in Mojo
I gave my first try at Mojo, and really love its design.
Did a weekend project on implementing online normalizer calculation of softmax, and made a vlog:
https://youtu.be/5JdP_YAH-iE?si=q7oJgu4ZZ87kv26J
Machine Minds
YouTube
Implement and benchmark Softmax algorithms in Mojo
This video about online normalizer calculation for softmax (https://arxiv.org/abs/1806.02867).
We use Mojo lang to implement two softmax algorithms: safe softmax and safe softmax with online normalizer calculation.
Along the way, we will learn about some intersting aspects of the Mojo lang, such as
- How to implement constructor with move sema...
0 Replies