When can we expect gpu kernels in mojo?
I need to implement a gpu kernel to perform a highly parallel mathematical computation.
I saw on github gpu support should land at the next max release, but when is that expected?
I need to know if I should wait, or start implementing in cuda instead...
3 Replies
Hi @Noam Y, no exact release date has been specified. We think an announcement (that is on the calendar) within the next couple weeks is for GPU, but can't say for sure.
Implement in Jax and then it probably will be easier to migrate to Mojo
To circle back on this, we did release some initial simple experimental examples for how to write GPU kernels in the nightlies alongside the 24.6 release: https://forum.modular.com/t/experimental-examples-of-custom-cpu-gpu-operations-in-mojo/348 and plan to continue to iterate on those to show off more capabilities. I'll warn that this is an early preview, and we'll have much more to say about GPU programming in MAX via Mojo throughout early 2025.
Modular
[Experimental] Examples of custom CPU / GPU operations in Mojo
We have a ton of stuff launching with MAX in 24.6, including a preview of GPU support. All of those new additions have great new docs and tutorials (for example, how to serve the Llama 3.1 model on GPUs at scale). One undocumented and experimental capability that we’re sharing with the community is very early support for writing custom GPU oper...