Running code at GPU
How can I write a mojo code that is executed at the GPU instead of the CPU?
12 Replies
That is currently not yet supported. They have been indicating that some insights how to do this will be revealed soon.
Coming in two days!
Curious what the extra hardware support entitles (if any). I get the feeling that Modular with their AI engine is first focusing on inference, so perhaps some Intel GPU/Habana hardware?
They will support NVIDIA hardware I guess, as they invited experts from NVIDIA to get talks. Good things are going to happen.
That would be great. If mojo gets indeed nvidia support on the short term, I can see machine learning in mojo becoming a thing quickly.
Stay tuned to the ModCon
It's HERE!
I only caught part of the keynote, but it sounded to me as if Mojo GPU execution was only available through the MAX Engine. Is it possible to execute Mojo code on the GPU without MAX?
Seems like it will be supported most likely in "Q1 2024" https://discord.com/channels/1087530497313357884/1098713601386233997/1181299299976491059
We just "previewed" GPU support in Mojo, it still has a bit of development to go before being generally available
is there a plan to support other GPUs? like GPUs on Android devices from QUALCOMM chipsets?
I'm just speculating but I remember they did say "stay tuned for GTC 2024" or something like that on ModCon. And it would be natural to announce GPU computing with all the fancy announcements that Nvidia will be making. That is of course just a speculation on my side