Matt
MModular
•Created by Matt on 3/9/2024 in #questions
Groq integration?
https://console.groq.com/playground
https://pypi.org/project/groq/
Has anyone explored running groq's python API library with mojo? Seems like a great way to accelerate things even more. And currently groqcloud api is free!
I'm not from the Groq team- I just like free stuff that makes AI go brrrrrrrr.
1 replies
MModular
•Created by Matt on 3/3/2024 in #questions
llama2.mojo to safetensors?
Very much a non traditional programmer here. I've really enjoyed the community and the innovation!
I'm probably asking something out of scope, but is it possible to convert the llama2.mojo made by tairov to a safetensors format? Or is it that the llama2.mojo file is only for inference and we are not at the point where mojo can be converted to safetensors for loading onto gpus?
https://github.com/tairov/llama2.mojo?tab=readme-ov-file - original mojo repo from Tairov.
https://github.com/tairov/llama2.py - llama2.py repo from Tairov
https://github.com/karpathy/llama2.c - karpathy llama2.c
4 replies