Aydyn
MModular
•Created by BrunoA on 5/21/2024 in #questions
How to Install Mojo previous versions?
Hi @BrunoA , I know you got a few errors when trying to run the llama2.🔥 , I merged a PR that adds support for Mojo v24.3, please pull latest changes from master branch. Thanks!
9 replies
MModular
•Created by rd4com on 10/21/2023 in #questions
Swapping pointers would cause memory problems ?
Thanks @rd4com for raising this..
So , the reasoning here is to try to reuse the buffer that is already allocated for file content, to avoid double allocation.
Since for example if we read full file content into memory as a next step we need to allocate some interal structures & weights.
This could lead to multiple OOMs in case of users will be trying to load huge models.
I have also filed a few "Feature Requests" that might help us to avoid full load OR make loading by chunks
https://github.com/modularml/mojo/issues/1135
https://github.com/modularml/mojo/issues/1134
https://github.com/modularml/mojo/issues/1130
2 replies