Need help putting 23 GB .pt file in serverless enviornment
I have a 23 GB .pt file containing tensors for 36 attention processors for each step, cannot reduce size
I need to somehow put this one on the serverless environment to use in the inference,
I am getting no space left on device error when bulding the docker image (I understand it should be small, but i don't have an option)
Can someone please help
2 Replies
No space left on device when building docker image means that your local disk on the machine where you are building the image is out of disk space, it has nothing to do with RunPod serverless.
Use network storage to store the .pt file