nayandhabarde

PostsComments

RRunPod

•Created by nayandhabarde on 7/1/2024 in #⛅｜pods

Just created a pod and it started with 99% gpu utilization

3 replies

RRunPod

•Created by nayandhabarde on 5/25/2024 in #⚡｜serverless

Need help putting 23 GB .pt file in serverless enviornment

I have a 23 GB .pt file containing tensors for 36 attention processors for each step, cannot reduce size I need to somehow put this one on the serverless environment to use in the inference, I am getting no space left on device error when bulding the docker image (I understand it should be small, but i don't have an option) Can someone please help

3 replies