morrow
RRunPod
•Created by morrow on 1/2/2025 in #⚡｜serverless
Best way to cache models with serverless ?
Good to know ! So even with a 22 gb sized model it's worth including it in the container image ? I'll try that
6 replies
RRunPod
•Created by morrow on 12/8/2024 in #⚡｜serverless
Serverless github endpoint stuck at uploading phase
11 replies
RRunPod
•Created by morrow on 12/8/2024 in #⚡｜serverless
Serverless github endpoint stuck at uploading phase
11 replies
RRunPod
•Created by morrow on 12/8/2024 in #⚡｜serverless
Serverless github endpoint stuck at uploading phase
Another thing I noticed, I don't know if this is intended but it seem pushing a simple change to the handler code trigger a full rebuild / reupload of the container (which takes ~30 min).
Before using the github feature, I was using a template and a docker container name directly. Doing a
docker build & a docker push with a simple code change (last step of the DockerFile) it would only take a sec because docker keep 99% of the container and only build / upload the last step (copying the code).11 replies
RRunPod
•Created by morrow on 12/8/2024 in #⚡｜serverless
Serverless github endpoint stuck at uploading phase
Wow thanks ! 🍻
11 replies