papanton
RRunPod
•Created by papanton on 4/29/2024 in #⚡｜serverless
Poor upload speed
I am uploading a large files (2GB) from a serverless endpoint in CA-MTL-1. I get consistenly low speeds and timeouts.
The GPU is attached to a network volume if that matters. I copy the file from the network volume to the
tmp directory before uploading.
I measured by upload speed and its about 30MB/s which is low considering the server advertises 1000mbps+ upload speeds
Please help16 replies
RRunPod
•Created by papanton on 2/25/2024 in #⚡｜serverless
Two Network Volumes
Id like to have an endpoint with a network volume but across data centers. I don’t mind if network volumes are in a different state as they act like a cache, however i’d like my traffic to be load balanced.
Is that possible ?
23 replies
RRunPod
•Created by papanton on 2/11/2024 in #⚡｜serverless
webhooks custom updates
Does the job webhook get invoked with
runpod.serverless.progress_update calls?18 replies
RRunPod
•Created by papanton on 2/8/2024 in #⚡｜serverless
Network Storage Cache
In serverless invocation; is it possible to store files in network storage and have those items be accessible between worker invocations?
Or is the runpod volume directory a copy of the network volume
10 replies
RRunPod
•Created by papanton on 2/8/2024 in #⚡｜serverless
network volume venv serverless
When trying to access venv/src pip installs from a network volume, I get moduleNotFound. When the same network volume is loaded on a Pod, it works just fine. Any tips?
9 replies
RRunPod
•Created by papanton on 2/8/2024 in #⚡｜serverless
Container start command behavior
I am starting a serverless container using image: runpod/pytorch:2.2.0-py3.10-cuda12.1.1-devel-ubuntu22.04
On the start command I am adding:
mv /runpod-volume /workspace && bash /workspace/runpod/pod-startup.sh
I exepct the runpod-volume to be renamed to workspace and then run the script, but instead this is what I get:
2024-02-08T00:28:01.115082438Z mv: target '/workspace/runpod/pod-startup.sh' is not a directory6 replies