joe
Random 404 errors thrown by runpod secure cloud instance
We are running a llm in production 24/7 and we have a heartbeat detector that checks the vllm health endpoint /health and we’ve noticed seemingly random 404 errors returned when we hit the runpod instance. Can someone from runpod comment on what might be causing these errors? We only hit every 5 minutes and we have been averaging 3-4 404’s the last few days. Our pod is in data center CA-1
4 replies
How do i create an encrypted volume programmatically?
https://blog.runpod.io/runpod-encrypted-volumes/
"If you would prefer to choose your own encryption key, you can deploy using the API."
I can't find documentation on this process anywhere, can someone please tell me where I can find the API that supports this? We are very interested in doing something like this for our future deployments.
2 replies