Is serverless cost per worker or per GPU?
I'm looking at serverless GPU options and when looking at 48 GB GPU it costs $0.00048/s. But is that per worker or per GPU?
For example if I set the max workers to 3, will I be charged 3 x $0.00048/s if all three are in use? That would get very quickly very expensive... Thanks
For example if I set the max workers to 3, will I be charged 3 x $0.00048/s if all three are in use? That would get very quickly very expensive... Thanks
6 Replies
Yes it is per GPU second, so cost will be number of gpu's used per second
But the three workers will run in parallel right? That would mean all workers are utilising the same GPU? Or will they run on different GPUs of the same class?
they will utilize different gpu's
I see. And they would still charge me only $0.00048 per second even though I have 5 workers running in parallel utilizing 5 different GPUs?
In that case, it's not a bad deal. Please confirm if I understood this correctly. Thanks
Actually it seems that's not true. Price is per worker.
Yep per worker per gpu