Serverless GPU Pricing
Hello. I chose a 24 GiB configuration with the following GPUs: L4, RTXA5000, and RTX3090. I ran some benchmarks and noticed that using only RTX3090 is better for my use-case (faster execution times and so on).
Is the base pricing for all these 3 GPUs the same? That is, supposing for a moment that the delay times and execution times are the same across all GPUs, will the billing result in the same value regardless of the one I choose?
3 Replies
if they're in the same class then yes
look at the endpoint settings, theres the price for them
they are grouped
Some gpus with higher or lower vram has different pricings
OK. That's what I thought; just wanted to make sure.
Many thanks.
No problem happy to help