[FEATURE REQUEST] Granular selection for Serverless Pod GPUs
Hi team, not sure if this is the correct place to post.
- Feature request: I'd like to select specific GPU pods for my server, example the grouped tier with L4, A5000, 3090, could be expanded in singular.
Why?
TensorRT models now take advantage of RTX GPUs, so been able to select 3090 and 4090, or different groups will be highly beneficial to keep Dockers that work with specific architecture.
Same is true for old architecture and new ones like L4 L40, etc.
Thanks.
1 Reply
#🧐｜feedback is a good place to post it 🙂