esho

PostsComments

RRunPod

•Created by esho on 4/12/2024 in #⚡｜serverless

Faster Whisper Latency is High

I test a 10-second audio , and i get latency about 1 second on RTX4090 after cold start. The default is base model, and on my own RTX3090, the latency is about 0.2s.

22 replies