madiator

PostsComments

RRunPod

•Created by madiator on 8/21/2024 in #⚡｜serverless

Long latencies

Thanks. I am loading from huggingface. Goes up only slightly, to about 1.6 seconds. So there is some overhead

5 replies