Charixfox
Explore posts from serversSMSatisfactory Modding
•Created by Charixfox on 12/9/2024 in #help-using-mods
Glass fluid buffers vanished with today's update
Windows Server and clients were updated today, and on loading any saves - including ones prior to the update - all Glass Fluid Buffers from the same-named mod have vanished. I'm not certain if this is me only or the update broke the mod, and if the latter, how to report it. Any ideas on a fix would be helpful.
8 replies
RRunPod
•Created by Charixfox on 5/21/2024 in #⚡｜serverless
Speed up cold start on large models
I'm trying to do some intermittent testing on a 70B LLM model, but any time a vLLM worker does a cold start, it downloads the model from HF. This takes about 19 minutes, so costs add up and the requests made to the API time out and fail. Once the model is loaded, things are fine with inference running in 12-15 seconds. Is there any good solution to work with this larger model without keeping a constant worker, which would defeat the whole purpose of running it on serverless for the very intermittent testing?
17 replies