Charixfox
Explore posts from serversSMSatisfactory Modding
•Created by Carter McCarthy on 11/27/2024 in #help-using-mods
Di more glass
I tested some graphics settings with no change. I'll test more shortly.
77 replies
SMSatisfactory Modding
•Created by Carter McCarthy on 11/27/2024 in #help-using-mods
Di more glass
77 replies
RRunPod
•Created by bp on 12/12/2024 in #⚡｜serverless
Using runpod serverless for HF 72b Qwen model --> seeking help
Have you successfully gotten a smaller model - 3B or 7B - to work first so you understand the process?
Downloading the model takes a large amount of time. If it's downloaded to a worker storage, it needs to download every time it starts a new worker or otherwise reinitializes. With small models, this is not a big deal. With a 72B model, that is 144GB of download for the full FP16.
3 replies
SMSatisfactory Modding
•Created by Carter McCarthy on 11/27/2024 in #help-using-mods
Di more glass
The server update broke things, and your update on the 10th fixed that break.
77 replies
SMSatisfactory Modding
•Created by Carter McCarthy on 11/27/2024 in #help-using-mods
Di more glass
Thank you for the amazing things you do.
77 replies
SMSatisfactory Modding
•Created by Carter McCarthy on 11/27/2024 in #help-using-mods
Di more glass
Woots!
77 replies
SMSatisfactory Modding
•Created by Carter McCarthy on 11/27/2024 in #help-using-mods
Di more glass
Interjecting here: The update of this mod also stopped the recently-updated and troubleshooting-reinstalled Windows Dedicated Server from failing on all mods altogether.
77 replies
SMSatisfactory Modding
•Created by Charixfox on 12/9/2024 in #help-using-mods
Glass fluid buffers vanished with today's update
End result:
A full DS removal and reinstall, and all mods reinstall did not correct the issue two days ago. "DI More Glass and Stuff" mod and related library were updated yesterday, and installing the updates today rectified the problem.
8 replies
SMSatisfactory Modding
•Created by Charixfox on 12/9/2024 in #help-using-mods
Glass fluid buffers vanished with today's update
Thank you Andre for the recommendation and the assist.
8 replies
SMSatisfactory Modding
•Created by Charixfox on 12/9/2024 in #help-using-mods
Glass fluid buffers vanished with today's update
(Semi) great news! I tested, broken, then updated the two DI mods (one listed, one library) that were updated after the Steam update, and now things work after the mod update.
8 replies
SMSatisfactory Modding
•Created by Charixfox on 12/9/2024 in #help-using-mods
Glass fluid buffers vanished with today's update
All things added by mods are missing. Seems to only impact the server. Loading the midnight continue save locally works just fine, but loading it onto the server is broken.
8 replies
RRunPod
•Created by octopus on 9/20/2024 in #⚡｜serverless
Llama-70B 3.1 execution and queue delay time much larger than 3.0. Why?
You can find sources online that indicate 3.0 averages around three times as fast as 3.1. So while 3.1 is more accurate, 3.0 is speedier.
2 replies
RRunPod
•Created by peteryoung2484 on 9/13/2024 in #⚡｜serverless
Is there a way to speed up the reading of external disks(network volume)?
Other threads say expect network loads to take longer, so bake it into the image if you can.
49 replies
RRunPod
•Created by NERDDISCO on 8/9/2024 in #⚡｜serverless
Slow network volume
I split the model layers just fine, but one of the stock layers on the worker-vllm image is just shy of 13GB when built, so I'll be poking at that for a bit.
64 replies
RRunPod
•Created by NERDDISCO on 8/9/2024 in #⚡｜serverless
Slow network volume
Is that a viable option for such a large model? I was under the impression it only scaled well for smaller models.
64 replies
RRunPod
•Created by NERDDISCO on 8/9/2024 in #⚡｜serverless
Slow network volume
Even more oddly, sometimes it will load two segments at 1-4 s/it, and then the next will be 38 s/it, and then the next three will be 50-60 each. It's very inconsistent. The 4+ minute loading is a cold start that I'm paying for every second of, and it might happen when the container is destroyed immediately after a run, and while the container is doing that cold start, any requests routed to it time out on the client side.
64 replies
RRunPod
•Created by NERDDISCO on 8/9/2024 in #⚡｜serverless
Slow network volume
s/it, out of seven segments. Full load of the model takes at least 280 seconds in those instances, but about 21 seconds in other geographical areas.
64 replies
RRunPod
•Created by NERDDISCO on 8/9/2024 in #⚡｜serverless
Slow network volume
Hopefully this gets resolved soon. I'm using storage to hold a 65GB model on specific GPU hardware and 40+ sec/it to load it is not good at all.
64 replies
RRunPod
•Created by naaviii on 8/29/2024 in #⚡｜serverless
Urgent: Issue with Runpod vllm Serverless Endpoint
I encountered the same problem, and swapped to the dev image mentioned after finding this, and things are not directly crashing.
22 replies
RRunPod
•Created by blabbercrab on 7/5/2024 in #⚡｜serverless
Serverless is timing out before full load
Ah. I have no advice on that one unfortunately.
39 replies