Long loading times
I am encountering very long load times (2-4 minutes) for a 3mb save, when my previous even 8mb saves loaded in like 10 seconds. I haven't had a chance to write my mod that pulls in more specific information, but instead made a python script that just parses the log file and finds big gaps between log entries. I quickly as possible started the game and loaded a save file, then exited, so it should only capture what's happening on load.
I am avoiding binary searching to find the culprit as I have 104 mods and this may take longer š
Solution:Jump to solution
I guess this is a kind of memory leak ... but it's a save file leak ... caused by me against myself :LUL:
41 Replies
The gaps here account for 80 seconds of time during loading, although it's not immediately obvious to me who the culprit is or why even with the two lines before/after context for each line
The first one isn't caused by AutoLink. I know Epp recently was messing with switches but that isn't it as it occurs even when disabled
The delays can also be caused by something that doesn't output a log
Not Cartograph, Not RP/FF/DS
Not Resource Roulette, not Modular Stations, not Foundations Under Railways, not Persistent Paintables, not Construction Preferences, not Extra Finishes
Could you drop your full debug info so we can see the modlist/full log?
absolutely. I wish the copy modlist function in SML worked
-# Responding to
Key Details for SMMDebug-2025-03-04-12-50-24.zip triggered by @BeefThis is with Foundations under railways, Infinite zoop, persistent paintables, construction preferences, and extra finishes disabled, but the gaps in the logfile remain the same
oh boy this is perhaps even more concerning
So I loaded up the 8mb save, which took some like 20s or so since it had a very different modlist, then saved it so that it has my current modlist with everything enabled.
After exiting the game and re-loading it, everything loaded in like 10s despite being significantly more developed and a larger number of items and foilage removed by far. First photo is slow save, 2nd is fast save
I guess this indicates either
1. Some kind of corrupted save or
2. Some modded building, of which since I've not put many so it's either Modular Stations, Industrial Evolution buildings, or DI Power Indicators - but I've disabled these and the errors remain
Okay, that narrows down what I was about to suggest. 5 suspects to try disabling next: [Narrowed priority: PoweredConveyorBelts, GardenerTools] [lower-likelihood: DifficultyTuner, TrainAlert, MoreEnemySpawns]
I would also suggest loading the save into SCIM, then downloading it again without changing anything. SCIM's save parser can occasionally straighten out some savegame issues.
Honestly though, those look like two completely different saves. It's not just a case of "some modded stuff has been removed". They're completely different buildout phases.
That's because they are two different saves - it was moreso to compare the significant load time difference between an 8mb save that takes 10s to load and my current 3mb save that takes >2min to load
Oh, fair enough.
SCIM didn't fix it.
I'll try making a megaprint of the save and pasting it into a new one and see what happens
What about those mods?
@Beef are you deleting the messages with logs or is the link bot getting it?
His log link is still showing for me ā :CertifiedDiscordMoment: ?
I'm not sure what you mean - can you screenshot it? Everything shows up for me
I have the log that I edited up top and the SMMDebug link below
I originally had pasted my the gap log from my python script parser as 3 messages but deleted those and made it one long message, if you are referring to something you saw in your bot logs
Started with all those mods you suggested disabled and no change to the loading time and/or messages š¦
I'm going to guess a somehow corrupted save
Here's the save in case it will help.
For the first file, the only "required" mod to get it to start will be Resource Roulette as running with no mods will crash after completing loading.
The second save I've removed the Modular Stations entirely thru SCIM (which wasn't the solution unfortunately) and run the "Prep Savegame for Mod Removal" in Resource Roulette so it will load without that mod without crashing.
Removing all mods, running and saving, then opening and resaving in SCIM, it speeds up loading time somewhat but it's still quite long, on the order of 30s or so, with some big time gaps in the logfile while loading as well
So I think I can rule out a mod specifically being the cause and instead point to something wonky in the save for sure :\
Disk I/O issue perhaps?
It's unique to this file so I doubt it. 990 PRO NVMe drive on the motherboard.
I just loaded up the save in SCIM, deleted everything, restored all foilage, then opened in satisfactory and saved it, and it still takes >2 min to load and it's still somehow 1.8mb
I guess its time to try porting it all over to a new save as a megaprint in SCIM š«
Now's as good a time to add functionality to manually force a seed number for Resource Roulette too, to keep the same resource distribution I had
Extra confirmation, pasting everything as a megaprint into a new save, it takes 3s to load (and it's smaller than the "empty" savefile at 1.5mb)
Forwarded one above
Ah yeah, I deleted these, thanks for double-checking!
As per the conversation in #save-editing, I have reached out to GrayHak on github for the save parser they've written to try and see if I can get support for some of the mods that are in this save added to it - I know my resource roulette mod is one but I'm not sure if there's other mods that can't be parsed at the moment too.
In the case that they have time to do it and get around to it at some point, I'm going to follow up with that "Empty" savefile that's still somehow 1.75mb and see what's taking up all the space in there, as it still takes a fairly long time to load and this should help narrow down what the issue is
https://github.com/GreyHak/sat_sav_parse/issues/8
Gozerr's editor tried to handle that by implementing reading and writing for most generic data types but I don't think it was able to support custom structs
hmm, so the 3d map can't fully parse the data afaik, but either way half this empty save file (about 9mb decompressed) appears to be filled with about 55k near identical lines to these
I'll probably follow back up in a couple days or so
(Coming here from the related discussion in #save-editing)
So I looked at the save with the 3d map and would also guess that these 55k resource nodes in the save are the problem. So does the problem still occur with all mods disabled for that save? I would guess the problem could be that one of the mods (maybe Resource roulette) just generates new nodes on load, but not removes the old ones, so it probably happens with all mods disabled and it is actually a corrupted save by having to many resource nodes in. So maybe that happend over time when you loaded and saved that savegame many times and every time all resource nodes are added again. Maybe you can try starting a new save with only Resource Roulette enabled and load and store the save a few times in a row to look if the number of resource nodes in the save increases. If yes, its probably from that mod, if not maybe try other mods related to resource nodes.
I am sure this is why the long loading times, although it may not be the only issue
I went back through and added some additional checks to Resource Roulette, but all the actors I spawn are transient flagged so I don't think it's that - even with more aggressive culling of all other actors the save file stayed the same.
I had an issue with "zombie nodes" from Refined Power/ Ficsit Farming that even showed up in SCIM (it may be a conflict with resource roulette or it may be something else), and I believe that's the only other mod I've got that touches resources, but I wanted to hold off coming to any conclusions until I get better information what these actors are - I would like to find out more metadata about these actors to see where they're coming from and why they're being saved
even with all mods disabled and saved as a new file then attempting to run it through SCIM to clean out any junk that may persist, the long load times persist and these lines are still part of the save
https://discord.com/channels/729807284103806981/729819936259834007/1315509854970056804 about "zombie nodes" ... which I will follow up on if I find these nodes they are somehow FF/RP nodes, but I believe this was resolved a long time ago
Do you talk about adding checks when spawing new actors in your mod? It may could be that the problem was with any older mod version and the resource nodes just survived in the save game (corrupting it), even the problem will not happen again with new nodes.
That is what I meant with, try a new save, do save > load > save > load > save that, and see in the 3d map (or any other save tool) if the number of resource nodes increases. So you at least know if the bug still occurs with new saves.
I tested some and it occurs even in newer saves with current versions š¦ It looks like it's still a holdover from those zombie nodes.
I just dumped all the metadata about all nodes in the world and the 57742 "None" resource nodes. The vanilla fracking nodes (which I don't touch) and the RP/FF nodes are all loaded from the save file, but since I have to destroy those nodes to move them about it looks like RP/FF respawns them every time and this is the source of the bloat since apparently my zombie-node-catching code doesn't remove them in their entirety. I'll move over to #Curing the Zombie Node Apocalypse in #help-developing-mods since it appears I've identified the biggest part of it anyways
Remember that your drive that you have the game installed on may wear out. It maybe a good idea to check its health.
that does not appear to be the issue here
Ok sounds good. I probably cannot help in that other thread, but hopefully you can find a bugfix for the involved mods there. In the best case to also fix old saves with too many nodes. However, in case you cannot fix the old corrupted save retrospectively from within the mods, you may can try to at least repair your save file with save editing. Removing the nodes should be possible with the 3d map save library pretty much by replacing the class name here:
https://github.com/moritz-h/satisfactory-3d-map/blob/master/libsavepy/examples/remove_foundations.py
Tricky part may be that you do not want to delete all nodes, i.e. keep the ones referenced by miners, etc. Anyway fixing within the mods would probably be the first better option, but feel free to ping in case you need to go the save editing way.
Cleaning up old saves shouldn't be too bad, since it's not a corrupted save but instead me punching myself in the face i can fix it within my own mod - I already have some framework for version-specific commands that will run, so updating from any old version to the current version I can just iterate through all actors and destroy the bad ones which will cause a hitch but only needs to run once, and it won't run in future versions
š
Solution
I guess this is a kind of memory leak ... but it's a save file leak ... caused by me against myself :LUL:
Ended up with a partial fix until I can think up something better, the "empty" save now went from 1.8mb down to 850kb and loads as fast as it should