quick question, LZ4 vs LZMA2

how much faster is LZ4, how much more space does it take up.
Solution:
DH with Terralith + Tectonic on a 9950X3D: LZMA2: Time: 6:23; DB Size: 443,4 MiB LZ4: Time: 6:05; DB Size: 971,7 MiB...
Jump to solution
31 Replies
This is fine
This is fineOP2d ago
cool basicly: LZMA2 is 50% size of LZ4, but LZ4 take 1000% less time to read and write
Skillnoob_
Skillnoob_2d ago
so far I've never really had a issue with lzma2 and I prefer my DH DB not taking up a ton of space
This is fine
This is fineOP2d ago
is it really noticible when generating lods? like its a 1ms vs 10 ms diffrence
Skillnoob_
Skillnoob_2d ago
idk I haven't benchmarked that
᲼
2d ago
its really not noticeable at all if you plan on just playing minecraft and LZ4 really does take up a LOT of space
david lynch movie hater
on my ryzen 7 5700x i feel that switching to lz4 improved frametimes
᲼
2d ago
in general distant horizons will, so i personally use the highest compression settings
david lynch movie hater
i'm not totally sure if that was the root cause, though
Skillnoob_
Skillnoob_2d ago
I'm benchmarking it right now, give it like 5 minutes
᲼
2d ago
i cant say ive noticed any frame differences in modes but ive only used it server side so far so that may be why
This is fine
This is fineOP2d ago
by the way did they remove the ignore block csz thing
᲼
2d ago
server + client ofc but using internal mode
This is fine
This is fineOP2d ago
cant find it
david lynch movie hater
does it really? i recently compressed my minecraft world in 7-zip (LZMA2, 256 mb dictionary) and the compression ratio for my dh sqlite file was only 70% wait, i'm an idiot. LZMA2 is a different algorithm from LZMA
Solution
Skillnoob_
Skillnoob_2d ago
DH with Terralith + Tectonic on a 9950X3D: LZMA2: Time: 6:23; DB Size: 443,4 MiB LZ4: Time: 6:05; DB Size: 971,7 MiB
david lynch movie hater
holy hmm
Skillnoob_
Skillnoob_2d ago
LZ4 is not worth it when your world gen is slow the speedup barely makes a difference and in those cases you usually end up with a larger DB than vanilla, so LZMA2 is more worth it there in conclusion, I recomend to use LZMA2
david lynch movie hater
wait but this was compression right?
᲼
2d ago
not to mention there are mods that can run alongside distant horizons and speed up that generation
Skillnoob_
Skillnoob_2d ago
yes
david lynch movie hater
perhaps the improvement is in fetching chunks and decompressing them
Skillnoob_
Skillnoob_2d ago
Idk how I would benchmark that
david lynch movie hater
yeah that's the problem
Skillnoob_
Skillnoob_2d ago
I'm just benchmarking a bunch of different configurations on my system rn for that google sheet
This is fine
This is fineOP2d ago
could you possibly benchmark how long it takes to load all the chunks from memory? like leave and rejoin
Skillnoob_
Skillnoob_2d ago
you would need to do that for your system I doubt our systems are comparable at all
This is fine
This is fineOP2d ago
just want to see if there is any speed up alr
Skillnoob_
Skillnoob_2d ago
probably, since LZ4 decompresses faster but its not gonna make a difference large enough to notice on my system
Miki_P98
Miki_P982d ago
With high enough DH RD it may be noticeable
Skillnoob_
Skillnoob_2d ago
i guess

Did you find this page helpful?