Admincraft•2y ago

Low TPS during peak hours.

Hello, I have asked on a couple of other discord to get help, and I feel like I don't get any smarter. I am fortunately lucky enough to have this issue, but it needs fixing 🙂 When our server has between 60-80 players online, the TPS drops and MSPT goes up. From what I can see myself, it could be too many entities loaded? We have followed the optimization guides that's on the web to try and hard-nerf it as much as possible, but also try to make it "playable". Here is the spark profile: https://spark.lucko.me/LlhXUuepDX Anyone got any tips? We have 192 GB Server, Ryzen 7950X, basically the most expensive you can find on Bloom.host. CPU seems to stay at around 10%, so idk what the bottleneck is. We allocated 50 GB of ram to the server in the Duck panel (re-skinned pterodactyl panel basically), but gave only 24% of that to the server (so 12 GB) which means we have a 38 GB of overheard (that's the idea at least) Java version 17, Purpur Minecraft version 1.20.1 Startup flags:

java -XX:+UseContainerSupport -Xms$((51200*24/100))M -Xmx$((51200*24/100))M --add-modules=jdk.incubator.vector -XX:+UseG1GC -XX:+ParallelRefProcEnabled -XX:MaxGCPauseMillis=200 -XX:+UnlockExperimentalVMOptions -XX:+DisableExplicitGC -XX:+AlwaysPreTouch -XX:G1HeapWastePercent=5 -XX:G1MixedGCCountTarget=4 -XX:InitiatingHeapOccupancyPercent=15 -XX:G1MixedGCLiveThresholdPercent=90 -XX:G1RSetUpdatingPauseTimePercent=5 -XX:SurvivorRatio=32 -XX:+PerfDisableSharedMem -XX:MaxTenuringThreshold=1 -Dusing.aikars.flags=https://mcflags.emc.gs -Daikars.new.flags=true -XX:G1NewSizePercent=40 -XX:G1MaxNewSizePercent=50 -XX:G1HeapRegionSize=16M -XX:G1ReservePercent=15 -jar server.jar

java -XX:+UseContainerSupport -Xms$((51200*24/100))M -Xmx$((51200*24/100))M --add-modules=jdk.incubator.vector -XX:+UseG1GC -XX:+ParallelRefProcEnabled -XX:MaxGCPauseMillis=200 -XX:+UnlockExperimentalVMOptions -XX:+DisableExplicitGC -XX:+AlwaysPreTouch -XX:G1HeapWastePercent=5 -XX:G1MixedGCCountTarget=4 -XX:InitiatingHeapOccupancyPercent=15 -XX:G1MixedGCLiveThresholdPercent=90 -XX:G1RSetUpdatingPauseTimePercent=5 -XX:SurvivorRatio=32 -XX:+PerfDisableSharedMem -XX:MaxTenuringThreshold=1 -Dusing.aikars.flags=https://mcflags.emc.gs -Daikars.new.flags=true -XX:G1NewSizePercent=40 -XX:G1MaxNewSizePercent=50 -XX:G1HeapRegionSize=16M -XX:G1ReservePercent=15 -jar server.jar

spark

spark is a performance profiler for Minecraft clients, servers, and proxies.

30 Replies

Discount Milk•2y ago

Executable items + GC Olds happening You got something sussy going on chief

Memory(process)
11.8 GB
/
12 GB
98.21%

Memory(process)
11.8 GB
/
12 GB
98.21%

Either you've got the worst memory leak, or you don't have enough memory. I'm thinking the latter.

MrMcyeet•2y ago

Wow, ok. You are paying a lot for that server. You would benefit greatly from pufferfish+'s async entity tracking here Since you're already paying 300/month for the server, you may consider just paying for a license to pufferfish+ (https://pufferfish.host/plus) (also, just contact Kevin on their discord) Or you could switch hosts completely. I don't know the location of your server, but Pufferfish+ comes complimentary with any of their servers (including the managed dedicated servers) And what Leche said goes too, your memory utilization really shouldn't be capped at almost 100% like that 😳

Discount Milk•2y ago

Where you seeing $300/mo? :FrogeBIGEYES:

MrMcyeet•2y ago

he posted this image

Discount Milk•2y ago

Oh I didn't see that

MrMcyeet•2y ago

unless im misreading/misinterpriting that

Discount Milk•2y ago

Snugly between the codeblock and the spark embed

MrMcyeet•2y ago

yuup, I almost missed it, too lol

QarthO•2y ago

I feel like you could bump up the server from 12 to 16gb. Even with that change 34gb of overhead seems way too generous. If you’re not using the memory, sure no harm. But I feel like it can be used elsewhere if needed. For my 16gb servers, I’ve allocated 24gbs to the containers and haven’t had any issues (8gb overhead) Someone better with overhead/memory utilization can give more insight and correct me if I’m wrong

kayohmedyOP•2y ago

We have a suspicion we have a memory leak, as the server have crashed multiple times this week due to MemoryHeap too much ram usage or whatever the message was. But I dont know how to troubleshoot memoryleak or even find what the issue is

MrMcyeet•2y ago

Spark heap dumps go brrrrr

Discount Milk•2y ago

Actually

kayohmedyOP•2y ago

I have never heard of this... Worth it? We use purpur today

MrMcyeet•2y ago

Yes Very worth it

Discount Milk•2y ago

Allocation profiler

kayohmedyOP•2y ago

We are going to try this now

MrMcyeet•2y ago

Contact @Kevin for more info, Pufferfish is his brain child and hosting service They'll work with you and help you out, too

QarthO•2y ago

Join the pufferhost disc and create a ticket, those guys are really on top of it

MrMcyeet•2y ago

^^ 100x that

Discount Milk•2y ago

I don't know if making a sales pitch is appropriate for this channel :FrogeBIGEYES:

Kevin•2y ago

hi somebody pinged

MrMcyeet•2y ago

Im not making a sales pitch, im helping him fix perf problems 😉

kayohmedyOP•2y ago

Does Pufferfish+ work well with a vanilla-type server? We try to focus on gameplay still being fun and smooth, rather than just closing our eyes and disabling entities/AI like huge servers do

MrMcyeet•2y ago

That is what its designed for, afaik

Kevin•2y ago

Yeah not sales pitching but the entity tracker is an absolute disaster on 1.20, contact me for details, I can help you out.

Cubicake•2y ago

wow pufferfish.host looks great wish they realised the asia pacific region exists dont actually take this as an insult I just wish the asia pacific region had more options and pufferfish.host looks really tempting

MrMcyeet•2y ago

They talked about this many times before tbh Bandwidth in the Asia region is just very expensive It really doesn't make sense to expand there, since it would just lose them money

Cubicake•2y ago

Yes I understand It was sarcastic

Kevin•2y ago

It might actually happen… But yeah APAC bandwidth is a nightmare

Cubicake•2y ago

please ping me if u ever do

Gaming

Programming

Low TPS during peak hours.

Did you find this page helpful?