Netty channel closed channel exceptions
At a bit of a loss so figured id ask here incase anyone's more knowledgeable about this stuff.
has anyone got any idea why i get this sometimes when a player disconnects?
its random what player it is and it doesn't happen everytime. sometimes the spam of the error is less then others (only a couple) and then other times it spams thousands of times and stops the server ticking and kicks everyone.
the strange thing is - this server is pretty much identical to another server we run on the same network and machine. all the plugins are the same and running the same versions but the other server does not have the problem.
at a bit of a loss due to it not really pointing specifically to what could be causing it other than the obvious that its a connection closing issue
https://mclo.gs/uuGuaWm
32 Replies
Thanks for asking your question!
Make sure to provide as much helpful information as possible such as logs/what you tried and what your exact issue is
Make sure to mark solved when issue is solved!!!
/close
!close
!solved
!answered
Requested by ophelovie#0
more full: https://mclo.gs/OfibtLu
running latest build pufferfish 1.21 on both servers but can reproduce on latest version of paper also
To quote the paper dev's
Evertime we've seen this exception it's been down to plugins injecting themselves into the networking logic in a manner that prevents the network connection for a user from actually closing
So that's something to look for. You can also give us a list of that.yeahh its just so confusing because we run 2 seperate SMP servers on the same hardware running the same plugins but 1 has the issue and the other does not

https://spark.lucko.me/fRlrGBUjGO not sure if providing this would be helpful in the slightest either but ill give anything
spark
spark is a performance profiler for Minecraft clients, servers, and proxies.
Spark Profile Analysis
These are not magic values. Many of these settings have real consequences on your server's mechanics. See this guide for detailed information on the functionality of each setting.
✅ Your server isn't lagging
Your server is running fine with an average TPS of 20.
Requested by ophelovie#0
!binary
Binary search your plugins
Remove half of your non-essential (ie not things like PAPI or LuckPerm) plugins and see if the problem is fixed.
If it still persists, the cause is in the half still installed.
Continue to halve the remaining plugins until you've narrowed it down to a single plugin.
Congratulations, you found the culprit.

Admincraft Canned Responses
a binary search could be very difficult as it doesn't happen every time - it's completely random
there's no better way to find it unless if someone happens to know what plugin is the culprit
is there a way of figuring out what plugins are using netty?
yes
checking the source code
I'm not too familiar with signedvelocity, but doesn't it do the same as antipopup?
no
antipopup is anti chat reporting
if you want to be mug compliant, reenable the popup, also update signed velocity if you havent
there was recently a RCE exploit in it
I see, so this only removes the popup message not the report function. Got it.
no
no?
antipopup does both
I know that.
signedvelocity just fixes a issue with commands/proxies
Right, and this message no longer pops up.
it shouldnt remove the popup
if it does then...
Anyways, it says it does on the page.
paper is recommending a plugin that breaks the MUG
fun
the popup needs to be there
if the server isnt doing secure profiles etc
ah not by default

yeahh we’re up to date on signed velocity
it’s just so strange because we run another server with the same plugins on the same versions with no issue :axolotl_think:
Well that's on paper so meh. 🤷
Right now the issue still seems to be up in the air. So let's see if anything can be done there.
@love what version of packetevents are you running? Scratch that, you're on 2.4.0.
also, can you try the latest dev version https://ci.codemc.io/job/retrooper/job/packetevents/lastSuccessfulBuild/ ?
yep just updated to the latest dev build of packet events and still happening unfortunately
Do you have a new log?
https://mclo.gs/pIFLtCO here's from right now - servers still running but still getting the random closed channel exceptions on random player disconnects
line 2324 is one, 2085
seeing
io.netty.handler.timeout.ReadTimeoutException
also
i’ve slowly started disabling plugins per day (it’s hard to disable half or many at a time as it’s a production server) and not had much luck yet.
does anyone have recommendations for what plugins to prioritise removing?
is it also possible that it’s not a plug-in? like could it be anything else?
(i ask purely because i run 2 smp servers on the same machine with the exact same plugins & setups and the other does not have this issue)anything that uses packets i would say
so start with plugins that depend on packetevents/protocollib
thanks! ive taken off all the protocollib ones now but no luck yet. working through it slowly.
something interesting or perhaps unrealted is another error popped up after one this time (not sure if its relevant)
https://mclo.gs/Eo1Ol7D