Duperemove continuing infinitely after getting stuck on a file

I've encountered an issue where duperemove will run into "invalid argument" on a certain file and just continue running and using a bunch of cpu+battery life forever unless I turn it off. I left it for about an hour yesterday with watch -n 0.5 systemctl status [email protected] and it never moved past the files it was stuck on. When I restart the service it'll scan a few files then run into the problem again. https://paste.centos.org/view/58666fce
3 Replies
wolfyreload
wolfyreload6mo ago
https://github.com/markfasheh/duperemove/issues/199 Looks like there is a known duperemove issue that sometimes occurs when the tool is run by an unprivileged user.
GitHub
"Invalid argument" when trying to deduplicate as non-root; prevents...
I have installed the current master (commit 1dbf731) on Linux Mint 18, Kernel: $ uname -rv 4.4.0-116-generic #140-Ubuntu SMP Mon Feb 12 21:23:04 UTC 2018 I have an empty btrfs volume mounted on /mn...
Daph
DaphOP6mo ago
Thanks. That's interesting as it occurred when run as a systemd service which I think is as root Update on this, it's moved on to another file but taking just as long with this next one, except with the status: had status (1) "data changed".
wolfyreload
wolfyreload6mo ago
It's probably just taking a really long time hashing the files, esp if the file is 4+GB in size
Want results from more Discord servers?
Add your server