Page 1 of 1

[SOLVED] backup directory - should I limit the number of files?

Posted: May 28th, 2018, 2:33 pm
by OneCD
Hello.

My backup NZB directory currently has 42,020 items in it. I only keep these for duplicate detection.

Is there a performance penalty for keeping this many files? Should I regularly delete files? Older than 12 months? Or a maximum of 10,000?

Thank you. :)

Re: backup directory - should I limit the number of files?

Posted: May 28th, 2018, 3:20 pm
by safihre
Shouldn't be a problem, we only check it with duplicate-detection.
In that case we only do a filename-exists check (no special hash-calculation) so it will be really fast anyway!
Besides that SAB ignores the folder :)

Re: backup directory - should I limit the number of files?

Posted: May 28th, 2018, 3:23 pm
by OneCD
Thanks @safihre. 8)

Re: [SOLVED] backup directory - should I limit the number of files?

Posted: May 28th, 2018, 3:26 pm
by OneCD
Maybe I can just keep the files names but with zero-byte files? Would duplicate detection still work?

Re: [SOLVED] backup directory - should I limit the number of files?

Posted: December 16th, 2018, 2:23 am
by OneCD
Quick follow-up to this: I finally got around to checking if zero-byte files work for the purpose of duplicate detection - they do.

So, I zero'ed all the existing files in the NZB backup path with:

Code: Select all

for f in /media/downloads/sabnzbd/nzb/backup/*; do truncate -s0 "$f"; done
Which took me from:
48076 Files (3.4 GiB)
down to:
48076 Files (0 B)
;D

Re: [SOLVED] backup directory - should I limit the number of files?

Posted: December 17th, 2018, 9:43 am
by safihre
Lol! :D