Hello.
My backup NZB directory currently has 42,020 items in it. I only keep these for duplicate detection.
Is there a performance penalty for keeping this many files? Should I regularly delete files? Older than 12 months? Or a maximum of 10,000?
Thank you.
[SOLVED] backup directory - should I limit the number of files?
Forum rules
Help us help you:
Help us help you:
- Are you using the latest stable version of SABnzbd? Downloads page.
- Tell us what system you run SABnzbd on.
- Adhere to the forum rules.
- Do you experience problems during downloading?
Check your connection in Status and Interface settings window.
Use Test Server in Config > Servers.
We will probably ask you to do a test using only basic settings. - Do you experience problems during repair or unpacking?
Enable +Debug logging in the Status and Interface settings window and share the relevant parts of the log here using [ code ] sections.
[SOLVED] backup directory - should I limit the number of files?
Last edited by OneCD on May 28th, 2018, 3:24 pm, edited 1 time in total.
Stuff I like: Apache bash cron DD-WRT Debian DNSMasq Entware FireFox GitHub ImageMagick Kate KDE LibreELEC Netrunner NFS NVIDIA OpenVPN Orvibo-S20 pfSense Python Raspberry-Pi RAID SABnzbd Transmission Usenet VirtualBox Watcher3 XFCE
Re: backup directory - should I limit the number of files?
Shouldn't be a problem, we only check it with duplicate-detection.
In that case we only do a filename-exists check (no special hash-calculation) so it will be really fast anyway!
Besides that SAB ignores the folder
In that case we only do a filename-exists check (no special hash-calculation) so it will be really fast anyway!
Besides that SAB ignores the folder
If you like our support, check our special newsserver deal or donate at: https://sabnzbd.org/donate
Re: backup directory - should I limit the number of files?
Thanks @safihre.
Stuff I like: Apache bash cron DD-WRT Debian DNSMasq Entware FireFox GitHub ImageMagick Kate KDE LibreELEC Netrunner NFS NVIDIA OpenVPN Orvibo-S20 pfSense Python Raspberry-Pi RAID SABnzbd Transmission Usenet VirtualBox Watcher3 XFCE
Re: [SOLVED] backup directory - should I limit the number of files?
Maybe I can just keep the files names but with zero-byte files? Would duplicate detection still work?
Stuff I like: Apache bash cron DD-WRT Debian DNSMasq Entware FireFox GitHub ImageMagick Kate KDE LibreELEC Netrunner NFS NVIDIA OpenVPN Orvibo-S20 pfSense Python Raspberry-Pi RAID SABnzbd Transmission Usenet VirtualBox Watcher3 XFCE
Re: [SOLVED] backup directory - should I limit the number of files?
Quick follow-up to this: I finally got around to checking if zero-byte files work for the purpose of duplicate detection - they do.
So, I zero'ed all the existing files in the NZB backup path with:
Which took me from:
So, I zero'ed all the existing files in the NZB backup path with:
Code: Select all
for f in /media/downloads/sabnzbd/nzb/backup/*; do truncate -s0 "$f"; done
down to:48076 Files (3.4 GiB)
48076 Files (0 B)
Stuff I like: Apache bash cron DD-WRT Debian DNSMasq Entware FireFox GitHub ImageMagick Kate KDE LibreELEC Netrunner NFS NVIDIA OpenVPN Orvibo-S20 pfSense Python Raspberry-Pi RAID SABnzbd Transmission Usenet VirtualBox Watcher3 XFCE
Re: [SOLVED] backup directory - should I limit the number of files?
Lol!
If you like our support, check our special newsserver deal or donate at: https://sabnzbd.org/donate