[SOLVED] backup directory - should I limit the number of files?

Get help with all aspects of SABnzbd
Forum rules
Help us help you:
  • Are you using the latest stable version of SABnzbd? Downloads page.
  • Tell us what system you run SABnzbd on.
  • Adhere to the forum rules.
  • Do you experience problems during downloading?
    Check your connection in Status and Interface settings window.
    Use Test Server in Config > Servers.
    We will probably ask you to do a test using only basic settings.
  • Do you experience problems during repair or unpacking?
    Enable +Debug logging in the Status and Interface settings window and share the relevant parts of the log here using [ code ] sections.
Post Reply
User avatar
OneCD
Hero Member
Hero Member
Posts: 557
Joined: March 4th, 2017, 3:47 pm

[SOLVED] backup directory - should I limit the number of files?

Post by OneCD »

Hello.

My backup NZB directory currently has 42,020 items in it. I only keep these for duplicate detection.

Is there a performance penalty for keeping this many files? Should I regularly delete files? Older than 12 months? Or a maximum of 10,000?

Thank you. :)
Last edited by OneCD on May 28th, 2018, 3:24 pm, edited 1 time in total.
Stuff I like: Apache bash cron DD-WRT Debian DNSMasq Entware FireFox GitHub ImageMagick Kate KDE LibreELEC Netrunner NFS NVIDIA OpenVPN Orvibo-S20 pfSense Python Raspberry-Pi RAID SABnzbd Transmission Usenet VirtualBox Watcher3 XFCE
User avatar
safihre
Administrator
Administrator
Posts: 5339
Joined: April 30th, 2015, 7:35 am
Contact:

Re: backup directory - should I limit the number of files?

Post by safihre »

Shouldn't be a problem, we only check it with duplicate-detection.
In that case we only do a filename-exists check (no special hash-calculation) so it will be really fast anyway!
Besides that SAB ignores the folder :)
If you like our support, check our special newsserver deal or donate at: https://sabnzbd.org/donate
User avatar
OneCD
Hero Member
Hero Member
Posts: 557
Joined: March 4th, 2017, 3:47 pm

Re: backup directory - should I limit the number of files?

Post by OneCD »

Thanks @safihre. 8)
Stuff I like: Apache bash cron DD-WRT Debian DNSMasq Entware FireFox GitHub ImageMagick Kate KDE LibreELEC Netrunner NFS NVIDIA OpenVPN Orvibo-S20 pfSense Python Raspberry-Pi RAID SABnzbd Transmission Usenet VirtualBox Watcher3 XFCE
User avatar
OneCD
Hero Member
Hero Member
Posts: 557
Joined: March 4th, 2017, 3:47 pm

Re: [SOLVED] backup directory - should I limit the number of files?

Post by OneCD »

Maybe I can just keep the files names but with zero-byte files? Would duplicate detection still work?
Stuff I like: Apache bash cron DD-WRT Debian DNSMasq Entware FireFox GitHub ImageMagick Kate KDE LibreELEC Netrunner NFS NVIDIA OpenVPN Orvibo-S20 pfSense Python Raspberry-Pi RAID SABnzbd Transmission Usenet VirtualBox Watcher3 XFCE
User avatar
OneCD
Hero Member
Hero Member
Posts: 557
Joined: March 4th, 2017, 3:47 pm

Re: [SOLVED] backup directory - should I limit the number of files?

Post by OneCD »

Quick follow-up to this: I finally got around to checking if zero-byte files work for the purpose of duplicate detection - they do.

So, I zero'ed all the existing files in the NZB backup path with:

Code: Select all

for f in /media/downloads/sabnzbd/nzb/backup/*; do truncate -s0 "$f"; done
Which took me from:
48076 Files (3.4 GiB)
down to:
48076 Files (0 B)
;D
Stuff I like: Apache bash cron DD-WRT Debian DNSMasq Entware FireFox GitHub ImageMagick Kate KDE LibreELEC Netrunner NFS NVIDIA OpenVPN Orvibo-S20 pfSense Python Raspberry-Pi RAID SABnzbd Transmission Usenet VirtualBox Watcher3 XFCE
User avatar
safihre
Administrator
Administrator
Posts: 5339
Joined: April 30th, 2015, 7:35 am
Contact:

Re: [SOLVED] backup directory - should I limit the number of files?

Post by safihre »

Lol! :D
If you like our support, check our special newsserver deal or donate at: https://sabnzbd.org/donate
Post Reply