SAB leaving unpack folder behind

[shypike]

"Cleanup list" at the bottom of "Post Processing".
Details here: https://sabnzbd.org/wiki/configuration/1.0/switches
(Or just hit the Help entry in the top menu.)

[atebark]

Thanks much!

[letkemanpete]

I am experiencing the same issue with my QNAP 419 setup running SABnzbd Version: 1.1.x and I already did have the "Ignore Samples" option selected.

It could be how I have my categories setup, so I will provide an ASCII version of them below:

Category Priority Processing Script Folder/Path Groups / Indexer tags
-------------------------------------------------------------------------------------------------
Default Normal +Delete CharTranslator.py
comics Default +Delete nzbToMylar.py /share/Comics
movies Default +Delete nzbToCouchPotato.py /share/Movies
tv Default +Delete nzbToSickBeard.py /share/TV

Any help that you can provide would be much appreciated,
Pete

See below for a copy of my config.ini and please let me know what I need to change

Code: Select all

__version__ = 19
__encoding__ = utf-8
[misc]
queue_complete = ""
https_port = 9095
folder_rename = 1
password_file = ""
rss_rate = 60
https_key = server.key
cleanup_list = nfo, sfv, srr
cache_limit = 128M
ignore_unrar_dates = 0
par_option = ""
web_color = gold
replace_spaces = 0
web_color2 = gold
dirscan_speed = 5
enable_filejoin = 1
create_group_folders = 0
never_repair = 0
no_penalties = 0
bandwidth_limit = 0
disable_api_key = 0
email_to = pete@*******************,
password = ""
permissions = 766
auto_disconnect = 1
enable_date_sorting = 0
replace_dots = 0
movie_sort_extra = -cd%1
ionice = ""
enable_unzip = 1
download_free = ""
port = 8800
email_dir = //share/MD0_DATA/.qpkg/SABnzbdplus/sabnzbd/email
pre_script = None
email_full = 0
admin_dir = admin
tv_sort_countries = 1
date_categories = tv,
ssl_type = v23
sfv_check = 1
date_sort_string = ""
schedlines = ,
host = 0.0.0.0
ignore_samples = 1
enable_tsjoin = 1
auto_browser = 0
pause_on_post_processing = 0
enable_unrar = 1
email_rss = 0
email_account = ""
email_server = smtp.*******************
allow_streaming = 0
config_lock = 0
api_warnings = 1
tv_sort_string = ""
username = ""
unpack_check = 0
size_limit = ""
enable_par_cleanup = 1
safe_postproc = 1
replace_illegal = 1
par2_multicore = 0
warned_old_queue = 0
language = en
check_new_rel = 1
enable_https = 0
no_dupes = 0
top_only = 1
quick_check = 1
movie_sort_string = ""
email_from = sabnzb@*******************
movie_extra_folder = 0
email_endjob = 1
tv_categories = ,
pause_on_pwrar = 2
login_realm = SABnzbd
send_group = 0
refresh_rate = 0
movie_categories = movies,
email_pwd = ""
ignore_wrong_unrar = 0
nice = ""
enable_movie_sorting = 0
https_cert = server.cert
web_dir2 = Plush
fail_on_crc = 0
auto_sort = 0
ampm = 0
web_dir = Plush
queue_complete_pers = 0
enable_tv_sorting = 0
folder_max_length = 256
log_dir = /share/Download/sabnzbd/logs
download_dir = /share/Download/sabnzbd/incomplete
complete_dir = /share/Download/sabnzbd/complete
nzb_backup_dir = /share/Download/sabnzbd/nzb/backup
cache_dir = /share/Download/sabnzbd/cache
dirscan_dir = /share/Download/sabnzbd/nzb
script_dir = /share/Download/nzbToMedia
win_menu = 1
allow_64bit_tools = 1
movie_rename_limit = 100M
notified_new_skin = 1
rating_filter_enable = 0
rating_enable = 0
inet_exposure = 0
enable_recursive = 1
selftest_host = self-test.sabnzbd.org
pre_check = 0
allow_duplicate_files = 0
api_key = *******************
rating_feedback = 1
load_balancing = 2
rating_filter_abort_video = 0
osx_speed = 1
quota_period = m
enable_7zip = 1
rating_filter_pause_audio = 0
rss_filenames = 0
quota_day = ""
use_pickle = 0
https_chain = ""
warn_empty_nzb = 1
history_limit = 10
rating_filter_pause_encrypted_confirm = 0
warned_old_queue9 = 0
enable_https_verification = 0
ipv6_hosting = 0
enable_bonjour = 1
quota_size = ""
wait_ext_drive = 5
ipv6_servers = 1
enable_all_par = 1
rating_filter_pause_encrypted = 0
queue_limit = 20
osx_menu = 1
show_sysload = 2
html_login = 1
sanitize_safe = 1
req_completion_rate = 100.2
rating_filter_abort_encrypted_confirm = 0
rating_filter_pause_spam_confirm = 0
fixed_ports = 0
fsys_type = 0
allow_incomplete_nzb = 0
rating_filter_abort_keywords = ""
enable_meta = 1
quota_resume = 0
wait_for_dfolder = 0
rating_filter_abort_encrypted = 0
prospective_par_download = 1
rating_filter_pause_keywords = ""
warn_dupl_jobs = 1
fail_hopeless = 1
rating_filter_abort_spam_confirm = 0
no_series_dupes = 0
propagation_delay = 0
new_nzb_on_failure = 0
nzb_key = *******************
rating_filter_pause_downvoted = 0
rating_filter_abort_audio = 0
nomedia_marker = ""
max_art_opt = 0
bandwidth_max = 2M
local_ranges = ,
keep_awake = 1
unwanted_extensions = exe, com, bat, scr
max_art_tries = 3
rss_odd_titles = nzbindex.nl/, nzbindex.com/, nzbclub.com/
rating_filter_pause_spam = 0
backup_for_duplicates = 1
sched_converted = 1
prio_sort_list = ,
rating_filter_abort_downvoted = 0
script_can_fail = 0
bandwidth_perc = 0
empty_postproc = 0
rating_host = api.oznzb.com
rating_filter_pause_video = 0
api_logging = 1
web_watchdog = 0
action_on_unwanted_extensions = 2
rating_api_key = ""
flat_unpack = 0
rating_filter_abort_spam = 0
start_paused = 0
overwrite_files = 0
[logging]
log_new = 0
max_log_size = 5242880
log_level = 1
log_backups = 5
enable_cherrypy_logging = 0
[newzbin]
username = ""
bookmark_rate = 60
bookmarks = 0
password = ""
unbookmark = 1
[nzbmatrix]
username = ""
apikey = ""
del_bookmark = 1
[categories]
[[*]]
priority = 0
pp = 3
name = *
script = CharTranslator.py
newzbin = ""
dir = ""
[[tv]]
priority = -100
pp = 3
name = tv
script = nzbToSickBeard.py
newzbin = ""
dir = /share/TV
[[comics]]
priority = -100
pp = 3
name = comics
script = nzbToMylar.py
newzbin = ""
dir = /share/Comics
[[movies]]
priority = -100
pp = 3
name = movies
script = nzbToCouchPotato.py
newzbin = ""
dir = /share/Movies
[ncenter]
ncenter_prio_download = 0
ncenter_prio_warning = 0
ncenter_prio_new_login = 0
ncenter_prio_queue_done = 0
ncenter_prio_startup = 0
ncenter_prio_failed = 0
ncenter_prio_disk_full = 0
ncenter_prio_error = 0
ncenter_enable = 0
ncenter_prio_complete = 0
ncenter_prio_pp = 0
ncenter_prio_other = 0
[nscript]
nscript_prio_warning = 0
nscript_prio_complete = 1
nscript_prio_other = 0
nscript_prio_queue_done = 1
nscript_prio_failed = 1
nscript_prio_pp = 0
nscript_prio_new_login = 0
nscript_script = None
nscript_prio_download = 0
nscript_prio_error = 0
nscript_prio_startup = 1
nscript_parameters = ""
nscript_enable = 0
nscript_prio_disk_full = 1
[pushover]
pushover_prio_error = 1
pushover_enable = 0
pushover_prio_complete = -1
pushover_prio_warning = 1
pushover_prio_startup = -3
pushover_prio_queue_done = -1
pushover_prio_other = -3
pushover_prio_pp = -3
pushover_prio_disk_full = 1
pushover_device = ""
pushover_token = ""
pushover_prio_new_login = -3
pushover_prio_failed = -1
pushover_prio_download = -2
pushover_userkey = ""
[growl]
growl_prio_disk_full = 1
growl_enable = 0
growl_prio_new_login = 0
growl_prio_other = 0
growl_prio_download = 0
growl_server = ""
growl_prio_startup = 1
growl_prio_failed = 1
growl_prio_queue_done = 1
growl_prio_warning = 0
growl_prio_error = 0
growl_prio_complete = 1
growl_prio_pp = 0
growl_password = ""
[prowl]
prowl_prio_disk_full = 1
prowl_prio_error = -3
prowl_prio_download = -3
prowl_enable = 0
prowl_prio_failed = 1
prowl_prio_pp = -3
prowl_prio_new_login = -3
prowl_apikey = ""
prowl_prio_startup = -3
prowl_prio_warning = -3
prowl_prio_other = -3
prowl_prio_complete = 0
prowl_prio_queue_done = 0
[acenter]
acenter_prio_warning = 0
acenter_prio_disk_full = 0
acenter_prio_new_login = 0
acenter_prio_error = 0
acenter_prio_failed = 0
acenter_prio_startup = 0
acenter_prio_queue_done = 0
acenter_enable = 0
acenter_prio_complete = 0
acenter_prio_download = 0
acenter_prio_pp = 0
acenter_prio_other = 0
[ntfosd]
ntfosd_prio_queue_done = 0
ntfosd_enable = 0
ntfosd_prio_error = 0
ntfosd_prio_startup = 0
ntfosd_prio_complete = 0
ntfosd_prio_pp = 0
ntfosd_prio_warning = 0
ntfosd_prio_other = 0
ntfosd_prio_disk_full = 0
ntfosd_prio_new_login = 0
ntfosd_prio_download = 0
ntfosd_prio_failed = 0
[pushbullet]
pushbullet_prio_download = 0
pushbullet_prio_queue_done = 0
pushbullet_enable = 0
pushbullet_prio_complete = 1
pushbullet_prio_warning = 0
pushbullet_device = 0
pushbullet_prio_failed = 1
pushbullet_prio_other = 0
pushbullet_apikey = ""
pushbullet_prio_disk_full = 1
pushbullet_prio_new_login = 0
pushbullet_prio_pp = 0
pushbullet_prio_startup = 0
pushbullet_prio_error = 0
[servers]
[[news.usenetserver.com]]
username = *******************
priority = 0
enable = 1
displayname = news.usenetserver.com
name = news.usenetserver.com
ssl_type = ""
notes = ""
connections = 9
ssl = 1
host = news.usenetserver.com
timeout = 120
send_group = 0
password = *******************
optional = 0
port = 563
categories = Default,
retention = 0
[[news-us.usenetserver.com]]
username = *******************
priority = 1
enable = 1
displayname = news-us.usenetserver.com
name = news-us.usenetserver.com
ssl_type = ""
notes = ""
connections = 9
ssl = 1
host = news-us.usenetserver.com
timeout = 120
send_group = 0
password = *******************
optional = 0
port = 563
categories = Default,
retention = 0
[[news-eu.usenetserver.com]]
username = *******************
priority = 2
enable = 1
displayname = news-eu.usenetserver.com
name = news-eu.usenetserver.com
ssl_type = ""
notes = ""
connections = 9
ssl = 1
host = news-eu.usenetserver.com
timeout = 120
send_group = 0
password = *******************
optional = 0
port = 563
categories = Default,
retention = 0

[shypike]

I am experiencing the same issue with my QNAP 419 setup running SABnzbd Version: 1.1.x and I already did have the "Ignore Samples" option selected.

Several different issues were discussed.
Please describe what goes wrong with your setup.

[letkemanpete]

Sorry for the delay, I did not get a notification email about your response shypike, I suspect I forgot to enable that feature or the email when directly to SPAM. I have now made sure that I get notified when a response is posted.

Here goes:

Let's say that I setup SickBeard to download TV Show X. SickBeard finds the NZB and sends the NZB to SABnzbd and is downloaded. The script copies the files from the unpack directory "/share/tv/unpack.tv.show.x.s01.e02.hd" to "/share/tv/ShowX/". However the directory "/share/tv/unpack.tv.show.x.s01.e02.hd" is still left on the server and is not cleaned up.

The same thing happens with a NZB found by Mylar and downloaded via SABnzbd, the only change is the name of the directories. I tried putting a * (asterisk) at the path, however this did not help and I was left to reorganize my files once again. I noticed that sometimes the unpack directory is empty and just left on the QNAP, where as other times the unpack directory has the TV show or comic file in it.

Prior to this I was using SABnzbd 7.20 on my QNAP 419. For testing purposes, since I have the SABnzbd scripts from the previous setup, I'm going to see what happens when the old script is used for TV show/Sickbeard.

One thing that I noticed is that when I was getting emails from SABnzbd 7.20 it was say that the file was moved from "/share/download/sabnzbd/tv/unpack.directory" to "/share/tv/ShowX".
Now when I get emails it says that the files were copied from "/share/tv/unpack.directory/" to "/share/tv/ShowX".

Thanks for your help with this,
Pete

[shypike]

If SickBeard copies files, it should delete the originals.
SABnzbd won't do that, it never did.
SickBeard should move instead of copy, but that not a problem that SABnzbd can solve.

[letkemanpete]

I can tell you that the I have the same problem with the older version of the SickBeard script. This issue also occurs with Mylar downloads, so I don't think that it's a Mylar or Sickbeard issue, but a SABnabd issue.

[shypike]

I don't see how it can be a SABnzbd issue.
It unpacks its stuff to the unpack folder and then runs the script.
After that it does nothing more.
It could be that Mylar or SickBeard do not move all the files of the folder.
There's an option in SABnzbd that lets you erase files based on their extension
(like "par2, nfo" etc. ) that does its work just before running the script.

Or are you instead trying to tell me that it leaves behind debris in form of
a folder in the "temporary download area"?
Some releases have that problem.

[letkemanpete]

Sometimes the unpack directory (in the temporary download area) is still left on the QNAP with one or more files in it, other times only the unpack directory (in the temporary download area) is left. I running version "1.1.x [unknown]" on my device. The version of SABnzbd that I have uses a directory named "nzbToMedia" which contains 'autoProcessMedia.cfg' and scripts such as 'nzbToCouchPotato.py', 'nzbToSickBeard.py', 'nzbToMylar.py'.

From what I can tell this is related to SABnzbd 1.1.x as this did not happen when I was running SABnabd 0.7.20.x.

shypike, I see that you have also answered my other forum post about a secondary script which only does the clean up of the files, thank you. What do you think I could do to help with this issue?

Please do not misunderstand me, I think that SABnzbd is great and I very much appreciate for your free help with this free program.

[shypike]

You're talking about the "unpack" directory.
For me that is the directory to which SABnzbd unpacks RAR files.
That is not in the "temporary download area".

If stuff remains in the "temporary download area", that is a bug in SABnzbd.
As I said, there has been some trouble in that area.
It should be solved in release 1.1.0RC4.
But it's not clear which one you have. Where does it come from?

[letkemanpete]

You're talking about the "unpack" directory.
For me that is the directory to which SABnzbd unpacks RAR files.

It's very possible that I'm using the incorrect term. The SABnzbd is downloading the files correctly to a temporary directory (e.g. /share/sabnzbd/complete) and decompressing them, after which it deletes the source compressed files.

This is what occurred just yesterday:

• /share/tv/tvshow.s01.e01.fum.zbc.hdtv/
  • tvshowx.avi

However the script(s) did put tvshowx.avi in the correct directory as well.

I also had this happen yesterday:

• /share/comics/book.1.annual.getcomics/

With the comic book file ending up in the correct location and just leaving an empty directory behind.

So after the data file was copied to it's proper location, sometimes (but not always) the files in the directory are deleted, yet the directory remains.

[safihre]

That's completely out of control of Sabnzbd, this is what the script is supposed to do.
Maybe it could be a rights issue that the script can't delete the folder?

[letkemanpete]

Okay, I'll see change the permissions on the directories and see what happens.

Thank you safhre for your thoughts on the matter,
Pete

[letkemanpete]

I can confirm that changing the permissions did not produce the desired outcome. Because this in on my QNAP which only has one user and it's using a non route able IP address (192.168.1.116) I gave that user full rights by doing running "chmod -R 777 ." on /share/tv and /share/comics.

I think that possibly that I'm beating a dead horse at this point as shypike stated that there will be a new version soon which will have some bug fixes.
What can I provide to the SABnzbd team to help them out, so that they can try to reproduce this situation and then try to fix it?

[letkemanpete]

I know part of the problem and part of the solution. Part of the problem is that for what ever reason the Mylar finds a comic book and tells SABnzbd to download it the category is set, but the script for that download is not. If I manually set the script to nzbToMylar.py then when comic books are downloaded I get the following line in the completed email:

Code: Select all

[14:24:37] [INFO]::CLEANDIR: Directory /share/Comics/Comic.Book.Name.002.2015.Digital.Cypher.2.0-Empire has been processed and removed ...
[14:24:37] [INFO]::MAIN: The /share/Download/nzbToMedia/nzbToMylar.py script completed successfully.

I was under the impression that if you set a category for a download that the script associated with would be executed as well. However this does not appear to be the case for some reason.
I know that this is a SABnzbd forum and not related Mylar forum so I will post to that Mylar form about this as well.

Thanks for your help with this,
Pete