Double unpacks?

Get help with all aspects of SABnzbd
Forum rules
Help us help you:
  • Are you using the latest stable version of SABnzbd? Downloads page.
  • Tell us what system you run SABnzbd on.
  • Adhere to the forum rules.
  • Do you experience problems during downloading?
    Check your connection in Status and Interface settings window.
    Use Test Server in Config > Servers.
    We will probably ask you to do a test using only basic settings.
  • Do you experience problems during repair or unpacking?
    Enable +Debug logging in the Status and Interface settings window and share the relevant parts of the log here using [ code ] sections.
Post Reply
AnonyMouse
Newbie
Newbie
Posts: 13
Joined: December 9th, 2017, 10:45 am

Double unpacks?

Post by AnonyMouse » February 1st, 2019, 3:56 pm

I have come back to sabnzbd as part of moving my setup to run on Linux instead of Windows. I'm running sabnzbd from a LSIO docker image, and it's been working as well as I remembered, except for one thing. I seem to get double unpacks frequently. I suspect that one is the direct unpack, and the other is the normal unpack, but it's not quite clear whey it's happening. Any ideas?

I also had (as I mentioned in another thread) a thing where 2 unrar processes hung at the same time and ultimately required me to reboot the machine. I'm wondering if that's a related thing. Any ideas?

Thanks!

AnonyMouse
Newbie
Newbie
Posts: 13
Joined: December 9th, 2017, 10:45 am

Re: Double unpacks?

Post by AnonyMouse » February 1st, 2019, 4:08 pm

Oh, maybe never mind. I think I see the problem now...the log says it failed the checksum...but it appears to have successfully unpacked regardless? Does sabnzbd not cleanup if the unpack fails? But...well...hmmm I don't get it...the log is odd to me. Maybe it failed the checksum when it shouldn't have?
2019-02-01 10:56:17,729::INFO::[directunpacker:271] DirectUnpacked volume 85 for 228966d71c5b45c2b44287c9e98ae3a1
2019-02-01 10:56:17,733::INFO::[directunpacker:183] Error in DirectUnpack of 228966d71c5b45c2b44287c9e98ae3a1: 228966d71c5b45c2b44287c9e98ae3a1.mkv - checksum error
2019-02-01 10:56:17,733::INFO::[directunpacker:385] Aborting DirectUnpack for 228966d71c5b45c2b44287c9e98ae3a1
2019-02-01 10:56:20,538::INFO::[postproc:675] Running verification and repair on set 228966d71c5b45c2b44287c9e98ae3a1
2019-02-01 10:56:20,553::INFO::[newsunpack:1107] Quick-check for 228966d71c5b45c2b44287c9e98ae3a1 is OK, skipping repair
2019-02-01 10:56:21,626::INFO::[newsunpack:256] Unrar starting on /incomplete-downloads/Stuff.S03E05.1080p.WEB.H264-METCON-ObfuscatedPostBot
2019-02-01 10:56:21,628::INFO::[newsunpack:516] Extracting rarfile /incomplete-downloads/Stuff.S03E05.1080p.WEB.H264-METCON-ObfuscatedPostBot/228966d71c5b45c2b4428
7c9e98ae3a1.part01.rar (belonging to 228966d71c5b45c2b44287c9e98ae3a1) to /downloads/_UNPACK_Stuff.S03E05.1080p.WEB.H264-METCON-ObfuscatedPostBot

AnonyMouse
Newbie
Newbie
Posts: 13
Joined: December 9th, 2017, 10:45 am

Re: Double unpacks?

Post by AnonyMouse » February 2nd, 2019, 10:47 am

Ok something weird I noticed last night. It seems to mostly happen if the unpack results in something larger then around 500MB. Also, sometimes the rars are cleaned up, sometimes not. In my config, I'm currently targetting the failed downloads to a disk local to sabnzbd, but the completed downloads is on a windows share. I'm starting to be concerned that this, combined with running sabnzbd from a Linux machine is an issue.

I ran it windows to windows for a long time with no issues previously, but maybe it's that? I even used to target a network share for the failed downloads, so there would be less time spent moving files around and no risk of filling up the local disk. I just never thought of there being any particular issues with Linux going to a windows share.

AnonyMouse
Newbie
Newbie
Posts: 13
Joined: December 9th, 2017, 10:45 am

Re: Double unpacks?

Post by AnonyMouse » February 2nd, 2019, 12:20 pm

Ok, I think I've found the culprit, although I haven't quite got it fixed. My Windows share is presenting an aggregate pooled disk I've been running this for so long I forgot I've had to adjust my Windows clients and turn off SMB caching on the client side, or I sometimes get excessive long times for the clients to notice changes in the shares. I think I'm running into this same thing, but Unrar/smb shares/sabnzbd on linux aren't quite reacting the same way so I'm getting weird effects as a result. Regardless, I don't think it's a sabnzbd problem anymore. I'll have to tweak my mount settings some more and see if I can hash it out.

User avatar
safihre
Administrator
Administrator
Posts: 3042
Joined: April 30th, 2015, 7:35 am
Location: Switzerland
Contact:

Re: Double unpacks?

Post by safihre » February 3rd, 2019, 5:37 am

We do try to cleanup, I was going to say that we don't show lot's of warnings when the cleanup fails. But seems you already figured it out :)

xtrips
Newbie
Newbie
Posts: 28
Joined: May 11th, 2010, 5:45 am

Re: Double unpacks?

Post by xtrips » February 3rd, 2019, 4:05 pm

Hello,

Something I don't understand. Why is Sabnzbd unraring while downloading, which is good since it is set to Direct Unpack, and then when the downloading is done, it actually deletes all that it has unrared, rechecks the whole download, and finally unrar, again?
Is that a misconfiguration in the switches on my part? or is it by design which would be pretty useless and wastes time.

User avatar
safihre
Administrator
Administrator
Posts: 3042
Joined: April 30th, 2015, 7:35 am
Location: Switzerland
Contact:

Re: Double unpacks?

Post by safihre » February 4th, 2019, 6:58 am

That usually only happens if an error occurred during the Direct Unpack, otherwise of course it wouldn't do it twice.
If you switch logging to Debug, you can see the output of DirectUnpack and see what goes wrong.
What does it show as Unrar output?

Post Reply