unpacking/repair is failing a lot lately

[JustinChase]

I'm not sure what changed, as this seems a newish problem for me, but lately over half my downloads fail to unpack. The most common error is

» Unpacking failed, unable to find Interstellar.2014.2-Disc.IMAX.Edition.Blu-ray.CEE.1080p.AVC.DD5.1-HDCLUB.part066.rar

This file isn't in the folder, but only because it's been changed to Interstellar.2014.2-Disc.IMAX.Edition.Blu-ray.CEE.1080p.AVC.DD5.1-HDCLUB.part066.1.rar and also in the folder is Interstellar.2014.2-Disc.IMAX.Edition.Blu-ray.CEE.1080p.AVC.DD5.1-HDCLUB.part066.rar.1

I manually changed one of these folders to be 'correct' by removing the extra .1 and deleted the other one, so it just showed the exact filename SAB is now complaining it can't find, but when I put it back in the queue, it tries to unpack and repair, then fails again, after SAB changes the filename back to one of these 2 names.

The file in question is not the same size as all the other files, so it's certainly an incomplete file, but the par files have always been able to work around this issue in the past.

Any ideas on how to correct this issue, and get this file unpacked once and for all? I have about 10 nzb files suffering this same fate currently.

FYI, we recently moved to the mountains and can only get (horrible) satellite internet, which has a 10GB cap and unlimited downloading from midnight to 5am. If I have to re-download all these files it will likely take all month; which I'd really like to avoid.

thanks in advance for any help.

[an3k]

I don't know what is causing this issue but I also noticed more unpacking fails than before. You don't have to re-download all of the data. Don't try&error with SABnzbd but get multipar.eu and open the main .par2 with that tool. It does what SABnzbd normally does; verifying and then repairing. You either could double-click the par2-file which will start MultiPar in the correct mode or you open MultiPar manually, click "Open" in the bottom left corner and select the par2-file. Now it verifies. After that is done it tells you how many parts are missing or - if you already have par2-files containing repair blocks - that repairing is possible. Either download the required par2-files or click "restore" on the bottom right. After that process is done simply unpack with winrar, 7zip or something else.

[shypike]

Please sample NZB files to [email protected]
And include the URL of this message and the Usenet providers you are using.

[JustinChase]

...get multipar.eu and open the main .par2 with that tool. It does what SABnzbd normally does; verifying and then repairing. You either could double-click the par2-file which will start MultiPar in the correct mode or you open MultiPar manually, click "Open" in the bottom left corner and select the par2-file. Now it verifies. After that is done it tells you how many parts are missing or - if you already have par2-files containing repair blocks - that repairing is possible. Either download the required par2-files or click "restore" on the bottom right. After that process is done simply unpack with winrar, 7zip or something else.

Great, I'll give it a try.

Please sample NZB files to [email protected]
And include the URL of this message and the Usenet providers you are using.

Done. I sent 5 problem nzb files in the email.

[JustinChase]

...get multipar.eu and open the main .par2 with that tool. ... Now it verifies. After that is done it tells you how many parts are missing or - if you already have par2-files containing repair blocks - that repairing is possible. Either download the required par2-files or click "restore" on the bottom right. After that process is done simply unpack with winrar, 7zip or something else.

Okay, gave it a go on the first file. it took nearly 2 hours to analyze (ouch!) and there was no "restore" button, but there was a "repair" button. I clicked it, and it seems to have started the whole process over. it's nearly 45 minutes into the process (again) and does not appear that it's actually fixing anything

It did show that I needed a dozen or so repair files, but was within the yellow band (whatever that means), so I kind of assumed it could/would just repair the file it took so long to analyze.

So far, it's not going well. Probably still faster than downloading everything again, but still, not fast at all.

[shypike]

Right, the examples are all 50G monsters which I won't download on a whim.
It is very likely that they are just incomplete. That happens a lot.
There are straight full DMCA takedowns and there are the nasty ones that just remove enough to prevent success.

[JustinChase]

no problem, I understand. with the multipar stand-alone program, I was able to get most of them fully repaired, so I'll just be happy with that.

Thanks for taking a look, and for all you do to make this a great program!

[fusen]

I'm also getting this. It's mainly on NZBs that I don't have automated and am downloading many hours after being uploaded so I'm assuming it's DMCA shananigans.

Oddly though, even though SABNZBd fails to unpack, when I click retry it will fail again but the download folder will have the video file extracted sitting next to all of the rar files.


So like this folder

H:\Downloads\TV\blahblah\Season 3\_FAILED_blahblah S03E05 720p HDTV X264-DIMENSION\ will include all of the files you'd expect to see in a _FAILED_ folder AS WELL as the actual fully extracted working complete .avi file.

So it isn't fully failing, it just seems confused.

[shypike]

with the multipar stand-alone program, I was able to get most of them fully repaired, so I'll just be happy with that.

You were able to repair the job using Multipar, without downloading anything extra?
If so, I am interested in more details.

[shypike]

Oddly though, even though SABNZBd fails to unpack, when I click retry it will fail again but the download folder will have the video file extracted sitting next to all of the rar files.
So like this folder
H:\Downloads\TV\blahblah\Season 3\_FAILED_blahblah S03E05 720p HDTV X264-DIMENSION\ will include all of the files you'd expect to see in a _FAILED_ folder AS WELL as the actual fully extracted working complete .avi file.
So it isn't fully failing, it just seems confused.

Possibly those NZBs have multiple RAR/PAR2 sets and some of those sets do verify and unpack.
SABnzbd gives up after one fails.
I would be interested in more details.

[fusen]

Oddly though, even though SABNZBd fails to unpack, when I click retry it will fail again but the download folder will have the video file extracted sitting next to all of the rar files.
So like this folder
H:\Downloads\TV\blahblah\Season 3\_FAILED_blahblah S03E05 720p HDTV X264-DIMENSION\ will include all of the files you'd expect to see in a _FAILED_ folder AS WELL as the actual fully extracted working complete .avi file.
So it isn't fully failing, it just seems confused.

Possibly those NZBs have multiple RAR/PAR2 sets and some of those sets do verify and unpack.
SABnzbd gives up after the one fails.
I would be interested in more details.

I've sent an email to the bugs address with the nzb file and the log file content for the download.

[JustinChase]

with the multipar stand-alone program, I was able to get most of them fully repaired, so I'll just be happy with that.

You were able to repair the job using Multipar, without downloading anything extra?
If so, I am interested in more details.

Yes, without downloading anything extra, I was able to repair 7-8 of the 10 or so files I'd downloaded that SABnzbd couldn't repair. There were a couple that repaired into 1 large .rar file, but most repaired the individual .rar files. in both cases, I was able to unpack them with 7zip after multipar finished.

I finished all this several days ago, so I don't remember exactly which ones, but if you have any specific questions, I'll do my best to help.

[shypike]

I finished all this several days ago, so I don't remember exactly which ones, but if you have any specific questions, I'll do my best to help.

It would be nice if I don't have to download all five of those biggies.

[JustinChase]

From my media player, here are the ones I believe repaired fine...

Independence Day
Interstellar
Seven Pounds (pretty sure this repaired into one large .rar file)
Taken 3
The Interview
Oceans 11.12.13
Fifty Shades of Grey

I've since moved to a new docker container which includes VPN tunneling, and I've not had any issues since I last posted. I also only finished downloading 1 movie since moving to a data capped ISP, but it finished fine. I'm currently waiting for repair to finish on another file, which is now 13% done. I'll report back if it doesn't finish successfully.

[ionicencode]

I've noticed that error recovery has sometimes given up on handling seemingly perfectly valid downloads. To recover manually I simply ran an external par2 program to fix the damaged archive files and then saved the newly completed media file. I have logs for two such failures. Unless I'm missing something I don't see in the log where par2 is attempted a second time after decoding the extra par2 files.

[snip]
36702 2015-07-25 11:38:17,367::DEBUG::[__init__:878] Loading data for SABnzbd_nzf_5WtexT from /SABnzbd/Incomplete/The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7/__ADMIN__/SABnzbd_nzf_5WtexT
36703 2015-07-25 11:38:17,479::DEBUG::[nzbstuff:209] Finishing import on AMS The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7 [58/59] - "The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7.vol127+128.par2" yEnc (1/166)
36705 2015-07-25 11:38:17,506::DEBUG::[__init__:878] Loading data for SABnzbd_nzf_M_9Gcd from /SABnzbd/Incomplete/The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7/__ADMIN__/SABnzbd_nzf_M_9Gcd
36715 2015-07-25 11:38:22,309::DEBUG::[__init__:844] Saving data for SABnzbd_nzo_cKZxqB in /SABnzbd/Incomplete/The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7/__ADMIN__
36717 2015-07-25 11:38:22,362::INFO::[assembler:89] Decoding /SABnzbd/Incomplete/The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7/The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7.vol000+001.par2 yenc
36726 2015-07-25 11:38:26,018::INFO::[assembler:89] Decoding /SABnzbd/Incomplete/The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7/The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7.vol001+002.par2 yenc
36732 2015-07-25 11:38:29,376::INFO::[assembler:89] Decoding /SABnzbd/Incomplete/The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7/The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7.vol003+004.par2 yenc
36744 2015-07-25 11:38:34,417::INFO::[assembler:89] Decoding /SABnzbd/Incomplete/The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7/The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7.vol007+008.par2 yenc
36767 2015-07-25 11:38:46,422::DEBUG::[__init__:844] Saving data for SABnzbd_nzo_cKZxqB in /SABnzbd/Incomplete/The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7/__ADMIN__
36769 2015-07-25 11:38:46,480::INFO::[assembler:89] Decoding /SABnzbd/Incomplete/The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7/The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7.vol015+016.par2 yenc
36816 2015-07-25 11:39:10,443::DEBUG::[__init__:844] Saving data for SABnzbd_nzo_cKZxqB in /SABnzbd/Incomplete/The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7/__ADMIN__
36818 2015-07-25 11:39:10,548::INFO::[assembler:89] Decoding /SABnzbd/Incomplete/The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7/The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7.vol031+032.par2 yenc
36884 2015-07-25 11:39:46,106::DEBUG::[__init__:844] Saving data for SABnzbd_nzo_cKZxqB in /SABnzbd/Incomplete/The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7/__ADMIN__
36886 2015-07-25 11:39:46,157::INFO::[assembler:89] Decoding /SABnzbd/Incomplete/The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7/The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7.vol255+045.par2 yenc
36979 2015-07-25 11:40:34,987::DEBUG::[__init__:844] Saving data for SABnzbd_nzo_cKZxqB in /SABnzbd/Incomplete/The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7/__ADMIN__
36981 2015-07-25 11:40:35,043::INFO::[assembler:89] Decoding /SABnzbd/Incomplete/The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7/The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7.vol063+064.par2 yenc
37169 2015-07-25 11:42:14,966::DEBUG::[__init__:844] Saving data for SABnzbd_nzo_cKZxqB in /SABnzbd/Incomplete/The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7/__ADMIN__
37171 2015-07-25 11:42:15,019::INFO::[assembler:89] Decoding /SABnzbd/Incomplete/The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7/The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7.vol127+128.par2 yenc
37174 2015-07-25 11:42:15,713::INFO::[__init__:908] /SABnzbd/Incomplete/The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7/__ADMIN__/SABnzbd_nzo_cKZxqB removed
37179 2015-07-25 11:42:15,715::INFO::[postproc:284] Starting PostProcessing on The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7 => Repair:True, Unpack:True, Delete:True, Script:PostProcess.sh, Cat:sickbeard
37180 2015-07-25 11:42:15,717::INFO::[newsunpack:150] Running external script /SABnzbd/Scripts/PostProcess.sh(/SABnzbd/Incomplete/The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7, The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7.nzb, The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7, , sickbeard, alt.binaries, 3, https://nzbsource.cr/fail/ae7bff22beb92 ... 4d4b745cc9)
37181 2015-07-25 11:42:16,279::INFO::[postproc:543] Cleaning up The.File.S01E08.1080p.WEB-DL.DD5.1.H.264-Coo7 (keep_basic=True)
[snip]

Switches:
Disable Abort jobs that cannot be completed
Disable Post-Process Only Verified Jobs

And under Special:
Enable empty_postproc