Another Corrupt RAR file issue

Get help with all aspects of SABnzbd
Forum rules
Help us help you:
  • Are you using the latest stable version of SABnzbd? Downloads page.
  • Tell us what system you run SABnzbd on.
  • Adhere to the forum rules.
  • Do you experience problems during downloading?
    Check your connection in Status and Interface settings window.
    Use Test Server in Config > Servers.
    We will probably ask you to do a test using only basic settings.
  • Do you experience problems during repair or unpacking?
    Enable +Debug logging in the Status and Interface settings window and share the relevant parts of the log here using [ code ] sections.
Post Reply
055sierra055
Newbie
Newbie
Posts: 8
Joined: September 26th, 2023, 5:42 am

Another Corrupt RAR file issue

Post by 055sierra055 »

Hi everyone, I've read through a number of similar topics but can't see a correlation with what my particular setup is.
I'm running SABnzbd 4.0.3 on a QNAP NAS and am having issues with many of my downloads failing due to corruption. I have "download all PAR2 files" enabled as well as "post process only verified jobs", though I have attempted turning that option off. The quick check completes fine, but then the file fails during unpacking. What I'm unsure of is why isn't quickpar running a repair? From what I gather, SABnzbd deletes the par2 files if quick check fails, but shouldn't it still be able to grab them again and run a repair during extraction if required?

I attempted to post the debug log in code switches, but the forum gives me an error saying I can't post links - despite not being able to find any link in the logs!

I'll try to break the logs down into the specific parts I THINK are relevant. Thanks for any assistance and advice.
Last edited by 055sierra055 on September 26th, 2023, 6:32 am, edited 1 time in total.
055sierra055
Newbie
Newbie
Posts: 8
Joined: September 26th, 2023, 5:42 am

Re: Another Corrupt RAR file issue

Post by 055sierra055 »

Main sections of the log that I think are relevant are

Code: Select all

2023-09-26 20:29:40,083::INFO::[newsunpack:1116] Quick-check for Download.Fileis OK, skipping repair
2023-09-26 20:29:40,083::DEBUG::[filesystem:913] [sabnzbd.newsunpack.par2_repair] Deleting file /share/Public/Usenet/SAB Download/Download.File.1/Download.File.vol-02.par2
2023-09-26 20:29:40,083::DEBUG::[filesystem:913] [sabnzbd.newsunpack.par2_repair] Deleting file /share/Public/Usenet/SAB Download/Download.File.1/Download.File.vol-03.par2
2023-09-26 20:29:40,084::DEBUG::[filesystem:913] [sabnzbd.newsunpack.par2_repair] Deleting file /share/Public/Usenet/SAB Download/Download.File.1/Download.File.vol-04.par2
2023-09-26 20:29:40,084::DEBUG::[filesystem:913] [sabnzbd.newsunpack.par2_repair] Deleting file /share/Public/Usenet/SAB Download/Download.File.1/Download.File.vol-05.par2
2023-09-26 20:29:40,084::DEBUG::[filesystem:913] [sabnzbd.newsunpack.par2_repair] Deleting file /share/Public/Usenet/SAB Download/Download.File.1/Download.File.vol-06.par2
2023-09-26 20:29:40,084::DEBUG::[filesystem:913] [sabnzbd.newsunpack.par2_repair] Deleting file /share/Public/Usenet/SAB Download/Download.File.1/Download.File.vol-07.par2
2023-09-26 20:29:40,084::DEBUG::[filesystem:913] [sabnzbd.newsunpack.par2_repair] Deleting file /share/Public/Usenet/SAB Download/Download.File.1/Download.File.vol-08.par2
2023-09-26 20:29:40,084::DEBUG::[filesystem:913] [sabnzbd.newsunpack.par2_repair] Deleting file /share/Public/Usenet/SAB Download/Download.File.1/Download.File.vol-09.par2
2023-09-26 20:29:40,085::DEBUG::[filesystem:913] [sabnzbd.newsunpack.par2_repair] Deleting file /share/Public/Usenet/SAB Download/Download.File.1/Download.File.vol-010.par2
2023-09-26 20:29:40,085::DEBUG::[filesystem:913] [sabnzbd.newsunpack.par2_repair] Deleting file /share/Public/Usenet/SAB Download/Download.File.1/Download.File.vol-011.par2
2023-09-26 20:29:40,085::DEBUG::[filesystem:913] [sabnzbd.newsunpack.par2_repair] Deleting file /share/Public/Usenet/SAB Download/Download.File.1/Download.File.vol-01.par2

Code: Select all

2023-09-26 20:29:41,573::INFO::[newsunpack:559] Extracting rarfile /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part01.rar (belonging to <HASH>bc1418a) to /share/Video/_UNPACK_Download.File
2023-09-26 20:29:41,573::DEBUG::[newsunpack:654] rar_extract(): Extractionpath: /share/Video/_UNPACK_Download.File
2023-09-26 20:29:41,573::DEBUG::[newsunpack:721] Analyzing rar file ... RAR5 found
2023-09-26 20:29:41,573::INFO::[misc:1175] [sabnzbd.newsunpack.rar_extract_core] Running external command: ['/opt/bin/unrar', 'x', '-idp', '-scf', '-o-', '-or', '-ai', '-p-', '/share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part01.rar', '/share/Video/_UNPACK_Download.File/']
2023-09-26 20:29:41,574::DEBUG::[misc:1176] Popen arguments: {'stdout': -1, 'stderr': -2, 'bufsize': 0, 'startupinfo': None, 'creationflags': 0, 'text': True, 'encoding': 'utf8', 'errors': 'replace'}
2023-09-26 20:30:22,777::DEBUG::[newsunpack:844] UNRAR output 
UNRAR 6.10 beta 3 freeware      Copyright (c) 1993-2021 Alexander Roshal


Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part01.rar

Extracting  /share/Video/_UNPACK_Download.File/<HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part02.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part03.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part04.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part05.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part06.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part07.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part08.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part09.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part10.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part11.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part12.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part13.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part14.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part15.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part16.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part17.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part18.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part19.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part20.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part21.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part22.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part23.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part24.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part25.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part26.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part27.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part28.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part29.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part30.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part31.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part32.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part33.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part34.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part35.rar

...         <HASH>bc1418a.mkv

Extracting from /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part36.rar

...         <HASH>bc1418a.mkv
<HASH>bc1418a.mkv : packed data checksum error in volume /share/Public/Usenet/SAB Download/Download.File.1/<HASH>bc1418a.part36.rar
2023-09-26 20:30:22,777::INFO::[newsunpack:297] Unrar finished on /share/Public/Usenet/SAB Download/Download.File.1
2023-09-26 20:30:22,777::INFO::[postproc:437] Unpacked files []
2023-09-26 20:30:22,778::INFO::[filesystem:330] Checking if any resulting filenames need to be sanitized
2023-09-26 20:30:22,778::INFO::[postproc:441] Finished unpack_magic on Download.File
2023-09-26 20:30:22,778::DEBUG::[filesystem:615] Applying permissions 0o777 (octal) to /share/Video/_UNPACK_Download.File
2023-09-26 20:30:22,778::DEBUG::[filesystem:615] Applying permissions 0o666 (octal) to /share/Video/_UNPACK_Download.File/<HASH>bc1418a.mkv
2023-09-26 20:30:22,778::DEBUG::[filesystem:877] Renaming "/share/Video/_UNPACK_Download.File" to "/share/Video/_FAILED_Download.File"

User avatar
safihre
Administrator
Administrator
Posts: 5196
Joined: April 30th, 2015, 7:35 am
Contact:

Re: Another Corrupt RAR file issue

Post by safihre »

The QuickCheck verifies that what was in memory before writing to disk is correct, it doesn't verify anymore what is actually written to disk because this should be the same as what was in memory.
So, most likely the problem is related to either corrupt memory or corrupt disk.
Or, the uploader uploaded a corrupt rarfile which was already bad before creating the par2 files.
This you can check by downloading the same job on a different device.
Actually, also hardware problems could be checked by verifying the same job downloads fine on a different device.
If you like our support, check our special newsserver deal or donate at: https://sabnzbd.org/donate
055sierra055
Newbie
Newbie
Posts: 8
Joined: September 26th, 2023, 5:42 am

Re: Another Corrupt RAR file issue

Post by 055sierra055 »

Thanks for the advice. I'd have thought corrupt memory would be an issue if the quick check was failing?

I have attempted downloading the each of test files which all complete fine, though downloading the same file from usenet on a local non SAB client succeeds, but redownloading again using the exact same .nzb file on SAB fails again, though on a different file (part 20 rather than 36).
User avatar
safihre
Administrator
Administrator
Posts: 5196
Joined: April 30th, 2015, 7:35 am
Contact:

Re: Another Corrupt RAR file issue

Post by safihre »

When you re-download and it fails, is that on the local or on the Unraid?
If you like our support, check our special newsserver deal or donate at: https://sabnzbd.org/donate
055sierra055
Newbie
Newbie
Posts: 8
Joined: September 26th, 2023, 5:42 am

Re: Another Corrupt RAR file issue

Post by 055sierra055 »

On the QNAP NAS. Downloaded successfully on Mac using NZBin.
Downloading the 100MB, 1GB and 10GB test files all succeed on the QNAP NAS.
User avatar
safihre
Administrator
Administrator
Posts: 5196
Joined: April 30th, 2015, 7:35 am
Contact:

Re: Another Corrupt RAR file issue

Post by safihre »

If the failures only happen on the QNAP (right?) then it makes the case stronger that there is a hardware problem.
Can you do some disk check or memory check?
If you like our support, check our special newsserver deal or donate at: https://sabnzbd.org/donate
User avatar
sander
Release Testers
Release Testers
Posts: 8674
Joined: January 22nd, 2008, 2:22 pm

Re: Another Corrupt RAR file issue

Post by sander »

055sierra055 wrote: September 27th, 2023, 4:14 am On the QNAP NAS. Downloaded successfully on Mac using NZBin.
Downloading the 100MB, 1GB and 10GB test files all succeed on the QNAP NAS.
And what if you download the same post with SAB on Mac?

That will make clear if it's a SAB problem, or a QNAP/HW problem.
055sierra055
Newbie
Newbie
Posts: 8
Joined: September 26th, 2023, 5:42 am

Re: Another Corrupt RAR file issue

Post by 055sierra055 »

Thanks guys, yes that's precisely what I did, downloaded the same post on the Mac which downloaded successfully.
I ran a disk and memory check on the QNAP and no issues were reported. Mind you, since then, I also haven't had any failures either. Will continue to test and will report back. I've also setup another download client on the NAS so I can test two clients on the same hardware. If it is hardware related, then I should see similar issues between the two clients.
055sierra055
Newbie
Newbie
Posts: 8
Joined: September 26th, 2023, 5:42 am

Re: Another Corrupt RAR file issue

Post by 055sierra055 »

So tested using SABnzbd and NZBGet on the same NAS downloading the same post. Download failed with corrupt RAR file on SAB but completed successfully in NZBGet.
User avatar
safihre
Administrator
Administrator
Posts: 5196
Joined: April 30th, 2015, 7:35 am
Contact:

Re: Another Corrupt RAR file issue

Post by safihre »

Can you download the file again on SABnzbd and send me the whole uncensored logs at [email protected]?
If you like our support, check our special newsserver deal or donate at: https://sabnzbd.org/donate
055sierra055
Newbie
Newbie
Posts: 8
Joined: September 26th, 2023, 5:42 am

Re: Another Corrupt RAR file issue

Post by 055sierra055 »

Sure thing, downloading now and will email shortly.
Thanks a lot for your help with this, really appreciate it
User avatar
sander
Release Testers
Release Testers
Posts: 8674
Joined: January 22nd, 2008, 2:22 pm

Re: Another Corrupt RAR file issue

Post by sander »

I wonder: with SAB on your QNAP, if you do the same download a few times: can you check the md5sum's of the rar's? Are the same, or do they change per download? And how do they compare to the succesfull download with SAB on your Mac?
but completed successfully in NZBGet
If you repeat it: each time it's OK? Or just a lucky shot?
055sierra055
Newbie
Newbie
Posts: 8
Joined: September 26th, 2023, 5:42 am

Re: Another Corrupt RAR file issue

Post by 055sierra055 »

I'm three from three on the same post so far with NZBget.
Safihre has taken a look at the logs and doesn't see anything wrong there. They also did a great job of explaining how the download and verification process works, so I can see logically why hardware issues would result in the corruption issues I'm seeing, but memtest and e2fsck come back fine.
I'm going to swap out some RAM just for interest sake too.
Post Reply