Corrupt RAR file on almost all files

[jcole]

Resolved: Finally figured it out. I removed the "overclock" on the memory and everything started working without error. Even though it passed memory checks etc, I downclocked it from 3600mhz to whatever default DDR4 speeds are. 2100mhz ? I removed the XMP/DOCP profile in the bios, and havent had an issue since.
For running dockers and plex transcode etc, I don't think I'll see a noticeable speed difference in any of my tasks. Even sabnzbd doesn't use much of the cores for an unrar.



Hello, forgive me if my help request is slightly unclear, I'm new to newsgroups as a file service.

I'm running sabnzbd in a container within unraid. It seems like almost all downloads fail with a "Corrupt Rar" error.
To double check I run 7zip from windows and check the downloaded file in the incomplete folder on the unraid NAS and get a "failed crc check" error.
The test download function seems fine within sabnzbd, it's just the unrar portion I think. I'm getting the files from the Eweka newsgroup server and nzbplanet for the nzb files. Is it possible the nzb files i download are bad ?
I have waited a couple weeks and then grabbed a different version of the nzb and had it come through successfully just last night.
I have settings all as default at the moment other than the usenet server settings.

I've located what I suspect is the error messages within the debug logs.

Code: Select all

A4C6daqa6h934aTBSzfObdWANGpYzx.mkv : packed data checksum error in volume /mnt/incomplete/****************************/uNPfrcw7Ym77BJaTAeqEt2jtArPSQZcnTc3Uh.part030.rar
2023-09-11 20:30:50,567::INFO::[newsunpack:297] Unrar finished on /mnt/incomplete/*******************************
2023-09-11 20:30:50,567::INFO::[postproc:437] Unpacked files []
2023-09-11 20:30:50,567::INFO::[filesystem:330] Checking if any resulting filenames need to be sanitized
2023-09-11 20:30:50,568::INFO::[postproc:441] Finished unpack_magic on ****************************
2023-09-11 20:30:50,569::DEBUG::[filesystem:615] Applying permissions 0o777 (octal) to /mnt/downloads/complete/_UNPACK_*****************
2023-09-11 20:30:50,839::DEBUG::[filesystem:615] Applying permissions 0o666 (octal) to /mnt/downloads/complete/_UNPACK_**************************/A4C6daqa6h934aTBSzfObdWANGpYzx.mkv
2023-09-11 20:30:50,841::DEBUG::[filesystem:877] Renaming "/mnt/downloads/complete/_UNPACK_**************************" to "/mnt/downloads/complete/_FAILED_***************************"
2023-09-11 20:30:50,842::DEBUG::[filesystem:920] [sabnzbd.postproc.rename_and_collapse_folder] Removing dir /mnt/downloads/complete/_UNPACK_*************************
2023-09-11 20:30:50,843::INFO::[nzbstuff:1836] [sabnzbd.postproc.process_job] Purging data for job ***************************** (delete_all_data=False)
2023-09-11 20:30:50,843::DEBUG::[articlecache:152] Purging 0 articles from the cache/disk
2023-09-11 20:30:50,846::INFO::[notifier:123] Sending notification: Download Failed - *************************** (type=failed, job_cat=*)
2023-09-11 20:30:50,861::DEBUG::[sorting:642] Initial guess for ************************** is MatchesDict([('title', *******'), ('season', 2), ('episode', 7), ('episode_title', '*******'), ('screen_size', '2160p'), ('streaming_service', 'AppleTV'), ('source', 'Web'), ('audio_codec', 'Dolby Digital Plus'), ('audio_channels', '5.1'), ('other', 'HDR10'), ('video_codec', 'H.265'), ('video_profile', 'High Efficiency Video Coding'), ('release_group', '*******'), ('type', 'episode')])
2023-09-11 20:30:50,861::DEBUG::[sorting:137] Matched sorter newsunpack__analyse_show to job ****************** (forced: True, custom: True)
2023-09-11 20:30:50,867::DEBUG::[assembler:79] Decoding part of /mnt/incomplete/***********************/UUDhEw24kMAfXTCWSX0iyTTGg8Z8rCApeuU.part047.rar
2023-09-11 20:30:50,867::INFO::[database:292] Added job ******************************** to history
2023-09-11 20:30:50,868::INFO::[postproc:130] Saving postproc queue
2023-09-11 20:30:50,869::DEBUG::[filesystem:1187] [sabnzbd.postproc.save] Saving data for postproc2.sab
2023-09-11 20:30:50,870::DEBUG::[filesystem:1119] [sabnzbd.filesystem.save_admin] Saving data for postproc2.sab in /sabnzbd/admin
2023-09-11 20:30:50,871::INFO::[downloader:457] Post-processing finished, resuming download
2023-09-11 20:30:51,753::INFO::[nzbstuff:1773] Detected filename based on par2: 87d3119f169545224c7063f1666dc156.29 -> UUDhEw24kMAfXTCWSX0iyTTGg8Z8rCApeuU.part031.rar

[sander]

In SABnzbd's upper right corner, click on the wrench symbol ("Status and interface options"), then click on first tab Status, click Test download 1GB. After downloading, in history, at the download in the drop down, what is the result ... corrupt rar or not?

[jcole]

Thanks for the quick reply. The 1GB test file seems to come through fine with "Completed" in history.

I tried 4 different tv episode files just an hour ago and all 4 failed. I'm kinda stumped. I'm considering setting up sabnzbd on a windows machine and see if the same files work or not.

[sander]

Yes, please do so.

Also: Make you have the most recent SAbnzbd docker image. Reason: I vaguely remember that a few months ago there was a SABnzbd image that had some mismatches inside, causing problems.

[safihre]

In Config Switches, do you have Post process only verified jobs turned ON?

[jcole]

In Config Switches, do you have Post process only verified jobs turned ON?

Currently yes which is the default setting in this build.

[jcole]

Yes, please do so.

Also: Make you have the most recent SAbnzbd docker image. Reason: I vaguely remember that a few months ago there was a SABnzbd image that had some mismatches inside, causing problems.

I'm using the ich777 version of the docker, which shows a latest update of June 24 2023 and its version 4.0.3.

[sander]

I'm considering setting up sabnzbd on a windows machine and see if the same files work or not.

Any progress on that?

[jcole]

I'm considering setting up sabnzbd on a windows machine and see if the same files work or not.

Any progress on that?

Hello,

Was delayed a bit but I set it up on a windows 11 machine, I used the NZB files from the incomplete/admin/ folder on the unraid NAS. All 4 files that failed through the unraid docker worked fine on windows.

I wonder if there is a hardware or ram issue, or perhaps that version of the docker is having issues. There looks to be 4 or 5 different sabnzbd dockers available through the unraid docker store.

[sander]

Aha. So bound to the Unraid machine. We see so many problems here with Unraid running SABnzbd, I think I'm going to introduce #UnraidAlert ... :-(

On your Unraid (or any SAB), the reference download test is:

In SABnzbd's upper right corner, click on the wrench symbol ("Status and interface options"), then click on first tab Status, click Test download 1GB. After downloading, what is the result?

If that also fails on your Unraid, you know 100% sure your Unraid setup is the problem. It might be with the docker image, but also with the disk setup on Unraid.

[jcole]

Aha. So bound to the Unraid machine. We see so many problems here with Unraid running SABnzbd, I think I'm going to introduce #UnraidAlert ... :-(

On your Unraid (or any SAB), the reference download test is:

In SABnzbd's upper right corner, click on the wrench symbol ("Status and interface options"), then click on first tab Status, click Test download 1GB. After downloading, what is the result?

If that also fails on your Unraid, you know 100% sure your Unraid setup is the problem. It might be with the docker image, but also with the disk setup on Unraid.

Yup earlier per your suggestion I tried the 1gb test and it comes through perfectly fine. Never had an issue with the test files. Just the nzb files out in the wild. I'll check the unraid forum and see if there are any suggestions and report back if I can find anything out.

[jcole]

Hello,

Following up on this. I've been using sabnzbd fine from windows for awhile now, and decided to try getting it working on my unraid box again. Since last time I was only using the 100MB and 1GB test files. I've upgraded to Gigabit internet and so 10GB test files are trivial now. Before, it would work fine with the smaller test files, however now with the ability to test 10GB I'm getting a currupt rar file error. Not always, but 3 out of 5 tests failed. I have included the relevant debug code below.

Any ideas with this new info ?

Code: Select all

2023-11-19 11:29:30,341::DEBUG::[newsunpack:843] UNRAR output 
UNRAR 6.23 freeware      Copyright (c) 1993-2023 Alexander Roshal


Extracting from /incomplete-downloads/test_download_10GB/sometestfile-10GB.part01.rar

Extracting  /downloads/_UNPACK_test_download_10GB/10GB-explanation.txt  OK
Extracting  /downloads/_UNPACK_test_download_10GB/10GB.bin

Extracting from /incomplete-downloads/test_download_10GB/sometestfile-10GB.part02.rar

...         10GB.bin

Extracting from /incomplete-downloads/test_download_10GB/sometestfile-10GB.part03.rar

...         10GB.bin

Extracting from /incomplete-downloads/test_download_10GB/sometestfile-10GB.part04.rar

...         10GB.bin
10GB.bin             : packed data checksum error in volume /incomplete-downloads/test_download_10GB/sometestfile-10GB.part04.rar
2023-11-19 11:29:30,341::INFO::[newsunpack:310] Unrar finished on /incomplete-downloads/test_download_10GB
2023-11-19 11:29:30,342::INFO::[postproc:437] Unpacked files []
2023-11-19 11:29:30,342::INFO::[filesystem:330] Checking if any resulting filenames need to be sanitized
2023-11-19 11:29:30,343::INFO::[postproc:441] Finished unpack_magic on test_download_10GB
2023-11-19 11:29:30,509::DEBUG::[interface:144] Request GET /api from ::ffff:192.168.4.40 [Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:109.0) Gecko/20100101 Firefox/119.0] {'mode': 'queue', 'start': '0', 'limit': '20', 'output': 'json', 'apikey': '86fcfa617ad64bffb96ddbd4f8de42cc', '_': '1700417521102'}
2023-11-19 11:29:30,510::DEBUG::[interface:144] Request GET /api from ::ffff:192.168.4.40 [Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:109.0) Gecko/20100101 Firefox/119.0] {'mode': 'history', 'failed_only': '0', 'start': '0', 'limit': '10', 'last_history_update': '9', 'output': 'json', 'apikey': '86fcfa617ad64bffb96ddbd4f8de42cc', '_': '1700417521103'}
2023-11-19 11:29:30,634::DEBUG::[filesystem:876] Renaming "/downloads/_UNPACK_test_download_10GB" to "/downloads/_FAILED_test_download_10GB"
2023-11-19 11:29:30,635::DEBUG::[filesystem:919] [sabnzbd.postproc.rename_and_collapse_folder] Removing dir /downloads/_UNPACK_test_download_10GB
2023-11-19 11:29:30,635::INFO::[nzbstuff:1833] [sabnzbd.postproc.process_job] Purging data for job test_download_10GB (delete_all_data=False)
2023-11-19 11:29:30,636::DEBUG::[articlecache:152] Purging 0 articles from the cache/disk
2023-11-19 11:29:30,637::INFO::[notifier:123] Sending notification: Download Failed - test_download_10GB (type=failed, job_cat=*)
2023-11-19 11:29:30,703::DEBUG::[sorting:640] Initial guess for test_download_10GB is MatchesDict([('title', 'test download'), ('size', <Size [10GB]>), ('type', 'movie')])
2023-11-19 11:29:30,703::DEBUG::[sorting:137] Matched sorter newsunpack__analyse_show to job test_download_10GB (forced: True, custom: True)
2023-11-19 11:29:30,838::INFO::[database:292] Added job test_download_10GB to history
2023-11-19 11:29:30,839::INFO::[postproc:130] Saving postproc queue
2023-11-19 11:29:30,840::DEBUG::[filesystem:1186] [sabnzbd.postproc.save] Saving data for postproc2.sab
2023-11-19 11:29:30,841::DEBUG::[filesystem:1118] [sabnzbd.filesystem.save_admin] Saving data for postproc2.sab in /config/admin
2023-11-19 11:29:30,842::INFO::[downloader:448] Post-processing finished, resuming download
2023-11-19 11:29:31,531::DEBUG::[interface:144] Request GET /api from ::ffff:192.168.4.40 [Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:109.0) Gecko/20100101 Firefox/119.0] {'mode': 'history', 'failed_only': '0', 'start': '0', 'limit': '10', 'last_history_update': '10', 'output': 'json', 'apikey': '86fcfa617ad64bffb96ddbd4f8de42cc', '_': '1700417521105'}
2023-11-19 11:29:31,532::DEBUG::[interface:144] Request GET /api from ::ffff:192.168.4.40 [Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:109.0) Gecko/20100101 Firefox/119.0] {'mode': 'queue', 'start': '0', 'limit': '20', 'output': 'json', 'apikey': '86fcfa617ad64bffb96ddbd4f8de42cc', '_': '1700417521104'}
2023-11-19 11:29:32,543::DEBUG::[interface:144] Request GET /api from ::ffff:192.168.4.40 [Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:109.0) Gecko/20100101 Firefox/119.0] {'mode': 'queue', 'start': '0', 'limit': '20', 'output': 'json', 'apikey': '86fcfa617ad64bffb96ddbd4f8de42cc', '_': '1700417521106'}
2023-11-19 11:29:32,543::DEBUG::[interface:144] Request GET /api from ::ffff:192.168.4.40 [Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:109.0) Gecko/20100101 Firefox/119.0] {'mode': 'history', 'failed_only': '0', 'start': '0', 'limit': '10', 'last_history_update': '12', 'output': 'json', 'apikey': '86fcfa617ad64bffb96ddbd4f8de42cc', '_': '1700417521107'}
2023-11-19 11:29:33,564::DEBUG::[interface:144] Request GET /api from ::ffff:192.168.4.40 [Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:109.0) Gecko/20100101 Firefox/119.0] {'mode': 'history', 'failed_only': '0', 'start': '0', 'limit': '10', 'last_history_update': '12', 'output': 'json', 'apikey': '86fcfa617ad64bffb96ddbd4f8de42cc', '_': '1700417521109'}
2023-11-19 11:29:33,565::DEBUG::[interface:144] Request GET /api from ::ffff:192.168.4.40 [Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:109.0) Gecko/20100101 Firefox/119.0] {'mode': 'queue', 'start': '0', 'limit': '20', 'output': 'json', 'apikey': '86fcfa617ad64bffb96ddbd4f8de42cc', '_': '1700417521108'}
2023-11-19 11:29:34,585::DEBUG::[interface:144] Request GET /api from ::ffff:192.168.4.40 [Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:109.0) Gecko/20100101 Firefox/119.0] {'mode': 'history', 'failed_only': '0', 'start': '0', 'limit': '10', 'last_history_update': '12', 'output': 'json', 'apikey': '86fcfa617ad64bffb96ddbd4f8de42cc', '_': '1700417521111'}
2023-11-19 11:29:34,585::DEBUG::[interface:144] Request GET /api from ::ffff:192.168.4.40 [Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:109.0) Gecko/20100101 Firefox/119.0] {'mode': 'queue', 'start': '0', 'limit': '20', 'output': 'json', 'apikey': '86fcfa617ad64bffb96ddbd4f8de42cc', '_': '1700417521110'}
2023-11-19 11:29:34,843::DEBUG::[articlecache:140] Saving 0 cached articles to disk

[sander]

Code: Select all

packed data checksum error in volume /incomplete-downloads/test_download_10GB/sometestfile-10GB.part04.rar

Intermittent problems, so probably hardware malfunction on your Unraid setup: bad RAM, bad disk.

[jcole]

Resolved: I forgot about the mismatched ram. I removed 32GB and left 2 sticks of 64gb and haven't had a failure since. Thanks for the reminder and I believe this solved the issue. I'll test it for a few days and if it seems stable I'll send a donation over.

[sander]

Good. To be sure: https://kb.synology.com/en-us/DSM/tutor ... e%20memory