"Badly formed yEnc article" error stops download

Questions and bug reports for Beta releases should be posted here.
Forum rules
Help us help you:
  • Tell us what system you run SABnzbd on.
  • Adhere to the forum rules.
  • Do you experience problems during downloading?
    Check your connection in Status and Interface settings window.
    Use Test Server in Config > Servers.
    We will probably ask you to do a test using only basic settings.
  • Do you experience problems during repair or unpacking?
    Enable +Debug logging in the Status and Interface settings window and share the relevant parts of the log here using [ code ] sections.
ALbino
Full Member
Full Member
Posts: 214
Joined: October 23rd, 2014, 12:28 am

Re: "Badly formed yEnc article" error stops download

Post by ALbino »

Maybe it's a combination of all of that plus the specifically malformed NZBs you were trying? You could upload some sample NZBs here for sander to try if you want:

https://nzbcache.info/
User avatar
sander
Release Testers
Release Testers
Posts: 8812
Joined: January 22nd, 2008, 2:22 pm

Re: "Badly formed yEnc article" error stops download

Post by sander »

88keyz wrote:I would agree that it seems that the issue is not with SABnzbd and it's more likely related to OpenSSL, the USP or a combination of both. Could be I was the only person affected by this particular issue (system or ISP issue maybe?) in which case it'll be hard to replicate. The only thing that was weird to me was that the issue only started with 0.8.x releases and 0.7.x continued to work perfectly. That was the reason that I assumed the issue was related to SABnzbd but it seems I was wrong. I'll continue to monitor the situation and see if it repeats itself and try to provide more info if I can spot anything that seems relevant to the problem.
I tested with SAB 0.7.20 on Ubuntu 15.04, and do I get the CRC errors.

So I can NOT confirm what you're saying about 0.7.20 working OK

Code: Select all

2016-02-07 00:10:20,471::DEBUG::[decoder:101] Decoding [email protected]
2016-02-07 00:10:20,517::DEBUG::[decoder:101] Decoding [email protected]
2016-02-07 00:10:20,526::INFO::[decoder:121] CRC Error in [email protected] (1F6B390B -> A2880B87)
2016-02-07 00:10:20,530::INFO::[decoder:230] <Article: [email protected], bytes=259166, partnum=607, art_id=None> => missing from all servers, discarding
2016-02-07 00:10:20,556::DEBUG::[decoder:101] Decoding [email protected]
2016-02-07 00:10:20,598::INFO::[decoder:121] CRC Error in [email protected] (73454019 -> A641CFE9)
2016-02-07 00:10:20,599::INFO::[decoder:230] <Article: [email protected], bytes=259091, partnum=608, art_id=None> => missing from all servers, discarding
2016-02-07 00:10:20,677::DEBUG::[decoder:101] Decoding [email protected]
2016-02-07 00:10:20,816::DEBUG::[decoder:101] Decoding [email protected]
2016-02-07 00:10:20,880::DEBUG::[decoder:101] Decoding [email protected]
2016-02-07 00:10:20,888::INFO::[decoder:121] CRC Error in [email protected] (EC2D999E -> 165F83EB)
2016-02-07 00:10:20,889::INFO::[decoder:230] <Article: [email protected], bytes=259287, partnum=612, art_id=None> => missing from all servers, discarding
2016-02-07 00:10:20,967::DEBUG::[decoder:101] 

Code: Select all

sander@streamer1504:~/Downloads$ cat sabnzbd\ \(2\).log  | grep 02-07 |  grep -e "Starting sab" -e CRC | head
2016-02-07 00:07:11,677::INFO::[sabnzbdplus:1585] Starting sabnzbdplus-0.7.20
2016-02-07 00:07:50,457::INFO::[decoder:121] CRC Error in [email protected] (E5EF55CE -> 8726ABD6)
2016-02-07 00:07:51,478::INFO::[decoder:121] CRC Error in [email protected] (7B363549 -> E774B9F7)
2016-02-07 00:07:51,549::INFO::[decoder:121] CRC Error in [email protected] (E59B5C27 -> 2D56B55E)
2016-02-07 00:09:18,258::INFO::[decoder:121] CRC Error in [email protected] (86B45542 -> 5CA7D53C)
2016-02-07 00:09:18,627::INFO::[decoder:121] CRC Error in [email protected] (0B5230BA -> E46BA117)
2016-02-07 00:09:18,853::INFO::[decoder:121] CRC Error in [email protected] (14BC84ED -> A3B39926)
2016-02-07 00:09:19,016::INFO::[decoder:121] CRC Error in [email protected] (08B08BB8 -> 32FDB6ED)
2016-02-07 00:09:19,091::INFO::[decoder:121] CRC Error in [email protected] (D4DFA6AD -> 0BE4D41A)
2016-02-07 00:09:19,222::INFO::[decoder:121] CRC Error in [email protected] (9E822642 -> E0F7435B)
User avatar
sander
Release Testers
Release Testers
Posts: 8812
Joined: January 22nd, 2008, 2:22 pm

Re: "Badly formed yEnc article" error stops download

Post by sander »

@88keyz

Can you post your SAB logging lines with "CRC Error in" (assuming you have them)?

It could confirm my "$-sign" hypothesis.
User avatar
sander
Release Testers
Release Testers
Posts: 8812
Joined: January 22nd, 2008, 2:22 pm

Re: "Badly formed yEnc article" error stops download

Post by sander »

@shypike:

Is there a way to see a copy of each article retrieved? Is that the stuff in __ADMIN__ ? If so: are those the articles before or after decoding?

If so, we can inspect the articles (see if they are malformed) and compare them the same article retrieved from another newsserver.

Code: Select all

sander@streamer1504:~/git/sabnzbd/Downloads/incomplete/bucks/__ADMIN__$ ll
total 7596
drwxrwxr-x 2 sander sander   4096 feb  7 07:44 ./
drwxrwxr-x 3 sander sander   4096 feb  7 07:39 ../
-rw-rw-r-- 1 sander sander  14160 feb  7 07:38 bucks.nzb.gz
-rw------- 1 sander sander 249600 feb  7 07:43 SABnzbd_article__4Ub_p
-rw------- 1 sander sander 249600 feb  7 07:40 SABnzbd_article_5tgfjQ
-rw------- 1 sander sander 249600 feb  7 07:43 SABnzbd_article_6b7E2R
-rw------- 1 sander sander 249600 feb  7 07:40 SABnzbd_article_8f5BiK
-rw------- 1 sander sander 249600 feb  7 07:43 SABnzbd_article_8J2A92
-rw------- 1 sander sander 249600 feb  7 07:43 SABnzbd_article_D811UQ
-rw------- 1 sander sander 249599 feb  7 07:39 SABnzbd_article_dMHiUm
-rw------- 1 sander sander 249600 feb  7 07:39 SABnzbd_article_dTCTyW
-rw------- 1 sander sander 249599 feb  7 07:39 SABnzbd_article_iZuUlr
-rw------- 1 sander sander 249600 feb  7 07:40 SABnzbd_article_JJBjQB
-rw------- 1 sander sander 249600 feb  7 07:39 SABnzbd_article_jJoQOE
-rw------- 1 sander sander 249600 feb  7 07:40 SABnzbd_article_kd74YP
-rw------- 1 sander sander 249600 feb  7 07:39 SABnzbd_article_kHUdmQ
-rw------- 1 sander sander 249600 feb  7 07:39 SABnzbd_article_LJsxq4
-rw------- 1 sander sander 249600 feb  7 07:40 SABnzbd_article_Mdt2Lp
-rw------- 1 sander sander 249600 feb  7 07:40 SABnzbd_article_N7kDmk
-rw------- 1 sander sander 249600 feb  7 07:43 SABnzbd_article_nmulyz
-rw------- 1 sander sander 249600 feb  7 07:40 SABnzbd_article_p0nZWV
-rw------- 1 sander sander 249600 feb  7 07:44 SABnzbd_article_pJzBNm
-rw------- 1 sander sander 249600 feb  7 07:39 SABnzbd_article_QBm3Nt
-rw------- 1 sander sander 249600 feb  7 07:39 SABnzbd_article_Qmuw51
-rw------- 1 sander sander 249600 feb  7 07:39 SABnzbd_article_ra4d34
-rw------- 1 sander sander 249600 feb  7 07:44 SABnzbd_article_rOwtg0
-rw------- 1 sander sander 249600 feb  7 07:44 SABnzbd_article_T7BO8d
-rw------- 1 sander sander 249599 feb  7 07:39 SABnzbd_article_Txjcxh
-rw------- 1 sander sander 249600 feb  7 07:39 SABnzbd_article__uvwuX
-rw------- 1 sander sander 249600 feb  7 07:39 SABnzbd_article_w5EoUI
-rw------- 1 sander sander 249600 feb  7 07:40 SABnzbd_article_wN5Qhs
-rw------- 1 sander sander 249600 feb  7 07:43 SABnzbd_article_x1qoUw
-rw------- 1 sander sander 249600 feb  7 07:43 SABnzbd_article_yUV30i
-rw-rw-r-- 1 sander sander     27 feb  7 07:44 SABnzbd_attrib
-rw------- 1 sander sander  57989 feb  7 07:38 SABnzbd_nzf_GGXMc0
-rw------- 1 sander sander  28999 feb  7 07:38 SABnzbd_nzf_WExuf_
-rw------- 1 sander sander 156620 feb  7 07:44 SABnzbd_nzo_NDEyYk
User avatar
sander
Release Testers
Release Testers
Posts: 8812
Joined: January 22nd, 2008, 2:22 pm

Re: "Badly formed yEnc article" error stops download

Post by sander »

If useful in the future: I've enhanced decoder.py with writing the full article to disk.

However, a download from xsnews and eweka give exact the same CRC's, and the downloaded articles are the same.

No I would say it is not server dependent.

Code: Select all

sander@streamer1504:/tmp/sab-dump$ md5sum xsnews/'[email protected]'
34f014eda24d32170755257637c44e66  xsnews/[email protected]
sander@streamer1504:/tmp/sab-dump$ md5sum eweka/'[email protected]'
34f014eda24d32170755257637c44e66  eweka/[email protected]

Code: Select all

if lines:
                logme = None
                try:
                    if nzo.precheck:
                        raise BadYenc
                    register = True
                    logging.debug("Decoding %s", art_id)

                    logging.debug("SJ: article is %s", article)
                    #logging.debug("SJ: lines is %s", lines)
                    filenamearticle = "/tmp/sab-dump/" + art_id
                    logging.debug("SJ: filenamearticle is %s", filenamearticle)
		    text_file = open(filenamearticle, "w")
                    for item in lines[1:-1]:
		        text_file.write(item)
		    text_file.close()

                    data = decode(article, lines)
                    #logging.debug("SJ: after decode(), data is %s", data)
                    nzf.article_count += 1
                    found = True
                except IOError, e:
Post Reply