Page 4 of 5

Re: downloads sit in queue at 99% (fixed... ?)

Posted: May 14th, 2016, 2:58 pm
by shypike
Getting to know more about why the job hangs.
Like I said, we cannot reproduce the problem,
so each little bit of information about it is welcome.

Re: downloads sit in queue at 99% (fixed... ?)

Posted: May 15th, 2016, 12:28 am
by blackkatt
shypike wrote:Getting to know more about why the job hangs.
Like I said, we cannot reproduce the problem,
so each little bit of information about it is welcome.
Yes I get that obviously. But seeing the file list. As seen in the screenshot i shared it said 100%. But your still saying this is the 99% problem correct?, just want to be sure.

Re: downloads sit in queue at 99% (fixed... ?)

Posted: May 15th, 2016, 6:44 am
by shypike
Interesting.
It could be that all is rounded to 100% of course, but I cannot be certain of that.
My guess is that there is at least one article pending.
Unfortunately, SABnzbd doesn't show that very well.
When hanging, what does the status menu show (the wrench symbol at the top right, tab Connections)?

Re: downloads sit in queue at 99% (fixed... ?)

Posted: May 16th, 2016, 11:25 am
by blackkatt
shypike wrote:Interesting.
My guess is that there is at least one article pending.
When hanging, what does the status menu show (the wrench symbol at the top right, tab Connections)?
But if it where missing something, that would be downloaded on restart? and that just aint happening :P its all done. Just needs a slap on the butt >:D
I've set to disconnect from the server as soon as it done. Quite sure it does that, But! I will check again next time.

Re: downloads sit in queue at 99% (fixed... ?)

Posted: May 17th, 2016, 1:38 am
by blackkatt
I think you where right. This is how it looks. First of all, I'm still connected to the server as you thought.
Seems to happen when sab switches to "force" So what I did was change to "stop" and it began repair, Did NOT download any. Just did the repair and finished.

Image

Re: downloads sit in queue at 99% (fixed... ?)

Posted: May 18th, 2016, 3:24 am
by shypike
OK, thanks for the confirmation.
We are still looking for this bug, but it seems it only happens
in some specific setups/systems/NZB whatever combination.
What we do know is that servers that timeout when they don't have an article
can halt completion for quite some time.
Suppose 15 articles are missing and you have a timeout of 60 seconds,
you'll get a delay of 3x15x60 sec equaling 45 minutes.
But if a restart of SABnzbd will complete the download quickly
then that isn't the cause and it's simply a bug in SABnzbd.
Like I said, we will solve it as soon as we can reproduce it and find the actual cause.

Re: downloads sit in queue at 99% (fixed... ?)

Posted: May 18th, 2016, 2:02 pm
by ALbino
Maybe just Force Disconnect after a certain time period to reset it? That's what I do manually anyway when I get the problem.

Re: downloads sit in queue at 99% (fixed... ?)

Posted: May 25th, 2016, 4:32 pm
by EvilFlanders
Hi all,

I've had the bug and been able to reproduce all the time.

First, here is the nzb file, it's 290Mb so it's easy to test: http://www.nzbindex.nl/download/1359189 ... l.par2.nzb

With the correct settings, the download will fail since there seems to be a problem with the file set and nothing related to sab. When I say the right settings, I mean the actual combination of Quick Check ENABLED and Download all par2 files DISABLED as per safhire's post.

When enabling both, the queue gets stuck at 99%. When I switched back from correct to incorrect settings, it added the par2 files later in the process and still got stuck to 99% (so it seems that it was behaving as if "Download all par2 files" was disabled).

It also seems that connections are not released. They do not appear in the status dialog box as active, but when I import a new nzb I will get the too many connections error (configured at 25 on 30 max available connections). Is it possible that you have ghost connections? The log file is not moving, still decoding the same file. Here's the pastebin: http://pastebin.com/BSZPsmhp

Re: downloads sit in queue at 99% (fixed... ?)

Posted: May 26th, 2016, 2:18 am
by safihre
What SABnzbd version are you on?

EDIT: I confirmed this download also gets stuck on develop... Clearly bug on our side :-[

EDIT2: But it does not happen on every download, just specifically on this one.

Re: downloads sit in queue at 99% (fixed... ?)

Posted: May 26th, 2016, 6:27 am
by EvilFlanders
Sorry I'm using 1.0.2 [b7e2bd9]

Re: downloads sit in queue at 99% (fixed... ?)

Posted: June 3rd, 2016, 9:09 am
by shypike
I think we have fixed it now.
Will be in the next release (1.0.3)

Re: downloads sit in queue at 99% (fixed... ?)

Posted: June 4th, 2016, 8:48 pm
by EvilFlanders
It's indeed fixed with the file I mentioned, and I'll see if it happens again in the future.

I have disabled "download all par2 files" for my regular use and only activated it for the test tonight, and I've noticed that there was a 3 to 5 seconds complete lag/freeze in version 1.0.3 [927ba3c] during the processing: I saw on the log that you force a disconnect on all connections before the par2 files are downloaded (which I guess prevents the too many connections message), then reinitiates the connections with the "Quickest IP address" message to finally download all the par2 files. That's where I have about 4 seconds where the log and the interfaces lags.

Is that normal? I mean couldn't you leave the connections open between the articles and the par2 downloads? Maybe it's just me and my connection.

Thanks

P.S. super cool update process now with the in-line message, so much simpler...

Re: downloads sit in queue at 99% (fixed... ?)

Posted: June 5th, 2016, 7:52 am
by qwserty
I've still got several stuck downloads with this problem after upgrading to 1.0.3
It is usually 1 or 2 files with in the full set they almost complete, but they get a Badly formed yEnc article error and that causes that file to get stuck. I can delete the file from the queue and the system will continue trying to process everything and find it doesn't have enough parts then it will attempt a download of pars so as long as those are working it will complete, but sometimes the pars will get the same error and then everything is stuck. My only option after that is to delete the bad files again from the queue and it finally fails the download.

Snippet from log file
2016-06-05 06:34:29,095::DEBUG::[decoder:103] Decoding [email protected]
2016-06-05 06:34:29,151::DEBUG::[decoder:103] Decoding [email protected]
2016-06-05 06:34:29,164::DEBUG::[decoder:103] Decoding [email protected]
2016-06-05 06:34:29,818::DEBUG::[decoder:103] Decoding [email protected]
2016-06-05 06:34:29,842::DEBUG::[decoder:103] Decoding [email protected]
2016-06-05 06:34:29,849::INFO::[decoder:154] Badly formed yEnc article in [email protected]
2016-06-05 06:34:29,864::DEBUG::[decoder:103] Decoding [email protected]
2016-06-05 06:34:29,926::DEBUG::[decoder:103] Decoding [email protected]
2016-06-05 06:34:30,136::DEBUG::[decoder:103] Decoding [email protected]
2016-06-05 06:34:30,148::DEBUG::[decoder:103] Decoding [email protected]
2016-06-05 06:34:30,364::DEBUG::[decoder:103] Decoding [email protected]
2016-06-05 06:34:30,447::DEBUG::[decoder:103] Decoding [email protected]
2016-06-05 06:34:31,085::DEBUG::[decoder:103] Decoding [email protected]
2016-06-05 06:34:31,114::DEBUG::[decoder:103] Decoding [email protected]

Re: downloads sit in queue at 99% (fixed... ?)

Posted: June 5th, 2016, 8:14 am
by shypike
Interesting, do you have an example NZB?
[email protected]

Re: downloads sit in queue at 99% (fixed... ?)

Posted: June 5th, 2016, 12:04 pm
by qwserty
This is not the service I normally use, but I believe this is the correct NZB
http://www.nzbindex.nl/download/1306529 ... 01.rar.nzb

I have several NZB files if you have a way for me to get them to you.

Thanks.