Page 1 of 2

New "Abort" for jobs that cannot be completed

Posted: January 30th, 2021, 1:29 pm
by nismozcar
Can we get a new optional switch to "Abort jobs that cannot be completed" that isn't based on percentage of missing articles? My queue stacks up so quickly, that reasonable data capturing in large quantities is not possible; jobs that are very large (20GB+) suck up too much time and data in my queue before they get aborted. I notice that most downloads that will complete will Ramp Up in Bandwidth very quickly at the start (5sec); and those those will ultimately fail will Ramp Down in Bandwidth and begin showing missing articles. Thanks.

Re: New "Abort" for jobs that cannot be completed

Posted: January 30th, 2021, 2:58 pm
by safihre
What version of Sabnzbd are you using?
Because it hasn't been based on a percentage for quite a while. It's based on the first articles of each file that are tried at the very start. It's called fast_fail in Config Specials.

However, ifn you have many servers, all methods take long because we have to try every single server.

Re: New "Abort" for jobs that cannot be completed

Posted: January 30th, 2021, 6:07 pm
by nismozcar
Using 3.1.1, with Fast_Fail ON, Abort if cannot be completed ON and Req_Completion on DEFAULT.

This 2600MB download below took roughly 3min to nearly complete and then fail.

Image
Image

Multiply that timeframe for larger files (26GB => 30min) and they can tie up the queue for long periods with back to back failures.

Fast_Fail appears to work great for those nzbs with poor first articles, but I'm assuming these scenarios have issues later in the process if the nzb is not being aborted immeadiately.

Re: New "Abort" for jobs that cannot be completed

Posted: January 30th, 2021, 7:07 pm
by nismozcar
I'm currently having to stalk my queue and remove the failing downloads; while sending the good ones to the bottom. I am averaging 80MB/s for throughput, so every minute I'm not on a good nzb I'm losing roughly 5GBs of data. The pattern I am noticing with the nzbs that are "hanging" is that they bandwidth drops below 1MB/s, would it be possible to signal an ABORT anytime the bandwidth drops below 1B/s for 3sec continuously? Or a setting that lets users choose the threshold (Bandwidth or Number of articles) in which they want to abort; such as any download below 5MB/s would be considered a fail regardless of missing articles? Thanks.

Re: New "Abort" for jobs that cannot be completed

Posted: January 31st, 2021, 1:48 am
by safihre
So far I've never seen cases where the first articles are fine, but then the rest suddenly isn't. I'd like to investigate what is going wrong.
Could you share one of the NZBs? You always see this happen exactly like this?
Another reason this could happen is if a job is retried, but I guess that's not the case here.

Re: New "Abort" for jobs that cannot be completed

Posted: January 31st, 2021, 9:10 pm
by nismozcar
How would you like me to share the nzb? Thanks.

Re: New "Abort" for jobs that cannot be completed

Posted: February 1st, 2021, 2:41 pm
by safihre
You can send it to me at [email protected]

Re: New "Abort" for jobs that cannot be completed

Posted: February 3rd, 2021, 11:50 am
by nismozcar
Any insights to my issues? Here's a screenshot of my queue after it encounters a number of consecutive "hanging" nzbs; note the severe droughts of data in between attempts.

Image

Re: New "Abort" for jobs that cannot be completed

Posted: February 3rd, 2021, 3:43 pm
by safihre
Just to be sure, can you enable Info logging in the Status and Interface settings window and then download the log after a while?
Can you check what it shows? The long breaks seem odd.
Due to regular work days I haven't had time to analyse the NZBs yet.

Re: New "Abort" for jobs that cannot be completed

Posted: February 4th, 2021, 2:41 pm
by Puzzled
This is a fairly common pattern when some articles are missing and some are there. The server actually takes a lot longer to respond for each article when it's missing. You could try using the servers from a specific country instead of the default news.usenetserver.com. Some of the Highwinds server farms respond a lot faster than others. If you can increase the number of connections it will also go faster.

Re: New "Abort" for jobs that cannot be completed

Posted: February 4th, 2021, 6:22 pm
by nismozcar
I was using the default UsenetServer @ 20 connections; tried the US-UsenetServer @ 20 connections with no change. I am only able to download approximately 1TB per day on average; I should be able to get closer to 4TB. Is it possible to add a "Missing Article Limit" to the switches page? It generally takes 5 seconds to determine visually if a nzb will complete or fail.

Re: New "Abort" for jobs that cannot be completed

Posted: February 5th, 2021, 8:58 am
by safihre
Have you tried lowering the req_completion_rate to something like 90%?
ALthough this indeed does not fix the multi-episode downloads.

Re: New "Abort" for jobs that cannot be completed

Posted: February 5th, 2021, 9:44 am
by Puzzled
I made a suggestion for a fix here: https://github.com/sabnzbd/sabnzbd/pull/1785

If you would like to try it you can download it here: https://github.com/sabnzbd/sabnzbd/acti ... /540666965

Go to Config/Special and set missing_threshold_mbytes to for instance 200. After having tried to download 200 MB it will fail if more than half is missing.

Re: New "Abort" for jobs that cannot be completed

Posted: February 5th, 2021, 11:36 am
by nismozcar
Puzzled-

Can you walk me through the install process? It appears that you edited a couple of different configuration files.

Re: New "Abort" for jobs that cannot be completed

Posted: February 5th, 2021, 12:14 pm
by Puzzled
Sorry, it seems you'll have to be logged in to Github to download them. I assumed they would work because the page is visible for anyone. If you are logged in you can click on one of the links listed under Artifacts to download an installer for Windows or the Mac binary. It's only available as source for other platforms.