Page 1 of 1

Speed Bouncing Up and down but generally slow.

Posted: February 1st, 2019, 1:52 am
by saozuser
Version: 2.3.7 [7a8df5e] installed as a service
Python Version: 2.7.15
Running on

i7 (2700k), 16GB, RAM, SSD HDD and SSD cached Drive pool for finished/data drive on Windows 10 (1809). >125k Pystone

50+/20+Mbit VDSL internet connection on Gbit Ethernet wired network. Speedtest maxes out the theoretical line maximum.

Sonarr/Radarr on same host (preferring Usenet).

My system was offline for a few months during a house move. Updated all software, signed up to some new new-servers and restarted, so I now have a backlog of 500 posts.

Getting 2/3 of them failing due to "Download failed - Not on your server(s)" or "RAR files failed to verify". Speed during download is varying between almost full speed of the connection at approx 5100KB/s but it will spend long periods at 900KB/s or 230KB/s especially if its on a post with missing articles.

News servers have been set to 7 connections each. 3x usegroupdirect servers and 1x usenetbucket server at pri 0, 1x usenet farm at pri 5 and 1x blocknews net at pri 10 (block account).

Check before download, Abort jobs that cannot be completed, Enable SFV-based checks, Post-Process Only Verified Jobs
all checked. ini file below (sans usernames/passwords)

Am I missing something simple?

Re: Speed Bouncing Up and down but generally slow.

Posted: February 1st, 2019, 2:33 am
by safihre
I would suggest the following: https://sabnzbd.org/wiki/faq#freshstart
Then only add 1 server, go into Status and Interface settings (the wrench icon) and click the 1000MB test-download.
Your system should easily get max speed on your connection, since my old i5 can maintain 1GBit speeds.

In 2.3.7 the "Check before download" feature should no longer be needed, since we will fail jobs super quickly now using new techniques that barely use any data.

The slow speed on missing articles makes sense, since it is really slow to ask the server if the article is there and then move on when it isn't. It has to do this for all your servers.

Re: Speed Bouncing Up and down but generally slow.

Posted: February 1st, 2019, 2:42 am
by sander
As of SABnzbd 2.3.7 there is a "Test Download" feature available. So:

Click on the Wrench symbol ("Status and Interface Options") in the upper right corner. Then, in the default tab Status, click on Test Download options: 100 MB, or 1000 MB.

What speed do you get with those downloads?

Image

Re: Speed Bouncing Up and down but generally slow.

Posted: February 1st, 2019, 2:54 am
by saozuser
Freshstarted

test file came at at between 2-3.1MB/s.

speedtest on the link still at 50Mbit

Re: Speed Bouncing Up and down but generally slow.

Posted: February 1st, 2019, 3:06 am
by sander
Next step:
Disable all newsservers but one, set connection to 15, do the Test Download again.
Repeat for each newsserver

So ... test which newsserver is fastest (and slowest).
Reason: in my experience, one slow newsserver at the hightest prio can slow down the overall download speed.

Re: Speed Bouncing Up and down but generally slow.

Posted: February 1st, 2019, 3:10 am
by saozuser
Its definitely not failing early .... 32% over 1000 missing articles and still going (slowly)

Re: Speed Bouncing Up and down but generally slow.

Posted: February 1st, 2019, 3:29 am
by saozuser
all three newsgroupdirect servers sit between 2.5-3.8MB/s individually (it's peak usage time here btw)
all the fill servers too

but usenetbucket maxing out at 900KB/s

Re: Speed Bouncing Up and down but generally slow.

Posted: February 1st, 2019, 3:37 am
by saozuser
How can I post a screenshot ans a newbie?

Re: Speed Bouncing Up and down but generally slow.

Posted: February 1st, 2019, 7:04 am
by safihre
Could be that your ISP is limiting you. Wouldn't make sense otherwise.. These speeds are just to slow.
And this is with the basic settings? Not tweaked too much?
Could always try a trial at a different server, maybe Frugal Usenet?

Re: Speed Bouncing Up and down but generally slow.

Posted: February 1st, 2019, 7:16 am
by saozuser
Right now I’m more concerned about the low end speeds and failed post handling. I have from time to time max Ed out my connection, but at the moment it’s taking 12 hours to download/fail 10-15 posts.

Re: Speed Bouncing Up and down but generally slow.

Posted: February 3rd, 2019, 5:40 am
by safihre
Testing all 4 servers is slow. If you prefer to be faster, use only 1 server-setup per server. So a total of 2.

Re: Speed Bouncing Up and down but generally slow.

Posted: February 3rd, 2019, 5:54 am
by saozuser
I have tested each server individually with 15 connections. (Previously all set to 7). It is a pretty standard setup that’s worked normally in the past.

Other things that have been happening are;

Posts downloading out of order
Posts hanging at 90-99% filling the download drive. If I then Search for them and sending them to the top of the queue it gets them completed and nicely tidied up.

Re: Speed Bouncing Up and down but generally slow.

Posted: February 6th, 2019, 8:39 pm
by saozuser
It's definitely an issue with incomplete posts. It only occurs when there are one or more "yellow progress bar" posts downloading I'm looking at 2 now that are at over 80% over 1000 missing articles and still trying to download.

Server timeout is 30s

Re: Speed Bouncing Up and down but generally slow.

Posted: February 7th, 2019, 12:40 am
by sander
saozuser wrote: February 6th, 2019, 8:39 pm It's definitely an issue with incomplete posts.
Uh? Yes ... incomplete posts will give slow download speeds.
saozuser wrote: February 6th, 2019, 8:39 pm It only occurs when there are one or more "yellow progress bar" posts downloading I'm looking at 2 now that are at over 80% over 1000 missing articles and still trying to download.
That's not good. Default SAB will notice & quit quite quickly. Check your settings:
config -> special -> fast_fail (it should be ON)
config -> special -> req_completion_rate:100.2

Re: Speed Bouncing Up and down but generally slow.

Posted: February 7th, 2019, 1:16 am
by saozuser
They are both set to that