[1.1.0RC2] Very, very slow initial connexion to Usenet serve

[EvilFlanders]

Hi!

As you can see in the pastebin, it takes sab about 20 seconds to establish 30 connexions. Is that normal? I've tried Nzbvortex for a change and will not keep using it but it managed to start downloads almost immediately.

Thanks

http://pastebin.com/Ja7L0BcH

EDIT by Sander:

Code: Select all

2016-08-01 11:43:26,144::INFO::[downloader:446] [email protected]: Initiating connection
2016-08-01 11:43:26,593::INFO::[happyeyeballs:111] Quickest IP address for news-eu.newshosting.com (port 563, ssl True, preferipv6 True) is 81.171.92.224
2016-08-01 11:43:26,596::INFO::[downloader:446] [email protected]: Initiating connection
2016-08-01 11:43:27,515::INFO::[happyeyeballs:111] Quickest IP address for news-eu.newshosting.com (port 563, ssl True, preferipv6 True) is 81.171.92.238
...
2016-08-01 11:43:43,245::INFO::[downloader:446] [email protected]: Initiating connection
2016-08-01 11:43:43,802::INFO::[happyeyeballs:111] Quickest IP address for news-eu.newshosting.com (port 563, ssl True, preferipv6 True) is 81.171.92.224
2016-08-01 11:43:43,803::INFO::[downloader:446] [email protected]: Initiating connection
2016-08-01 11:43:44,288::INFO::[happyeyeballs:111] Quickest IP address for news-eu.newshosting.com (port 563, ssl True, preferipv6 True) is 81.171.92.238
2016-08-01 11:43:44,381::INFO::[downloader:649] Connecting [email protected] finished
2016-08-01 11:43:44,381::INFO::[downloader:649] Connecting [email protected] finished
2016-08-01 11:43:44,382::INFO::[downloader:649] Connecting [email protected] finished

[sander]

Do you mean the first download only starts after 20 seconds? Or does the first download start after 1 second?

Anyway:
In SABnzbd: Config -> Switches -> Server load-balancing ... change to the first option "Prevent Load-balancing", and try again. Post back the result.

[EvilFlanders]

Thanks sander, it solved the problem.
The lag occurred on the first download after sab was disconnected from the server i.e. with 0 active connections.
With the setting you've advised, the download starts immediately after an nzb has been imported.

[sander]

Are you on Linux or MacOS? If so, can you do an extra test?

[EvilFlanders]

Sure! I'm using MacOS v10.11.6 (15G31)

[sander]

OK, great. Before the Real Test, can you do this:

In SABnzbd: Config -> Switches -> Server load-balancing ... change to the second option "Allow Load Balancing". Retest and please post the result here.

PS:

Please do this too: click on the Wrench symbol in the upper right corner, and set Logging to +Debug.

[EvilFlanders]

To summarise, knowing that I press "Force disconnect" between every try:

"Prevent Load-balancing" takes less than a second to start downloading.
"Allow Load Balancing" takes 2 seconds to start downloading.
"Allow Load Balancing with optimisation for IPv6" takes from 15 to 20 seconds to start downloading.

[sander]

OK, next step:

I'm assuming that on MacOS you run SABnzbd from source. If so, can you find the directory "sabnzbd" with the file "downloader.py" in it?

If so, open it for editing and find these lines:

Code: Select all

            # RFC6555 / Happy Eyeballs:
            ip = happyeyeballs(self.host, port=self.port, ssl=self.ssl)

and change the second line to:

Code: Select all

            # RFC6555 / Happy Eyeballs:
            ip = happyeyeballs(self.host, port=self.port, ssl=self.ssl, preferipv6=False)

Save and exit and (re)start SABnzbd.

In SABnzbd, select/keep the option "Allow Load Balancing with optimisation for IPv6" and retest.

Please also post the relevant sabnzbd.log

[EvilFlanders]

Sorry I'm using the packaged app (as in https://github.com/sabnzbd/sabnzbd/rele ... g/1.1.0RC2).
And I can't find the downloader.py file either in the package contents or on my computer. Is it different for the packaged app?

[sander]

I see. So that is not possible. Pity.

Something else to test then: did you set Logging to +Debug? And the load balancing to the third option (so: "Allow Load Balancing with optimisation for IPv6" )?
Can you then do a download again, and show the sabnzbd.log lines with happy eyeballs?

What I still don't understand: your experience seems to be that SAB only starts downloading after the last connection has been set up. I find that strange. Hopefully @shypike can say something about this.

EDIT:

PS: I now see news.newshosting.com has only IPv4 addresses and no IPv6 addresses, so IPv6 can't be a reason for what you describe. So my request for "preferIPv6 = False" would probably not have revealed something useful

Code: Select all

news.newshosting.com 563 True True
DEBUG:root:No IPv6 address found for news.newshosting.com
DEBUG:root:Input for thread is 81.171.92.238 563 True
DEBUG:root:Input for thread is 81.171.92.224 563 True
INFO:root:Quickest IP address for news.newshosting.com (port 563, ssl True, preferipv6 True) is 81.171.92.224
DEBUG:root:Happy Eyeballs lookup and port connect took 41 ms
81.171.92.224

[EvilFlanders]

Sorry but there was lot of "Happy Eyeballs" lines and some others in between. I preffered to make whole extracts for the three alternatives if it's okay with you. Here they are:

Prevent Load Balancing: http://pastebin.com/eeXpKBGi
Allow Load Balancing: http://pastebin.com/W2GbCcfd
Allow Load Balancing with optimisation for IPv6: http://pastebin.com/0w3zyb8r

[EvilFlanders]

P.S. And, yes, there are issues with newshosting's IPv6. They have newsserver IPv6 addresses but I cannot reach them (see list here).
Apparently, there are known issues with MacOSX and IPv6 reversing since I can't ping Google's IPv6 DNSs nor set them in my DNS settings either.

[sander]

I'll investigate further this weekend.

[mastyman]

ah, i had the same problem, when i switched from supernews, to newsgroup ninja, about a week ago, it was crazy slow for the download to start on newsgroup ninja- 10-20 seconds, whereas supernews was instant for the many years i used it

i switched to "Allow Load Balancing" instead of "Allow Load Balancing with optimisation for IPv6" and now its almost INSTANT download start on newsgroup ninja.

I dont have IPv6 available on my wan connection.

[1.1.0RC3] on Windows 10x64

[sander]

ah, i had the same problem, when i switched from supernews, to newsgroup ninja, about a week ago, it was crazy slow for the download to start on newsgroup ninja- 10-20 seconds, whereas supernews was instant for the many years i used it

i switched to "Allow Load Balancing" instead of "Allow Load Balancing with optimisation for IPv6" and now its almost INSTANT download start on newsgroup ninja.

I dont have IPv6 available on my wan connection.

[1.1.0RC3] on Windows 10x64

Mastyman, more info would be nice:

- you use news.newsgroup.ninja ?
- how many connections?
- SSL newsserver connection, or plain connection?