Download performance issue when using 1.1.0

Report & discuss bugs found in SABnzbd
Forum rules
Help us help you:
  • Are you using the latest stable version of SABnzbd? Downloads page.
  • Tell us what system you run SABnzbd on.
  • Adhere to the forum rules.
  • Do you experience problems during downloading?
    Check your connection in Status and Interface settings window.
    Use Test Server in Config > Servers.
    We will probably ask you to do a test using only basic settings.
  • Do you experience problems during repair or unpacking?
    Enable +Debug logging in the Status and Interface settings window and share the relevant parts of the log here using [ code ] sections.
Post Reply
asarian
Newbie
Newbie
Posts: 18
Joined: June 9th, 2016, 6:35 am

Download performance issue when using 1.1.0

Post by asarian »

Ever since I upgraded my (Synology) Sabnzbd to 1.1.0 [8abcf08] (upgraded from 1.0.3), download-performance seems to have been cut in half. I used to download at ca. 4.8 Mbps, and now it's never higher than ca. 2.6 Mbps.

I have 2 servers at priority 0, both with 8 connections defined. Lowering those, are adding more, didn't make a real difference.
User avatar
shypike
Administrator
Administrator
Posts: 19774
Joined: January 18th, 2008, 12:49 pm

Re: Download performance issue when using 1.1.0

Post by shypike »

In 1.1.0 we chose tuning parameters that turn out to be non-optimal for some low-CPU systems.
In 1.2.0, we'll change that and also look at optimizations that benefit such systems.
asarian
Newbie
Newbie
Posts: 18
Joined: June 9th, 2016, 6:35 am

Re: Download performance issue when using 1.1.0

Post by asarian »

shypike wrote:In 1.1.0 we chose tuning parameters that turn out to be non-optimal for some low-CPU systems.
In 1.2.0, we'll change that and also look at optimizations that benefit such systems.
Thanks.

My system is hardly low-CPU, though. It's Synology DSM 6 inside a VM, with 4x i7 980X virtual CPU's, and 4G RAM. CPU usage, as a result, is therefore not an issue here (repair, for instance, takes around 17% CPU, at the most). It's just the download speed which has dropped significantly (downloading itself takes only ca. 6% CPU or less).

I even briefly reniced the process (to -n1), but that made no visible difference.

EDIT: P.S. Is there a manual way to undo the new 'tuning parameters'?
User avatar
safihre
Administrator
Administrator
Posts: 5362
Joined: April 30th, 2015, 7:35 am
Contact:

Re: Download performance issue when using 1.1.0

Post by safihre »

Only if you can get to the python code, can you?
If you like our support, check our special newsserver deal or donate at: https://sabnzbd.org/donate
User avatar
jcfp
Release Testers
Release Testers
Posts: 989
Joined: February 7th, 2008, 12:45 pm

Re: Download performance issue when using 1.1.0

Post by jcfp »

On my system, commenting out the following code in sabnzbd/downloader.py around line 487 (first introduced in this commit) causes download speed to go up significantly:

Code: Select all

# Why check so often when so few things happend?
if len(readkeys) >= 8 and len(read) < len(readkeys)/4:
    time.sleep(0.05)
asarian
Newbie
Newbie
Posts: 18
Joined: June 9th, 2016, 6:35 am

Re: Download performance issue when using 1.1.0

Post by asarian »

safihre wrote:Only if you can get to the python code, can you?
Sure, I can get to it just fine. ;) Please, tell me what to do!
asarian
Newbie
Newbie
Posts: 18
Joined: June 9th, 2016, 6:35 am

Re: Download performance issue when using 1.1.0

Post by asarian »

jcfp wrote:On my system, commenting out the following code in sabnzbd/downloader.py around line 487 (first introduced in this commit) causes download speed to go up significantly:

Code: Select all

# Why check so often when so few things happend?
if len(readkeys) >= 8 and len(read) < len(readkeys)/4:
    time.sleep(0.05)
Thanks, will do! :)
User avatar
safihre
Administrator
Administrator
Posts: 5362
Joined: April 30th, 2015, 7:35 am
Contact:

Re: Download performance issue when using 1.1.0

Post by safihre »

Right, so clearly this optimization works on Windows and Mac, but not on Linux.
Guess will have to make that conditional.
If you like our support, check our special newsserver deal or donate at: https://sabnzbd.org/donate
asarian
Newbie
Newbie
Posts: 18
Joined: June 9th, 2016, 6:35 am

Re: Download performance issue when using 1.1.0

Post by asarian »

asarian wrote:
jcfp wrote:On my system, commenting out the following code in sabnzbd/downloader.py around line 487 (first introduced in this commit) causes download speed to go up significantly:

Code: Select all

# Why check so often when so few things happend?
if len(readkeys) >= 8 and len(read) < len(readkeys)/4:
    time.sleep(0.05)
Thanks, will do! :)
Yep, this worked immediately. :) Thanks again.
GTunney
Newbie
Newbie
Posts: 31
Joined: September 19th, 2011, 5:42 am

Re: Download performance issue when using 1.1.0

Post by GTunney »

jcfp wrote:On my system, commenting out the following code in sabnzbd/downloader.py around line 487 (first introduced in this commit) causes download speed to go up significantly:

Code: Select all

# Why check so often when so few things happend?
if len(readkeys) >= 8 and len(read) < len(readkeys)/4:
    time.sleep(0.05)
Thank you so much, took my speed from 5.3MB/s back up to what it was before the update 7.9MB/s
Post Reply