Page 1 of 2
SABnzbd too slow
Posted: June 11th, 2020, 7:35 pm
by iio7
Hi,
I'm running SABnzbd on a box on a 1 Gbit wired connection and with NZBGet I get download speeds at about 90 MB/s, with SABnzbd I get at the very max. 21.4 MB/s on the very same box.
This is unbearably slow!
I have followed the guide on "highspeed-downloading" (cannot post link, but it's on this forum) to the letter. It claims that on a Intel Celeron J4105 (4GB RAM) and a 700/700 Mbps fiber line, SABnzbd can achieve a sustained 80 MB/s. I am running Sabnzbd on Celeron J1900 with also 4GB RAM.
Re: SABnzbd too slow
Posted: June 12th, 2020, 1:02 am
by sander
https://sabnzbd.org/wiki/advanced/highspeed-downloading says "On a 2017 Intel Celeron J4105 (4GB RAM, System Performance (Pystone) 95.000), built-in SSD and a 700/700 Mbps fiber line, SABnzbd can achieve a sustained 80 MB/s, thus linespeed."
So: In SABnzbd's upper right corner, click on the wrench symbol ("Status and interface options"), then click on first tab Status, and there click on the refresh arrow ... what Pystone score does your 2013 Celeron J1900 give you?
Re: SABnzbd too slow
Posted: June 12th, 2020, 12:28 pm
by Hydranet
Must be something on your side causing it because I have a 500bmit internet connection and download at speeds bewtween 55 MB/s and 60MB/s
Re: SABnzbd too slow
Posted: June 12th, 2020, 6:57 pm
by iio7
Thank you very much for your help.
I am getting the following:
Code: Select all
System performance (Pystone)
44426 Intel(R) Celeron(R) CPU J1900 @ 1.99GHz
Download folder speed
32.6 MB/s
Complete folder speed
33.4 MB/s
I will try to install SABnzbd on one of my more powerful machines to see if the problem persists. However, when I run top on the Celeron box SABnzbd doesn't consume too much PCU, only about 134% during download, so it should be much better.
Also did a test download with the 1GB file (wanted to attach a screenshot, but apparently as a new user I cannot link or attach
), I still get about 20.8 MB/s.
Re: SABnzbd too slow
Posted: June 13th, 2020, 1:36 am
by sander
OK, so:
half the cpu power
your disks are not fast: 33 MB/s. I guess HDD (not SSD). Correct? I must say I'm surprised NZBget can achieve 90 MB/s on that
"only about 134%" that might mean 1 of your 4 cores is fully used. SAB is built with Python, which can only use core for the main task.
BTW: which version of SAB are you using, on which OS?
Re: SABnzbd too slow
Posted: June 14th, 2020, 6:23 am
by cphmichael
My computer is an old IBM x3650 M4 with a NVME SSD running unRAID:
System performance (Pystone) 89426 Intel(R) Xeon(R) CPU E5-2470 0 @ 2.30GHz
Download folder speed: 557.7 MB/s (/downloads/tmp)
Complete folder speed: 549.7 MB/s (/downloads/completed)
Internet Bandwidth: 91.5 MB/s (732 Mbps)
Re: SABnzbd too slow
Posted: June 14th, 2020, 2:11 pm
by iio7
sander wrote: ↑June 13th, 2020, 1:36 am
OK, so:
half the cpu power
your disks are not fast: 33 MB/s. I guess HDD (not SSD). Correct? I must say I'm surprised NZBget can achieve 90 MB/s on that
"only about 134%" that might mean 1 of your 4 cores is fully used. SAB is built with Python, which can only use core for the main task.
BTW: which version of SAB are you using, on which OS?
Yes, it's HDD, but I can get 90 MB/s with NZBget and about 95 MB/s just doing "wget" something.
SABnzbd version: 2.3.9 running on Arch Linux.
Yes, the 134% just shows that my CPU isn't "over taxed".
Re: SABnzbd too slow
Posted: June 19th, 2020, 9:18 am
by iio7
So I finally had the time to test SABnzbd on an i5 which also runs NZBget at 90 MB/s. And on this box I get about 83 MB/s with SABnzbd. So it seems like the Celeron box, for some reason, doesn't handle SABnzbd very well. So far I haven't been able to determine why. I would have expected it to be the slower CPU, but since it is just using about 134% that isn't it. And since NZBget gets 90 MB/s on the Celeron box it cannot be the harddrive or anything like that.
Both the Celeron and i5 are running the same version of Arch Linux and SABnzbd.
Re: SABnzbd too slow
Posted: June 19th, 2020, 9:28 am
by sander
iio7 wrote: ↑June 19th, 2020, 9:18 am
So I finally had the time to test SABnzbd on an i5 which also runs NZBget at 90 MB/s. And on this box I get about 83 MB/s with SABnzbd. So it seems like the Celeron box, for some reason, doesn't handle SABnzbd very well. So far I haven't been able to determine why. I would have expected it to be the slower CPU, but since it is just using about 134% that isn't it. And since NZBget gets 90 MB/s on the Celeron box it cannot be the harddrive or anything like that.
Both the Celeron and i5 are running the same version of Arch Linux and SABnzbd.
Good info.
The 134% CPU load ... AFAIK python is single-core. So ... the core on which SAB is running ... is that core at 100% ?
Re: SABnzbd too slow
Posted: June 19th, 2020, 10:06 am
by safihre
SABnzbd can be multi-core because SABYenc offloads some work to the other cores
Re: SABnzbd too slow
Posted: June 19th, 2020, 3:36 pm
by sander
Oh, yes, and unrar will also run on a separate core:
Code: Select all
$ ps -o pid,ppid,pgid,comm,cpuid,%cpu,%mem -u $USER | grep -i sabnzbd
255686 255680 255686 SABnzbd.py 2 8.9 3.5
Code: Select all
$ ps -o pid,ppid,pgid,comm,cpuid,%cpu,%mem -u $USER | grep -i 255686
255686 255680 255686 SABnzbd.py 2 8.9 3.6
269447 255686 255686 unrar 1 5.0 0.0
So SAB is running on CPUID 2, and unrar is running on CPUID 1.
I don't know if you can see sabyenc running / CPU usage. So far I can only see the sabyenc library is loaded by SABnzbd:
Code: Select all
$ sudo awk '/\.so/{print $6}' /proc/255686/maps | sort -u | grep -i sabyenc
/home/sander/.local/lib/python3.8/site-packages/sabyenc3.cpython-38-x86_64-linux-gnu.so
and
Code: Select all
$ pmap 255686 | grep sabyenc
00007f6a31d6f000 12K r-x-- sabyenc3.cpython-38-x86_64-linux-gnu.so
00007f6a31d72000 2044K ----- sabyenc3.cpython-38-x86_64-linux-gnu.so
00007f6a31f71000 4K rw--- sabyenc3.cpython-38-x86_64-linux-gnu.so
Re: SABnzbd too slow
Posted: July 4th, 2020, 5:40 pm
by iio7
I haven't been able to determine why SABnzbd is so slow on this box, but it will not go beyond about the 20 MB/s no matter what I do.
Re: SABnzbd too slow
Posted: July 18th, 2020, 1:36 am
by marthaneilson
I have a 500bmit web association and download at speeds bewtween 55 MB/s and 60MB/s.
military alphabet chart
Re: SABnzbd too slow
Posted: July 19th, 2020, 5:32 pm
by iio7
My problem has to be related to the box I use, something about this particular Celeron machine that just doesn't "fit well" with SABnzbd. I get 90 MB/s with NZBget and all other download related applications as well.
Re: SABnzbd too slow
Posted: July 20th, 2020, 8:45 am
by Ahrhome
You guys have to understand megabits and megabytes.One megabyte is equal to eight megabits.So if your download 60MB/s it is 480 Mbps.