Graph shape appears a little odd

Report & discuss bugs found in SABnzbd
Forum rules
Help us help you:
  • Are you using the latest stable version of SABnzbd? Downloads page.
  • Tell us what system you run SABnzbd on.
  • Adhere to the forum rules.
  • Do you experience problems during downloading?
    Check your connection in Status and Interface settings window.
    Use Test Server in Config > Servers.
    We will probably ask you to do a test using only basic settings.
  • Do you experience problems during repair or unpacking?
    Enable +Debug logging in the Status and Interface settings window and share the relevant parts of the log here using [ code ] sections.
Post Reply
User avatar
OneCD
Full Member
Full Member
Posts: 214
Joined: March 4th, 2017, 3:47 pm

Graph shape appears a little odd

Post by OneCD » September 23rd, 2018, 12:09 am

Hello,

The graph for my primary server shows valleys that seem to indicate zero-byte days:
Image
My backup servers are rarely used (the graphs for each one are almost a flat line and there are no corresponding peaks that match the valleys shown above).

I think the shape should look more like this GIMP'd mockup:
Image

Or, have I misunderstood this graph? ;)

Also, the graph indicates days where I exceeded the mid-range of 93.1GB. I have a slow 8Mb/s link and on a really perfect day, I can download ~ 70GB in 24 hours. Is the difference due to the awesome sabyenc module?

Thank you.
Stuff I like: Apache BASH CouchPotato CRON DD-WRT Debian DNSMasq Entware FireFox GitHub ImageMagick Kate KDE LibreELEC Netrunner NFS NVIDIA OpenVPN Orvibo S20 Python Raspberry Pi RAID SABnzbd+ SickChill Transmission Usenet VirtualBox WordPress XFCE

User avatar
sander
Release Testers
Release Testers
Posts: 6478
Joined: January 22nd, 2008, 2:22 pm

Re: Graph shape appears a little odd

Post by sander » September 23rd, 2018, 3:01 pm

AFAIK, the graph means that your downloads on day 9 and 12 and 16 were ... 0 MB. So you cannot truthfully create your gimp graph from that (which shows a download of 90GB on day 9).
IMHO a better graph would be a bar chart, so horizontal line the days, with vertical a bar for the download on that day.

"93.1GB. I have a slow 8Mb/s " ... 8 Mb/s = 1 MB/s. With 86400 seconds in a day, you could download 86400 MB = 86 GB per day. So less than 10% extra ... can your line be 9 Mb/s?

User avatar
OneCD
Full Member
Full Member
Posts: 214
Joined: March 4th, 2017, 3:47 pm

Re: Graph shape appears a little odd

Post by OneCD » September 23rd, 2018, 3:18 pm

sander wrote:
September 23rd, 2018, 3:01 pm
AFAIK, the graph means that your downloads on day 9 and 12 and 16 were ... 0 MB. So you cannot truthfully create your gimp graph from that (which shows a download of 90GB on day 9).
Except that's not the case. I download continuously - no days off. Certainly no drops down to zero.
sander wrote:
September 23rd, 2018, 3:01 pm
"93.1GB. I have a slow 8Mb/s " ... 8 Mb/s = 1 MB/s. With 86400 seconds in a day, you could download 86400 MB = 86 GB per day. So less than 10% extra ... can your line be 9 Mb/s?
8Mb/s is the maximum line-speed. But then, I assume some of that gets consumed with protocol overheads. I can download (at best) around 70GB per day.

Here's my usage shown in DD-WRT:
Image
Stuff I like: Apache BASH CouchPotato CRON DD-WRT Debian DNSMasq Entware FireFox GitHub ImageMagick Kate KDE LibreELEC Netrunner NFS NVIDIA OpenVPN Orvibo S20 Python Raspberry Pi RAID SABnzbd+ SickChill Transmission Usenet VirtualBox WordPress XFCE

User avatar
sander
Release Testers
Release Testers
Posts: 6478
Joined: January 22nd, 2008, 2:22 pm

Re: Graph shape appears a little odd

Post by sander » September 23rd, 2018, 3:50 pm

So ... overshoot and undershoot?

You can check the values: in Config -> Server, do View Source, and find "serverData[0]" ... which data do you see for this month?

User avatar
OneCD
Full Member
Full Member
Posts: 214
Joined: March 4th, 2017, 3:47 pm

Re: Graph shape appears a little odd

Post by OneCD » September 23rd, 2018, 3:58 pm

sander wrote:
September 23rd, 2018, 3:50 pm
So ... overshoot and undershoot?
Yes, that's the best way of describing it. ;D

Here's the figures for September:

"2018-09-01": 52461309985
"2018-09-02": 122218246298
"2018-09-03": 50809504586
"2018-09-04": 60778472807
"2018-09-05": 73869088851
"2018-09-06": 52928925796
"2018-09-07": 14948118100
"2018-09-08": 117224349607
"2018-09-09": 932092
"2018-09-10": 99037106005
"2018-09-11": 104555351540
"2018-09-12": 782336
"2018-09-13": 141164127318
"2018-09-14": 61036801042
"2018-09-15": 68334119746
"2018-09-16": 512000
"2018-09-17": 72185495515
"2018-09-18": 131712995762
"2018-09-19": 66396274996
"2018-09-20": 992987
"2018-09-21": 114928222112
"2018-09-22": 495616
"2018-09-23": 67059254694
Stuff I like: Apache BASH CouchPotato CRON DD-WRT Debian DNSMasq Entware FireFox GitHub ImageMagick Kate KDE LibreELEC Netrunner NFS NVIDIA OpenVPN Orvibo S20 Python Raspberry Pi RAID SABnzbd+ SickChill Transmission Usenet VirtualBox WordPress XFCE

User avatar
sander
Release Testers
Release Testers
Posts: 6478
Joined: January 22nd, 2008, 2:22 pm

Re: Graph shape appears a little odd

Post by sander » September 23rd, 2018, 4:11 pm

(Note: if you have more than one server, apart from"serverData[0]" there will "serverData[1]" and "serverData[2]" etc)

Your dates with your highest GB's:
"2018-09-13": 131
"2018-09-18": 122
"2018-09-02": 113
"2018-09-08": 109
"2018-09-21": 107

So ... impossible on your line?

I don't know why. Even if SAB includes non-downloaded par2-files, it is too high.

User avatar
OneCD
Full Member
Full Member
Posts: 214
Joined: March 4th, 2017, 3:47 pm

Re: Graph shape appears a little odd

Post by OneCD » September 23rd, 2018, 4:16 pm

sander wrote:
September 23rd, 2018, 4:11 pm
So ... impossible on your line?
Yes.
sander wrote:
September 23rd, 2018, 4:11 pm
I don't know why. Even if SAB includes non-downloaded par2-files, it is too high.
Agree.

Maybe the day counts are not resetting at a consistent time of day?
Stuff I like: Apache BASH CouchPotato CRON DD-WRT Debian DNSMasq Entware FireFox GitHub ImageMagick Kate KDE LibreELEC Netrunner NFS NVIDIA OpenVPN Orvibo S20 Python Raspberry Pi RAID SABnzbd+ SickChill Transmission Usenet VirtualBox WordPress XFCE

User avatar
sander
Release Testers
Release Testers
Posts: 6478
Joined: January 22nd, 2008, 2:22 pm

Re: Graph shape appears a little odd

Post by sander » September 24th, 2018, 1:02 am

OneCD wrote:
September 23rd, 2018, 4:16 pm
Maybe the day counts are not resetting at a consistent time of day?
Interesting hypothesis. Based on your SAB values, your mean value per day over those 23 days is 59 GB. That does fit on your 8 Mbps line, doesn't it?

Your DD-WRT graph shows an amount of 65 - 72 GB each day. Those numbers fit on your 8Mbps-line.

So ... hypothesis is that SAB 'chooses' the measure point not at the same moment? Maybe only after a download. Or the measurement is each day at the same moment, but SAB only updates the counter after a download?
Do you do downloads of 20-30+GB each?

User avatar
safihre
Administrator
Administrator
Posts: 2887
Joined: April 30th, 2015, 7:35 am
Location: Switzerland
Contact:

Re: Graph shape appears a little odd

Post by safihre » September 24th, 2018, 1:24 am

The code measures every single character that is received independent from the content or the NZB's, so also the overhead.

But looking at it, the reset code looks really strange.. Maybe I just don't understand it yet, have to double check.
How often do you restart the system the sabnzbd is run on or how often is sabnzbd restarted?
https://github.com/sabnzbd/sabnzbd/blob ... psmeter.py

User avatar
OneCD
Full Member
Full Member
Posts: 214
Joined: March 4th, 2017, 3:47 pm

Re: Graph shape appears a little odd

Post by OneCD » September 24th, 2018, 2:13 am

sander wrote:
September 24th, 2018, 1:02 am
Interesting hypothesis. Based on your SAB values, your mean value per day over those 23 days is 59 GB. That does fit on your 8 Mbps line, doesn't it?

Your DD-WRT graph shows an amount of 65 - 72 GB each day. Those numbers fit.
Agree.
sander wrote:
September 24th, 2018, 1:02 am
So ... hypothesis is that SAB 'chooses' the measure point not at the same moment? Maybe only after a download. Or the measurement is each day at the same moment, but SAB only updates the counter after a download?
Do you do downloads of 20-30+GB each?
Sure did, I’ve been grabbing a few remuxes lately. They’re anywhere from 20GB to 50GB. A 50GB takes most of the day.

I was thinking the same thing. Maybe the counts only update when a download completes.
safihre wrote:
September 24th, 2018, 1:24 am
How often do you restart the system the sabnzbd is run on or how often is sabnzbd restarted?
System reboot is every 2 months (long uptimes make me nervous). I don’t think I’ve restarted SAB since the day 2.3.5 was released.
Stuff I like: Apache BASH CouchPotato CRON DD-WRT Debian DNSMasq Entware FireFox GitHub ImageMagick Kate KDE LibreELEC Netrunner NFS NVIDIA OpenVPN Orvibo S20 Python Raspberry Pi RAID SABnzbd+ SickChill Transmission Usenet VirtualBox WordPress XFCE

Post Reply