SabNZB doesn't release it memory on RPi3b [SabNZB 2.3.9]

Get help with all aspects of SABnzbd
Forum rules
Help us help you:
  • Are you using the latest stable version of SABnzbd? Downloads page.
  • Tell us what system you run SABnzbd on.
  • Adhere to the forum rules.
  • Do you experience problems during downloading?
    Check your connection in Status and Interface settings window.
    Use Test Server in Config > Servers.
    We will probably ask you to do a test using only basic settings.
  • Do you experience problems during repair or unpacking?
    Enable +Debug logging in the Status and Interface settings window and share the relevant parts of the log here using [ code ] sections.
Post Reply
RomMon
Newbie
Newbie
Posts: 6
Joined: December 24th, 2020, 9:57 pm

SabNZB doesn't release it memory on RPi3b [SabNZB 2.3.9]

Post by RomMon »

SabNZB 2.3.9
LibreELEC 9.2.6 (only python 2)
Kodi 18.9.0 (Leia)
Python 2.7.16


I'm monitoring the used memory for some weeks on my LibreELEC HTPC with Kodi.
After using SabNZB two nights ago the memory usage of Python jumped from arround 13% to 31% and doesn't go down.

Memory before using SabNZB (see PID 608):

Code: Select all

Dumping top -o +%MEM | head -n 20
================================================
- 13:59:44 up 21 days, 11:42,  2 users,  load average: 0.33, 0.20, 0.15
Tasks: 119 total,   1 running, 118 sleeping,   0 stopped,   0 zombie
%Cpu(s):  1.5 us,  2.9 sy,  0.0 ni, 95.6 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
MiB Mem :    747.9 total,     37.4 free,    335.2 used,    375.2 buff/cache
MiB Swap:      0.0 total,      0.0 free,      0.0 used.    336.4 avail Mem 

  PID USER      PR  NI    VIRT    RES    SHR S  %CPU  %MEM     TIME+ COMMAND    
22745 root      20   0  654480 165088  20648 S   6.2  21.6 610:17.73 kodi.bin   
  608 root      30  10  342040  96564   1172 S   0.0  12.6 273:37.69 python     
  343 root      20   0  150312  21048   4428 S   0.0   2.7 108:25.71 tvheadend  
Memory after using SabNZB (see PID 608)

Code: Select all

  Dumping top -o +%MEM | head -n 20
================================================
- 14:03:18 up 26 days, 11:46,  2 users,  load average: 0.22, 0.21, 0.17
Tasks: 119 total,   1 running, 118 sleeping,   0 stopped,   0 zombie
%Cpu(s):  1.5 us,  2.9 sy,  0.0 ni, 95.6 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
MiB Mem :    747.9 total,     44.9 free,    493.9 used,    209.1 buff/cache
MiB Swap:      0.0 total,      0.0 free,      0.0 used.    179.9 avail Mem 

  PID USER      PR  NI    VIRT    RES    SHR S  %CPU  %MEM     TIME+ COMMAND    
  608 root      30  10  608612 235412   2312 S   0.0  30.7 368:49.57 python     
22745 root      20   0  714548 197052  24108 S   0.0  25.7   1794:21 kodi.bin   
  343 root      20   0  150460  18224   1060 S   0.0   2.4 210:40.03 tvheadend  

Code: Select all

 # ps -ef | grep python
  598 root      7:33 python
  608 root      6h08 python /storage/.kodi/addons/service.sabnzbd/sabnzbd/SABnzbd.pyo
 1004 root      0:00 grep python

The issue looks a bit like a thread with title "Memory leak?"

I do have an image if the memory usage, but as a new user I'm not able to insert it yet.

[edit 2020-12-26]
Restarted Sabnzb (systemctl restart service.sabnzbd.service), and now it dropped to 5%.

Image

[/edit]




Merry Christmas everyone
Last edited by RomMon on January 8th, 2021, 8:19 pm, edited 7 times in total.
User avatar
safihre
Administrator
Administrator
Posts: 5338
Joined: April 30th, 2015, 7:35 am
Contact:

Re: SabNZB doesn't release it memory on RPi3b [SabNZB 2.3.9]

Post by safihre »

You are running a very old version of SABnzbd, please update to 3.1.1.
If you like our support, check our special newsserver deal or donate at: https://sabnzbd.org/donate
RomMon
Newbie
Newbie
Posts: 6
Joined: December 24th, 2020, 9:57 pm

Re: SabNZB doesn't release it memory on RPi3b [SabNZB 2.3.9]

Post by RomMon »

@safihre thanks for your reply.
I'm running SabNZB on LibreELEC 9.2.6 (the latest released version), which is python-2 only.
I understand there is no development effort put into SabNZB 2 anymore.
User avatar
shypike
Administrator
Administrator
Posts: 19774
Joined: January 18th, 2008, 12:49 pm

Re: SabNZB doesn't release it memory on RPi3b [SabNZB 2.3.9]

Post by shypike »

Indeed development of SABnzbd for Python 2.7 has stopped.
Also because support of Python 2.7 itself has stopped and support of required packages is dropping fast.
The memory issues may very well be caused by the Python2 of your platform.
It should be possibly to install Python 3.8 on LibreELEC.
I installed it recently on Rasbian using a blog article I found through Google.
RomMon
Newbie
Newbie
Posts: 6
Joined: December 24th, 2020, 9:57 pm

Re: SabNZB doesn't release it memory on RPi3b [SabNZB 2.3.9]

Post by RomMon »

@shypike thanks.
I will have to wait for LibreELEC 10 which will (only) support Python3.
Until than I will have to monitor memory usage and restart SABnzbd if needed.
brokenr1bgolfer
Newbie
Newbie
Posts: 1
Joined: December 30th, 2020, 9:32 am

Re: SabNZB doesn't release it memory on RPi3b [SabNZB 2.3.9]

Post by brokenr1bgolfer »

After three nice years of using SABnzbd I have hit a memory leak:

Levovo Laptop 64G RAM
Lates SABnzbd version
Windows 10 Pro
All paths to NFS V4 share on QNAP NAS (I am betting that this is the problem. Had to switch from SMB because of a QNAP bug.)

Sadly my solution is switching to NZBGet. Not that NZBGet is a bad idea because it does not have the same problem, but I like SABnzbd.

Many thanks to the developers of this product. I might switch back if the issue is resolved. If you would like me to send any logs and/or data please just let me know. It is the least I can do.

Mark
User avatar
safihre
Administrator
Administrator
Posts: 5338
Joined: April 30th, 2015, 7:35 am
Contact:

Re: SabNZB doesn't release it memory on RPi3b [SabNZB 2.3.9]

Post by safihre »

brokenr1bgolfer: this is not very helpful, you don't give any details.... How can we possibly fix it??
What kind of leak do you see? When does it occur?
If you like our support, check our special newsserver deal or donate at: https://sabnzbd.org/donate
RomMon
Newbie
Newbie
Posts: 6
Joined: December 24th, 2020, 9:57 pm

Re: SabNZB doesn't release it memory on RPi3b [SabNZB 2.3.9]

Post by RomMon »

@brokenr1bgolfer

Be aware that my issue is on a RPi3 with only 1GB RAM, and stuck at SABnzb 2 due to the use of LibreELEC which doesn't support Python-3 yet.
I was monitoring my memory usage because of Kodi crashes, and noticed this memory issue.
User avatar
OneCD
Hero Member
Hero Member
Posts: 557
Joined: March 4th, 2017, 3:47 pm

Re: SabNZB doesn't release it memory on RPi3b [SabNZB 2.3.9]

Post by OneCD »

brokenr1bgolfer wrote: December 30th, 2020, 9:41 am After three nice years of using SABnzbd I have hit a memory leak:

Levovo Laptop 64G RAM
Lates SABnzbd version
Windows 10 Pro
All paths to NFS V4 share on QNAP NAS (I am betting that this is the problem. Had to switch from SMB because of a QNAP bug.)

Sadly my solution is switching to NZBGet. Not that NZBGet is a bad idea because it does not have the same problem, but I like SABnzbd.
You might be better-off running SABnzbd on the QNAP instead of Windows.
Stuff I like: Apache bash cron DD-WRT Debian DNSMasq Entware FireFox GitHub ImageMagick Kate KDE LibreELEC Netrunner NFS NVIDIA OpenVPN Orvibo-S20 pfSense Python Raspberry-Pi RAID SABnzbd Transmission Usenet VirtualBox Watcher3 XFCE
RomMon
Newbie
Newbie
Posts: 6
Joined: December 24th, 2020, 9:57 pm

Re: SabNZB doesn't release it memory on RPi3b [SabNZB 2.3.9]

Post by RomMon »

As a test I downgraded SABnzb to the oldest version available 1.1.1.
With SABnzb-1.1.1 the memory usage is much less, but also here the memory doesn't look to be released again after use.

Image
User avatar
safihre
Administrator
Administrator
Posts: 5338
Joined: April 30th, 2015, 7:35 am
Contact:

Re: SabNZB doesn't release it memory on RPi3b [SabNZB 2.3.9]

Post by safihre »

I am sorry but I can't really spend time on investigating this for the Python 2 version(s)...
Things we store in memory have changed a lot over the years where we choose to keep things more in memory to aid performance, by design.
Python itself might also be the problem, but it's only worth investigating for the Python 3 version.
If you like our support, check our special newsserver deal or donate at: https://sabnzbd.org/donate
RomMon
Newbie
Newbie
Posts: 6
Joined: December 24th, 2020, 9:57 pm

Re: SabNZB doesn't release it memory on RPi3b [SabNZB 2.3.9]

Post by RomMon »

Hi Sahihre,
Thanks for your reply! And yes that is fine.
Also indeed could be an issue external to SABnzb, and start to suspect something in that direction more and more
I see memory misbehavior with Kodi, SABnzb, and now also Plex Media Server on the RPi3 with LibreELEC 9.
The behavior of SABnzb-2 is far more obvious than the others. The behavior of SABnzb-1.1.1 is more comparable with Kodi and PMS.

Just wanted to update my findings because I'm not alone 'stuck' at Python 2 for a few more months.
Kodi v19 release (which switch to Python 3) is expected 'early 2021' with LibreELEC 10 hopefully following soon.
Post Reply