Intermittent crashing with massive error log

[pdenner]

I've got SAB running on my Raspberry Pi and it's more or less been working great, but every once in a while it seems that a failed download crashes it – when I go realize nothing downloading, I'll try "sudo service sabnzbdplus status" and it'll show "active (exited)" so I restart it and it'll throw 20 or so error warnings in the UI when it's finished starting.

Tried to take a look at sabnzbd.error.log and realized the thing is over 7 gigs which seems massive...I can't even really take a look at it to debug with it that so huge so not sure exactly where to go from here. Any help would be appreciated!

[sander]

7 gigs ... ? Wow! That is a really bad sign.

worth trying on your Raspi:

Code: Select all

tail -40 ~/.sabnzbd/logs/sabnzbd.error.log

Post the output here

Or, maybe easier / faster:

(re)move sabnzbd.error.log
start sabnzbd
wait until sabnzbd.error.log has content again

[safihre]

And what version of SABnzbd are you using?

[pdenner]

Thanks all – I'm running Sab v2.3.8.

I can't seem to paste in the output of that tail command as I'm a new user and it seemed to throw a false positive for posting links even though there weren't any, so I put it in a pastebin here see below, was able to paste it in

[pdenner]

I should also note that that was after a fresh service restart. Next time I notice it down, I'll retry that command to see if it can better show what's up.

[pdenner]

Just crashed again, here's the output (no diff between this and previously but now I have the ability to "paste links"):

Code: Select all

????A??
??R?
????+?
)??ƒ

??Fr3Ř
iS?s?TF
D?ͭ????
??x+??
?2V?b\??
Wme??.??
%?~Exception in thread Thread-508:
Traceback (most recent call last):
  File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
    self.run()
  File "/usr/share/sabnzbdplus/sabnzbd/directunpacker.py", line 171, in run
    char = self.active_instance.stdout.read(1)
ValueError: I/O operation on closed file

Exception in thread Thread-8:
Traceback (most recent call last):
  File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
    self.run()
  File "/usr/share/sabnzbdplus/sabnzbd/assembler.py", line 140, in run
    nzo.add_to_direct_unpacker(nzf)
  File "/usr/share/sabnzbdplus/sabnzbd/nzbstuff.py", line 1434, in add_to_direct_unpacker
    self.direct_unpacker.add(nzf)
  File "/usr/share/sabnzbdplus/sabnzbd/decorators.py", line 36, in call_func
    return f(*args, **kw)
  File "/usr/share/sabnzbdplus/sabnzbd/directunpacker.py", line 147, in add
    self.create_unrar_instance()
  File "/usr/share/sabnzbdplus/sabnzbd/decorators.py", line 36, in call_func
    return f(*args, **kw)
  File "/usr/share/sabnzbdplus/sabnzbd/directunpacker.py", line 374, in create_unrar_instance
    startupinfo=stup, creationflags=creationflags)
  File "/usr/lib/python2.7/subprocess.py", line 390, in __init__
    errread, errwrite)
  File "/usr/lib/python2.7/subprocess.py", line 916, in _execute_child
    self.pid = os.fork()
OSError: [Errno 12] Cannot allocate memory

[sander]

From your log:

Code: Select all

self.pid = os.fork()
OSError: [Errno 12] Cannot allocate memory

... so a memory problem. Which you can expect on a Raspi with it's low RAM.

Check: do you have swap enabled? You should. If needed, it will make the system slower, but the process will keep working. Without swap, and you need more memory, processes will crash.

Check with

Code: Select all

free -m

On my own ARM-board:

Code: Select all

$ free -m
              total        used        free      shared  buff/cache   available
Mem:            494         407          51           4          35          73
Swap:           247         247           0

So, yes, I have swap

[pdenner]

Think I do too, from my output here:

Code: Select all

$ free -m
              total        used        free      shared  buff/cache   available
Mem:            927         491         337          17          98         369
Swap:            99          93           6

Should I increase that (I have a 32gb SD card for my Pi)/how do I do that? Does it not seem odd though that it's when a download fails – each time I restart Sab after the crash it shows something like "Error importing <NzbFile: filename=XXXXXX.rar, type=None>"? And also the massive error log?

[sander]

1GB RAM is nice. Unless you're running X Windowing on your raspi. Do you do that? If so, do you need it?

swap is a bit little. Google how to increase it.

Parallel track

stop sabnzbd
remove sabnzbd.error.log
start sabnzbd
wait until sabnzbd.error.log has content again

[pdenner]

Had no idea what X Windowing is until I just Googled it and from what I can tell...no, I don't need it since my raspi is completely headless. Not sure how best to check if I have any X Windowing on there/how to best remove?

Thanks – upped it to 1024 but lmk if you think that's too much/little.

Done and done. Will update here if/when there's another crash with the output of sabnzbd.error.log.

[sander]

Check if X is running:

Code: Select all

ps -e | grep X 

On my Ubuntu:

Code: Select all

$ ps -e | grep X 
 1613 tty1     00:00:00 Xwayland
 1937 tty2     00:21:03 Xorg

Anyway:

Let's wait if you get errors again.

[pdenner]

I got nothing from that – doesn't seem like X is running.

I do get a bunch of errors like this fairly often though...



Apparently, the sab error log has now blown up to 800+ mb in the short time since I deleted it yesterday...this is what I get from the end, seems like a bunch of gibberish?

Code: Select all

ݻ˝-u?q
?>f?Щ?k
?o2[:
?.2Z\?6?
+?у?\?
????B?r?
?<????
.?{?2??
A¼M?K?2
?QE?^
??{rPw?
Y??,??
pvt0?
????Dғ
?!c6ߩ)?
3_???
?@{??U?%
?i?gOuJ?
u?????0
/+ԉ{j(
????!ZDP
?w?6?T?u
?+q?\??#
?K?3?.?
$?,7
?
к?Z+?x 
??w???A
i%@q?zO
e?;?-?h
)?;?,C?

Pt&^x?h
??:?PAR2
PKT?
r.??
?j???}?

??C?ȑ
?kqN???k
=??9PAR 

[sander]

That looks you're 'feeding' rar files as NZB files. If true, that's wrong and bad.

Did you mix up Temp or Complete directory, and Watch directory?

If you can't answer that question, the most easy way is:

stop sabnzbd
delete sabnzbd.ini (you will lose all settings ... the good settings and the bad settings)
delete sabnzbd.error.log
start sabnzbd ... that should give the wizard. ONLY fill out your newsserver, and you should be OK

[pdenner]

See I don't think I have them mixed up but maybe I do:


Tbh I don't think I've ever used the Watch files because all my NZBs are are getting added from Sonarr/Radarr, is it a setting maybe on that side?

[safihre]

Seems your settings are correct.
Just to be 100% sure: have you set any paths in Config > Categories?

In any case, maybe it's good to first try this:
https://sabnzbd.org/wiki/faq#freshstart

Just use 1 server for a bit and only basic settings, does the downloading work fine? Then you can start adding back settings to see where it breaks.