Sabnzbd crashes (SSL ?)

[hyperbart]

Jeah I know it will work, my old physical server worked well for ages... But I wanna know what went wrong here...
I think in the end I'm going to reïnstall my whole VM...

[sander]

Jeah I know it will work, my old physical server worked well for ages... But I wanna know what went wrong here...
I think in the end I'm going to reïnstall my whole VM...

Even if you want to find out what went wrong, a second, fresh VM with Ubuntu is the best thing to do: checking whether SAB works there is the first step in your analysis. If SAB works on your fresh Ubuntu-VM (which I certainly expect), from there you can start pinpointing the problem by comparing, and by adding the software like you did on your first VM. At the moment your second VM's SAB goes 'wrong', you've found the conflicting software.

Oh, PS: You know 0.6.1 is out?



BTW: I think it's better to post your error text as a text (not a link / picture), so that Google will find it:

Code: Select all

ERROR DURING SCHEDULER EXECUTION list index out of range
Traceback (most recent call last):
File "/usr/share/sabnzbdplus/sabnzbd/utils/kronos.py", line 277, in _run
self.sched.run()
File "/usr/lib/python2.6/sched.py", line 111, in run
delayfunc(time - now)
File "/usr/share/sabnzbdplus/sabnzbd/utils/kronos.py", line 104, in __delayfunc
toptime = self._getqueuetoptime()
File "/usr/share/sabnzbdplus/sabnzbd/utils/kronos.py", line 263, in _getqueuetoptime
return self.sched._queue[0].time
IndexError: list index out of range
 

[jcfp]

BTW: I think it's better to post your error text as a text (not a link / picture), so that Google will find it:

Don't forget the shitty part:

Code: Select all

Fatal Python error: GC object already tracked

These kind of errors are the result of problems in code written in C, like (guess what) pyopenssl.

[hyperbart]

I reinstalled everything (OS, Sabnzbd+, CouchPotato, Sickbeard, Periscope) and this night (with again a queue of about 4-6 downloads, 4 of them paused, the rest downloading) and my schedule set to genereally resume sabnzbd at 0.30, Sabnzbd stopped working during the night...

Should I try without SSL then?

[sander]

I reinstalled everything (OS, Sabnzbd+, CouchPotato, Sickbeard, Periscope) and this night (with again a queue of about 4-6 downloads, 4 of them paused, the rest downloading) and my schedule set to genereally resume sabnzbd at 0.30, Sabnzbd stopped working during the night...

Should I try without SSL then?

SAB stopped working, or crashed?

... post the output of SAB's stdout / stderr ...

[hyperbart]

I reinstalled everything (OS, Sabnzbd+, CouchPotato, Sickbeard, Periscope) and this night (with again a queue of about 4-6 downloads, 4 of them paused, the rest downloading) and my schedule set to genereally resume sabnzbd at 0.30, Sabnzbd stopped working during the night...

Should I try without SSL then?

SAB stopped working, or crashed?

How do I know the difference? I had another kind of cosmetic error. With the previous VM if I surfed to my Sab, I got some error in Firefox about a session reinit, now it just says that the site I'm trying to visit is unreachable (like something is not running on it).

When  I did an

"sudo /etc/init.d/sabnzbd status"

It said "not running"

... post the output of SAB's stdout / stderr ...

Can you help me a little bit with that?

[hyperbart]

Someone?

[sander]

start sabnzbdplus (or SABnzbd) from the command line (=terminal). Let it run. If it stops / crashes, post the output from the terminal here in this forum.

[hyperbart]

Hi

Sab crashed again this time (after working for a while).

I always started it as: "/etc/init.d/sabnzbdplus start".

Can i check other logs (or recheck some things?) or start it in an other way? Sander told me something about starting it from terminal, but that's what i'm doing, right? Or do you mean something else?

[sander]

Open a teriminal, and type "/usr/bin/sabnzbdplus" ... does that start sabnzbd?

BTW: which version of SABnzbd are you using?

[hyperbart]

Hi Sander, did some testing in the meanwhile after the holidays and everything, did a "/usr/bin/sabnzbdplus" and got the output... Everything worked fine for a couple of hours, I started some downloads (I can download unlimited now...) and my log ended with this and sab crashed:

Code: Select all

2011-08-30 20:08:46,778::INFO::[downloader:229] Post-processing finished, resuming download
2011-08-30 20:09:07,574::INFO::[assembler:85] Decoding /home/bart/downloads/incomplete/DENAAMVANMIJNDOWNLOAD.part044.rar yenc
2011-08-30 20:10:19,209::INFO::[__init__:833] Saving data for totals9.sab in /home/bart/.sabnzbd/admin/totals9.sab
2011-08-30 20:10:19,210::INFO::[assembler:85] Decoding /home/bart/downloads/incomplete/DENAAMVANMIJNDOWNLOAD.part045.rar yenc
2011-08-30 20:11:26,266::INFO::[assembler:85] Decoding /home/bart/downloads/incomplete/DENAAMVANMIJNDOWNLOAD.part046.rar yenc
2011-08-30 20:12:33,031::INFO::[__init__:833] Saving data for totals9.sab in /home/bart/.sabnzbd/admin/totals9.sab
2011-08-30 20:12:33,032::INFO::[assembler:85] Decoding /home/bart/downloads/incomplete/DENAAMVANMIJNDOWNLOAD.part047.rar yenc
2011-08-30 20:13:40,815::INFO::[assembler:85] Decoding /home/bart/downloads/incomplete/DENAAMVANMIJNDOWNLOAD.part048.rar yenc
2011-08-30 20:14:46,625::INFO::[__init__:833] Saving data for totals9.sab in /home/bart/.sabnzbd/admin/totals9.sab
2011-08-30 20:14:46,626::INFO::[assembler:85] Decoding /home/bart/downloads/incomplete/DENAAMVANMIJNDOWNLOAD.part049.rar yenc
2011-08-30 20:15:53,805::INFO::[assembler:85] Decoding /home/bart/downloads/incomplete/DENAAMVANMIJNDOWNLOAD.part050.rar yenc
2011-08-30 20:17:08,444::INFO::[__init__:833] Saving data for totals9.sab in /home/bart/.sabnzbd/admin/totals9.sab
2011-08-30 20:17:08,445::INFO::[assembler:85] Decoding /home/bart/downloads/incomplete/DENAAMVANMIJNDOWNLOAD.part051.rar yenc
2011-08-30 20:18:08,084::INFO::[assembler:85] Decoding /home/bart/downloads/incomplete/DENAAMVANMIJNDOWNLOAD.part052.rar yenc
2011-08-30 20:19:15,908::INFO::[__init__:833] Saving data for totals9.sab in /home/bart/.sabnzbd/admin/totals9.sab
2011-08-30 20:19:15,909::INFO::[assembler:85] Decoding /home/bart/downloads/incomplete/DENAAMVANMIJNDOWNLOAD.part053.rar yenc
2011-08-30 20:20:22,722::INFO::[assembler:85] Decoding /home/bart/downloads/incomplete/DENAAMVANMIJNDOWNLOAD.part054.rar yenc
2011-08-30 20:21:30,026::INFO::[__init__:833] Saving data for totals9.sab in /home/bart/.sabnzbd/admin/totals9.sab
2011-08-30 20:21:30,027::INFO::[assembler:85] Decoding /home/bart/downloads/incomplete/DENAAMVANMIJNDOWNLOAD.part055.rar yenc
2011-08-30 20:22:36,997::INFO::[assembler:85] Decoding /home/bart/downloads/incomplete/DENAAMVANMIJNDOWNLOAD.part056.rar yenc
2011-08-30 20:23:44,560::INFO::[__init__:833] Saving data for totals9.sab in /home/bart/.sabnzbd/admin/totals9.sab
2011-08-30 20:23:44,560::INFO::[assembler:85] Decoding /home/bart/downloads/incomplete/DENAAMVANMIJNDOWNLOAD.part057.rar yenc
2011-08-30 20:24:51,267::INFO::[assembler:85] Decoding /home/bart/downloads/incomplete/DENAAMVANMIJNDOWNLOAD.part058.rar yenc
2011-08-30 20:25:58,153::INFO::[__init__:833] Saving data for totals9.sab in /home/bart/.sabnzbd/admin/totals9.sab
2011-08-30 20:25:58,153::INFO::[assembler:85] Decoding /home/bart/downloads/incomplete/DENAAMVANMIJNDOWNLOAD.part059.rar yenc
2011-08-30 20:27:05,008::INFO::[assembler:85] Decoding /home/bart/downloads/incomplete/DENAAMVANMIJNDOWNLOAD.part060.rar yenc
2011-08-30 20:28:12,261::INFO::[__init__:833] Saving data for totals9.sab in /home/bart/.sabnzbd/admin/totals9.sab
2011-08-30 20:28:12,262::INFO::[assembler:85] Decoding /home/bart/downloads/incomplete/DENAAMVANMIJNDOWNLOAD.part061.rar yenc
2011-08-30 20:29:19,674::INFO::[assembler:85] Decoding /home/bart/downloads/incomplete/DENAAMVANMIJNDOWNLOAD.part062.rar yenc
2011-08-30 20:30:28,326::INFO::[__init__:833] Saving data for totals9.sab in /home/bart/.sabnzbd/admin/totals9.sab
2011-08-30 20:30:28,327::INFO::[assembler:85] Decoding /home/bart/downloads/incomplete/DENAAMVANMIJNDOWNLOAD.part063.rar yenc
2011-08-30 20:31:35,107::INFO::[assembler:85] Decoding /home/bart/downloads/incomplete/DENAAMVANMIJNDOWNLOAD.part064.rar yenc
2011-08-30 20:32:48,455::INFO::[__init__:833] Saving data for totals9.sab in /home/bart/.sabnzbd/admin/totals9.sab
2011-08-30 20:32:48,457::INFO::[assembler:85] Decoding /home/bart/downloads/incomplete/DENAAMVANMIJNDOWNLOAD.part065.rar yenc
2011-08-30 20:33:54,366::INFO::[assembler:85] Decoding /home/bart/downloads/incomplete/DENAAMVANMIJNDOWNLOAD.part066.rar yenc
2011-08-30 20:35:01,982::INFO::[__init__:833] Saving data for totals9.sab in /home/bart/.sabnzbd/admin/totals9.sab
2011-08-30 20:35:01,983::INFO::[assembler:85] Decoding /home/bart/downloads/incomplete/DENAAMVANMIJNDOWNLOAD.part067.rar yenc
2011-08-30 20:36:09,444::INFO::[assembler:85] Decoding /home/bart/downloads/incomplete/DENAAMVANMIJNDOWNLOAD.part068.rar yenc
2011-08-30 20:37:17,978::INFO::[__init__:833] Saving data for totals9.sab in /home/bart/.sabnzbd/admin/totals9.sab
2011-08-30 20:37:17,980::INFO::[assembler:85] Decoding /home/bart/downloads/incomplete/DENAAMVANMIJNDOWNLOAD.part069.rar yenc
2011-08-30 20:38:25,785::INFO::[assembler:85] Decoding /home/bart/downloads/incomplete/DENAAMVANMIJNDOWNLOAD.part070.rar yenc
2011-08-30 20:39:35,236::INFO::[__init__:833] Saving data for totals9.sab in /home/bart/.sabnzbd/admin/totals9.sab
2011-08-30 20:39:35,237::INFO::[assembler:85] Decoding /home/bart/downloads/incomplete/DENAAMVANMIJNDOWNLOAD.part071.rar yenc
2011-08-30 20:40:42,295::INFO::[assembler:85] Decoding /home/bart/downloads/incomplete/DENAAMVANMIJNDOWNLOAD.part072.rar yenc
2011-08-30 20:41:51,281::INFO::[__init__:833] Saving data for totals9.sab in /home/bart/.sabnzbd/admin/totals9.sab
2011-08-30 20:41:51,282::INFO::[assembler:85] Decoding /home/bart/downloads/incomplete/DENAAMVANMIJNDOWNLOAD.part073.rar yenc
Segmentation fault

[sander]

Ah, a Segmentation fault. Great. ;-)

The good news: I don't think it's a SABnzbd itself; a python script can't cause a segfault AFAIK.

So find out which program is causing the segfault: you have to let it create a core dump file. Open a terminal, type "ulimit -c unlimited", then start SABnzbd. At the moment it crashes, it should show a file "core" in the directory. I'm not sure in which directory: in the working directory, or in the SABnzbd.py directory. So make sure it's writable. Best way: download SABnzbd*gz, unpack it in your home directory, and start SABnzbd from there, as that directory is writable for you.

As soon as you get the core file, there must be a good way to view it (gdb?), but I can't find it. So just use "strings core | head" , and look in that page: it should give the name of the crashing program. It could be python, or unrar, or ...

As soon as you find the segfaulting program, ... well, I'm not sure ... The problem could be the program, your install of Linux, or problematic memory. So maybe best to first run memtest86 on your system for a few hours to check the stability of your system.

[shypike]

Python can cause segmentation faults if there's a bug in the Python runtime libraries, the yEnc module or the OpenSSL libraries.
None of these are under our control.

[hyperbart]

Ok, switching to Dutch now, since I noticed you are Dutch-speaking too...

En er is geen enkele manier om dit probleem op te vangen? Kan ik die Python runtime libraries of de yEnc-module updaten?

Sabnzbd draait bij mij in een VM op ESXi, kan hier ook een probleem mee zijn? Als ik mijn setup uitvoer op een fysieke machine uitvoer, dan zou ik hetzelfde probleem moeten hebben?

Oeps, Sander, ik heb even over je post gelezen, ik doe op dit moment wat je voorstelde...

[sander]

Ik heb nog nooit van dit probleem gehoord in combinatie met SABnzbd, dus ik verdenk je systeem ervan. Draai SAB maar op een fysieke machine, dan moet het gewoon werken. En draai sowieso memtest86 op die hardware waarop SAB een probleem toont ...