Connecting to nzbs(dot)org but not downloading files

[bugmenot]

Here is the error with 0.5.0 i'll install RC2 and get the error with nzbs.org in a few

2010-04-09 21:59:52,970::DEBUG::[rss:248] Running feedparser on http://tvnzbrss.com/feedgen.php?id=74123842164
2010-04-09 21:59:53,213::INFO::[__init__:753] Restarting crashed urlgrabber
2010-04-09 21:59:53,276::DEBUG::[rss:250] Done parsing http://tvnzbrss.com/feedgen.php?id=74123842164
2010-04-09 21:59:53,276::INFO::[rss:260] RSS Feed was empty: http://tvnzbrss.com/feedgen.php?id=74123842164
2010-04-09 22:00:23,276::INFO::[__init__:643] Saving data for rss_data.sab in C:\Users\XXXXX\AppData\Local\sabnzbd\cache\rss_data.sab
2010-04-09 22:00:26,213::INFO::[__init__:753] Restarting crashed urlgrabber

[bugmenot]

Here's RC2 with nzbs.org

Code: Select all

2010-04-10 09:01:11,490::INFO::[__init__:379] Fetching http://nzbs.org/index.php?action=getnzb&nzbid=329259&i=44113&h=FOOBAR
2010-04-10 09:01:11,493::INFO::[nzbqueue:92] Saving queue
2010-04-10 09:01:11,493::INFO::[__init__:641] Saving data for SABnzbd_nzo_exj_22 in C:\Users\XXXXX\AppData\Local\sabnzbd\cache\SABnzbd_nzo_exj_22
2010-04-10 09:01:11,496::INFO::[__init__:641] Saving data for queue9.sab in C:\Users\XXXXX\AppData\Local\sabnzbd\cache\queue9.sab
2010-04-10 09:01:21,413::DEBUG::[articlecache:122] Purgable articles -> []
2010-04-10 09:01:21,414::INFO::[__init__:693] C:\Users\XXXXX\AppData\Local\sabnzbd\cache\SABnzbd_nzo_exj_22 removed
2010-04-10 09:01:21,414::INFO::[nzbqueue:92] Saving queue
2010-04-10 09:01:21,414::INFO::[__init__:641] Saving data for queue9.sab in C:\Users\XXXXX\AppData\Local\sabnzbd\cache\queue9.sab
2010-04-10 09:01:22,733::INFO::[__init__:751] Restarting crashed urlgrabber
2010-04-10 09:01:25,091::DEBUG::[rss:247] Running feedparser on http://nzbs.org/rss.php?action=mynzbs&i=44113&h=FOOBAR&dl=1
2010-04-10 09:01:25,311::DEBUG::[rss:249] Done parsing http://nzbs.org/rss.php?action=mynzbs&i=44113&h=FOOBAR&dl=1
2010-04-10 09:01:25,311::INFO::[rss:259] RSS Feed was empty: http://nzbs.org/rss.php?action=mynzbs&i=44113&h=FOOBAR&dl=1
2010-04-10 09:01:55,311::INFO::[__init__:641] Saving data for rss_data.sab in C:\Users\XXXXX\AppData\Local\sabnzbd\cache\rss_data.sab
2010-04-10 09:01:55,733::INFO::[__init__:751] Restarting crashed urlgrabber
2010-04-10 09:02:04,888::DEBUG::[rss:247] Running feedparser on http://nzbs.org/rss.php?action=mynzbs&i=44113&h=FOOBAR&dl=1
2010-04-10 09:02:05,140::DEBUG::[rss:249] Done parsing http://nzbs.org/rss.php?action=mynzbs&i=44113&h=FOOBAR&dl=1
2010-04-10 09:02:05,141::DEBUG::[rss:296] Trying title The.F00BAR
2010-04-10 09:02:05,141::DEBUG::[rss:305] Filter matched on rule 0
2010-04-10 09:02:05,141::INFO::[rss:456] Adding http://nzbs.org/index.php?action=getnzb&nzbid=328982&i=44113&h=FOOBAR&from=mynzbs (The.Bounty.Hunter.2010.PROPER.R5.LINE.XviD-iLG) to queue
2010-04-10 09:02:05,141::INFO::[__init__:379] Fetching http://nzbs.org/index.php?action=getnzb&nzbid=328982&i=44113&h=FOOBAR&from=mynzbs
2010-04-10 09:02:05,144::INFO::[nzbqueue:92] Saving queue
2010-04-10 09:02:05,144::INFO::[__init__:641] Saving data for SABnzbd_nzo_j8xd5k in C:\Users\XXXXX\AppData\Local\sabnzbd\cache\SABnzbd_nzo_j8xd5k
2010-04-10 09:02:05,145::INFO::[__init__:641] Saving data for queue9.sab in C:\Users\XXXXX\AppData\Local\sabnzbd\cache\queue9.sab
2010-04-10 09:02:05,148::DEBUG::[rss:296] Trying title Spartacus.Blood.and.Sand.S01E12.REAL.PROPER.720p.HDTV.X264-DIMENSION
2010-04-10 09:02:05,148::DEBUG::[rss:305] Filter matched on rule 0
2010-04-10 09:02:05,150::INFO::[rss:456] Adding http://nzbs.org/index.php?action=getnzb&nzbid=329275&i=44113&h=FOOBAR&from=mynzbs (Spartacus.Blood.and.Sand.S01E12.REAL.PROPER.720p.HDTV.X264-DIMENSION) to queue
2010-04-10 09:02:05,151::INFO::[__init__:379] Fetching http://nzbs.org/index.php?action=getnzb&nzbid=329275&i=44113&h=FOOBAR&from=mynzbs
2010-04-10 09:02:05,153::INFO::[nzbqueue:92] Saving queue
2010-04-10 09:02:05,153::INFO::[__init__:641] Saving data for SABnzbd_nzo_j8xd5k in C:\Users\XXXXX\AppData\Local\sabnzbd\cache\SABnzbd_nzo_j8xd5k
2010-04-10 09:02:05,154::INFO::[__init__:641] Saving data for SABnzbd_nzo_ey3r-p in C:\Users\XXXXX\AppData\Local\sabnzbd\cache\SABnzbd_nzo_ey3r-p
2010-04-10 09:02:05,155::INFO::[__init__:641] Saving data for queue9.sab in C:\Users\XXXXX\AppData\Local\sabnzbd\cache\queue9.sab
2010-04-10 09:02:28,734::INFO::[__init__:751] Restarting crashed urlgrabber
2010-04-10 09:03:01,736::INFO::[__init__:751] Restarting crashed urlgrabber
2010-04-10 09:03:34,736::INFO::[__init__:751] Restarting crashed urlgrabber

it seems to continually say "Restarting crashed urlgrabber"

[shypike]

That's at least a clue.
For 0.5.1 Final I already added some extra protection.
It crashed on unexpected data coming from nzbmatrix.com.
Possibly there's some issue when handling problems with nzbs.org as well.
I'll look into that.
BTW: there will be no 0.5.1 release.
What we released to the test group contained new problems.
There will soon be a 0.5.2RC1
Hopefully I can solve this issue too.

[bugmenot]

Maybe this will help also... it doesn't just fail when fetching from a rss feed. If I manually add an NZB url it fails too

Code: Select all

2010-04-10 11:28:46,443::INFO::[__init__:379] Fetching http://nzbs.org/index.php_action=getnzb&nzbid=329372&i=FOOBAR
2010-04-10 11:28:46,444::INFO::[nzbqueue:92] Saving queue
2010-04-10 11:28:46,446::INFO::[__init__:641] Saving data for SABnzbd_nzo_fwexhv in C:\Users\XXX\AppData\Local\sabnzbd\cache\SABnzbd_nzo_fwexhv
2010-04-10 11:28:46,447::INFO::[__init__:641] Saving data for queue9.sab in C:\Users\XXX\AppData\Local\sabnzbd\cache\queue9.sab
2010-04-10 11:28:47,078::INFO::[__init__:751] Restarting crashed urlgrabber

It's probably the urlgrabber not the feed parser.

[shypike]

I know it's the urlgrabber that crashes,
it's finding out why which is the problem.

[bugmenot]

Does it make a difference that I have python installed for other purposes or does sab use it's own python implementation?

I use imdbpy in my post processing scripts. I had to install a bunch of other url/xml parsers/libraries to get imbdpy to work properly.

[bugmenot]

Hey... I fixed it.

Totally uninstall SAB and uninstall your logs/history/etc... but of course backup your sabnzbd.ini

reinstall and copy back your ini and it's all working now

[shypike]

Sounds like corruption of SABnzbd's data structures.
What you did is easier to do by starting up SABnzbd once with the --clean parameter.

[timcdn]

I too did this, it worked!

For a day...

Now I am back to "Trying to fetch"

[timcdn]

But, if I remove the tvnzb rss feed the nzbs(dot)org feeds work fine.

Strange.

[shypike]

Possibly the current tvnzb problems either hold up of crash the process
that's responsible for downloading nzb files.
Given the state tvnzb is in now, you should consider removing it.
Meanwhile, I'm still looking at what the issue inside SABnzbd could be.

[bugmenot]

Arrgghh, mine is choking again too... this time with nzbs.org only.

It sucks cuz my bro's box works perfectly, which makes me think it's something on my box causing this.

[bugmenot]

When it gets stuck at "trying to fetch http://nzbs.org/index.php_action=getnzb ... rom=mynzbs"

Shouldn't it be http://nzbs.org/index.php?action=getnzb ... rom=mynzbs

Why is the ? replaced with a _

[shypike]

Again: the replacement of '?' with '_' is just a cosmetic issue, this is not sent to nzbs.org.
So far I have not been able to reproduce any problem with nzbs.org.

[bugmenot]

How does the urlfetcher work? if the url responds with a 404 what happens? or if the url is not a valid nzb what happens?