Rss Stopped Working

[supertom44]

Hi all.

I have had my RSS's set up for a while now and its been working great until recently.

For some reason its not adding the new shows to the queue.

If I preview the feed then it finds the new show but for some reason it doesn't automatically add it to the queue.

The nzbs are generated from nzbmatrix and all user information is correct.

I found this in the error log, not sure if its related to my problem.

ERROR DURING TASK EXECUTION dictionary changed size during iteration
Traceback (most recent call last):
  File "/boot/custom/usr/share/packages/sabnzbd/sabnzbd/utils/kronos.py", line 301, in __call__
    self.execute()
  File "/boot/custom/usr/share/packages/sabnzbd/sabnzbd/utils/kronos.py", line 313, in execute
    self.action(*self.args, **self.kw)
  File "/boot/custom/usr/share/packages/sabnzbd/sabnzbd/rss.py", line 77, in run_method
    return __RSS.run()
  File "/boot/custom/usr/share/packages/sabnzbd/sabnzbd/rss.py", line 378, in run
    for feed in feeds:
RuntimeError: dictionary changed size during iteration

[supertom44]

I restarted Sab and now it added them, just gotta wait for new release to make sure its working.

[shypike]

The error message you saw looks like a bug in SABnzbd,
which could be triggered by a corrupt rss_data.sab.
Preview never downloads anything, you need to click "download" for that.
You can stop SABnzbd, remove cache/rss_data.sab and start again.
This will make all RSS feeds look like "new", so be aware
that SABnzbd will not download anything until it sees
new NZBs in subsequent scheduled runs.

I'll look into the potential bug.

[supertom44]

Cheers.

I know preview doesn't download anything, I only used it to see if the new content was added to the rss.

[hikaricore]

I had this exact issue a couple days ago and removing rss_data.sab did the trick.  ^_^

[TinCanFury]

I've been having this issue as well, I will have to try this. I'll let you know!

[hikaricore]

**update** Nevermind, this fixes the issue for a time but after awhile rss stops downloading again even if new episodes are up.  >.>

[shypike]

When new episodes stop coming up,
you can check if the problem is with SABnzbd or the RSS site.
Just enter the RSS feed in the browser's address bar.
You will get a rendering of the feed content which you can easily check for new episodes.
If the episodes are present, but SABnzbd doesn't see them, please contact me.
That may enable me to find the true issue.

[hikaricore]

My feeds are working fine as I can view them externally, preview them, and see the new items listed but sabnzb doesn't download them.
At 6pm an episode of a show from an rss feed downloads, everything completes normally, over the next 4-5 hours 7 other items appear on my feeds and sabnzb does nothing.  There are no entries in my log file until 2am when I activate the items for download manually.  :/
If I remove the rss_data file and new content is added to the feeds it will download, but after awhile it stops and I see nothing in the log indicating why.
If you'd like I can still post a log file here but I don't know what good it will do since literally nothing is occurring.

I'm going to purge all my feeds and re-add them to see if the problem clears up, I'll let you know if I figure anything out.
Atleast 1 of my feeds contains the special character × I'll also leave that feed unadded just to make sure that a non-standard char isn't part of the problem.

[shypike]

To get things clear.
What you claim is that the periodic scan of the feeds stops occurring?
It happens for all the feeds?
Is is (temporarily) solved by clearing the rss_data.sab file?

Checklist (rather obvious, but just to be sure):
- The feeds are enabled (checkbox upper left corner)
- When the scanning stops, the feeds are not disabled (because that could be a bug in itself)?
- When you click preview, the new jobs do show up?

Remark about the last point.
Clicking preview interferes with auto-scan in the sense that any new job seen for the first
time in a preview, will not be downloaded automatically.

[hikaricore]

To get things clear.
What you claim is that the periodic scan of the feeds stops occurring?
It happens for all the feeds?
Is is (temporarily) solved by clearing the rss_data.sab file?

Seems to be what's occurring but with no indication in the logs of anything it's hard to say.
It happens for all of my feeds and it is solved by stopping the process, removing rssdata, and restarting it.
Of course this only work for new items that are added to the rss after this point but it works none-the-less.

Checklist (rather obvious, but just to be sure):
- The feeds are enabled (checkbox upper left corner)  Yes
- When the scanning stops, the feeds are not disabled (because that could be a bug in itself)?  The feeds never disable that I've seen other than when I disable them.
- When you click preview, the new jobs do show up?  When I click preview news jobs do show up

I've not seen any change in the feeds themselves while this occurs, they're enabled when I leave the house and still enabled when i come home.
I can check my rss feeds externally and they show new content has been listed for hours.

Remark about the last point.
Clicking preview interferes with auto-scan in the sense that any new job seen for the first
time in a preview, will not be downloaded automatically.

Let me clarify that I understand what you're saying.
At any point in between scans I click preview, any item that shows here even without an asterisk next to it won't download?
I am aware that things with an asterisk will not download as that's always been that way, but new items should do so no matter what I click and always have.
This has not been the case in the past and I'm pretty sure I'm misunderstanding your statement there.

Btw sorry for threadjacking this, I originally thought my issue was solved with the mentioned fix. >.>
As I said before I've purged my rss feeds and logs and will be posting back any other info I find after this little experiment.
If need be I will refrain from clicking preview on anything just incase.

[TinCanFury]

Since this exact same thing is happening to me I'll respond as well...

To get things clear.
What you claim is that the periodic scan of the feeds stops occurring?

Yes, exactly. Clicking "Preview" on the feed shows the new "hits" that should be downloading, and when the scanner runs properly it picks up, but SAB does not automatically download them.

It happens for all the feeds?

Yes.

Is is (temporarily) solved by clearing the rss_data.sab file?

Yes.

Checklist (rather obvious, but just to be sure):
- The feeds are enabled (checkbox upper left corner)

Yups

- When the scanning stops, the feeds are not disabled (because that could be a bug in itself)?

nope, the feeds always show the checkbox for being enabled. Whether this actually means anything "behind the scenes" I don't know.

- When you click preview, the new jobs do show up?

Yes

Remark about the last point.
Clicking preview interferes with auto-scan in the sense that any new job seen for the first
time in a preview, will not be downloaded automatically.

now THAT is poor design decision. When the RSS feed doesn't download the user clicks "Preview" to make sure the RSS feed that SAB is linked to has the NZB as a hit. But doing so also prevents SAB from downloading automatically. How does this process make any sense? Preview should be independent of whether the items get downloaded.

I'll also add that occasionally I've gotten the RSS scan to work by changing the interval, shutting down SAB via the init script, then starting SAB via the init script. So I'll change from 15minutes to 20, shutdown, startup, feeds get added.

When I tried the fix mentioned above, I did this first, luckily it worked, so I was able to download the missed hits, then I stopped SAB deleted the file and started again. since then it's picked up the new hits. It's been two days. but I haven't checked since about 8pm last night.

[shypike]

There have been reports about a failing scheduler before and I have never been able to reproduce them.
That the scanning starts again after changing the interval makes sense, because each change in the scheduler
requires a restart of that task.
The odd thing is that a guardian task runs too, which will cause the scheduler to restart when the
guardian misses a few beats.
Given that your problem is reproducible, I would like to keep in contact to solve this blasted problem permanently.
I'll get back to you, possible with a patched release adding diagnostics.

now THAT is poor design decision. When the RSS feed doesn't download the user clicks "Preview" to make sure the RSS feed that SAB is linked to has the NZB as a hit. But doing so also prevents SAB from downloading automatically. How does this process make any sense? Preview should be independent of whether the items get downloaded.

Yes and no. Preview is just that, a preview. It shouldn't start downloading stuff while you're still fine-tuning your filters.
You're supposed to use "Force download" to download. But I agree, it's not very intuitive.
BTW: we're overhauling the RSS UI for release 0.6.0, so this will not be a real issue any more.

[TinCanFury]

There have been reports about a failing scheduler before and I have never been able to reproduce them.
That the scanning starts again after changing the interval makes sense, because each change in the scheduler
requires a restart of that task.
The odd thing is that a guardian task runs too, which will cause the scheduler to restart when the
guardian misses a few beats.
Given that your problem is reproducible, I would like to keep in contact to solve this blasted problem permanently.
I'll get back to you, possible with a patched release adding diagnostics.

I have to restart SAB after changing the interval. just changing the interval does nothing. just restarting SAB does nothing.
It's hard to say if doing both always works, or just sometimes, because I've done it before and it's seemed to have no effect, but that could just have been due to a lack of any new hits.

[Jodo]

Hi I seem to be having a similar problem. When I click Preview I see new things to download in the RSS feed, however they will not download unless I either: a) click Download from the RSS previewer or b) click Force Download from the RSS setup screen. Any help would be greatly appreciated! Thanks!