RSS Duplicate Downloads

Get help with all aspects of SABnzbd
Forum rules
Help us help you:
  • Are you using the latest stable version of SABnzbd? Downloads page.
  • Tell us what system you run SABnzbd on.
  • Adhere to the forum rules.
  • Do you experience problems during downloading?
    Check your connection in Status and Interface settings window.
    Use Test Server in Config > Servers.
    We will probably ask you to do a test using only basic settings.
  • Do you experience problems during repair or unpacking?
    Enable +Debug logging in the Status and Interface settings window and share the relevant parts of the log here using [ code ] sections.
Post Reply
Tenny
Newbie
Newbie
Posts: 9
Joined: January 11th, 2011, 8:40 pm

RSS Duplicate Downloads

Post by Tenny »

Hey everyone, I searched a bit but found a lot of stuff related to duplicates, but nothing "like" mine I felt... Apologizes if there is one.

Anyways I use NZBMatrix for my RSS feed, and the feed is only setup with my bookmarks. I am using Sabnzbd+ 0.5.6. This began happening months back but I don't recall exactly what changed when this began happening. I do have "Prevent Duplicate Downloads" checked, but it hasn't made any dent in this.

Whenever I add something to the bookmarks, it'll download the same thing twice. I have three RSS feeds (coming from the original Bookmarks RSS feed) but I have plenty of conditions (rejects, accepts, etc). None of these duplicates are from overlapping feeds (or at least when that does happen I understand it and not looking to solve that.)

For Example...
File A

RSS Feed A will only grab things with "File A" in the name.
RSS Feed B will only grab things with "File B" in the name.

I bookmark "File A".

When I preview:
RSS Feed A: Finds it matched only once.
RSS Feed B: Finds it, but it is not matched (thus ignored).

When it gets added to the queue it is added, and downloaded. After it is finished downloading it is added again and downloaded again, so I have it twice. Folders: File A & File A.1

This problem has confused me for a few months now, and I cannot for the life of me figure out what is triggering it. This doesn't happen when things are added through Sickbeard.
User avatar
shypike
Administrator
Administrator
Posts: 19774
Joined: January 18th, 2008, 12:49 pm

Re: RSS Duplicate Downloads

Post by shypike »

The bookmarks are read out via their own RSS feed.
Do your other feeds match the same stuff as your bookmarks?
Tenny
Newbie
Newbie
Posts: 9
Joined: January 11th, 2011, 8:40 pm

Re: RSS Duplicate Downloads

Post by Tenny »

shypike wrote: The bookmarks are read out via their own RSS feed.
Do your other feeds match the same stuff as your bookmarks?
There are no other feeds other than the bookmarks one.

Then it's added multiple times so that they are moved to the right folder.

So like
Feed1: requires "string"
Feed2: rejects "string"

Thus they aren't overlapping like that (and they end up in the correct folder). So it's not the other feed grabbing it.

Sorry I am being vague, I don't want to get anyone into trouble but if posting simple "qualities" is acceptable I am more than happy to share what I have for my feeds.
Tenny
Newbie
Newbie
Posts: 9
Joined: January 11th, 2011, 8:40 pm

Re: RSS Duplicate Downloads

Post by Tenny »

pair of dimes wrote: If you look at the feed definition, in the Downloaded listing, do you see the nzb twice?

Simple solution is just to enable "Prevent Duplicate Downloads" in Config>Switches
The feed definition I gather is the "Preview" button on the RSS Tab in the config? If so, it doesn't show a duplicate there.

I also do have "Prevent Duplicate Downloads" checked.
User avatar
shypike
Administrator
Administrator
Posts: 19774
Joined: January 18th, 2008, 12:49 pm

Re: RSS Duplicate Downloads

Post by shypike »

You contradict yourself.
First you say you have only one feed and then you talk about "Feed1" and "Feed2".
Also reading this, confuses me:
[quote]
So like
Feed1: requires "string"
Feed2: rejects "string"
[/qoute]
Are these your filters?
Tenny
Newbie
Newbie
Posts: 9
Joined: January 11th, 2011, 8:40 pm

Re: RSS Duplicate Downloads

Post by Tenny »

Sorry, I know it sounds confusing, but it really isn't. Just explaining it isn't working very well for me. 

All the "feeds" come from the Bookmark RSS feed from the site.

I just create multiple feeds based off the "bookmarks" feed. Then use Reject / Accepts / Requires to have them sorted to the right folders / post processing.
User avatar
shypike
Administrator
Administrator
Posts: 19774
Joined: January 18th, 2008, 12:49 pm

Re: RSS Duplicate Downloads

Post by shypike »

OK, so your filters are not accurate and cause double hits.
Don't use multiple feeds.
Just use a list of Accept filters to assign categories.
Like this:
Accept | Show 1 | Show-1-folder
Accept | Show 2 | Show-2-folder
Accept | * | Other-folder
Tenny
Newbie
Newbie
Posts: 9
Joined: January 11th, 2011, 8:40 pm

Re: RSS Duplicate Downloads

Post by Tenny »

shypike wrote: OK, so your filters are not accurate and cause double hits.
Don't use multiple feeds.
Just use a list of Accept filters to assign categories.
Like this:
Accept | Show 1 | Show-1-folder
Accept | Show 2 | Show-2-folder
Accept | * | Other-folder
Ok I tried that, and I'm still getting duplicates.

Order | Type | Filter | Category | Processing | Script
0 | ACCEPT | TV | tv | default | default
1 | ACCEPT | x264 | movieshd | default | default
2 | ACCEPT | xvid | movies | default | default

And I've gotten duplicates for both Movies & MoviesHD so far.
Stretchstrong
Newbie
Newbie
Posts: 3
Joined: February 19th, 2011, 1:28 am

Re: RSS Duplicate Downloads

Post by Stretchstrong »

I'm having this exact same problem. I use my bookmarks feed from NzbMatrix, only one feed and no filters at all. When I look at the feed there's only one entry for each item but sabnzb downloads every new item twice. I've come across this problem in a number of threads. There's definitely a bug here.
User avatar
shypike
Administrator
Administrator
Posts: 19774
Joined: January 18th, 2008, 12:49 pm

Re: RSS Duplicate Downloads

Post by shypike »

If it's a bug, there's not enough data to reproduce it.

Enable the duplicates detection in Config->Switches.
It helps to enable NZB backups too in Config->Folder.
This will at least stop the same NZB from entering twice.
Stretchstrong
Newbie
Newbie
Posts: 3
Joined: February 19th, 2011, 1:28 am

Re: RSS Duplicate Downloads

Post by Stretchstrong »

I've checked both those options and it still doesn't help. Two downloads for every item in the feed. But only one nzb file in the nzb file backup directory.

Have you tried using an NzbMatrix bookmarks rss feed? I can give you access to mine if it'd help repo the issue.
User avatar
shypike
Administrator
Administrator
Posts: 19774
Joined: January 18th, 2008, 12:49 pm

Re: RSS Duplicate Downloads

Post by shypike »

Stretchstrong wrote: But only one nzb file in the nzb file backup directory.
There would never be two files, the second would overwrite the first.
I have an nzbmatrix account myself, but I cannot reproduce the problem.
You might want to try the public Beta for 0.6.0 that we'll release today.
Stretchstrong
Newbie
Newbie
Posts: 3
Joined: February 19th, 2011, 1:28 am

Re: RSS Duplicate Downloads

Post by Stretchstrong »

0.6 seems to have fixed it.
Post Reply