RSS duplicates in 0.4.5

Report & discuss bugs found in SABnzbd
Forum rules
Help us help you:
  • Are you using the latest stable version of SABnzbd? Downloads page.
  • Tell us what system you run SABnzbd on.
  • Adhere to the forum rules.
  • Do you experience problems during downloading?
    Check your connection in Status and Interface settings window.
    Use Test Server in Config > Servers.
    We will probably ask you to do a test using only basic settings.
  • Do you experience problems during repair or unpacking?
    Enable +Debug logging in the Status and Interface settings window and share the relevant parts of the log here using [ code ] sections.
Post Reply
def1ant
Release Testers
Release Testers
Posts: 8
Joined: November 17th, 2008, 10:41 am

RSS duplicates in 0.4.5

Post by def1ant »

Hi all,

I noticed some earlier submissions regarding duplicates that get downloaded when RSS is enabled.  I am running 0.4.5 on my mac and end up getting dups.  The files are the exact same and the nzb files are identical.  I end up getting ShowYYY and ShowYYY.1 in my completed folder. 

The RSS feed itself seems to be ok - every time I check the feed when there are duplicates - the feed has only one entry. 

Looking at the time of the downloads, the dupes are often within 10-20 minutes of each other.  It seems like the dup starts to download even before the original completes.  Is there any tips for debugging this?  Thanks in advance.
User avatar
shypike
Administrator
Administrator
Posts: 19774
Joined: January 18th, 2008, 12:49 pm

Re: RSS duplicates in 0.4.5

Post by shypike »

Give us the RSS URL so we can examine it ourselves.
[email protected]
def1ant
Release Testers
Release Testers
Posts: 8
Joined: November 17th, 2008, 10:41 am

Re: RSS duplicates in 0.4.5

Post by def1ant »

Emailed link to the address. Thanks.
User avatar
shypike
Administrator
Administrator
Posts: 19774
Joined: January 18th, 2008, 12:49 pm

Re: RSS duplicates in 0.4.5

Post by shypike »

Rather late reply, sorry.

The only thing I can think that happened is this.
1. The feed is read and some jobs start downloading.
2. These jobs are kept in the internal admin of SABnzbd (stored in rss.sab)
3. The next  feed read has the same jobs. No problem, SABnzbd knows it has downloaded these jobs
4. The next feed read does not contain the previous jobs any more.
    Now SABnzbd removes the jobs from it's internal admin to prevent the file from growing forever.
5. The next feed read contains the previous jobs again.
    SABnzbd thinks they are new jobs and adds them to the queue.

Normally jobs will be dropped from the feed and they don't return any more.
But if a feed drops jobs sometimes and they re-appear the next time, it will not help.

The only way to prevent these double downloads is to remember the downloaded jobs forever.

So far this is speculation and so the "solution" may not even work.
The trouble is, it's almost impossible to diagnose these problems.

Maybe if it happens again, you can send the complete logging to [email protected]

There's an open ticket now asking for an option that prevents downloading the same job again if an identically
named NZB file is already in the nzb-backup folder.
This would also fix your problem.
I'll see if this can be done for release 0.4.6.
def1ant
Release Testers
Release Testers
Posts: 8
Joined: November 17th, 2008, 10:41 am

Re: RSS duplicates in 0.4.5

Post by def1ant »

Thank you for the detailed response. 

rss.sab is not the same as the history that is displayed in the UI is it?  The reason I ask is I have not cleared my history and it shows all my jobs including the duplicates it got.

For now, I have temporarily disabled scheduling and just click download manually.  That works fine.
User avatar
shypike
Administrator
Administrator
Posts: 19774
Joined: January 18th, 2008, 12:49 pm

Re: RSS duplicates in 0.4.5

Post by shypike »

rss.sab holds only the RSS items.
The history is kept in queue7.sab.

I can confirm that this one will be implemented in 0.4.6.
There's an open ticket now asking for an option that prevents downloading the same job again if an identically
named NZB file is already in the nzb-backup folder.
Post Reply