Duplicates Title from RSS

[bugmenot]

In one of the beta's there was an option to skip duplicate titles from newzbin to be downloaded via rss.
Is there any chance of having this feature put back in?


Thanks a lot!

[shypike]

It's still there. It was never an option.
Before entering a job in the queue, it's checked whether an exactly identical job was used before.
The information is lost when SABnzbd is shutdown.

[bugmenot]

I am still getting duplicates... I setup the RSS feed to only filter out the season I am interested in.
There are duplicate titles in the feed.
I think the doubles occur when it is from a different release group but from the same title.

Example:
Leave.It.To.Beaver.S04E09-mVs
Leave.It.To.Beaver.S04E09-LoL

Should be treated as the same set because the newzbin title will be identical:
Leave It To Beaver -04x09 - Wally's New Dildo
Leave It To Beaver -04x09 - Wally's New Dildo

[bugmenot]

Bump...

I'm still getting duplicates even from the same release group.
Can anyone else confirm this a bug?

[shypike]

There are two ways in which duplicates are checked.
First the title is checked (so that's the title you see in the Preview).
Second is the link to the NZB (e.g. http://www.tvnzb.com/12345).

But suppose you get these titles:
Insane.Justice.S01E01.HDTV.XviD-BiA
Insane.Justice.S01E01.720p.HDTV.x264-BiA

These are not duplicates and you need to use a Reject filter to prevent a double download.

Can you give an exampe of what goes wrong.
Should you need to send confidential material, email it to bugs at sabnzbd dot org.
(Please add the URL of this thread).

[bugmenot]

If I can fix this myself then thats cool.. this is newzbin not tvrage.

Here a C&P of the RSS feed:

Code: Select all

<?xml version="1.0" encoding="utf-8" ?>
<rss version="2.0" xml:lang="en-GB"
xmlns:report="http://www.newzbin.com/DTD/2007/feeds/report/">
   <channel>
      <title>v3.newzbin.com (reports)</title>
      <link>http://v3.newzbin.com/search/?go=1&ss=188691&fpn=p</link>
      <description>Newzbin Reports Feed</description>
      <pubDate>Wed, 16 Jul 2008 02:53:02 GMT</pubDate>
      <ttl>42</ttl>
      <generator>v3.newzbin.com - Usenet Search</generator>
      <copyright>Copyright (c) 2002 - 2007 Newzbin Limited. All Rights Reserved.</copyright>
      <image>
         <url>http://v3.newzbin.com/m/i/logo/newzbinv3.png</url>
         <link>http://v3.newzbin.com/search/?go=1&ss=188691&fpn=p</link>
         <title>v3.newzbin.com</title>
         <description>Visit Newzbin.com - The Ultimate In Usenet Indexing</description>
      </image>
      <item>
         <title>Weeds - 4x05 - No Man is Pudding</title>
         <guid isPermaLink="true">http://v3.newzbin.com/browse/post/3113225/</guid>
         <link>http://v3.newzbin.com/browse/post/3113225/</link>
         <comments>http://v3.newzbin.com/browse/post/3113225/#CommentsPH</comments>
         <description>
         <![CDATA[
         <ul>
         <li>
         ID: <a href="http://v3.newzbin.com/browse/post/3113225">3113225</a>
         (<a
         href="http://v3.newzbin.com/account/bookmarks/add/?ps_id=3113225">Bookmark</a>)
         (<a href="http://v3.newzbin.com/browse/post/3113225/nzb/">NZB</a>)
         (<a href="http://v3.newzbin.com/nfo/view/txt/190419366/">NFO</a>)
         (<a href="http://www.tvrage.com/Weeds/episodes/645620/4x05">More Info</a>)
         (Size: 266.7MB)
         </li>
         <li>
            Attributes:
            Category - TV
            |  Video Source - TV Cap, HDTV |  Video Format - XviD |  Video Genre - Comedy, Crime, Drama |  Language - English
         </li>
         <li>Groups:  alt.binaries.multimedia,  alt.binaries.tv</li>
         <li>Poster: Fake@address.com</li>
         <li>PostDate: Tuesday 15 Jul 2008, 12:01AM EST</li>
         </ul>         ]]>
         </description>
         <report:id>3113225</report:id>
         <report:category>TV</report:category>
         <report:attributes>
            <report:attribute type="Source">TV Cap</report:attribute>
            <report:attribute type="Source">HDTV</report:attribute>
            <report:attribute type="Video Fmt">XviD</report:attribute>
            <report:attribute type="Video Genre">Comedy</report:attribute>
            <report:attribute type="Video Genre">Crime</report:attribute>
            <report:attribute type="Video Genre">Drama</report:attribute>
            <report:attribute type="Language">English</report:attribute>
         </report:attributes>
         <report:groups>
            <report:group>alt.binaries.multimedia</report:group>
            <report:group>alt.binaries.tv</report:group>
         </report:groups>
         <report:progress value="1">Report is complete</report:progress>
         <report:moreinfo>http://www.tvrage.com/Weeds/episodes/645620/4x05</report:moreinfo>
         <report:nfo>
            <report:fileid>190419366</report:fileid>
            <report:filename>weeds.405.hdtv-0tv.nfo</report:filename>
            <report:link>http://v3.newzbin.com/nfo/view/txt/190419366/</report:link>
         </report:nfo>
         <report:nzb>http://v3.newzbin.com/browse/post/3113225/nzb/</report:nzb>
         <report:poster>Fake@address.com</report:poster>
         <report:size type="bytes">279631073</report:size>
         <report:postdate>Tue, 15 Jul 2008 04:01:37 GMT</report:postdate>
         <report:stats>
            <report:views>570</report:views>
            <report:comments>0</report:comments>
         </report:stats>
         <pubDate>Tue, 15 Jul 2008 04:24:17 GMT</pubDate>
      </item>
      <item>
         <title>Weeds - 4x05 - No Man is Pudding</title>
         <guid isPermaLink="true">http://v3.newzbin.com/browse/post/3113224/</guid>
         <link>http://v3.newzbin.com/browse/post/3113224/</link>
         <comments>http://v3.newzbin.com/browse/post/3113224/#CommentsPH</comments>
         <description>
         <![CDATA[
         <ul>
         <li>
         ID: <a href="http://v3.newzbin.com/browse/post/3113224">3113224</a>
         (<a
         href="http://v3.newzbin.com/account/bookmarks/add/?ps_id=3113224">Bookmark</a>)
         (<a href="http://v3.newzbin.com/browse/post/3113224/nzb/">NZB</a>)
         (<a href="http://v3.newzbin.com/nfo/view/txt/190419376/">NFO</a>)
         (<a href="http://www.tvrage.com/Weeds/episodes/645620/4x05">More Info</a>)
         (Size: 265.4MB)
         </li>
         <li>
            Attributes:
            Category - TV
            |  Video Source - TV Cap, HDTV |  Video Format - XviD |  Video Genre - Comedy, Crime, Drama |  Language - English
         </li>
         <li>Groups:  alt.binaries.multimedia,  alt.binaries.tv</li>
         <li>Poster: guy <me@my.net></li>
         <li>PostDate: Tuesday 15 Jul 2008, 12:01AM EST</li>
         </ul>         ]]>
         </description>
         <report:id>3113224</report:id>
         <report:category>TV</report:category>
         <report:attributes>
            <report:attribute type="Source">TV Cap</report:attribute>
            <report:attribute type="Source">HDTV</report:attribute>
            <report:attribute type="Video Fmt">XviD</report:attribute>
            <report:attribute type="Video Genre">Comedy</report:attribute>
            <report:attribute type="Video Genre">Crime</report:attribute>
            <report:attribute type="Video Genre">Drama</report:attribute>
            <report:attribute type="Language">English</report:attribute>
         </report:attributes>
         <report:groups>
            <report:group>alt.binaries.multimedia</report:group>
            <report:group>alt.binaries.tv</report:group>
         </report:groups>
         <report:progress value="1">Report is complete</report:progress>
         <report:moreinfo>http://www.tvrage.com/Weeds/episodes/645620/4x05</report:moreinfo>
         <report:nfo>
            <report:fileid>190419376</report:fileid>
            <report:filename>weeds.405.hdtv-0tv.nfo</report:filename>
            <report:link>http://v3.newzbin.com/nfo/view/txt/190419376/</report:link>
         </report:nfo>
         <report:nzb>http://v3.newzbin.com/browse/post/3113224/nzb/</report:nzb>
         <report:poster>guy <me@my.net></report:poster>
         <report:size type="bytes">278305529</report:size>
         <report:postdate>Tue, 15 Jul 2008 04:01:47 GMT</report:postdate>
         <report:stats>
            <report:views>350</report:views>
            <report:comments>0</report:comments>
         </report:stats>
         <pubDate>Tue, 15 Jul 2008 04:23:24 GMT</pubDate>
      </item>
   </channel>
</rss>


This feed is taken from a saved search. As you can see both titles are the same. Yet both download.

[shypike]

I'll file this as a bug report (#64), so that someone from the team will investigate it.

[bugmenot]

thanks a lot,

Is there a url to the bug report so I can check the status?

[shypike]

http://trac2.assembla.com/SABnzbd/ticket/64

[shypike]

I found a problem in the duplicate detection, which will be fixed in release 0.4.3.