Duplicates Title from RSS

Want something added? Ask for it here.
Post Reply
bugmenot
Full Member
Full Member
Posts: 102
Joined: January 30th, 2008, 9:25 pm

Duplicates Title from RSS

Post by bugmenot »

In one of the beta's there was an option to skip duplicate titles from newzbin to be downloaded via rss.
Is there any chance of having this feature put back in?


Thanks a lot! :)
User avatar
shypike
Administrator
Administrator
Posts: 19773
Joined: January 18th, 2008, 12:49 pm

Re: Duplicates Title from RSS

Post by shypike »

It's still there. It was never an option.
Before entering a job in the queue, it's checked whether an exactly identical job was used before.
The information is lost when SABnzbd is shutdown.
bugmenot
Full Member
Full Member
Posts: 102
Joined: January 30th, 2008, 9:25 pm

Re: Duplicates Title from RSS

Post by bugmenot »

I am still getting duplicates... I setup the RSS feed to only filter out the season I am interested in.
There are duplicate titles in the feed.
I think the doubles occur when it is from a different release group but from the same title.

Example:
Leave.It.To.Beaver.S04E09-mVs
Leave.It.To.Beaver.S04E09-LoL

Should be treated as the same set because the newzbin title will be identical:
Leave It To Beaver -04x09 - Wally's New Dildo
Leave It To Beaver -04x09 - Wally's New Dildo
bugmenot
Full Member
Full Member
Posts: 102
Joined: January 30th, 2008, 9:25 pm

Re: Duplicates Title from RSS

Post by bugmenot »

Bump...

I'm still getting duplicates even from the same release group.
Can anyone else confirm this a bug?
User avatar
shypike
Administrator
Administrator
Posts: 19773
Joined: January 18th, 2008, 12:49 pm

Re: Duplicates Title from RSS

Post by shypike »

There are two ways in which duplicates are checked.
First the title is checked (so that's the title you see in the Preview).
Second is the link to the NZB (e.g. http://www.tvnzb.com/12345).

But suppose you get these titles:
Insane.Justice.S01E01.HDTV.XviD-BiA
Insane.Justice.S01E01.720p.HDTV.x264-BiA

These are not duplicates and you need to use a Reject filter to prevent a double download.

Can you give an exampe of what goes wrong.
Should you need to send confidential material, email it to bugs at sabnzbd dot org.
(Please add the URL of this thread).
bugmenot
Full Member
Full Member
Posts: 102
Joined: January 30th, 2008, 9:25 pm

Re: Duplicates Title from RSS

Post by bugmenot »

If I can fix this myself then thats cool.. this is newzbin not tvrage.

Here a C&P of the RSS feed:

Code: Select all

<?xml version="1.0" encoding="utf-8" ?>
<rss version="2.0" xml:lang="en-GB"
xmlns:report="http://www.newzbin.com/DTD/2007/feeds/report/">
	<channel>
		<title>v3.newzbin.com (reports)</title>
		<link>http://v3.newzbin.com/search/?go=1&ss=188691&fpn=p</link>
		<description>Newzbin Reports Feed</description>
		<pubDate>Wed, 16 Jul 2008 02:53:02 GMT</pubDate>
		<ttl>42</ttl>
		<generator>v3.newzbin.com - Usenet Search</generator>
		<copyright>Copyright (c) 2002 - 2007 Newzbin Limited. All Rights Reserved.</copyright>
		<image>
			<url>http://v3.newzbin.com/m/i/logo/newzbinv3.png</url>
			<link>http://v3.newzbin.com/search/?go=1&ss=188691&fpn=p</link>
			<title>v3.newzbin.com</title>
			<description>Visit Newzbin.com - The Ultimate In Usenet Indexing</description>
		</image>
		<item>
			<title>Weeds - 4x05 - No Man is Pudding</title>
			<guid isPermaLink="true">http://v3.newzbin.com/browse/post/3113225/</guid>
			<link>http://v3.newzbin.com/browse/post/3113225/</link>
			<comments>http://v3.newzbin.com/browse/post/3113225/#CommentsPH</comments>
			<description>
			<![CDATA[
			<ul>
			<li>
			ID: <a href="http://v3.newzbin.com/browse/post/3113225">3113225</a>
			(<a
			href="http://v3.newzbin.com/account/bookmarks/add/?ps_id=3113225">Bookmark</a>)
			(<a href="http://v3.newzbin.com/browse/post/3113225/nzb/">NZB</a>)
			(<a href="http://v3.newzbin.com/nfo/view/txt/190419366/">NFO</a>)
			(<a href="http://www.tvrage.com/Weeds/episodes/645620/4x05">More Info</a>)
			(Size: 266.7MB)
			</li>
			<li>
				Attributes:
				Category - TV
				|  Video Source - TV Cap, HDTV |  Video Format - XviD |  Video Genre - Comedy, Crime, Drama |  Language - English
			</li>
			<li>Groups:  alt.binaries.multimedia,  alt.binaries.tv</li>
			<li>Poster: Fake@address.com</li>
			<li>PostDate: Tuesday 15 Jul 2008, 12:01AM EST</li>
			</ul>			]]>
			</description>
			<report:id>3113225</report:id>
			<report:category>TV</report:category>
			<report:attributes>
				<report:attribute type="Source">TV Cap</report:attribute>
				<report:attribute type="Source">HDTV</report:attribute>
				<report:attribute type="Video Fmt">XviD</report:attribute>
				<report:attribute type="Video Genre">Comedy</report:attribute>
				<report:attribute type="Video Genre">Crime</report:attribute>
				<report:attribute type="Video Genre">Drama</report:attribute>
				<report:attribute type="Language">English</report:attribute>
			</report:attributes>
			<report:groups>
				<report:group>alt.binaries.multimedia</report:group>
				<report:group>alt.binaries.tv</report:group>
			</report:groups>
			<report:progress value="1">Report is complete</report:progress>
			<report:moreinfo>http://www.tvrage.com/Weeds/episodes/645620/4x05</report:moreinfo>
			<report:nfo>
				<report:fileid>190419366</report:fileid>
				<report:filename>weeds.405.hdtv-0tv.nfo</report:filename>
				<report:link>http://v3.newzbin.com/nfo/view/txt/190419366/</report:link>
			</report:nfo>
			<report:nzb>http://v3.newzbin.com/browse/post/3113225/nzb/</report:nzb>
			<report:poster>Fake@address.com</report:poster>
			<report:size type="bytes">279631073</report:size>
			<report:postdate>Tue, 15 Jul 2008 04:01:37 GMT</report:postdate>
			<report:stats>
				<report:views>570</report:views>
				<report:comments>0</report:comments>
			</report:stats>
			<pubDate>Tue, 15 Jul 2008 04:24:17 GMT</pubDate>
		</item>
		<item>
			<title>Weeds - 4x05 - No Man is Pudding</title>
			<guid isPermaLink="true">http://v3.newzbin.com/browse/post/3113224/</guid>
			<link>http://v3.newzbin.com/browse/post/3113224/</link>
			<comments>http://v3.newzbin.com/browse/post/3113224/#CommentsPH</comments>
			<description>
			<![CDATA[
			<ul>
			<li>
			ID: <a href="http://v3.newzbin.com/browse/post/3113224">3113224</a>
			(<a
			href="http://v3.newzbin.com/account/bookmarks/add/?ps_id=3113224">Bookmark</a>)
			(<a href="http://v3.newzbin.com/browse/post/3113224/nzb/">NZB</a>)
			(<a href="http://v3.newzbin.com/nfo/view/txt/190419376/">NFO</a>)
			(<a href="http://www.tvrage.com/Weeds/episodes/645620/4x05">More Info</a>)
			(Size: 265.4MB)
			</li>
			<li>
				Attributes:
				Category - TV
				|  Video Source - TV Cap, HDTV |  Video Format - XviD |  Video Genre - Comedy, Crime, Drama |  Language - English
			</li>
			<li>Groups:  alt.binaries.multimedia,  alt.binaries.tv</li>
			<li>Poster: guy <me@my.net></li>
			<li>PostDate: Tuesday 15 Jul 2008, 12:01AM EST</li>
			</ul>			]]>
			</description>
			<report:id>3113224</report:id>
			<report:category>TV</report:category>
			<report:attributes>
				<report:attribute type="Source">TV Cap</report:attribute>
				<report:attribute type="Source">HDTV</report:attribute>
				<report:attribute type="Video Fmt">XviD</report:attribute>
				<report:attribute type="Video Genre">Comedy</report:attribute>
				<report:attribute type="Video Genre">Crime</report:attribute>
				<report:attribute type="Video Genre">Drama</report:attribute>
				<report:attribute type="Language">English</report:attribute>
			</report:attributes>
			<report:groups>
				<report:group>alt.binaries.multimedia</report:group>
				<report:group>alt.binaries.tv</report:group>
			</report:groups>
			<report:progress value="1">Report is complete</report:progress>
			<report:moreinfo>http://www.tvrage.com/Weeds/episodes/645620/4x05</report:moreinfo>
			<report:nfo>
				<report:fileid>190419376</report:fileid>
				<report:filename>weeds.405.hdtv-0tv.nfo</report:filename>
				<report:link>http://v3.newzbin.com/nfo/view/txt/190419376/</report:link>
			</report:nfo>
			<report:nzb>http://v3.newzbin.com/browse/post/3113224/nzb/</report:nzb>
			<report:poster>guy <me@my.net></report:poster>
			<report:size type="bytes">278305529</report:size>
			<report:postdate>Tue, 15 Jul 2008 04:01:47 GMT</report:postdate>
			<report:stats>
				<report:views>350</report:views>
				<report:comments>0</report:comments>
			</report:stats>
			<pubDate>Tue, 15 Jul 2008 04:23:24 GMT</pubDate>
		</item>
	</channel>
</rss>
This feed is taken from a saved search. As you can see both titles are the same. Yet both download.
User avatar
shypike
Administrator
Administrator
Posts: 19773
Joined: January 18th, 2008, 12:49 pm

Re: Duplicates Title from RSS

Post by shypike »

I'll file this as a bug report (#64), so that someone from the team will investigate it.
bugmenot
Full Member
Full Member
Posts: 102
Joined: January 30th, 2008, 9:25 pm

Re: Duplicates Title from RSS

Post by bugmenot »

thanks a lot,

Is there a url to the bug report so I can check the status?
User avatar
shypike
Administrator
Administrator
Posts: 19773
Joined: January 18th, 2008, 12:49 pm

Re: Duplicates Title from RSS

Post by shypike »

User avatar
shypike
Administrator
Administrator
Posts: 19773
Joined: January 18th, 2008, 12:49 pm

Re: Duplicates Title from RSS

Post by shypike »

I found a problem in the duplicate detection, which will be fixed in release 0.4.3.
Post Reply