For anyone that uses sabnzbd+ on a frequent basis with automatic-downloading/RSS, you'll get plenty of duplicate content -- even if you use the option to eliminate duplicate.
To the best of my knowledge, the reason for this is that duplicates rarely ever have the same filename *prior* to the renaming rules being applied.
For an easy example, consider TV episodes. Imagine I get an RSS Feed for TV episodes, and I have a f I have a filter setup to only download "How I Met Your Mother". The actual filename might look something like "How.I.Met.Your.Mother.S01E02.PDTV.Comment" then the next day I might get a duplicate, whose filename was something similar, but slighting different, for example "How.I.Met.Your.Mother.S01E02.DiffGroup.OtherComment"
If the user has "no duplicates" selected, one would hope that the second file would not be downloaded. However, at this point that does not happen, because the names are only compared directly. My request is to compare duplicates by applying the rename rules.
So, for example, you'd iterate through the history, and compare the "new" RSS file, to all previously downloaded files, by using the rename function on the new file, against the renamed downloaded files. You could also check against the non-renamed version, however, I can't presently see where that would be necessary, because in the event that would match, so would the renamed (or the renamed would be off, etc).
Thank you in advance,
RKM