Page 1 of 1

RSS feeds broken??

Posted: July 15th, 2011, 9:49 am
by reznorio
Hi,

Ever since I've upgraded to 0.6.# with the new RSS interface, the feeds seems broken.

The old way I'd click rss then view a feed and I could see the 25 latest postings and click download on any of them. NOW I click on a feed and I see nothing. No items under Not Matched at all. When I open the rss feed in my browser I see everything as per normal. Is this a known issue? Sometimes I can hit 'read feed' and a couple show up. I think I'm going back to 0.5.6. This version has been a disappointment.

Matched

Skip Filter Title
Not Matched

Skip Filter Title
Downloaded

Title


If anyone can help, it'd be appreciated.

Cheers

Re: RSS feeds broken??

Posted: July 15th, 2011, 12:17 pm
by shypike
Odd, could be a data corruption due to the upgrade.
Stop SABnzbd, remove rss_data.sab in the admin folder and start SABnzbd again.
Side effect: all your feeds look like new ones.

Re: RSS feeds broken??

Posted: July 15th, 2011, 1:45 pm
by reznorio
SUCCESS!

So I found a gotcha... With the new SAB (dhtml?) rss feed, it somehow triggers Adblock (chrome) to prohibit the output. It doesn't break the page, it just doesn't show any new entries, which is very misleading. I have no idea why it thinks it's an ad but I could reproduce it, so it's Adblock's fault. You MUST put that ip/domain as an exception in your browser plugin if you do use it (like tons of you do).

Thanks for veering me away from Sab itself! I deleted that rss file and it still didn't show. Then it dawned on me...

Cheers!

Re: RSS feeds broken??

Posted: July 15th, 2011, 2:54 pm
by shypike
Weird, I use AdBlock and have never seen this problem.

Re: RSS feeds broken??

Posted: August 5th, 2011, 6:42 am
by combspecialist
I've just noticed this issue (running 0.6.7 on Win7 x64) and deleting the rss_data.sab file fixed it. However a couple of hours later, I'm now seeing the same problem again. If I go into the [Filter] tab for any of my feeds, they're showing (0) matched and (0) unmatched. Clicking [Read Feed] doesn't solve the problem either. I think they are are still working as I'm still seeing new jobs being automatically added to the queue, I just can't browse the current feed data for some reason. Any ideas what would be causing this?

edit: the feed URLs are still valid as if I plug them into a web browser, I see the 100 items as expected. I've disabled AdMuncher and unloaded it and still no joy. I've just tried restarting sab with +Debug enabled in Logging (not sure if that's just for the GUI though) and then done a [Read all feeds now] but all 4 of my feeds still show (0) matched and (0) unmatched. Nothing seems to get written to the log when doing those steps.

Re: RSS feeds broken??

Posted: August 5th, 2011, 7:25 am
by shypike
It's useful to run the SABnzbd-console.exe program instead of the SABnzbd.exe for this.
That will give you a live view of the logging and may reveal some hidden error message.
We're not to keep to file warnings and errors for the RSS feed, because when it's run
automatically, you're not interested in transient errors.
Recently we did improve error reporting though.
Which RSS feed is it? Do you have multiple?

Re: RSS feeds broken??

Posted: August 5th, 2011, 10:12 am
by combspecialist
Hi shypike,

I've got 4 feeds, all coming from nzbindex.nl. I just shutdown sab and ran the -console executable, at startup I can see it reading all 4 feeds and each one just states "Done Parsing [RSS URL]" and after the last one rss_data.sab gets updated.

I then tried navigating to the Feeds section using the web interface - when I try clicking "Read Feed" there, the console shows the following:

RSS READOUT = TRUE
Running feedparser on [RSS URL]
Done parsing [RSS URL]

I still get (0) matched and (0) Not matched though :(

Here's the URL for one of my 4 feeds: http://www.nzbindex.nl/rss/alt.binaries ... 100&more=1

edit: The console has just shown the output from a scheduled RSS check

Code: Select all

Starting scheduled RSS Readout
Running feedparser on [RSS Feed 1 URL]
Done parsing [RSS Feed 1 URL]
Trying title [Lopez Tonight...]
Running feedparser on [RSS Feed 2 URL]
Done parsing [RSS Feed 2 URL]
Running feedparser on [RSS Feed 3 URL]
Done parsing [RSS Feed 3 URL]
Running feedparser on [RSS Feed 4 URL]
Done parsing [RSS Feed 4 URL]
Trying title [TNA.Impact.Wrestling...]
Saving data for rss_data.sab
Finished scheduled RSS read-out
Now when I look at the web interface, the 2 feeds that mention trying a title are showing that 1 title in the [Not Matched] section. I wonder why sab is only reading 1 hit from those 2 feeds and none from the other 2 even though they all look fine in IE. I'm holding off deleting the rss_data.sab file again in case you want me to try anything else while it's not working.

Re: RSS feeds broken??

Posted: August 5th, 2011, 2:00 pm
by shypike
Can you do the following?
Stop SABnzbd.
Look up the file rss_data.sab in the admin folder.
Copy that file to a safe place.
Email the file to bugs at sabnzbd.org
Remove the file.
Start SABnzbd.
Check again.

Re: RSS feeds broken??

Posted: August 5th, 2011, 2:22 pm
by combspecialist
Hi, I've mailed the file as requested. Huge difference in the console now I've deleted the rss data file - I see lots and lots of "Trying Title" lines on startup, before I was only seeing 2 of those (and that's across 4 feeds which should total 350 titles to check). As expected, the web interface is correctly showing the number of matched and not matched titles. Hopefully you can see something obviously wrong with the .sab fikle which would explain this.

Re: RSS feeds broken??

Posted: August 5th, 2011, 2:52 pm
by reznorio
Update:

Not soon after my "SUCCESS" post I noticed my 'solution' never really licked it. I find you're able to somtimes view a RSS feed once but if you look at it again you just see an empty Match/Not Matched queue. It's kind of hit and miss.

Whereas the RSS feed is always functional via the web.

Just thought I'd mention it...

Re: RSS feeds broken??

Posted: August 5th, 2011, 3:06 pm
by shypike
Nzbindex.nl is a bit of a strange RSS feed in that it always creates new download links for every read-out.
This isn't quite compatible with the way SABnzbd is designed.
I'll look into it, but it may take a while.

Re: RSS feeds broken??

Posted: August 5th, 2011, 3:16 pm
by reznorio
Mine was from Nzbmatrix if that helps, a sample feed is the Other:Radio category matching Stern regex. Likewise, it works fine in the background (the matched files are indeed being downloaded) but when I try and view it it shows empty.

Re: RSS feeds broken??

Posted: August 5th, 2011, 3:21 pm
by combspecialist
Thanks shypike, so is that the cause of the (0) readouts for matched and unmatched on the web interface? It took me a while to arrive at nzbindex as the RSS feed of choice but I settled on it because it offered the most powerful filtering on it's feeds. You can set min/max sizes, specify 1 or more groups to look in, add search terms, add exclusions and specify complete posts only. Does anyone know of any other RSS feeds which offer that much flexibility?

Do I need to look for alternate feeds or does this issue only affect the web interface? I only noticed the problem a few days ago, it's been picking up new downloads based on those feeds fine all last week...

Re: RSS feeds broken??

Posted: August 5th, 2011, 5:04 pm
by shypike
I'm not sure what's going on.
SABnzbd doesn't suddenly change its behaviour,
especially not after you removed the .sab file.
Maybe something changed in nzbindex, I'll look into it.

Re: RSS feeds broken??

Posted: August 7th, 2011, 4:34 am
by shypike
So far I see that the cleanup of rss_data.sab isn't always working properly.
I haven't been able to find out why the preview is sometimes just empty, while there are actual items in the feed.
I've now seen that once on my own system, but not since then.
It may take a while, but I'm determined to solve this.
The root cause may also be responsible for other incidents reported.