Page 1 of 1
Everything Queued Up Again
Posted: September 1st, 2010, 8:48 am
by asktheeightball
Hi all,
This morning for some reason, my queue showed that everything I had downloaded previously was re-queued and SAB was trying to DL it all.
Has anyone else experienced this?
Re: Everything Queued Up Again
Posted: September 1st, 2010, 7:47 pm
by jeremy034
Yes. My Mac Mini filled up the remaining 60 GB on the hard drive today.
WTH? Is this some kind of time bomb? Am I being punished cuz I didn't rush to download the new release?
Re: Everything Queued Up Again
Posted: September 2nd, 2010, 3:27 am
by shypike
SABnzbd doesn't just start downloading everything again.
How dp you send NZB's to it?
Watched Folder? Is SABnzbd prevented from deleting files?
Did you have a system crash?
Did you need to forcefully stop SABnzbd?
Re: Everything Queued Up Again
Posted: September 2nd, 2010, 10:35 am
by jeremy034
I use a watched folder. SABnzbd has never had problems deleting/moving files from what I can tell. Is there something specific I should look at?
No crash, no force stop.
I've used SABnzbd for a couple of years, and I've never seen it do this. It re-downloaded stuff originally downloaded as recently as a couple of days ago and stuff downloaded months ago.
Thanks.
Re: Everything Queued Up Again
Posted: September 2nd, 2010, 1:53 pm
by shypike
It's impossible to analyse lone incidents like this.
Check the watched folder, are there any files in there now?
It could be a queue corruption.
You can try to empty the "cache" folder to get rid of it.
Stop SABnzbd, erase everything in /home/user/Library/Application Support/SABnzbd/cache
and start SABnzbd again.
This will clear the queue completely (and erase the RSS memory).
If your queue was empty already, there should be a few files in there.
If there are many files starting with SABnzbd, that may mean trouble.
Re: Everything Queued Up Again
Posted: September 2nd, 2010, 2:18 pm
by jeremy034
I know what you mean. I tried looking through the logs, but there are over 5MB of logs just from yesterday.
However, it seems beyond coincidence that the same thing happened to two of us (so far) at the same time.
How would I know if my queue is corrupted? The items I had in the queue (all were paused) are still there and seem to be valid.
Re: Everything Queued Up Again
Posted: September 2nd, 2010, 3:14 pm
by shypike
jeremy034 wrote:
How would I know if my queue is corrupted?
You don't.
A truly corrupted queue could do anything, although clean behaviour is unlikely.
The most plausible scenario would be if you accidentally set the nzb backup folder
to be the watched folder (or SABnzbd doing that spontaneously).
Your two reports are the only ones.
Re: Everything Queued Up Again
Posted: September 2nd, 2010, 7:20 pm
by jeremy034
I'll keep my eye on it. Just weird cuz it's a Mac Mini that is ONLY used for Plex and SABnzbd. Haven't rebooted it, changed any configuration, or even logged into it in a while.
Re: Everything Queued Up Again
Posted: September 3rd, 2010, 9:40 pm
by jeremy034
Happened again. Looks like it may be re-queueing items that are in my nzbmatrix bookmarks. Here's an example from the log:
Code: Select all
2010-09-03 19:41:52,719::INFO::[rss:282] Ignoring duplicate job Fringe S02E01 720p HDTV x264 SiTV
...
2010-09-03 20:59:27,627::INFO::[rss:463] Adding http://api.nzbmatrix.com/v1.1/download.php?id=503201&username=<snip>&apikey=<snip> (Fringe S02E01 720p HDTV x264 SiTV) to queue
Notice that it correctly ignores the bookmark, then 20 minutes later it queues it. The log file is full of correct ignores of this nzb before it decided to queue it. Does this help diagnose?
Re: Everything Queued Up Again
Posted: September 4th, 2010, 5:09 pm
by shypike
The weak point of nzbmatrix bookmarks is that there is no way
for SABnzbd to remove them (unlike newzbin's).
Normally RSS entries are remembered (and stored in cache/rss_data.sab)
and the "duplicate" check isn't needed.
Not sure what to make of this.
I'll make a note to investigate this at a later time.
Re: Everything Queued Up Again
Posted: September 6th, 2010, 7:46 pm
by bedlam
I had the same problem crop up yesterday as well. I traced it down to NZBMatrix bookmarks as well. Curiously, the other RSS feeds I had for NZBMatrix weren't affected, so it's just the bookmarks.
I'm running 0.5.3 on a Synology DS209j NAS. I can post the logs too if need be.
**Edit: feature request posted in Feature Requests.**
Re: Everything Queued Up Again
Posted: September 7th, 2010, 4:47 am
by shypike
Currently SABnzbd uses the report URL's to rember what it already did.
This will fail when for some reason the URL changes.
We see that in in nzbindex.nl's RSS searches, where they dynamically
generate URLs. In such cases you need to have the "duplicate" check on.
Re: Everything Queued Up Again
Posted: October 20th, 2010, 2:15 pm
by stergil
shypike wrote:
The weak point of nzbmatrix bookmarks is that there is no way
for SABnzbd to remove them (unlike newzbin's).
Normally RSS entries are remembered (and stored in cache/rss_data.sab)
and the "duplicate" check isn't needed.
Not sure what to make of this.
I'll make a note to investigate this at a later time.
There is now API support to remove items from the user's nzbmatrix bookmarks. Any chance we can get sabnzbd support to clean up after a download?
https://nzbmatrix.com/api-info.php
Code: Select all
BOOMARKS API:
This API can control adding and removal of NZB bookmarks for your account.
Usage:
To use the BOOMARKS API please use the following syntax:
http://api.nzbmatrix.com/v1.1/bookmarks.php?id={NZBID}&username={USERNAME}&apikey={APIKEY}&action={ACTION}
eg: http://api.nzbmatrix.com/v1.1/bookmarks.php?id=123456&username=foobar&apikey=838d43ef5cb5346d83520f6886adf935
Breakdown:
http://api.nzbmatrix.com/v1.1/bookmarks.php? = URL to use. No other URL is supported, please do not try to use them.
id={NZBID} = NZBid from NZBMatrix.com
&username={USERNAME} = Your account username.
&apikey={APIKEY} = Your API Key.
&action={ACTION} = Action required (add, remove).
Re: Everything Queued Up Again
Posted: October 21st, 2010, 2:18 pm
by shypike
Can probably be done for release 0.6.0
Re: Everything Queued Up Again
Posted: October 21st, 2010, 2:21 pm
by stergil
Great.. looking forward to it!