Everything Queued Up Again

[asktheeightball]

Hi all,

This morning for some reason, my queue showed that everything I had downloaded previously was re-queued and SAB was trying to DL it all.

Has anyone else experienced this?

[jeremy034]

Yes. My Mac Mini filled up the remaining 60 GB on the hard drive today.

WTH? Is this some kind of time bomb? Am I being punished cuz I didn't rush to download the new release?

[shypike]

SABnzbd doesn't just start downloading everything again.
How dp you send NZB's to it?
Watched Folder? Is SABnzbd prevented from deleting files?
Did you have a system crash?
Did you need to forcefully stop SABnzbd?

[jeremy034]

I use a watched folder. SABnzbd has never had problems deleting/moving files from what I can tell. Is there something specific I should look at?
No crash, no force stop.

I've used SABnzbd for a couple of years, and I've never seen it do this. It re-downloaded stuff originally downloaded as recently as a couple of days ago and stuff downloaded months ago.

Thanks.

[shypike]

It's impossible to analyse lone incidents like this.
Check the watched folder, are there any files in there now?
It could be a queue corruption.
You can try to empty the "cache" folder to get rid of it.
Stop SABnzbd, erase everything in /home/user/Library/Application Support/SABnzbd/cache
and start SABnzbd again.
This will clear the queue completely (and erase the RSS memory).
If your queue was empty already, there should be a few files in there.
If there are many files starting with SABnzbd, that may mean trouble.

[jeremy034]

I know what you mean. I tried looking through the logs, but there are over 5MB of logs just from yesterday.

However, it seems beyond coincidence that the same thing happened to two of us (so far) at the same time.

How would I know if my queue is corrupted? The items I had in the queue (all were paused) are still there and seem to be valid. 

[shypike]

How would I know if my queue is corrupted?

You don't.
A truly corrupted queue could do anything, although clean behaviour is unlikely.
The most plausible scenario would be if you accidentally set the nzb backup folder
to be the watched folder (or SABnzbd doing that spontaneously).
Your two reports are the only ones.

[jeremy034]

I'll keep my eye on it. Just weird cuz it's a Mac Mini that is ONLY used for Plex and SABnzbd. Haven't rebooted it, changed any configuration, or even logged into it in a while.

[jeremy034]

Happened again. Looks like it may be re-queueing items that are in my nzbmatrix bookmarks. Here's an example from the log:

Code: Select all

2010-09-03 19:41:52,719::INFO::[rss:282] Ignoring duplicate job Fringe S02E01 720p HDTV x264 SiTV
...
2010-09-03 20:59:27,627::INFO::[rss:463] Adding http://api.nzbmatrix.com/v1.1/download.php?id=503201&username=<snip>&apikey=<snip> (Fringe S02E01 720p HDTV x264 SiTV) to queue

Notice that it correctly ignores the bookmark, then 20 minutes later it queues it. The log file is full of correct ignores of this nzb before it decided to queue it. Does this help diagnose?

[shypike]

The weak point of nzbmatrix bookmarks is that there is no way
for SABnzbd to remove them (unlike newzbin's).
Normally RSS entries are remembered (and stored in cache/rss_data.sab)
and the "duplicate" check isn't needed.
Not sure what to make of this.
I'll make a note to investigate this at a later time.

[bedlam]

I had the same problem crop up yesterday as well.  I traced it down to NZBMatrix bookmarks as well.  Curiously, the other RSS feeds I had for NZBMatrix weren't affected, so it's just the bookmarks.

I'm running 0.5.3 on a Synology DS209j NAS.  I can post the logs too if need be.

**Edit: feature request posted in Feature Requests.**

[shypike]

Currently SABnzbd uses the report URL's to rember what it already did.
This will fail when for some reason the URL changes.
We see that in in nzbindex.nl's RSS searches, where they dynamically
generate URLs. In such cases you need to have the "duplicate" check on.

[stergil]

The weak point of nzbmatrix bookmarks is that there is no way
for SABnzbd to remove them (unlike newzbin's).
Normally RSS entries are remembered (and stored in cache/rss_data.sab)
and the "duplicate" check isn't needed.
Not sure what to make of this.
I'll make a note to investigate this at a later time.

There is now API support to remove items from the user's nzbmatrix bookmarks.  Any chance we can get sabnzbd support to clean up after a download?

https://nzbmatrix.com/api-info.php

Code: Select all

BOOMARKS API:

This API can control adding and removal of NZB bookmarks for your account.

Usage:
To use the BOOMARKS API please use the following syntax:

http://api.nzbmatrix.com/v1.1/bookmarks.php?id={NZBID}&username={USERNAME}&apikey={APIKEY}&action={ACTION}

eg: http://api.nzbmatrix.com/v1.1/bookmarks.php?id=123456&username=foobar&apikey=838d43ef5cb5346d83520f6886adf935


Breakdown:
http://api.nzbmatrix.com/v1.1/bookmarks.php? = URL to use. No other URL is supported, please do not try to use them.
id={NZBID} = NZBid from NZBMatrix.com
&username={USERNAME} = Your account username.
&apikey={APIKEY} = Your API Key.
&action={ACTION} = Action required (add, remove).

[shypike]

Can probably be done for release 0.6.0

[stergil]

Great.. looking forward to it!