Where did the files go

Get help with all aspects of SABnzbd
Forum rules
Help us help you:
  • Are you using the latest stable version of SABnzbd? Downloads page.
  • Tell us what system you run SABnzbd on.
  • Adhere to the forum rules.
  • Do you experience problems during downloading?
    Check your connection in Status and Interface settings window.
    Use Test Server in Config > Servers.
    We will probably ask you to do a test using only basic settings.
  • Do you experience problems during repair or unpacking?
    Enable +Debug logging in the Status and Interface settings window and share the relevant parts of the log here using [ code ] sections.
Post Reply
tonycollinet
Newbie
Newbie
Posts: 9
Joined: January 31st, 2010, 10:32 am

Where did the files go

Post by tonycollinet »

V4.2.? - Running on Synology DS110j

Following from this thread.
http://forums.sabnzbd.org/index.php?topic=3546.0

The download restarted, but it has been dumped in the "incomplete" folder with only the files downloaded before the restart (about 10%) there. The rest were downloaded after the restart (I can tell from my usage monitor, and I was watching some of them come in), but they are not in the folder. I had to stop and start the service to trigger the restart.

Where can I look for them?

Thanks.
tonycollinet
Newbie
Newbie
Posts: 9
Joined: January 31st, 2010, 10:32 am

Re: Where did the files go

Post by tonycollinet »

OK - I've found them in /var/packages/sabnzbd/target/sab/cache.

However, they all have filenames of the form sabnzbd_article_xxxxxx

where xxxxxx seems to be a random string of some sort. How can I get all the rar/par files out of that lot?

Thanks
TC
Last edited by tonycollinet on February 1st, 2010, 6:17 pm, edited 1 time in total.
User avatar
shypike
Administrator
Administrator
Posts: 19773
Joined: January 18th, 2008, 12:49 pm

Re: Where did the files go

Post by shypike »

These are not your files, those are just unjoined articles and administration.
Please don't touch these files.

You'll have to find out which folder was mounted just after the restart.
You may want to search the log files for clues.
tonycollinet
Newbie
Newbie
Posts: 9
Joined: January 31st, 2010, 10:32 am

Re: Where did the files go

Post by tonycollinet »

It seems clear to me from the size and dates of the files in the cache folder, that these are the downloaded data I am looking for. I assume the individual rar/par files are downloaded to the cache for error correction and decoding after everything is down. However, that process seems to have failed, probably due to the restart of the service.

The individual rar/par files downloaded before the restart have been put in the "incomplete" folder. There must be a way of getting the data in the cache file to be processed back to the par/rar files, so I can error correct, and decode manually if necessary.

Or have I got it all wrong?

Thanks.
User avatar
shypike
Administrator
Administrator
Posts: 19773
Joined: January 18th, 2008, 12:49 pm

Re: Where did the files go

Post by shypike »

The cache contains separate articles, which need to be joined into actual files.
That will be very hard without the admin files containing the
relation between files and articles.
You need to look for folders named after your NZB files.
The files you need have the same name as listed in the NZB file.
tonycollinet
Newbie
Newbie
Posts: 9
Joined: January 31st, 2010, 10:32 am

Re: Where did the files go

Post by tonycollinet »

I think we are saying the same thing. Normally a file on usenet is encoded into a number of rar files. There are also par files for data recovery. These rar and par files are what you are (I think) calling articles. The newsreader downloads all the rar and par files, then uses the par files to fill any gaps, then un-rars the resulting rar files to give the actual file I wanted to download.

My problem is: all the rar and par files (articles) have been downloaded. I know this because my usage monitor tells me, and I have found them (but in some way renamed) in the cache folder.

There is a folder in the downloads folder with the same name as my nzb file - but it is in the "incomplete" folder in downloads - meaning I assume there is not enough info to decode the original file. And it only holds a small number of rar files, and a couple of par files.

For some reason - even though all the "articles" have been downloaded, they have not been assembled into the file I want, nor copied (like the others) into the "incomplete" folder.


EDIT: a little more info. If I look in the history, the download I am talking about still has the status "queued" rather than "completed", even though it is a couple of days since it finished. I suspect that as a result, the post processing has not happened. Is there any way I can force this download to complete, or force the post processing to take place?

Thanks.
Last edited by tonycollinet on February 2nd, 2010, 2:57 pm, edited 1 time in total.
tonycollinet
Newbie
Newbie
Posts: 9
Joined: January 31st, 2010, 10:32 am

Re: Where did the files go

Post by tonycollinet »

I've just stopped and restarted the service. It has now set the status to failed in history, and has started downloading some more par files.
User avatar
shypike
Administrator
Administrator
Posts: 19773
Joined: January 18th, 2008, 12:49 pm

Re: Where did the files go

Post by shypike »

Most files will consist of multiple articles that need to be
concatenated to form rar and par file and those files go to the "incomplete" folder.
The cache folder does not contain these files.

You will have to download the files that are missing in "incomplete".
(The foldernames are not very informative).

A "queued" job has all normal files plus the minimum amount of par2 files.
SABnzbd will not process them now. Try with QuickPar and Winrar (or unrar).
You may need to get more par2 files, QuickPar will tell you.

Edit: it did remember something about the job. Good.
tonycollinet
Newbie
Newbie
Posts: 9
Joined: January 31st, 2010, 10:32 am

Re: Where did the files go

Post by tonycollinet »

I think I am going to have to restart the whole job, because all the articles (the bulk of the file) in the cache folder seem to be being ignored.

Thanks for your help anyway.
CoxswainLovalot
Newbie
Newbie
Posts: 2
Joined: February 4th, 2010, 10:05 am

Re: Where did the files go

Post by CoxswainLovalot »

I am having a similar issue.. Both my incomplete and complete folders reside on an external USB HD, Sab seems to forget that it is there sometimes (It is still visible in the file system of my computer) and continues to download articles to the .cach folder, from there I am not sure where they go.. The History tab says they are completed ie. articles concatenated into .rars, verified and then unpacked and deleted. I find if I empty my que, reconfigure the folders and download again the files download ok.. Any ideas? Is this a bug or is there an issue with my HD?
User avatar
shypike
Administrator
Administrator
Posts: 19773
Joined: January 18th, 2008, 12:49 pm

Re: Where did the files go

Post by shypike »

CoxswainLovalot wrote: Sab seems to forget that it is there sometimes
SABnzbd knows nothing about external drives.
It relies completely on the operating system to do the right thing.
A path is a path for SABnzbd, the OS decides where the files go.
CoxswainLovalot
Newbie
Newbie
Posts: 2
Joined: February 4th, 2010, 10:05 am

Re: Where did the files go

Post by CoxswainLovalot »

Ok.. is it possible it is losing the path? As I said in my post I can still see the drive in the finder while this is happening..
User avatar
shypike
Administrator
Administrator
Posts: 19773
Joined: January 18th, 2008, 12:49 pm

Re: Where did the files go

Post by shypike »

It doesn't loose the path.
How do you know the OS does it right?
Does it handle things OK when the external drive has to wake up from standby?
We've see reports before from OS's that don't handle this transparently.

If you doubt SABnzbd, set the logging level to "Debug" and examine the
log after an error to see where SABnzbd tries to write the files.
Look specifically for the text "Creating directories:" where it creates the final folder.
Or "Checking existance of" where it checks if all files unpacked properly.
(Yes, there's a typo in "existance").
Post Reply