Page 1 of 1
First download +processing fine, rest not processing after download completion
Posted: November 14th, 2008, 1:07 pm
by thunderhawk
Version: 0.4.5
OS: Linux, Debian Etch
Install-type: Native Linux Binaries (from .tar.gz package @ sourceforge)
Skin (if applicable): Plush
Firewall Software: IPTables
Are you using IPV6? No
Is the issue reproducible? For me yes, for others, no idea
Well the subject kinda says it all: The first download SABnzbd processes goes perfectly fine. Downloading, Par checking, Unrarring & cleanup, no problemo! But every download after that ends up completing download and not being processed, and it simply 'hangs'. When I stop SABnzbd, clean the cache and restart SABnzbd, the first download goes perfecetly fine again etc. How could I fix this?
In the screenshot below, item #4 went fine (after restart, this time WITHOUT clearing cache, so doesn't really matter).

Re: First download +processing fine, rest not processing after download completion
Posted: November 14th, 2008, 1:15 pm
by shypike
Looks like an unreliable par2 or unrar program. What are you using?
Re: First download +processing fine, rest not processing after download completion
Posted: November 14th, 2008, 1:57 pm
by thunderhawk
server:~# /usr/bin/unrar
UNRAR 3.51 freeware Copyright (c) 1993-2005 Alexander Roshal
server:~# dpkg --list | grep tar
ii tar 1.16-2etch1 GNU tar
But I thought SABnzbd used its own internal engine for unrarring and such. Anyways, that's the thingies im using.
Re: First download +processing fine, rest not processing after download completion
Posted: November 14th, 2008, 3:28 pm
by shypike
Your unrar is rather old, please try to get 3.71.
The other program is par2, not tar.
The package is usually called par2cmdline.
Obviously SABnzbd doesn't have its own par2 and unrar.
Unrar is proprietary and par2 is a really complex program requiring
highly optimized C++ code.
Trying to duplicate this software would be silly.
Re: First download +processing fine, rest not processing after download completion
Posted: November 14th, 2008, 6:23 pm
by thunderhawk
I tried downloading this one today:
http://www.rarlab.com/rar/rarlinux-3.8.0.tar.gz
But that thing is useless, I keep getting
./unrar: /lib/tls/i686/cmov/libc.so.6: version `GLIBC_2.4' not found (required by ./unrar)
Sorry for tar, thats wrong ofcourse!
server:~/temp# dpkg --list | grep par2
ii par2 0.4-8 Parity Archive Volume Set, for checking and
server:~/temp/rar# dpkg --list | grep unrar
ii unrar 3.5.4-1.1 Unarchiver for .rar files (non-free version)
Re: First download +processing fine, rest not processing after download completion
Posted: November 14th, 2008, 6:29 pm
by thunderhawk
Ok nevermind, I've been able to switch to that new Unrar. It's 3.80 currently.
server:/# unrar
RAR 3.80 Copyright (c) 1993-2008 Alexander Roshal 16 Sep 2008
Testing now...
Re: First download +processing fine, rest not processing after download completion
Posted: November 14th, 2008, 6:46 pm
by thunderhawk
Ok so, stopped SABnzbd, cleared queue, cleared cache, cleared incompletes. Rar/Unrar version 3.80. Start SABnzbd with fresh NZB's. Problem persists:
Download 1
[Time-Taken] 2 seconds
[Avg-Speed] 612kB/s
[Par-Info] => No par2 sets
[RAR-INFO] WinRAR 3.80 => Unpacked 1 files/folders in 0.2s
[RAR-INFO] WinRAR 3.8 => Unpacked 1 files/folders in 0.3s
[DEL-INFO] WinRAR 3.80 => Deleted 1 file(s)
[DEL-INFO] WinRAR 3.8 => Deleted 1 file(s)
Download 2
[Time-Taken] 2 seconds
[Avg-Speed] 587kB/s
Re: First download +processing fine, rest not processing after download completion
Posted: November 15th, 2008, 6:56 am
by shypike
For par2 I have 0.4-9 (on Ubuntu, which is a Debian derivative).
Can you see which program hangs? Is it par2 or unrar?
The trouble is SABnzbd must rely on separately installed programs.
For Windows and OSX, we just package the binaries,
we cannot do that for the multitude of Unix/Linux/BSD distributions.
Re: First download +processing fine, rest not processing after download completion
Posted: November 15th, 2008, 7:42 am
by thunderhawk
server:~# ps aux | grep rar
root 4001 0.0 0.1 2848 696 pts/0 R+ 13:33 0:00 grep rar
server:~# ps aux | grep par
root 4005 0.0 0.1 2848 696 pts/0 R+ 13:34 0:00 grep par
Also, is it normal the WinRAR thingy's display twice?
[RAR-INFO] WinRAR 3.80 => Unpacked 1 files/folders in 0.2s
[RAR-INFO] WinRAR 3.8 => Unpacked 1 files/folders in 0.3s
[DEL-INFO] WinRAR 3.80 => Deleted 1 file(s)
[DEL-INFO] WinRAR 3.8 => Deleted 1 file(s)
Re: First download +processing fine, rest not processing after download completion
Posted: November 15th, 2008, 11:40 am
by shypike
Looks like neither program is actually running.
It looks like you downloaded WinRAR 3.80 itself and it looks like the NZB
contained two sets of files.
If so, then the output is normal.
Please, mail me the full logging (
bugs@sabnzbd.org).
Re: First download +processing fine, rest not processing after download completion
Posted: November 15th, 2008, 11:54 am
by thunderhawk
Yea I just came up with the brilliant idea myself that might be the case. Stupid me :-), Anyways, I tried another file, but same thing happens. (Not as in 2x Winrar showing up, but just the hanging issue

)
Sending full log to your e-mail.
Re: First download +processing fine, rest not processing after download completion
Posted: November 15th, 2008, 1:42 pm
by shypike
What you emailed is like a successful job.
It unrars, removed the junk and disconnects the news server.
So what's wrong in this situation?
I would need the logfiles for the successful job and the following hanging job.
BTW: what happens if you stop SABnzbd (with the shutdown button) when post-processing hangs.
Does post-processing resume on restart?
How much memory does your system have and do you have a swap partition?
Re: First download +processing fine, rest not processing after download completion
Posted: November 15th, 2008, 2:58 pm
by thunderhawk
How much memory does your system have and do you have a swap partition?
server:/# swapon -s
Filename Type Size Used Priority
/dev/md1 partition 3903672 88296 -1
A recent try showed that *some* NZB's are processing just fine and ending as it should. Therefore I mailed you 2 example NZB files which make the thing hang. Notice however that about 75% of the NZB's fail. So it can hardly be related to the NZB files.
Cleaned all. Inserted 2 NZB's in the queue.
BTW: what happens if you stop SABnzbd (with the shutdown button) when post-processing hangs.
Does post-processing resume on restart?
It does resume, but it 'hangs' again after finishing the post process (notice the circling thingy not being changed to the finished star icon). So it only does 1 post-process per restart as usual, and the other one goes red with the skull.
Log files sent to the mail address.
Re: First download +processing fine, rest not processing after download completion
Posted: November 16th, 2008, 7:47 am
by shypike
In your log file I see that the post-processing task crashes when it tries
to set permissions on the resulting files.
I suspect that this happens at the end of the first download and because
of the crash no further downloads are post-processed.
It looks like there is something wrong with the access rights of your destination folder.
OSError: [Errno 13] Permission denied: '/bulk/usenet/item2/BLABLABLA.exe'
Of course, SABnzbd should handle this gracefully and it will be repaired in the next release.
But you probably can solve the problem by checking (and fixing) access rights.
Maybe it is an incorrect value of "Permissions for completed downloads", check that too.
Re: First download +processing fine, rest not processing after download completion
Posted: November 16th, 2008, 8:17 am
by thunderhawk
Permissions:
After downloading & unpacking item1.nzb:
server:/bulk/usenet/item1# ls
total 44
drw-rw-rw- 5 usenet usenet 4096 2008-11-16 14:03 .
drwxrw-rw- 7 usenet usenet 4096 2008-11-16 14:03 ..
drwx------ 2 usenet usenet 4096 2008-11-11 15:52 Crack
-rw------- 1 usenet usenet 19263 2008-11-11 15:52 DJiNN.nfo
-rw------- 1 usenet usenet 900 2008-11-11 15:52 FILE_ID.diz
drwx------ 2 usenet usenet 4096 2008-11-16 14:03 SomeFile.Cracked-DJiNN
drwx------ 2 usenet usenet 4096 2008-11-11 15:52 Setup
server:/bulk/usenet/item1# su usenet
usenet@server:/bulk/usenet/item1$ ls
ls: .: Permission denied
usenet@server:/bulk/usenet/item1$ chmod a+rwx DJiNN.nfo
chmod: cannot access `DJiNN.nfo': Permission denied
Finally narrowed down the problem! Now for the right permissions then.
---
I think it's fixed now. I set the permission to 777 and they now complete!
Thanks a million!
