First download +processing fine, rest not processing after download completion

[thunderhawk]

Version: 0.4.5
OS: Linux, Debian Etch
Install-type: Native Linux Binaries (from .tar.gz package @ sourceforge)
Skin (if applicable): Plush
Firewall Software: IPTables
Are you using IPV6? No
Is the issue reproducible? For me yes, for others, no idea

Well the subject kinda says it all: The first download SABnzbd processes goes perfectly fine. Downloading, Par checking, Unrarring & cleanup, no problemo! But every download after that ends up completing download and not being processed, and it simply 'hangs'. When I stop SABnzbd, clean the cache and restart SABnzbd, the first download goes perfecetly fine again etc. How could I fix this?

In the screenshot below, item #4 went fine (after restart, this time WITHOUT clearing cache, so doesn't really matter).

[shypike]

Looks like an unreliable par2 or unrar program. What are you using?

[thunderhawk]

server:~# /usr/bin/unrar
UNRAR 3.51 freeware  Copyright (c) 1993-2005 Alexander Roshal

server:~# dpkg --list | grep tar
ii  tar  1.16-2etch1  GNU tar

But I thought SABnzbd used its own internal engine for unrarring and such. Anyways, that's the thingies im using.

[shypike]

Your unrar is rather old, please try to get 3.71.

The other program is par2, not tar.
The package is usually called par2cmdline.

Obviously SABnzbd doesn't have its own par2 and unrar.
Unrar is proprietary and par2 is a really complex program requiring
highly optimized C++ code.
Trying to duplicate this software would be silly.

[thunderhawk]

I tried downloading this one today: http://www.rarlab.com/rar/rarlinux-3.8.0.tar.gz
But that thing is useless, I keep getting

./unrar: /lib/tls/i686/cmov/libc.so.6: version `GLIBC_2.4' not found (required by ./unrar)

Sorry for tar, thats wrong ofcourse!

server:~/temp# dpkg --list | grep par2
ii  par2  0.4-8  Parity Archive Volume Set, for checking and

server:~/temp/rar# dpkg --list | grep unrar
ii  unrar  3.5.4-1.1  Unarchiver for .rar files (non-free version)

[thunderhawk]

Ok nevermind, I've been able to switch to that new Unrar. It's 3.80 currently.

server:/# unrar
RAR 3.80   Copyright (c) 1993-2008 Alexander Roshal   16 Sep 2008

Testing now...

[thunderhawk]

Ok so, stopped SABnzbd, cleared queue, cleared cache, cleared incompletes. Rar/Unrar version 3.80. Start SABnzbd with fresh NZB's. Problem persists:




Download 1
[Time-Taken] 2 seconds
[Avg-Speed] 612kB/s
[Par-Info] => No par2 sets
[RAR-INFO] WinRAR 3.80 => Unpacked 1 files/folders in 0.2s
[RAR-INFO] WinRAR 3.8 => Unpacked 1 files/folders in 0.3s
[DEL-INFO] WinRAR 3.80 => Deleted 1 file(s)
[DEL-INFO] WinRAR 3.8 => Deleted 1 file(s)

Download 2
[Time-Taken] 2 seconds
[Avg-Speed] 587kB/s

[shypike]

For par2 I have 0.4-9 (on Ubuntu, which is a Debian derivative).

Can you see which program hangs? Is it par2 or unrar?

The trouble is SABnzbd must rely on separately installed programs.
For Windows and OSX, we just package the binaries,
we cannot do that for the multitude of Unix/Linux/BSD distributions.

[thunderhawk]

server:~# ps aux | grep rar
root      4001  0.0  0.1   2848   696 pts/0    R+   13:33   0:00 grep rar

server:~# ps aux | grep par
root      4005  0.0  0.1   2848   696 pts/0    R+   13:34   0:00 grep par



Also, is it normal the WinRAR thingy's display twice?

[RAR-INFO] WinRAR 3.80 => Unpacked 1 files/folders in 0.2s
[RAR-INFO] WinRAR 3.8 => Unpacked 1 files/folders in 0.3s
[DEL-INFO] WinRAR 3.80 => Deleted 1 file(s)
[DEL-INFO] WinRAR 3.8 => Deleted 1 file(s)

[shypike]

Looks like neither program is actually running.

It looks like you downloaded WinRAR 3.80 itself and it looks like the NZB
contained two sets of files.
If so, then the output is normal.

Please, mail me the full logging (bugs@sabnzbd.org).

[thunderhawk]

Yea I just came up with the brilliant idea myself that might be the case. Stupid me :-), Anyways, I tried another file, but same thing happens. (Not as in 2x Winrar showing up, but just the hanging issue )

Sending full log to your e-mail.

[shypike]

What you emailed is like a successful job.
It unrars, removed the junk and disconnects the news server.
So what's wrong in this situation?

I would need the logfiles for the successful job and the following hanging job.
BTW: what happens if you stop SABnzbd (with the shutdown button) when post-processing hangs.
Does post-processing resume on restart?

How much memory does your system have and do you have a swap partition?

[thunderhawk]

How much memory does your system have and do you have a swap partition?
server:/# swapon -s
Filename    Type          Size         Used      Priority
/dev/md1   partition    3903672  88296   -1

A recent try showed that *some* NZB's are processing just fine and ending as it should. Therefore I mailed you 2 example NZB files which make the thing hang. Notice however that about 75% of the NZB's fail. So it can hardly be related to the NZB files.

Cleaned all. Inserted 2 NZB's in the queue.



BTW: what happens if you stop SABnzbd (with the shutdown button) when post-processing hangs.
Does post-processing resume on restart?

It does resume, but it 'hangs' again after finishing the post process (notice the circling thingy not being changed to the finished star icon). So it only does 1 post-process per restart as usual, and the other one goes red with the skull.


Log files sent to the mail address.

[shypike]

In your log file I see that the post-processing task crashes when it tries
to set permissions on the resulting files.
I suspect that this happens at the end of the first download and because
of the crash no further downloads are post-processed.

It looks like there is something wrong with the access rights of your destination folder.
OSError: [Errno 13] Permission denied: '/bulk/usenet/item2/BLABLABLA.exe'

Of course, SABnzbd should handle this gracefully and it will be repaired in the next release.
But you probably can solve the problem by checking (and fixing) access rights.
Maybe it is an incorrect value of "Permissions for completed downloads", check that too.

[thunderhawk]

Permissions:



After downloading & unpacking item1.nzb:

server:/bulk/usenet/item1# ls
total 44
drw-rw-rw- 5 usenet usenet  4096 2008-11-16 14:03 .
drwxrw-rw- 7 usenet usenet  4096 2008-11-16 14:03 ..
drwx------ 2 usenet usenet  4096 2008-11-11 15:52 Crack
-rw------- 1 usenet usenet 19263 2008-11-11 15:52 DJiNN.nfo
-rw------- 1 usenet usenet   900 2008-11-11 15:52 FILE_ID.diz
drwx------ 2 usenet usenet  4096 2008-11-16 14:03 SomeFile.Cracked-DJiNN
drwx------ 2 usenet usenet  4096 2008-11-11 15:52 Setup

server:/bulk/usenet/item1# su usenet

usenet@server:/bulk/usenet/item1$ ls
ls: .: Permission denied

usenet@server:/bulk/usenet/item1$ chmod a+rwx DJiNN.nfo
chmod: cannot access `DJiNN.nfo': Permission denied

Finally narrowed down the problem! Now for the right permissions then.

---

I think it's fixed now. I set the permission to 777 and they now complete!

Thanks a million!