SABnzbd Forums

Hello,

I'm trying to configure my Iomega Storcenter ix2-200 Cloud Edition as a SABnzbd download server. The Storcenter OS is EMC Lifeline which is based on the Debian Linux distro. I installed all the software according to a procedure I made for myself from differrent sources on the internet. Everything was working at some point, but then I wanted to test my startup script to see if this worked too. After the reboot SAB is complaining it can't find par2, unrar and unzip while they are installed. How can I fix this problem?
I have tried somethings already. I tried a factory reset, removing all software I installed and starting the install procedure from scratch. None has worked.

2012-05-28 10:56:28,256::INFO::[SABnzbd:269] Web dir is /opt/share/SABnzbd/interfaces/Classic
2012-05-28 10:56:28,934::INFO::[SABnzbd:1038] Starting SABnzbd.py-0.5.6
2012-05-28 10:56:29,168::INFO::[dirscanner:375] Dirscanner starting up
2012-05-28 10:56:29,188::INFO::[urlgrabber:103] URLGrabber starting up
2012-05-28 10:56:29,197::INFO::[SABnzbd:390] _yenc module... found!
2012-05-28 10:56:29,208::ERROR::[SABnzbd:400] par2 binary... NOT found!
2012-05-28 10:56:29,211::WARNING::[SABnzbd:408] unrar binary... NOT found
2012-05-28 10:56:29,214::WARNING::[SABnzbd:413] unzip binary... NOT found!
2012-05-28 10:56:29,216::INFO::[SABnzbd:417] nice binary... found (/usr/bin/nice)
2012-05-28 10:56:29,229::INFO::[SABnzbd:421] ionice binary... found (/usr/bin/ionice)
2012-05-28 10:56:29,231::INFO::[SABnzbd:426] pyOpenSSL... found (True)
2012-05-28 10:56:29,257::INFO::[SABnzbd:1136] Starting web-interface on 0.0.0.0:8080

root@ix2-200:/opt/share/SABnzbd# ipkg list_installed
apr - 1.4.6-1 - Apache Portable Runtime library
apr-util - 1.4.1-1 - Apache Portable Runtime utilities library
autoconf - 2.69-1 - Creating scripts to configure source code packages using templates
automake - 1.12-1 - Creates GNU standards-compliant Makefiles from template files
bash - 3.2.49-1 - A bourne style shell
binutils - 2.19.1-1 - The GNU assembler and linker and related tools
bison - 2.4.1-1 - a general-purpose parser generator that converts an annotated context-free grammar into an LALR(1) or GLR parser for that gramm
bzip2 - 1.0.6-1 - Very high-quality data compression program
coreutils - 8.4-1 - Bunch of heavyweight *nix core utilities
cyrus-sasl-libs - 2.1.23-2 - Provides client or server side authentication (see RFC 2222).
diffutils - 3.1-1 - contains gnu diff, cmp, sdiff and diff3 to display differences between and among text files
e2fslibs - 1.41.14-1 - Ext2 Filesystem Libraries
expat - 2.0.1-1 - XML Parser library
file - 5.09-1 - Ubiquitous file identification utility.
findutils - 4.2.32-1 - File finding utilities
flex - 2.5.35-1 - Generates programs that perform pattern-matching on text.
gawk - 4.0.1-1 - Gnu AWK interpreter
gcc - 4.2.3-1 - The GNU Compiler Collection.
gdbm - 1.8.3-4 - GNU dbm is a set of database routines that use extensible hashing. It works similar to the standard UNIX dbm routines.
git - 1.7.10.3-1 - GIT is a directory tree content manager that can be used for distributed revision control.
groff - 1.19.2-2 - front-end for the groff document formatting system
gzip - 1.4-4 - GNU Zip data compression program
libc-dev - 2.5-5 - libc development files.
libcurl - 7.24.0-1 - Curl is a command line tool for transferring files with URL syntax, supporting FTP, FTPS, HTTP, HTTPS, GOPHER, TELNET, DICT, FI
libdb - 4.2.52-3 - Berkeley DB Libraries
libidn - 1.21-1 - GNU Libidn is an implementation of the Stringprep, Punycode and IDNA specifications defined by the IETF Internationalized Domai
libnsl - 2.5-4 - Network Services Library
libstdc++ - 6.0.9-6 - Standard C++ library, needed for dynamically linked C++ programs
libtool - 1.5.26-1 - Library tools.
libxml2 - 2.7.8-1 - Libxml2 is the XML C parser and toolkit developed for the Gnome project.
m4 - 1.4.16-1 - gnu macro processor and compiler front end
make - 3.82-1 - examines files and runs commands necessary for compilation
nano - 2.2.6-1 - A pico like editor
ncurses - 5.7-1 - NCurses libraries
ncursesw - 5.7-1 - NCurses libraries with wide char support
neon - 0.29.3-1 - an HTTP and WebDAV client library, with a C interface
openldap-libs - 2.3.43-2 - Open Lightweight Directory Access Protocol
openssl - 0.9.8v-2 - Openssl provides the ssl implementation in libraries libcrypto and libssl, and is needed by many other applications and librari
optware-devel - 6.8-10 - This is a meta package that bundles all the packages required for optware native development. When fully functional, it should
par2cmdline - 0.4-4 - tool to apply the data-recovery capability concepts of RAID-like systems to the posting & recovery of multi-part archives on Us
patch - 2.6.1-1 - applies a diff to produce a patched file
perl - 5.10.0-6 - Practical Extraction and Report Language.
pkgconfig - 0.15.0-2 - Package configuration tool
psmisc - 22.15-1 - A set of some small useful utilities that use the proc filesystem.
py25-cheetah - 2.4.2.1-1 - Cheetah - The Python-Powered Template Engine.
py25-yenc - 0.3-1 - A module that provides only raw yEnc encoding/decoding with builtin crc32 calculation (C implementation).
py26-cheetah - 2.4.2.1-1 - Cheetah - The Python-Powered Template Engine.
python25 - 2.5.6-2 - Python is an interpreted, interactive, object-oriented programming language.
python26 - 2.6.8-1 - Python is an interpreted, interactive, object-oriented programming language.
rcs - 5.7-2 - The Revision Control System (RCS) manages multiple revisions of files.
readline - 6.1-2 - The GNU Readline library provides a set of functions for use by applications that allow users to edit command lines as they are
rsync - 3.0.9-1 - fast remote file copy program (like rcp)
sabnzbdplus - 0.5.6-1 - A web-interface based binary newsgrabber written in python, with nzb file support.
sed - 4.2.1-1 - Stream editor.
sqlite - 3.7.12-1 - SQLite is a small C library that implements a self-contained, embeddable, zero-configuration SQL database engine.
svn - 1.7.5-2 - a compelling replacement for CVS
tar - 1.26-1 - heavyweight version of the Tape ARchiver
tcl - 8.4.19-2 - The Tool Command Language
unrar - 4.2.1-1 - unrar is an application that can decompress files and archives created using the RAR compression scheme
unzip - 6.0-2 - A (de)compression library for the ZIP format
wget-ssl - 1.12-2 - A network utility to retrieve files from the Web
zip - 3.0-1 - a compression and file packaging utility.
zlib - 1.2.5-1 - zlib is a library implementing the 'deflate' compression system.
Successfully terminated.
root@ix2-200:/opt/share/SABnzbd#

On the command line, what happens when you type

par2 <ENTER>
which par2 <ENTER>

root@ix2-200:/# par2
Not enough command line arguments.
par2cmdline version 0.4, Copyright (C) 2003 Peter Brian Clements.

par2cmdline comes with ABSOLUTELY NO WARRANTY.

This is free software, and you are welcome to redistribute it and/or modify
it under the terms of the GNU General Public License as published by the
Free Software Foundation; either version 2 of the License, or (at your
option) any later version. See COPYING for details.


Usage:

par2 c(reate) [options] <par2 file> [files] : Create PAR2 files
par2 v(erify) [options] <par2 file> [files] : Verify files using PAR2 file
par2 r(epair) [options] <par2 file> [files] : Repair files using PAR2 files

You may also leave out the "c", "v", and "r" commands by using "parcreate",
"par2verify", or "par2repair" instead.

Options:

-b<n> : Set the Block-Count
-s<n> : Set the Block-Size (Don't use both -b and -s)
-r<n> : Level of Redundancy (%%)
-c<n> : Recovery block count (Don't use both -r and -c)
-f<n> : First Recovery-Block-Number
-u : Uniform recovery file sizes
-l : Limit size of recovery files (Don't use both -u and -l)
-n<n> : Number of recovery files (Don't use both -n and -l)
-m<n> : Memory (in MB) to use
-v [-v]: Be more verbose
-q [-q]: Be more quiet (-q -q gives silence)
-- : Treat all remaining CommandLine as filenames

If you wish to create par2 files for a single source file, you may leave
out the name of the par2 file from the command line.

root@ix2-200:/# which par2
/opt/bin/par2

OK, so par2 is installed and in the path. Good. Let's check whether that path is also used by python and thus SABnzbd:
and a test in the way SABnzbd works: Go into the directory containing SABnzbd.py, in my case SABnzbd-0.7.0Beta8, and do the following tests:
And, possibly important:
Can you run sabnzbd as a normal user?
Can you run sabnzbd as a root?
Which account you filled in the daemon / service setup?
Can you run the above python tests both as normal user, and as root?

root@ix2-200:/# python
Python 2.5.2 (r252:60911, Jan 24 2010, 21:03:09)
[GCC 4.3.2] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> import os
>>> print os.system('par2')
Not enough command line arguments.
par2cmdline version 0.4, Copyright (C) 2003 Peter Brian Clements.

par2cmdline comes with ABSOLUTELY NO WARRANTY.

This is free software, and you are welcome to redistribute it and/or modify
it under the terms of the GNU General Public License as published by the
Free Software Foundation; either version 2 of the License, or (at your
option) any later version. See COPYING for details.


Usage:

par2 c(reate) [options] <par2 file> [files] : Create PAR2 files
par2 v(erify) [options] <par2 file> [files] : Verify files using PAR2 file
par2 r(epair) [options] <par2 file> [files] : Repair files using PAR2 files

You may also leave out the "c", "v", and "r" commands by using "parcreate",
"par2verify", or "par2repair" instead.

Options:

-b<n> : Set the Block-Count
-s<n> : Set the Block-Size (Don't use both -b and -s)
-r<n> : Level of Redundancy (%%)
-c<n> : Recovery block count (Don't use both -r and -c)
-f<n> : First Recovery-Block-Number
-u : Uniform recovery file sizes
-l : Limit size of recovery files (Don't use both -u and -l)
-n<n> : Number of recovery files (Don't use both -n and -l)
-m<n> : Memory (in MB) to use
-v [-v]: Be more verbose
-q [-q]: Be more quiet (-q -q gives silence)
-- : Treat all remaining CommandLine as filenames

If you wish to create par2 files for a single source file, you may leave
out the name of the par2 file from the command line.
768

root@ix2-200:/opt/share/SABnzbd# ls -l
total 360
-rw-r--r-- 1 root root 28466 Nov 15 2010 CHANGELOG.txt
-rw-r--r-- 1 root root 673 Nov 15 2010 COPYRIGHT.txt
-rw-r--r-- 1 root root 17990 Nov 15 2010 GPL2.txt
-rw-r--r-- 1 root root 35147 Nov 15 2010 GPL3.txt
-rw-r--r-- 1 root root 5125 Nov 15 2010 INSTALL.txt
-rw-r--r-- 1 root root 4168 Nov 15 2010 ISSUES.txt
-rw-r--r-- 1 root root 794 Nov 15 2010 LICENSE.txt
-rw-r--r-- 1 root root 319 Nov 15 2010 PKG-INFO
-rw-r--r-- 1 root root 10166 Nov 15 2010 README.txt
-rwxr-xr-x 1 root root 45177 Feb 14 17:20 SABnzbd.py
-rw-r--r-- 1 root root 421 Nov 15 2010 Sample-PostProc.cmd
-rwxr-xr-x 1 root root 433 Nov 15 2010 Sample-PostProc.sh
drwxr-xr-x 2 root root 24 May 28 12:26 admin
drwxr-xr-x 2 root root 53248 May 28 12:25 cache
drwxr-xr-x 6 root root 4096 May 28 12:00 cherrypy
drwx------ 4 root root 38 May 25 20:52 downloads
drwxr-xr-x 7 root root 69 Feb 14 17:20 interfaces
drwxr-xr-x 2 root root 4096 May 28 12:00 language
drwxr-xr-x 2 root root 4096 May 28 12:00 licenses
drwxr-xr-x 2 root root 88 May 27 08:48 logs
-rw-r--r-- 1 root root 96689 Nov 15 2010 nzb.ico
drwxr-xr-x 3 root root 4096 May 28 12:00 sabnzbd
-rw------- 1 root root 3612 May 28 12:25 sabnzbd.ini
root@ix2-200:/opt/share/SABnzbd# python
Python 2.5.2 (r252:60911, Jan 24 2010, 21:03:09)
[GCC 4.3.2] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> from sabnzbd.misc import find_on_path
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/mnt/system/opt/share/SABnzbd/sabnzbd/__init__.py", line 66, in <module>
import sabnzbd.nzbqueue as nzbqueue
File "/mnt/system/opt/share/SABnzbd/sabnzbd/nzbqueue.py", line 29, in <module>
from sabnzbd.nzbstuff import NzbObject
File "/mnt/system/opt/share/SABnzbd/sabnzbd/nzbstuff.py", line 37, in <module>
import sabnzbd.misc
File "/mnt/system/opt/share/SABnzbd/sabnzbd/misc.py", line 41, in <module>
from sabnzbd.codecs import unicoder, latin1
File "/mnt/system/opt/share/SABnzbd/sabnzbd/codecs.py", line 24, in <module>
from Cheetah.Filters import Filter
ImportError: No module named Cheetah.Filters
>>> print find_on_path('par2')
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
NameError: name 'find_on_path' is not defined

I got this "No module named Cheetah.Filters" error for SickBeard, CouchPotato and Headphones too and after some searching I found they needed Python 2.6. Perhaps SABnzbd also needs Python 2.6?

Can you run sabnzbd as a normal user?
I don't know. I SSH into the Storcenter with root. I have created an admin account for myself which also has root privilleges I think, but I can't use it to SSH onto the Storcenter.

Can you run sabnzbd as a root?
I only use the root account to start SABnzbd.

Which account you filled in the daemon / service setup?
I don't actually specify an account. This is the command I use to start SABnzbd:

/opt/share/SABnzbd/SABnzbd.py -f /opt/share/SABnzbd/sabnzbd.ini -s 0.0.0.0:8080 -d

Two things about this startup command:
1. For the other programs like SickBeard I specify the python version, because otherwise they won't start.

/opt/bin/python2.6 /opt/local/sickbeard/SickBeard.py --quiet --config=/opt/local/sickbeard/config.ini --datadir=/opt/local/sickbeard --daemon

There are two versions of python installed: 2.5 and 2.6.
2. For the -f option I have also tried it with /.sabnzbd/sabnzbd.ini. But after the reinstallation of the software it's no longer there.

Can you run the above python tests both as normal user, and as root?
I don't know how to create a normal account that also has the privillege to use SSH. If you give me sometime I can find out and let you know the results.

Hi Sander,

Thanks for your help by the way. I tried starting SABnzbd specifying python 2.6, like so:

/opt/bin/python2.6 /opt/share/SABnzbd/SABnzbd.py -f /opt/share/SABnzbd/sabnzbd.ini -s 0.0.0.0:8080 -d

Unfortunately it hasn't worked. Still the same error message appears that par2, unzip and unrar can't be found.

So you have only one account (root). So the cause cannot be one account having a full PATH, and another having no full PATH. Good.

SABnzbd does (still) support Python 2.5. So that shouldn't be the cause.

The Cheetah error message: I don't know how it is related to the find_on_path, but I do know Cheetah is needed by SABnzbd. So: did you install the debian package "python-cheetah"? The commands below should work after installing it:

FYI: In the old days, when SABnzbd was not yet a package on Ubuntu, this was the command I used to install the required packages:
Question: your system is Debian based, but based on your post I assume it does not use the Debian repository? Otherwise installing the sabnzbdplus package (http://packages.debian.org/sid/sabnzbdplus) would resolved all dependencies ...

HTH

I didn't see the complete code you typed. Here's the rest of it:

>>> print os.environ['PATH']
/opt/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
>>>

nextraa wrote:I didn't see the complete code you typed. Here's the rest of it:

>>> print os.environ['PATH']
/opt/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
>>>

Let's focus on the python-cheetah package: have you installed that?

I did install the Cheetah packages for both Python 2.5 and 2.6. And they are detected as installed:

root@ix2-200:/# ipkg list_installed py*
py25-cheetah - 2.4.2.1-1 - Cheetah - The Python-Powered Template Engine.
py25-yenc - 0.3-1 - A module that provides only raw yEnc encoding/decoding with builtin crc32 calculation (C implementation).
py26-cheetah - 2.4.2.1-1 - Cheetah - The Python-Powered Template Engine.
python25 - 2.5.6-2 - Python is an interpreted, interactive, object-oriented programming language.
python26 - 2.6.8-1 - Python is an interpreted, interactive, object-oriented programming language.
Successfully terminated.

>>> from Cheetah.Filters import Filters
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
ImportError: No module named Cheetah.Filters

ipkg is installed by default in the Storcenter and it uses the NSLU2 linux repository. http://ipkg.nslu2-linux.org/feeds/optwa ... oss/stable I read there is a way to install Debian packages too. I haven't tried it yet. If I can't get this package to work I might try a Debian package. But I still think it's weird, because it was working before.

So you have python-cheetah installed. Good. Can you check if there is a Filters.py in the Cheetah directory?

On my ubuntu the check is easy:
And: The ipk packages link you gave contains "sabnzbdplus_0.5.6-1_arm.ipk". Did you install that?

EDIT:

I did some hacking on the py26-cheetah_2.4.2.1-1_arm.ipk package: you can unpack it with "tar xvfz", and then "tar xvfz data.tar.gz", which will unpack and show all the files therein. The good news: it does contain this file:
So I expect Cheetah/Filters.py to be available on your system. Is it? If not, did you install py26-cheetah_2.4.2.1-1_arm.ipk, and run SABnzbd with python2.6?

Well ... If even the above fails, how about some hacking?

In the file sabnzbd/newsunpack.py there is this code for non-Windows systems like yours:
First of all: I find it strange that your SABnzbd does find 'nice' and 'ionice', but doesn't find 'par2'. Can you check where those programs are installed.
Then: let's just hack something:

Delete (or comment) this line and add this line right after it with the exact same indention: Then save the file, and start SABnzbd again ... does that work?

I cannot use locate:

root@ix2-200:/# locate
-sh: locate: command not found
root@ix2-200:/# ipkg-opt install locate
Nothing to be done
An error ocurred, return value: 4.
Collected errors:
Cannot find package locate.
Check the spelling or perhaps run 'ipkg update'

I installed the sabnzbdplus_0.5.6-1_arm.ipk package

root@ix2-200:/opt/lib/python2.6/site-packages/Cheetah# ls -l Fi*
-rw-r--r-- 1 root root 10664 Jan 3 2010 FileUtils.py
-rw-r--r-- 1 root root 13374 Feb 14 17:23 FileUtils.pyc
-rw-r--r-- 1 root root 7639 Jan 3 2010 Filters.py
-rw-r--r-- 1 root root 8641 Feb 14 17:23 Filters.pyc

I did find the Filters.py where you said it would be.

I have to go to work, but I will try your other suggestions tonight.

root@ix2-200:/opt/bin# which unrar
/opt/bin/unrar
root@ix2-200:/opt/bin# which unzip
/opt/bin/unzip
root@ix2-200:/opt/bin# which nice
/opt/bin/nice
root@ix2-200:/opt/bin# which ionice
/usr/bin/ionice
root@ix2-200:/opt/bin# which par2
/opt/bin/par2

I edited the newsunpack.py file like you said.

else:
if not sabnzbd.newsunpack.PAR2_COMMAND:
sabnzbd.newsunpack.PAR2_COMMAND = find_on_path('par2')
sabnzbd.newsunpack.PAR2_COMMAND = '/opt/bin/par2'
if not sabnzbd.newsunpack.RAR_COMMAND:
sabnzbd.newsunpack.RAR_COMMAND = find_on_path(('unrar', 'rar', 'unrar3', 'rar3',))
sabnzbd.newsunpack.NICE_COMMAND = find_on_path('nice')
sabnzbd.newsunpack.IONICE_COMMAND = find_on_path('ionice')
sabnzbd.newsunpack.ZIP_COMMAND = find_on_path('unzip')

It worked!! When I started SABnzbd it did find the PAR2 program. So I guess I have to do the same for unrar and unzip too, right? Should I take out the lines with the "find_on_path" line?

2012-05-29 20:22:59,723::INFO::[SABnzbd:973] --------------------------------
2012-05-29 20:22:59,739::INFO::[SABnzbd:974] SABnzbd.py-0.5.6 (rev=2503)
2012-05-29 20:22:59,741::INFO::[SABnzbd:984] Platform = posix
2012-05-29 20:22:59,744::INFO::[SABnzbd:985] Python-version = 2.5.6 (r256:88840, Feb 15 2012, 19:50:54)
[GCC 4.2.3]
2012-05-29 20:23:00,105::INFO::[__init__:702] /opt/share/SABnzbd/cache/bookmarks.sab removed
2012-05-29 20:23:00,121::INFO::[postproc:139] Loading postproc queue
2012-05-29 20:23:00,126::INFO::[__init__:702] /opt/share/SABnzbd/cache/postproc1.sab removed
2012-05-29 20:23:00,141::INFO::[downloader:334] Resuming
2012-05-29 20:23:00,305::INFO::[__init__:251] All processes started
2012-05-29 20:23:00,309::INFO::[SABnzbd:269] Web dir is /opt/share/SABnzbd/interfaces/Classic
2012-05-29 20:23:00,863::INFO::[SABnzbd:1038] Starting SABnzbd.py-0.5.6
2012-05-29 20:23:00,917::INFO::[dirscanner:375] Dirscanner starting up
2012-05-29 20:23:00,947::INFO::[urlgrabber:103] URLGrabber starting up
2012-05-29 20:23:00,955::INFO::[SABnzbd:390] _yenc module... found!
2012-05-29 20:23:00,958::INFO::[SABnzbd:398] par2 binary... found (/opt/bin/par2)
2012-05-29 20:23:00,976::WARNING::[SABnzbd:408] unrar binary... NOT found
2012-05-29 20:23:00,979::WARNING::[SABnzbd:413] unzip binary... NOT found!
2012-05-29 20:23:00,982::INFO::[SABnzbd:417] nice binary... found (/usr/bin/nice)
2012-05-29 20:23:00,984::INFO::[SABnzbd:421] ionice binary... found (/usr/bin/ionice)
2012-05-29 20:23:00,997::INFO::[SABnzbd:428] pyOpenSSL... NOT found - try apt-get install python-pyopenssl (SSL is optional)
2012-05-29 20:23:01,030::INFO::[SABnzbd:1136] Starting web-interface on 0.0.0.0:8080

Yes, that's right.

However: I still don't get the logic behind the not finding par2 and unrar and unzip. Hey, wait:
How about this hypthosis: only binaries in /usr/bin are found, and binaries in /opt/bin are not found?