SAB fails to repair when temp folder over network

[summer10]

Forgot to say that this solution doesn't work:

EDIT:

Probably easier / better: edit the .NZB and move the Big.Buck.Bunny.2008.1080p.x264-60fps.vol93+92.par2 block to the beginning of the .NZB

I moved the file one line up within the NZB file (I confirm it was the last file listed).But it was still downloaded last (I verified). And the MD5 remains incorrect after download. Maybe SAB sorts the file list alphabetically.

[summer10]

EDIT 2:

Even more easy: put the regular .NZB into SAB, in SAB's main interface, right of the download click on the folder icon, and drag-and-drop the par2 files at the bottom a few lines higher.

I can't do that - I am not quick enough. The first PAR2 files that are downloaded just take 1-2 seconds.
By the time I go to the file list when the PAR2 download is initiated (after initial verification), the first few files have been downloaded and it's too late.

If somebody can point me to the source code location where I can maybe reverse the order of the PAR2 downloads, I can test that and report back.

It is highly unlikely there is a problem with Samba, both client and server side.
I already know it is not a problem with the NTFS filesystem on the server side, as I have tested with another USB drive, this time formatted with ext4, and the problem remains the same.
For me, there is something fishy with SAB.

[shypike]

There is something fishy with the operating system.
For SABnzbd it doesn't matter where files reside.
It does rather simple calls to the operating system for reading and writing chunks of data.
Nothing special.

[summer10]

I tried mounting the Samba share with the cache=none option, to no avail.

[summer10]

Tried various mount options, all to no avail.

Code: Select all

//myserver/myshare        /media/freeboxusb       cifs    _netdev,nounix,cache=none,noserverino,rw,users,uid=1000,file_mode=0777,dir_mode=0777,user=XXXX,pass=XXXX,sec=none     0       0

Tried cache=none,noserverino,nounix or combination thereof, nothing works.
Alright, I'm done, enough is enough.

[sander]

EDIT 2:

Even more easy: put the regular .NZB into SAB, in SAB's main interface, right of the download click on the folder icon, and drag-and-drop the par2 files at the bottom a few lines higher.

I can't do that - I am not quick enough. The first PAR2 files that are downloaded just take 1-2 seconds.
By the time I go to the file list when the PAR2 download is initiated (after initial verification), the first few files have been downloaded and it's too late.

If you still want, do this:
First pause SABnzbd itself (top line).
Get this NZB: https://gist.github.com/sanderjo/c17b6d3e6e9e692627fb
Add it to SABnzbd (which is still paused), with "Download" selected (not repair and delete)
With the NZB in the download queue, click on the folder icon on the right of it. In there, drag and drop the line with ....mp3 to the bottom.
If that succeeds: unpause SABnzbd
Wait for the download to complete.

Afterwards, check if all files have the correct SFV value.

[sander]

I mounted my Synology Diskstation as a Samba share from my Ubuntu, and used that as Temp and Complete folder.

Code: Select all

$ cat ~/.sabnzbd/sabnzbd.ini | grep -i gvfs
download_dir = "/run/user/1000/gvfs/afp-volume:host=DiskStation.local,user=admin,volume=home/CloudStation/Downloads/incomplete"
complete_dir = "/run/user/1000/gvfs/afp-volume:host=DiskStation.local,user=admin,volume=home/CloudStation/Downloads/"

Results so far:

- SABnzbd's webinterface becomes very slow and even unresponsive
- 'top' shows a CPU load of 100% for gvfsd-afp ...

Code: Select all

$ top -bn1 | grep -i -e gvfsd -e COMMAND
  PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
 4077 sander    20   0  887588  11844   8048 S 101,7  0,3   6:43.05 gvfsd-afp
 2941 sander    20   0  194052   5904   5248 S   0,0  0,2   0:00.13 gvfsd
 2949 sander    20   0 1230484   9240   5092 S   0,0  0,2   0:06.99 gvfsd-fuse
 3452 sander    20   0  356848   6884   6016 S   0,0  0,2   0:00.05 gvfsd-trash
 3578 sander    20   0  267660   6712   4272 S   0,0  0,2   0:00.01 gvfsd-burn
 4312 sander    20   0  294068  10676   7728 S   0,0  0,3   0:00.00 gvfsd-http

Code: Select all

$ time lynx --dump http://localhost:8080/
^C

real	5m48.484s
user	0m0.056s
sys	0m0.040s

... no response within 5 minutes ...

So ... those are not good ingredients for a successful download.

[summer10]

There shouldn't be a problem with the temp folder over the network (I use cifs, not gvfs, by the way).
SAB does not give too much of a hard time to the network, I've seen much worse, quite frankly.
When you think (already back in the late 90's), many universities used setups with Linux systems booting with root on NFS... imagine the load there was, and the quantity of random access.

I should be able to test in the next day or two.

[sander]

Ignore my post; it's an AFP share, which is Apple File Protocol.

I will now connect via SMB.

Code: Select all

$ cat ~/.sabnzbd/sabnzbd.ini | grep smb
download_dir = '"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete'
complete_dir = '"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/'

EDIT:

No problems with SMB; Download completes successfully.

Code: Select all

$ cat ~/.sabnzbd/logs/sabnzbd.log | grep smb | grep Decoding
2016-01-17 19:01:58,031::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part02.rar yenc
2016-01-17 19:02:02,158::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part03.rar yenc
2016-01-17 19:02:05,080::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part04.rar yenc
2016-01-17 19:02:11,497::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part01.rar yenc
2016-01-17 19:02:13,626::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part23.rar yenc
2016-01-17 19:02:15,212::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part05.rar yenc
2016-01-17 19:02:19,968::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part06.rar yenc
2016-01-17 19:02:20,852::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.par2 yenc
2016-01-17 19:02:21,977::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/SBYO14-52 Sarah Bird - The Yokota Officers Club.mp3 yenc
2016-01-17 19:02:24,474::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part07.rar yenc
2016-01-17 19:02:28,703::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part08.rar yenc
2016-01-17 19:02:34,212::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part09.rar yenc
2016-01-17 19:02:37,311::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part10.rar yenc
2016-01-17 19:02:41,459::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part11.rar yenc
2016-01-17 19:02:45,673::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part12.rar yenc
2016-01-17 19:02:50,221::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part13.rar yenc
2016-01-17 19:02:54,748::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part14.rar yenc
2016-01-17 19:02:58,596::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part15.rar yenc
2016-01-17 19:03:01,796::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.sfv yenc
2016-01-17 19:03:01,937::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.nzb yenc
2016-01-17 19:03:01,989::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.nfo yenc
2016-01-17 19:03:02,410::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part16.rar yenc
2016-01-17 19:03:08,976::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part17.rar yenc
2016-01-17 19:03:11,981::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part18.rar yenc
2016-01-17 19:03:16,730::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part19.rar yenc
2016-01-17 19:03:19,698::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part20.rar yenc
2016-01-17 19:03:22,641::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part21.rar yenc
2016-01-17 19:03:25,058::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part22.rar yenc

[summer10]

Maybe I will try with gvfs, too. So far, I've been using the more popular cifs, but it's a good test.
After that, this may come from the Raspberry OS or software components, or the SMB server.