Page 2 of 2
Re: SAB fails to repair when temp folder over network
Posted: January 16th, 2016, 2:54 am
by summer10
Forgot to say that this solution doesn't work:
sander wrote:EDIT:
Probably easier / better: edit the .NZB and move the Big.Buck.Bunny.2008.1080p.x264-60fps.vol93+92.par2 block to the beginning of the .NZB
I moved the file one line up within the NZB file (I confirm it was the last file listed).But it was still downloaded last (I verified). And the MD5 remains incorrect after download. Maybe SAB sorts the file list alphabetically.
Re: SAB fails to repair when temp folder over network
Posted: January 16th, 2016, 4:23 am
by summer10
sander wrote:EDIT 2:
Even more easy: put the regular .NZB into SAB, in SAB's main interface, right of the download click on the folder icon, and drag-and-drop the par2 files at the bottom a few lines higher.
I can't do that - I am not quick enough. The first PAR2 files that are downloaded just take 1-2 seconds.
By the time I go to the file list when the PAR2 download is initiated (after initial verification), the first few files have been downloaded and it's too late.
If somebody can point me to the source code location where I can maybe reverse the order of the PAR2 downloads, I can test that and report back.
It is highly unlikely there is a problem with Samba, both client and server side.
I already know it is not a problem with the NTFS filesystem on the server side, as I have tested with another USB drive, this time formatted with ext4, and the problem remains the same.
For me, there is something fishy with SAB.
Re: SAB fails to repair when temp folder over network
Posted: January 16th, 2016, 5:28 am
by shypike
There is something fishy with the operating system.
For SABnzbd it doesn't matter where files reside.
It does rather simple calls to the operating system for reading and writing chunks of data.
Nothing special.
Re: SAB fails to repair when temp folder over network
Posted: January 16th, 2016, 6:06 am
by summer10
I tried mounting the Samba share with the cache=none option, to no avail.
Re: SAB fails to repair when temp folder over network
Posted: January 16th, 2016, 7:51 am
by summer10
Tried various mount options, all to no avail.
Code: Select all
//myserver/myshare /media/freeboxusb cifs _netdev,nounix,cache=none,noserverino,rw,users,uid=1000,file_mode=0777,dir_mode=0777,user=XXXX,pass=XXXX,sec=none 0 0
Tried cache=none,noserverino,nounix or combination thereof, nothing works.
Alright, I'm done, enough is enough.
Re: SAB fails to repair when temp folder over network
Posted: January 17th, 2016, 3:45 am
by sander
summer10 wrote:sander wrote:EDIT 2:
Even more easy: put the regular .NZB into SAB, in SAB's main interface, right of the download click on the folder icon, and drag-and-drop the par2 files at the bottom a few lines higher.
I can't do that - I am not quick enough. The first PAR2 files that are downloaded just take 1-2 seconds.
By the time I go to the file list when the PAR2 download is initiated (after initial verification), the first few files have been downloaded and it's too late.
If you still want, do this:
First pause SABnzbd itself (top line).
Get this NZB:
https://gist.github.com/sanderjo/c17b6d3e6e9e692627fb
Add it to SABnzbd (which is still paused), with "Download" selected (not repair and delete)
With the NZB in the download queue, click on the folder icon on the right of it. In there, drag and drop the line with ....mp3 to the bottom.
If that succeeds: unpause SABnzbd
Wait for the download to complete.
Afterwards, check if all files have the correct SFV value.
Re: SAB fails to repair when temp folder over network
Posted: January 17th, 2016, 12:35 pm
by sander
I mounted my Synology Diskstation as a Samba share from my Ubuntu, and used that as Temp and Complete folder.
Code: Select all
$ cat ~/.sabnzbd/sabnzbd.ini | grep -i gvfs
download_dir = "/run/user/1000/gvfs/afp-volume:host=DiskStation.local,user=admin,volume=home/CloudStation/Downloads/incomplete"
complete_dir = "/run/user/1000/gvfs/afp-volume:host=DiskStation.local,user=admin,volume=home/CloudStation/Downloads/"
Results so far:
- SABnzbd's webinterface becomes very slow and even unresponsive
- 'top' shows a CPU load of 100% for gvfsd-afp ...
Code: Select all
$ top -bn1 | grep -i -e gvfsd -e COMMAND
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
4077 sander 20 0 887588 11844 8048 S 101,7 0,3 6:43.05 gvfsd-afp
2941 sander 20 0 194052 5904 5248 S 0,0 0,2 0:00.13 gvfsd
2949 sander 20 0 1230484 9240 5092 S 0,0 0,2 0:06.99 gvfsd-fuse
3452 sander 20 0 356848 6884 6016 S 0,0 0,2 0:00.05 gvfsd-trash
3578 sander 20 0 267660 6712 4272 S 0,0 0,2 0:00.01 gvfsd-burn
4312 sander 20 0 294068 10676 7728 S 0,0 0,3 0:00.00 gvfsd-http
Code: Select all
$ time lynx --dump http://localhost:8080/
^C
real 5m48.484s
user 0m0.056s
sys 0m0.040s
... no response within 5 minutes ...
So ... those are not good ingredients for a successful download.
Re: SAB fails to repair when temp folder over network
Posted: January 17th, 2016, 12:54 pm
by summer10
There shouldn't be a problem with the temp folder over the network (I use cifs, not gvfs, by the way).
SAB does not give too much of a hard time to the network, I've seen much worse, quite frankly.
When you think (already back in the late 90's), many universities used setups with Linux systems booting with root on NFS... imagine the load there was, and the quantity of random access.
I should be able to test in the next day or two.
Re: SAB fails to repair when temp folder over network
Posted: January 17th, 2016, 1:01 pm
by sander
Ignore my post; it's an AFP share, which is Apple File Protocol.
I will now connect via SMB.
Code: Select all
$ cat ~/.sabnzbd/sabnzbd.ini | grep smb
download_dir = '"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete'
complete_dir = '"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/'
EDIT:
No problems with SMB; Download completes successfully.
Code: Select all
$ cat ~/.sabnzbd/logs/sabnzbd.log | grep smb | grep Decoding
2016-01-17 19:01:58,031::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part02.rar yenc
2016-01-17 19:02:02,158::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part03.rar yenc
2016-01-17 19:02:05,080::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part04.rar yenc
2016-01-17 19:02:11,497::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part01.rar yenc
2016-01-17 19:02:13,626::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part23.rar yenc
2016-01-17 19:02:15,212::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part05.rar yenc
2016-01-17 19:02:19,968::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part06.rar yenc
2016-01-17 19:02:20,852::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.par2 yenc
2016-01-17 19:02:21,977::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/SBYO14-52 Sarah Bird - The Yokota Officers Club.mp3 yenc
2016-01-17 19:02:24,474::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part07.rar yenc
2016-01-17 19:02:28,703::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part08.rar yenc
2016-01-17 19:02:34,212::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part09.rar yenc
2016-01-17 19:02:37,311::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part10.rar yenc
2016-01-17 19:02:41,459::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part11.rar yenc
2016-01-17 19:02:45,673::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part12.rar yenc
2016-01-17 19:02:50,221::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part13.rar yenc
2016-01-17 19:02:54,748::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part14.rar yenc
2016-01-17 19:02:58,596::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part15.rar yenc
2016-01-17 19:03:01,796::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.sfv yenc
2016-01-17 19:03:01,937::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.nzb yenc
2016-01-17 19:03:01,989::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.nfo yenc
2016-01-17 19:03:02,410::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part16.rar yenc
2016-01-17 19:03:08,976::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part17.rar yenc
2016-01-17 19:03:11,981::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part18.rar yenc
2016-01-17 19:03:16,730::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part19.rar yenc
2016-01-17 19:03:19,698::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part20.rar yenc
2016-01-17 19:03:22,641::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part21.rar yenc
2016-01-17 19:03:25,058::INFO::[assembler:88] Decoding /home/sander/"/run/user/1000/gvfs/smb-share:server=diskstation,share=home/CloudStation/Downloads/incomplete/Big%20Buck%20Bunny%20plus%20a%20bit%20more/Big.Buck.Bunny.2008.1080p.x264-60fps.part22.rar yenc
Re: SAB fails to repair when temp folder over network
Posted: January 17th, 2016, 1:27 pm
by summer10
Maybe I will try with gvfs, too. So far, I've been using the more popular cifs, but it's a good test.
After that, this may come from the Raspberry OS or software components, or the SMB server.