CRC errors on 80pct downloads...

[Dannermax]

Hello.

I have installed Sabnzbd from Git, and im running it with OpenMediaVault on my Proliant Server. The problem im having, is that alot of my downloads have missing blocks in them.

Like How i Met Your Mother s08e17. I grabbed this with sickbeard and sab downloaded it. It had 3 missing blocks, and if i translate some of the text (its Danish) the following means:

mangler fra alle servere, afviser = "missing from all servers, rejected" (from the code below)

I tried downloading this (with the nzb file) from another download client: "Newsleecher", and it downloaded and extracted without any errors.

I also tried downloading How I Met Your Mother s08e16 and this failed with only 1 missing block...! I tried downloading this again with sab, and this time is didnt report any errors.. Besides this, alot of movie downloads gives me CRC errors aswell..

I didnt have problems like this when i installed sab from this script: http://forums.openmediavault.org/viewtopic.php?f=13&t=6

Could this have anything to do with the dependencies i have installed with sab. I did this command, after i installed sab:

sudo apt-get install python python-cheetah python-openssl python-yenc par2 unzip

and

apt-get unzip

Because somehow unzip wasnt installed with the first command line.

It is very frustrating that all of a sudden almost 80pct of downloads fail. When downloading, the transfer speed is around 1,3 mbps. Does download speed and crc errors have anything to do with each other? Perhaps i should turn it down li like 500kbps and see if that makes it any better?

Here is the log of the download from sab. Sorry for all the code, but i just figued id better post it all.

Here is the paste:

http://pastebin.com/Rt1Ls89m

Thanks

[sander]

Weird path:
/media/03b6b2de-5b48-4a79-a826-ab98dd33b908/\\home/video/downloads/sab-temp/sab-done/incomplete/

Why the \\home? Is this on your local harddisk, or on a NAS?

Furthermore:

As a test, download a recent Ubuntu image ( http://goo.gl/dgcJ8 )and tell us your download result.
(And no, I'm NOT asking you to use Ubuntu. Just download it as a test; it's free content, so always available on a newsservers and not removed)

[Dannermax]

Hey Sander.

The home directory is a mounted samba share on my NAS which is running OpenMediaVault. Its Debian i think.

Could you post the link again.. it looks wierd and brings me to a search engine: http://binsearch.info/index.php?q=ubunt ... &postdate=

Thanks for the quick reply.

[sander]

Unpacking over a network share is not recommended. First step is to set the "complete" directory to a local drive. Can you do that?

Ubuntu URL binsearch is: http://goo.gl/dgcJ8

[Dannermax]

ahh i see..

But my server is running sabnzbd, and the incomplete and complete files are copied and extracted to one of its harddrives. I have 4 harddrives running in raid 5 and a 5th harddrive which is running the OS. So would it matter which harddrive it extracted to?

I will try and download the file once i get home!

[sander]

So the incomplete and complete directory are both on the local harddrives? That would be nice (and rule out NAS/network problems), but why then the strange "\\home" in the path?

[Dannermax]

Hello again.

yes the complete and incomplete is on the raid 5 array of harddrives which is on the same system that runs sabnzbd.

I tried downloading the newest ubuntu build as you suggested from here: http://goo.gl/dgcJ8
I had the "check before download" enabled in sab and the download returned with a message saying something like: Not enough blocks in the file. I then clicked try again, and turned the "check before download" off. Now the download is done, but if i hover the mouse courser over it, it tells me: downloaded: 1 article missing and no par2 sets. What could this mean? Should i try and download to the harddrive, which is running the OS? Could it be, that sab cant properly download to a raid array of harddrives? Or perhaps i need to install some more dependencies?

Thanks for your time. THis is driving me nuts..

Update:

I just dwnloaded the same build again, and now 2 articles are missing instead of 1...strange!!

[sander]

That's weird. I same some possible explanations, but first another test:

Choose one of the posts from here: http://goo.gl/cr5PI

Download it, and post back the result.

[Dannermax]

Here are the results:

Færdig 2013-04-14 18:38:14
Navn bigrandomfile
Størrelse 104 MB
Status Færdig
Kategori a.b.boneless
Sti /media/03b6b2de-5b48-4a79-a826-ab98dd33b908/\home/video/downloads/sab-temp/sab-done/bigrandomfile/random-100MB.bin
Downloader Hentede i 1 minute 33 sekunder med et gennemsnit på 1.1 MB/s
1 artikler mangled (translated means 1 article missing)
Kilde http://binsearch.info/?action=nzb&102566975=1
Udpak [bigrandomfile] Udpakket 2 filer/mapper i 1 second
Reparerer [bigrandomfile] Repareret i 1 second

Sorry its Danish, but hope it makes sense to you. In my complete download folder is this file: random-100MB.bin

What now?

[sander]

With a bit of Dutch and German I can read Danish a bit.

Anyway: that works.

And the Ubuntu download didn't: missing articles. How old was the Ubuntu download? Here's how to check that: while it's still in the download queue, over over the download; it will tell the age.

Which newsserver do you use?

[Dannermax]

I downloaded the newest ubuntu and random file. Ther random file is 9 hours old, and the ubuntu is 4 days old. But both the bigrandom file and ubuntu image have missing articles.. so i guess neither of them downloaded successfully?

Im using astraweb:

ssl-eu.astraweb.com

ssl encrypted connection on port 563.

Sorry for the late reply, i will try and reply you as fast as possible.

So the files i download shouldent have any missing articles at all right?

[sander]

Indeed: the posts should be complete. So I would say something is wrong with astraweb, or in the communcation between astraweb and your system, or on your system.

Can you try another, non-SSL astraweb server?

EDIT:
back to your subject: CRC errors are rare, AFAIK. Can it be your local filesystem has problems?

[Dannermax]

Yes it seems Like the Way the files are saved on the harddrive is a bit off. Ill try with some adjustments and tell you how it went...