NZBs fail to load - Cannot read from incomplete folder

[AncientWisdom]

Hi There,

This is a bit of a weird one as everything was working really well for quite some time now and suddenly stopped working a couple of days ago. I cannot find the source of the change.

Version: 0.7.7, updated to 0.7.9 and still happening
OS: Win7 64bit
Install-type: Windows Installer
Skin (if applicable): Default
Firewall Software: Windows
Are you using IPV6? no
Is the issue reproducible? yes

Additional information:
I'm using FlexRAID as a software raid. The issue does not occur when I set the temp folder to my C drive, but happens whenever assigned to the pool drive created by FlexRAID.

Basically now when a new nzb is loaded either manually or through the API, the progress bar quickly moves through the file as if d/l REALLY fast and when it reaches the end I get:

Code: Select all

2013-01-08 15:13:28,187	WARNING:	Cannot read F:\incomplete\{nzb_name}\__ADMIN__\{nzb_name}.nzb.gz

Checking the folder using Unlocker I cannot see any processes locking the folder, all explorer windows has been closed and Rename Folders option has been ticked off as suggested in other similar threads I've found, however the issue persists.

FlexRAID does not report any errors, could also not find anything in the Event Viewer.

There is usually additional stuff in the log itself (happy to PM to whoever is happy to help) such as:

Code: Select all

2013-01-08 15:13:27,385::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_rpjnb_ removed
2013-01-08 15:13:27,392::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_jpl4f7 removed
2013-01-08 15:13:27,418::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_v_zf_n removed
2013-01-08 15:13:27,427::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_qyciq2 removed
2013-01-08 15:13:27,437::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_mocpyc removed
2013-01-08 15:13:27,447::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_2mvdqa removed
2013-01-08 15:13:27,460::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_vdaoce removed
2013-01-08 15:13:27,473::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_gpvcrm removed
2013-01-08 15:13:27,486::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_za4-ns removed
2013-01-08 15:13:27,494::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_ofoiqu removed
2013-01-08 15:13:27,505::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_jjrrdr removed
2013-01-08 15:13:27,513::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_hpgbp1 removed
2013-01-08 15:13:27,523::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_weyvpj removed
2013-01-08 15:13:27,533::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_dwcphk removed
2013-01-08 15:13:27,542::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_gqbws9 removed
2013-01-08 15:13:27,572::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_-eefnt removed
2013-01-08 15:13:27,579::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_f-ukv5 removed
2013-01-08 15:13:27,589::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_v8yjxi removed
2013-01-08 15:13:27,671::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_oxtn7b removed
2013-01-08 15:13:27,688::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_aa8kxd removed
2013-01-08 15:13:27,707::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_ocz3iy removed
2013-01-08 15:13:27,720::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_0gyygz removed
2013-01-08 15:13:27,756::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_nam4rj removed
2013-01-08 15:13:27,769::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_6higvv removed
2013-01-08 15:13:27,782::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_bwn3jl removed
2013-01-08 15:13:27,795::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_jhdyzn removed
2013-01-08 15:13:27,809::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_7i4qse removed
2013-01-08 15:13:27,844::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_mzcshn removed
2013-01-08 15:13:27,861::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_cuumrx removed
2013-01-08 15:13:27,874::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_gcqhye removed
2013-01-08 15:13:27,888::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_t-wcca removed
2013-01-08 15:13:27,918::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_g7zsge removed
2013-01-08 15:13:27,933::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_1xgttb removed
2013-01-08 15:13:27,947::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_p4ucsn removed
2013-01-08 15:13:27,969::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_rhb-u- removed
2013-01-08 15:13:27,989::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_s8l9qm removed
2013-01-08 15:13:28,003::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_zj5n_r removed
2013-01-08 15:13:28,023::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_vu9p3v removed
2013-01-08 15:13:28,035::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_-wafyy removed
2013-01-08 15:13:28,053::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_nc5qn4 removed
2013-01-08 15:13:28,071::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_nzqgoj removed
2013-01-08 15:13:28,085::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_mvgb_s removed
2013-01-08 15:13:28,098::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_xgvotr removed
2013-01-08 15:13:28,112::INFO::[__init__:886] F:\incomplete\{nzb_name}\__ADMIN__\SABnzbd_nzf_uhkric removed
2013-01-08 15:13:28,158::INFO::[misc:1288] Cannot remove folder F:\incomplete\{nzb_name}\__ADMIN__
2013-01-08 15:13:28,164::INFO::[misc:1288] Cannot remove folder F:\incomplete\{nzb_name}\__ADMIN__
2013-01-08 15:13:28,187::WARNING::[dirscanner:158] Cannot read F:\incomplete\{nzb_name}\__ADMIN__\{nzb_name}.nzb.gz
2013-01-08 15:13:28,187::INFO::[dirscanner:159] Traceback: 
Traceback (most recent call last):
  File "sabnzbd\dirscanner.pyo", line 155, in ProcessSingleFile
  File "gzip.pyo", line 220, in read
  File "gzip.pyo", line 292, in _read
  File "gzip.pyo", line 308, in _read_eof
  File "gzip.pyo", line 40, in read32
  File "struct.pyo", line 87, in unpack
error: unpack requires a string argument of length 4

Thanks for the help guys, much appreciated!

AW

[AncientWisdom]

Just found this post that looks extremely similar to the problem I'm having:
http://forums.sabnzbd.org/viewtopic.php?f=2&t=12303

Not sure if the other problem was eventually resolved or not.

[shypike]

SABnzbd assumes that the file system works properly.
If not, what can it do?
SABnzbd doesn't do anything special, it reads, writes and deletes files.
On a side note: using RAID to store short-lived files isn't very efficient.

[AncientWisdom]

Fair enough.

So just to make sure I understand correctly, basically from the logs it looks like the file system is denying access?

One of my main problems when approaching this issue is the integration between the two systems (FlexRAID and SABnzbd) which makes it harder for me to know where the problem originates from.

In the issue I linked it seemed that it did look like SABnzbd had a defect - are we certain there is no defect present here?

[shypike]

are we certain there is no defect present here?

There's never a 100% certainty.
However, we only ever get these kind of complaints from people using external drives or otherwise "special" drives.
RAID, USB-mounted, network-mounted.
SABnzbd does simpleton things with files through the standard Python libraries.