Page 1 of 1

Facing "Disk error on creating file" with cloud storage mounted

Posted: June 19th, 2024, 5:41 am
by Cheesecakee
Hello,

Whenever sabnzbd downloads something it stops very shortly after starting downloading with the following error "Disk error on creating file"

I am running everything (rclone, sabnzbd) on a VPS with ubuntu as OS which has some sftp cloud storage mounted.

I purged the log and then let it run again until the error appeared (after a few seconds)

Code: Select all

pastebin .com /SjVMxKSz

Could it be that the different GID / UID is causing it (on my VPS compared to the cloud storage)? Since on my VPS the user is on UID / GID 1000 and on the storage box its something along UID / GID 40000+

If you need anything else from the logs / settings let me know!

Re: Facing "Disk error on creating file" with cloud storage mounted

Posted: June 19th, 2024, 6:26 am
by safihre
Seems indeed that the main error is "PermissionError: [Errno 1] Operation not permitted".
So could be a rights issue.

But there is also "OSError: [Errno 29] Invalid seek", so maybe the cloud storage is from a type that doesnt support seeking like normal?
I think a rights issue seems more likely.

Re: Facing "Disk error on creating file" with cloud storage mounted

Posted: June 19th, 2024, 6:49 am
by sander

Code: Select all

2024-06-19 12:56:12,686::ERROR::[assembler:108] Disk error on creating file /mnt/remote/cloudstorage/data/usenet/incomplete/blabla.blabla.Ein.neues.Zeitalter.2022.German.1080p.DL.DTSX.BluRay.AVC.Remux-pmHD/Lcls148HJximyNVbM7BZ0p.part014.rar
2024-06-19 12:56:12,686::INFO::[assembler:116] Traceback: 
Traceback (most recent call last):
  File "/app/sabnzbd/assembler.py", line 185, in assemble
    written = fout.write(data)
              ^^^^^^^^^^^^^^^^
OSError: [Errno 29] Invalid seek
Interesting.

And the writing pre-check at startup of SABnzbd went OK? Please show your log.

Possible causes:
- intermittent
- file there, but medium not OK with seek
- too long path
- too deep path
- weird chars in filename (doesn't look like it)

But first of all: incomplete should be on your local disk, not something mounted, for highest availability and avoiding errors as much as possible.
So can you do that first?

Re: Facing "Disk error on creating file" with cloud storage mounted

Posted: June 19th, 2024, 7:14 am
by Cheesecakee
And the writing pre-check at startup of SABnzbd went OK? Please show your log.

Possible causes:
- intermittent
- file there, but medium not OK with seek
- too long path
- too deep path
- weird chars in filename (doesn't look like it)

But first of all: incomplete should be on your local disk, not something mounted, for highest availability and avoiding errors as much as possible.
So can you do that first?

With the inclompete folder set to the Local SSD of my VPS it seems to go through, but wouldnt that cause double bandwith usage on my VPS and also require extra time? Since it downloads to local disk then uploads to cloud box again. Sorry its my first time doing all this

Re: Facing "Disk error on creating file" with cloud storage mounted

Posted: June 19th, 2024, 8:01 am
by sander
Cheesecakee wrote: June 19th, 2024, 7:14 am


With the inclompete folder set to the Local SSD of my VPS it seems to go through, but wouldnt that cause double bandwith usage on my VPS and also require extra time? Since it downloads to local disk then uploads to cloud box again. Sorry its my first time doing all this
No, the opposite: files and thus traffic back and forth, back and forth, via your local system as hub.

And you can measure that:

per setup
1. measure amount of traffic on interface
2. do your SABnzbd NZB download
3. measure speed as reported by SABnzbd
4. measure amount traffic on interface again => calculate amount of traffic done for the SAB download

To measure amount of traffic on Linux and probably MacOS:

ip -s addr

/sbin/ifconfig