Special character make download fail

[Triggerfish]

Hi all,

I recently moved sabnzbd from my desktop to a raspberry pi. So far so good. It just fails to download/process nzb's with special characters in the name. I have tried a lot, but I can not figure out whatthe problem is.

I put everything on a QNAP NAS share that is mounted with all the needed stuff.

Code: Select all

//192.168.51.15/SabNZBD /home/pi/SabNZBData     cifs    username=xxxx,password=yyyy,_netdev,uid=1000,gid=1000,file_mode=0755,dir_mode=0755,forceuid,forcegid,iocharset=utf8,nounix      0       0

Downloads without any ÉÉë stuff work like a charm. Whenever something odd is in a name, it fails. The gui asks if the file is out of server retention. The logs shows:

Code: Select all

2016-07-27 10:07:31,293::INFO::[__init__:626] Adding dutch epub(2).nzb
2016-07-27 10:07:31,307::INFO::[misc:792] Creating directories: /home/pi/SabNZBData/Incomplete/dutch epub(2)
2016-07-27 10:07:31,375::INFO::[nzbstuff:444] File Nöldeke, Eva - Martha.epub - dutch epub (1/2) added to queue
2016-07-27 10:07:31,376::INFO::[__init__:582] Backing up /home/pi/SabNZBData/Incomplete/dutch epub(2)/__ADMIN__/dutch epub(2).nzb.gz
2016-07-27 10:07:31,438::INFO::[nzbqueue:214] Saving queue
2016-07-27 10:07:31,474::INFO::[__init__:917] Saving data for queue9.sab in /home/pi/.sabnzbd/admin/queue9.sab
2016-07-27 10:07:38,635::INFO::[__init__:917] Saving data for totals9.sab in /home/pi/.sabnzbd/admin/totals9.sab
2016-07-27 10:07:38,639::INFO::[assembler:88] Decoding /home/pi/SabNZBData/Incomplete/dutch epub(2)/N▒ldeke, Eva - Martha.epub yenc
2016-07-27 10:07:38,789::INFO::[__init__:906] /home/pi/SabNZBData/Incomplete/dutch epub(2)/__ADMIN__/SABnzbd_nzo_x2At20 removed
2016-07-27 10:07:38,790::INFO::[nzbqueue:214] Saving queue
2016-07-27 10:07:38,791::INFO::[__init__:917] Saving data for queue9.sab in /home/pi/.sabnzbd/admin/queue9.sab
2016-07-27 10:07:38,793::INFO::[postproc:85] Saving postproc queue
2016-07-27 10:07:38,794::INFO::[__init__:917] Saving data for postproc1.sab in /home/pi/.sabnzbd/admin/postproc1.sab
2016-07-27 10:07:38,812::INFO::[postproc:284] Starting PostProcessing on dutch epub(2) => Repair:False, Unpack:False, Delete:True, Script:None, Cat:*
2016-07-27 10:07:39,348::INFO::[postproc:540] Cleaning up dutch epub(2) (keep_basic=True)
2016-07-27 10:07:39,355::INFO::[misc:1307] Cannot remove folder /home/pi/SabNZBData/Incomplete/dutch epub(2)/__ADMIN__
2016-07-27 10:07:39,512::INFO::[misc:1307] Cannot remove folder /home/pi/SabNZBData/Incomplete/dutch epub(2)/__ADMIN__

The funny stuff is, that if I unmount the share and save to local sd, it seems to work.

Code: Select all

2016-07-27 10:42:43,753::INFO::[__init__:626] Adding dutch epub(2).nzb
2016-07-27 10:42:43,777::INFO::[misc:792] Creating directories: /home/pi/SabNZBData/Incomplete/dutch epub(2)
2016-07-27 10:42:43,804::INFO::[nzbstuff:444] File Nöldeke, Eva - Martha.epub - dutch epub (1/2) added to queue
2016-07-27 10:42:43,806::INFO::[__init__:582] Backing up /home/pi/SabNZBData/Incomplete/dutch epub(2)/__ADMIN__/dutch epub(2).nzb.gz
2016-07-27 10:42:43,810::INFO::[nzbqueue:214] Saving queue
2016-07-27 10:42:43,816::INFO::[__init__:917] Saving data for queue9.sab in /home/pi/.sabnzbd/admin/queue9.sab
2016-07-27 10:42:45,329::INFO::[downloader:381] [email protected]:119: Initiating connection
2016-07-27 10:42:46,339::INFO::[downloader:577] Connecting [email protected]:119 finished
2016-07-27 10:42:50,134::INFO::[downloader:381] [email protected]:119: Initiating connection
2016-07-27 10:42:51,146::INFO::[downloader:577] Connecting [email protected]:119 finished
2016-07-27 10:42:53,820::INFO::[__init__:917] Saving data for totals9.sab in /home/pi/.sabnzbd/admin/totals9.sab
2016-07-27 10:42:53,822::INFO::[assembler:88] Decoding /home/pi/SabNZBData/Incomplete/dutch epub(2)/N▒ldeke, Eva - Martha.epub yenc
2016-07-27 10:42:53,917::INFO::[__init__:906] /home/pi/SabNZBData/Incomplete/dutch epub(2)/__ADMIN__/SABnzbd_nzo_5WsqdR removed
2016-07-27 10:42:53,918::INFO::[nzbqueue:214] Saving queue
2016-07-27 10:42:53,919::INFO::[__init__:917] Saving data for queue9.sab in /home/pi/.sabnzbd/admin/queue9.sab
2016-07-27 10:42:53,920::INFO::[postproc:85] Saving postproc queue
2016-07-27 10:42:53,923::INFO::[postproc:284] Starting PostProcessing on dutch epub(2) => Repair:True, Unpack:True, Delete:True, Script:None, Cat:*
2016-07-27 10:42:53,924::INFO::[__init__:917] Saving data for postproc1.sab in /home/pi/.sabnzbd/admin/postproc1.sab
2016-07-27 10:42:54,427::INFO::[postproc:571] Par2 check starting on dutch epub(2)
2016-07-27 10:42:54,439::INFO::[__init__:872] /home/pi/SabNZBData/Incomplete/dutch epub(2)/__ADMIN__/__verified__ missing
2016-07-27 10:42:54,440::INFO::[postproc:604] No par2 sets for dutch epub(2)
2016-07-27 10:42:54,443::INFO::[postproc:619] Par2 check finished on dutch epub(2)
2016-07-27 10:42:54,446::INFO::[misc:792] Creating directories: /home/pi/SabNZBData/Complete/dutch epub(2)
2016-07-27 10:42:54,448::INFO::[postproc:349] Running unpack_magic on dutch epub(2)
2016-07-27 10:42:54,449::INFO::[postproc:351] unpack_magic finished on dutch epub(2)

Code: Select all

pi@MediaPie:~/.sabnzbd/logs $ ls -la /home/pi/SabNZBData/Complete/dutch\ epub\(2\)/
totaal 740
drwxr-xr-x 2 pi pi   4096 jul 27 10:42 .
drwxr-xr-x 5 pi pi   4096 jul 27 10:42 ..
-rw-r--r-- 1 pi pi 745857 jul 27 10:42 N▒ldeke, Eva - Martha.epub

So obviously this would be an issue between pi and nas. However, when I touch a file with special characters on the share, it does work... So the pi is able to create such files. Somehow sabnzbdplus is not able tot tell the nas correctly what it wants.

Any thoughts?

Thanx, Peter

[shypike]

First of all, which SABnzbd version are you using.
Second, most of these problems occur because the file name encoding of the file system isn't properly set up.
Are you sure the iocharset=utf8 in the CIFS line is correct?
SABnzbd expects the same encoding for all file systems attached to device.
So make sure your local file system is also UTF8 and that the NLS settings reflect this.

[Triggerfish]

Hi,

SABnzbd Versie: 0.7.18 (according to gui help)

The iocharset is correct, since I get no errors on mounting.When i change it to UTF8, the mount command conplains about an unknown option, so I assume utf8 is accepted.

The device on my nas is ext4.

Code: Select all

/dev/md0 on /share/MD0_DATA type ext4 (rw,usrjquota=aquota.user,jqfmt=vfsv0,user_xattr,data=ordered,delalloc,noacl)

Not sure about the other question about NLS. How can I check what and where?

Best regards, Peter

[shypike]

Download SABnzbd's log file from the Status menu (under the wrench icon).
It's a text file and it should contain a line like this:

Code: Select all

Preferred encoding = UTF-8

Search for "Preferred encoding" and check what value is behind it.

Other than that, UTF-8 can be spelled in different ways. Samba wants it in lower case, that doesn't matter.

[safihre]

Shouldn't this be fixed when he updates to 1.0.3? Since now it's fully unicode
0.7.18 is 2 years old!

[Triggerfish]

Hi,

I click "status" "show logging" and look in the file that is saved then. No Preferred encoding found... Sorry. Same as in ~/.sabnzbd/logs files

Best regards, Peter

[Triggerfish]

OK, sudo apt-get upgrade says I am up to date. I downloaded the tarball from the site and installed. It still fails, but now the log says "Preferred encoding = ISO-8859-15"

[Triggerfish]

Also... This install does not actually replaces the old install. The service daemon still starts the old version

[safihre]

What OS are you on? I think you can use our custom PPA that has the latest version, if your OS is supported:
https://sabnzbd.org/wiki/installation/i ... buntu-repo

But clearly SAB is started not with UTF8, ShyPike this should say UTF8 right?

[Triggerfish]

Error changed to "» Download failed - Not on your server(s)" btw...

I run Jessie on a Raspberry Pi 3.

[Triggerfish]

Good morning again.

I was able to add the repo and perform an upgrade from that. It gave me version

Code: Select all

SABnzbd Version: 1.1.0RC1

That way it also installed or replaced the service, so I am happy with that too.

The preferred encoding still is not utf8:

Code: Select all

2016-07-28 07:38:41,221::INFO::[sabnzbdplus:1325] Preferred encoding = ISO-8859-15

And maybe as a result of that, the failed download still fails.

I'm lost Still do not understand why I can create the files from the command prompt, but SabNZBD fails. Apparently the OS is able to handle the file names on the share.

I hope someone has a brilliant idea...

Best regards, Peter

[shypike]

This means that the operating systems tells SABnzbd that its root file system is ISO-8859-15.
This is not a good choice nowadays.
Can you change it?
It could be an option to set the share to work with ISO-8859-15 too.
Is that a possibility? Or can that drive only work with utf-8?

[Triggerfish]

I never consciously choose that charset. Maybe it was chosen, because I selected Dutch language everywhere... Anyway, I did:

Code: Select all

$ sudo dpkg-reconfigure locales
Check if en_US.UTF-8 is selected.
Now add the line:
export LANG=en_US.UTF-8
to .bshsc

And it works!

I want to thank everyone for their help, suggestions and input!

Best regards, Peter

[shypike]

You're welcome.