Warning resulting in NZB's not downloading

[cyberhank]

Hi,
Today none of my NZB's is processed by Sabnzbd anymore.
I put them in the watched folder as usual but nothing happens.
Even if I activate "scan watched folder".
When I do that, the following error appears under the warning section:

[08/Jan/2017:16:37:11] HTTP Traceback (most recent call last): File "/volume1/.@plugins/AppCentral/sabnzbdplus/sabnzbdplus/cherrypy/_cprequest.py", line 670, in respond response.body = self.handler() File "/volume1/.@plugins/AppCentral/sabnzbdplus/sabnzbdplus/cherrypy/lib/encoding.py", line 220, in __call__ self.body = self.oldhandler(*args, **kwargs) File "/volume1/.@plugins/AppCentral/sabnzbdplus/sabnzbdplus/cherrypy/_cpdispatch.py", line 60, in __call__ return self.callable(*self.args, **self.kwargs) File "/volume1/.@plugins/AppCentral/sabnzbdplus/sabnzbdplus/sabnzbd/interface.py", line 514, in tapi return api_handler(kwargs) File "/volume1/.@plugins/AppCentral/sabnzbdplus/sabnzbdplus/sabnzbd/api.py", line 112, in api_handler response = _api_table.get(mode, (_api_undefined, 2))[0](name, output, kwargs) File "/volume1/.@plugins/AppCentral/sabnzbdplus/sabnzbdplus/sabnzbd/api.py", line 702, in _api_watched_now sabnzbd.dirscanner.dirscan() File "/volume1/.@plugins/AppCentral/sabnzbdplus/sabnzbdplus/sabnzbd/dirscanner.py", line 437, in dirscan DirScanner.do.scan() File "/volume1/.@plugins/AppCentral/sabnzbdplus/sabnzbdplus/sabnzbd/dirscanner.py", line 416, in scan run_dir(dirscan_dir, None) File "/volume1/.@plugins/AppCentral/sabnzbdplus/sabnzbdplus/sabnzbd/dirscanner.py", line 345, in run_dir if os.path.isdir(path) or path in self.ignored or filename[0] == '.': File "/usr/local/AppCentral/python/lib/python2.7/genericpath.py", line 49, in isdir st = os.stat(s) UnicodeEncodeError: 'ascii' codec can't encode character u'\u2013' in position 47: ordinal not in range(128)

Any ideas what could be wrong and how to resolve ?

[safihre]

On the first page of the Config, what does it say for Python Version?

[cyberhank]

2.7.10 (default, Aug 19 2015, 09:18:54) [GCC 4.6.3] [ANSI_X3.4-1968]

[sander]

UnicodeEncodeError: 'ascii' codec can't encode character u'\u2013' in position 47: ordinal not in range(128)

OK, let's check:

Code: Select all

>>> print  u'\u2013'
–

Doesn't look special (just a dash), but it is ... it is "Unicode Character 'EN DASH' (U+2013)"

Any ideas what could be wrong and how to resolve ?

Yes: check for a filename / directory name (in your NZB scan directory?) with that "–", which is different (wider) than the normal (and plain ASCII) "-", and rename it.

As you're on Linux / Unix (right?), this will help:

Code: Select all

$ find /home/sander | grep "–"
/home/sander/Downloads/complete/mp3/bla bla bla – brrr brrrr.bin

EDIT:

Command to find all files with non-ASCII characters in the filenames:

Code: Select all

find /home/sander | grep --color='auto' -P '[^\x00-\x7F]' 

On my system:

Code: Select all

$ find /home/sander | grep --color='auto' -P '[^\x00-\x7F]' 
/home/sander/.cache/wallch/thumbs/513216=^usr^share^backgrounds^Classic_Guitar_Detail_by_Sten_Jørgen_Pettersen.jpg
/home/sander/.cache/wallch/thumbs/1667994=^usr^share^backgrounds^Alien_wing_by_Ralph_Crützen.jpg
/home/sander/Downloads/complete/mp3/bla bla bla – brrr brrrr.bin

[sander]

@cyberhank Did this solve the problem?

[cyberhank]

Hi sander,
Yes this did it !
Didn't expect the root cause to be this simple...
Actually one of my first assumptions was that it would have something to do with the file naming, but after I added another (just regular text characters) file name and the download still didn't start, I thought it had to be something else.
Now I realize that the files with the "bad" names where also still in the download queue and therefore the error still popped up when the queue needed to be processed.
Many thanks for your quick help :-)

[sander]

Now I realize that the files with the "bad" names where also still in the download queue and therefore the error still popped up when the queue needed to be processed.

Oh, really? Then I have the following questions for you:

Which version of SABnzbd?
Which OS is SAB running on?
In the SAB logging, what does the line "Preferred encoding =" say?

Code: Select all

2017-01-10 08:45:23,673::INFO::[sabnzbdplus:1169] --------------------------------
2017-01-10 08:45:23,673::INFO::[sabnzbdplus:1170] sabnzbdplus-1.2.0RC1 (rev=669e43a65edcee0b0b12950ed3307dcf38bb2c1a)
2017-01-10 08:45:23,673::INFO::[sabnzbdplus:1171] Full executable path = /usr/bin/sabnzbdplus
2017-01-10 08:45:23,674::INFO::[sabnzbdplus:1183] Platform = posix

Code: Select all

2017-01-05 22:35:00,395::INFO::[SABnzbd:1204] Preferred encoding = UTF-8
2017-01-07 09:38:35,614::INFO::[sabnzbdplus:1192] Preferred encoding = UTF-8

[safihre]

@sander: ANSI_X3.4-1968
(we also show it on first page of the Config in the Python version string, that's why I asked him )

[cyberhank]

@sander:
preferred encoding: see above.
OS: I believe it's LINUX (it's running om my ASUSTOR NAS).
SABnzbd version: Im am not sure, but I think it's 1.1.1
(I can double-check later on; I am @ work now...)

[sander]

@sander: ANSI_X3.4-1968
(we also show it on first page of the Config in the Python version string, that's why I asked him )

So it's not only Python version, but also the encoding used?


"ANSI_X3.4-1968 which is commonly called US-ASCII or simply ASCII" (source: http://www.iana.org/assignments/charact ... sets.xhtml ) so plain ASCII. That explains the problems with stuff in the queue, I would say.

[cyberhank]

OK, I will keep monitoring the filenames of the files I download in the future for non-plain-ASCII characters.
In case of issues, the first thing I will check will be the filename...

[sander]

OK, I will keep monitoring the filenames of the files I download in the future for non-plain-ASCII characters.
In case of issues, the first thing I will check will be the filename...

Hmmm ... can you check if you can change ASUSTOR's encoding to UTF-8 / Unicode? Somewhere in the system settings ... ?

[cyberhank]

I will do and report back this evening.

[cyberhank]

Can't find the option.
Can only find this:
Select the codepage for non-Unicode filename conversion.
This is default set to English.

[sander]

Can't find the option.
Can only find this:
Select the codepage for non-Unicode filename conversion.
This is default set to English.

That "Select the codepage for non-Unicode filename conversion." seems to suggest that Unicode is already the default on your Asustor, doesn't it? If so, it's strange your Python / SABnzbd has ANSI as encoding.

I'm afraid I can't help you further

FWIW: info on code pages https://en.wikipedia.org/wiki/Code_page