Page 1 of 3
obfuscated names
Posted: April 20th, 2021, 9:20 am
by freds
Hi. deobfuscation has worked great for me until the past couple of months. At first it only did it occasionally to Movies, not TV. Now it's almost every movie and even some TV episodes.
has something changed in the past few months in the latest version(s) of SAB?
Re: obfuscated names
Posted: April 20th, 2021, 9:56 am
by sander
freds wrote: ↑April 20th, 2021, 9:20 am
has something changed in the past few months in the latest version(s) of SAB?
Certainly!
If you don't want deobfuscation, you can turn it off:
http://127.0.0.1:8080/config/switches/# ... _filenames
But, maybe better: can you post examples of renamings you don't want?
Re: obfuscated names
Posted: April 20th, 2021, 1:42 pm
by freds
Sorry, I was in a hurry and wasn't clear. My problem is that deobfuscation is NOT working at all for Movies, and intermittently for TV shows. I end up with movies like 45eb1fe5c4bf4f6898cc97f136109b51.mkv
I do have "Deobfuscate final filenames" checked.
As I dig into this deeper, do I need to have deobfuscate.py selected on the Categories page in the Script column?
Thanks for your help!
Re: obfuscated names
Posted: April 20th, 2021, 2:58 pm
by Dingus
I'm having similar problems. I have spent hours changing options in the Switches and Sorting tabs but I still end up with obfuscated file names. My goal is to have a completed file stored in my C/Downloads/Completed directory. I don't want the file in it's own separate folder in that directory. I had SABNZB configured to do this until a week ago when I had to reload my OS and all my apps and settings. Now the closest I can get is storing the files in their own separate folders and these folders are accurately named. But the files inside the folders are obfuscated.
I was instructed by someone in live chat that I should either use the Sorting options or the Deobuscate Files option but never both. I've done this and it didn't fix the problem. Right now I'm configured with all the sorting options disabled and just Deobfuscate Files enabled. Still no luck.
Any advice is welcome.
Re: obfuscated names
Posted: April 20th, 2021, 3:04 pm
by freds
I do not and never have used any of the sorting features. I'll try the deobfuscate.py script option and report back.
If anyone has suggestions of what to look for in the log file, I have it in Debug mode.
Re: obfuscated names
Posted: April 20th, 2021, 3:14 pm
by sander
@freds: do NOT use deobfuscate.py ... that is outdated. SAB has now built-in high-tech deobfuscation
Re: obfuscated names
Posted: April 20th, 2021, 4:01 pm
by sander
both of you:
set SABnzbd's logging to +Debug.
do downloads
inspect sabnzbd.log: lines with deobfuscate_filenames
For example:
Code: Select all
2021-04-20 22:58:00,772::DEBUG::[deobfuscate_filenames:140] No par2 files found to process, running renamer.
2021-04-20 22:58:00,772::DEBUG::[deobfuscate_filenames:175] Trying to see if there are qualifying files to be deobfuscated
2021-04-20 22:58:00,772::DEBUG::[deobfuscate_filenames:182] Deobfuscate inspecting /media/zeegat/test_download_100MB.4/sometestfile-100MB.bin
2021-04-20 22:58:00,772::DEBUG::[deobfuscate_filenames:84] Checking: sometestfile-100MB
2021-04-20 22:58:00,773::DEBUG::[deobfuscate_filenames:125] Obfuscated (default)
2021-04-20 22:58:00,773::INFO::[deobfuscate_filenames:194] Deobfuscate renaming /media/zeegat/test_download_100MB.4/sometestfile-100MB.bin to /media/zeegat/test_download_100MB.4/test_download_100MB.bin
And other reasons you might find:
Code: Select all
Not obfuscated: spacesdots >= 3
Not obfuscated: upperchars >= 2 and lowerchars >= 2 and spacesdots >= 1
Not obfuscated: (upperchars + lowerchars >= 4) and decimals > 3 and spacesdots > 1
Re: obfuscated names
Posted: April 20th, 2021, 7:23 pm
by freds
Sander, thanks for helping.
So using deofuscate.py worked for me just fine. I know it is the "old way", but thought I'd see if it worked and it does!
So I changed the script back to "default", redownloaded the exact same movie file, and it left it obfuscated.
I looked at the log file, it looks like it realizes it's obfuscated when it starts the download, but it never changes the name.:
2021-04-20 20:00:42,645::DEBUG::[deobfuscate_filenames:84] Checking: <HASH>0bc3aac
2021-04-20 20:00:42,645::DEBUG::[deobfuscate_filenames:88] Obfuscated: 32 hex digit
Is there a way to send the entire log file to you? I'd rather not post it with movie titles
Re: obfuscated names
Posted: April 22nd, 2021, 10:51 am
by freds
I did some more testing... I downloaded the same episode twice (exact same file). Here is the log for the one that did NOT rename. The file in question is the one that ends with 41bc1b5.mkv It looks like it inspects it, but never "checks" it.
Code: Select all
2021-04-22 11:06:35,733::DEBUG::[deobfuscate_filenames:182] Deobfuscate inspecting \\?\z:\dls\nzb\TV\<HASH>41bc1b5.mkv
2021-04-22 11:06:35,733::DEBUG::[deobfuscate_filenames:182] Deobfuscate inspecting \\?\z:\dls\nzb\TV\TVShow.S02E06.episode.name.1080p.WEB-DL.AAC2.0.H.264.1-NTb-Obfuscated.mkv
2021-04-22 11:06:35,733::DEBUG::[deobfuscate_filenames:182] Deobfuscate inspecting \\?\z:\dls\nzb\TV\<HASH>b8dba0c.txt
2021-04-22 11:06:35,733::DEBUG::[deobfuscate_filenames:182] Deobfuscate inspecting \\?\z:\dls\nzb\TV\<HASH>fe5f697.txt
2021-04-22 11:06:35,734::DEBUG::[deobfuscate_filenames:182] Deobfuscate inspecting \\?\z:\dls\nzb\TV\<HASH>53adbc2.txt
2021-04-22 11:06:35,734::DEBUG::[deobfuscate_filenames:182] Deobfuscate inspecting \\?\z:\dls\nzb\TV\<HASH>92792a1.txt
2021-04-22 11:06:35,734::DEBUG::[deobfuscate_filenames:182] Deobfuscate inspecting \\?\z:\dls\nzb\TV\<HASH>65f8793.txt
2021-04-22 11:06:35,734::DEBUG::[deobfuscate_filenames:182] Deobfuscate inspecting \\?\z:\dls\nzb\TV\<HASH>e615401.txt
Here is the snippet of log when I downloaded exact same file again. again, it's 41bc1b5.mkv
Code: Select all
2021-04-22 11:26:12,298::DEBUG::[deobfuscate_filenames:182] Deobfuscate inspecting \\?\z:\dls\nzb\TV\<HASH>41bc1b5.mkv
2021-04-22 11:26:12,298::DEBUG::[deobfuscate_filenames:84] Checking: <HASH>41bc1b5
2021-04-22 11:26:12,298::DEBUG::[deobfuscate_filenames:88] Obfuscated: 32 hex digit
2021-04-22 11:26:12,298::INFO::[deobfuscate_filenames:194] Deobfuscate renaming \\?\z:\dls\nzb\TV\<HASH>41bc1b5.mkv to \\?\z:\dls\nzb\TV\TVShow.S02E06.episode.name.1080p.WEB-DL.AAC2.0.H.264.1-NTb-Obfuscated.mkv
2021-04-22 11:26:12,298::DEBUG::[filesystem:833] Renaming "\\?\z:\dls\nzb\TV\<HASH>41bc1b5.mkv" to "\\?\z:\dls\nzb\TV\TVShow.S02E06.episode.name.1080p.WEB-DL.AAC2.0.H.264.1-NTb-Obfuscated.mkv"
2021-04-22 11:26:12,299::DEBUG::[deobfuscate_filenames:182] Deobfuscate inspecting \\?\z:\dls\nzb\TV\<HASH>b8dba0c.txt
2021-04-22 11:26:12,299::DEBUG::[deobfuscate_filenames:182] Deobfuscate inspecting \\?\z:\dls\nzb\TV\<HASH>fe5f697.txt
2021-04-22 11:26:12,300::DEBUG::[deobfuscate_filenames:182] Deobfuscate inspecting \\?\z:\dls\nzb\TV\<HASH>53adbc2.txt
Re: obfuscated names
Posted: April 22nd, 2021, 1:47 pm
by sander
So for exact same download, once it got not renamed, and the once it got renamed?! Weird.
What is the size of <HASH>41bc1b5.mkv in the first download?
Can you mail the NZB to
[email protected] with in subject "freds / still obfuscated names (a.o. sander)"
Re: obfuscated names
Posted: April 22nd, 2021, 2:01 pm
by freds
sander wrote: ↑April 22nd, 2021, 1:47 pm
So for exact same download, once it got not renamed, and the once it got renamed?! Weird.
What is the size of <HASH>41bc1b5.mkv in the first download?
Can you mail the NZB to
[email protected] with in subject "freds / still obfuscated names (a.o. sander)"
Correct. Same file. same nzb in fact. first time NOT renamed, second time renamed. agreed, it's weird. It very well could (probably) is a problem on my end. Like I mentioned earlier, this has been happening for awhile now. The mkv is about 1.2 GB.
Yes, I'll send the nzb file to that address. My guess is it will work fine for you. It's gotta be me that's the problem or you'd have hundreds of folks complaining. I downloaded about 30 episodes of a different show a few days ago, and all but one were NOT renamed.
Thanks,
Re: obfuscated names
Posted: April 22nd, 2021, 2:06 pm
by sander
Which version of SABnzbd are you running? If not the newest SABnzbd = 3.2.1, upgrade, and retry, please.
Re: obfuscated names
Posted: April 22nd, 2021, 2:09 pm
by sander
Oh, and:
Windows & Intermittent file problems ... are you running a virus scanner? Did you exclude the SAB download directories? If not, please do so. Or disable your virusscanner completely for the test.
Because maybe your virusscanner is blocking access to the file resulting the os.path.getsize(filename) in the code below to be 0 or something like that ... ? #longshot
Code: Select all
logging.debug("Deobfuscate inspecting %s", filename)
# Do we need to rename this file?
# Criteria: big, not-excluded extension, obfuscated (in that order)
if (
os.path.getsize(filename) > MIN_FILE_SIZE
and get_ext(filename) not in excluded_file_exts
and is_probably_obfuscated(filename) # this as last test to avoid unnecessary analysis
):
# Rename and make sure the new filename is unique
path, file = os.path.split(filename)
# construct new_name: <path><usefulname><extension>
new_name = get_unique_filename("%s%s" % (os.path.join(path, usefulname), get_ext(filename)))
logging.info("Deobfuscate renaming %s to %s", filename, new_name)
... because you see the first logging but not the next, but no Traceback.
OH WAIT: scan your sabnzbd.log for "traceback"!!!
Re: obfuscated names
Posted: April 23rd, 2021, 8:23 am
by freds
sander wrote: ↑April 22nd, 2021, 2:06 pm
Which version of SABnzbd are you running? If not the newest SABnzbd = 3.2.1, upgrade, and retry, please.
Version: 3.2.1 [0542c25]
Re: obfuscated names
Posted: April 23rd, 2021, 9:53 am
by freds
sander wrote: ↑April 22nd, 2021, 2:09 pm
Oh, and:
Windows & Intermittent file problems ... are you running a virus scanner? Did you exclude the SAB download directories? If not, please do so. Or disable your virusscanner completely for the test.
Because maybe your virusscanner is blocking access to the file resulting the os.path.getsize(filename) in the code below to be 0 or something like that ... ? #longshot
Code: Select all
logging.debug("Deobfuscate inspecting %s", filename)
# Do we need to rename this file?
# Criteria: big, not-excluded extension, obfuscated (in that order)
if (
os.path.getsize(filename) > MIN_FILE_SIZE
and get_ext(filename) not in excluded_file_exts
and is_probably_obfuscated(filename) # this as last test to avoid unnecessary analysis
):
# Rename and make sure the new filename is unique
path, file = os.path.split(filename)
# construct new_name: <path><usefulname><extension>
new_name = get_unique_filename("%s%s" % (os.path.join(path, usefulname), get_ext(filename)))
logging.info("Deobfuscate renaming %s to %s", filename, new_name)
... because you see the first logging but not the next, but no Traceback.
OH WAIT: scan your sabnzbd.log for "traceback"!!!
Thanks again!
Last night several episodes and a couple movies downloaded. None were renamed correctly. The problem is becoming more consistent.
The only virus scanner I have is the built-in Microsoft security. I disabled it this morning and redownloaded one of the episodes that had downloaded overnight. Exact same file. It was not renamed last night, and was not renamed after this morning's test (with virus scan turned off). I don't have any other security on this Windows 10 box.
I searched the log file from this morning's test (with virus off, downloading same episode as last night) and there is no "traceback" in it at all. It's a small mkv, only 138 MB, so easy to test.
I hope this is OK, but I am going to send that log file to the email address from above, along with the nzb file. You will see that the episode in question starts at:
2021-04-23 10:09:37,163::DEBUG::[deobfuscate_filenames:84] Checking: <HASH>0903247
and ends here:
2021-04-23 10:10:18,259
If you look at the log file, you can see that the file is identified as "obfuscated" at the beginning, but when it runs filename_deobfuscate after the download and unpacking completes, it inspects all the files in that folder, but doesn't do anything with them.
I sent the email with the same subject as before
freds / still obfuscated names (a.o. sander)
very confusing!
Thank you for taking the time to help!