obfuscated names

Get help with all aspects of SABnzbd
Forum rules
Help us help you:
  • Are you using the latest stable version of SABnzbd? Downloads page.
  • Tell us what system you run SABnzbd on.
  • Adhere to the forum rules.
  • Do you experience problems during downloading?
    Check your connection in Status and Interface settings window.
    Use Test Server in Config > Servers.
    We will probably ask you to do a test using only basic settings.
  • Do you experience problems during repair or unpacking?
    Enable +Debug logging in the Status and Interface settings window and share the relevant parts of the log here using [ code ] sections.
freds
Newbie
Newbie
Posts: 27
Joined: December 4th, 2020, 3:02 pm

obfuscated names

Post by freds »

Hi. deobfuscation has worked great for me until the past couple of months. At first it only did it occasionally to Movies, not TV. Now it's almost every movie and even some TV episodes.
has something changed in the past few months in the latest version(s) of SAB?
User avatar
sander
Release Testers
Release Testers
Posts: 8812
Joined: January 22nd, 2008, 2:22 pm

Re: obfuscated names

Post by sander »

freds wrote: April 20th, 2021, 9:20 am has something changed in the past few months in the latest version(s) of SAB?
Certainly!

If you don't want deobfuscation, you can turn it off: http://127.0.0.1:8080/config/switches/# ... _filenames

But, maybe better: can you post examples of renamings you don't want?
freds
Newbie
Newbie
Posts: 27
Joined: December 4th, 2020, 3:02 pm

Re: obfuscated names

Post by freds »

Sorry, I was in a hurry and wasn't clear. My problem is that deobfuscation is NOT working at all for Movies, and intermittently for TV shows. I end up with movies like 45eb1fe5c4bf4f6898cc97f136109b51.mkv

I do have "Deobfuscate final filenames" checked.

As I dig into this deeper, do I need to have deobfuscate.py selected on the Categories page in the Script column?

Thanks for your help!
Dingus
Newbie
Newbie
Posts: 1
Joined: April 20th, 2021, 2:45 pm

Re: obfuscated names

Post by Dingus »

I'm having similar problems. I have spent hours changing options in the Switches and Sorting tabs but I still end up with obfuscated file names. My goal is to have a completed file stored in my C/Downloads/Completed directory. I don't want the file in it's own separate folder in that directory. I had SABNZB configured to do this until a week ago when I had to reload my OS and all my apps and settings. Now the closest I can get is storing the files in their own separate folders and these folders are accurately named. But the files inside the folders are obfuscated.

I was instructed by someone in live chat that I should either use the Sorting options or the Deobuscate Files option but never both. I've done this and it didn't fix the problem. Right now I'm configured with all the sorting options disabled and just Deobfuscate Files enabled. Still no luck.

Any advice is welcome.
freds
Newbie
Newbie
Posts: 27
Joined: December 4th, 2020, 3:02 pm

Re: obfuscated names

Post by freds »

I do not and never have used any of the sorting features. I'll try the deobfuscate.py script option and report back.

If anyone has suggestions of what to look for in the log file, I have it in Debug mode.
User avatar
sander
Release Testers
Release Testers
Posts: 8812
Joined: January 22nd, 2008, 2:22 pm

Re: obfuscated names

Post by sander »

@freds: do NOT use deobfuscate.py ... that is outdated. SAB has now built-in high-tech deobfuscation
User avatar
sander
Release Testers
Release Testers
Posts: 8812
Joined: January 22nd, 2008, 2:22 pm

Re: obfuscated names

Post by sander »

both of you:

set SABnzbd's logging to +Debug.
do downloads
inspect sabnzbd.log: lines with deobfuscate_filenames

For example:

Code: Select all

2021-04-20 22:58:00,772::DEBUG::[deobfuscate_filenames:140] No par2 files found to process, running renamer.
2021-04-20 22:58:00,772::DEBUG::[deobfuscate_filenames:175] Trying to see if there are qualifying files to be deobfuscated
2021-04-20 22:58:00,772::DEBUG::[deobfuscate_filenames:182] Deobfuscate inspecting /media/zeegat/test_download_100MB.4/sometestfile-100MB.bin
2021-04-20 22:58:00,772::DEBUG::[deobfuscate_filenames:84] Checking: sometestfile-100MB
2021-04-20 22:58:00,773::DEBUG::[deobfuscate_filenames:125] Obfuscated (default)
2021-04-20 22:58:00,773::INFO::[deobfuscate_filenames:194] Deobfuscate renaming /media/zeegat/test_download_100MB.4/sometestfile-100MB.bin to /media/zeegat/test_download_100MB.4/test_download_100MB.bin

And other reasons you might find:

Code: Select all

 Not obfuscated: spacesdots >= 3
 Not obfuscated: upperchars >= 2 and lowerchars >= 2  and spacesdots >= 1
 Not obfuscated: (upperchars + lowerchars >= 4) and decimals > 3 and spacesdots > 1
freds
Newbie
Newbie
Posts: 27
Joined: December 4th, 2020, 3:02 pm

Re: obfuscated names

Post by freds »

Sander, thanks for helping.
So using deofuscate.py worked for me just fine. I know it is the "old way", but thought I'd see if it worked and it does!
So I changed the script back to "default", redownloaded the exact same movie file, and it left it obfuscated.

I looked at the log file, it looks like it realizes it's obfuscated when it starts the download, but it never changes the name.:

2021-04-20 20:00:42,645::DEBUG::[deobfuscate_filenames:84] Checking: <HASH>0bc3aac
2021-04-20 20:00:42,645::DEBUG::[deobfuscate_filenames:88] Obfuscated: 32 hex digit

Is there a way to send the entire log file to you? I'd rather not post it with movie titles :)
freds
Newbie
Newbie
Posts: 27
Joined: December 4th, 2020, 3:02 pm

Re: obfuscated names

Post by freds »

I did some more testing... I downloaded the same episode twice (exact same file). Here is the log for the one that did NOT rename. The file in question is the one that ends with 41bc1b5.mkv It looks like it inspects it, but never "checks" it.

Code: Select all

2021-04-22 11:06:35,733::DEBUG::[deobfuscate_filenames:182] Deobfuscate inspecting \\?\z:\dls\nzb\TV\<HASH>41bc1b5.mkv
2021-04-22 11:06:35,733::DEBUG::[deobfuscate_filenames:182] Deobfuscate inspecting \\?\z:\dls\nzb\TV\TVShow.S02E06.episode.name.1080p.WEB-DL.AAC2.0.H.264.1-NTb-Obfuscated.mkv
2021-04-22 11:06:35,733::DEBUG::[deobfuscate_filenames:182] Deobfuscate inspecting \\?\z:\dls\nzb\TV\<HASH>b8dba0c.txt
2021-04-22 11:06:35,733::DEBUG::[deobfuscate_filenames:182] Deobfuscate inspecting \\?\z:\dls\nzb\TV\<HASH>fe5f697.txt
2021-04-22 11:06:35,734::DEBUG::[deobfuscate_filenames:182] Deobfuscate inspecting \\?\z:\dls\nzb\TV\<HASH>53adbc2.txt
2021-04-22 11:06:35,734::DEBUG::[deobfuscate_filenames:182] Deobfuscate inspecting \\?\z:\dls\nzb\TV\<HASH>92792a1.txt
2021-04-22 11:06:35,734::DEBUG::[deobfuscate_filenames:182] Deobfuscate inspecting \\?\z:\dls\nzb\TV\<HASH>65f8793.txt
2021-04-22 11:06:35,734::DEBUG::[deobfuscate_filenames:182] Deobfuscate inspecting \\?\z:\dls\nzb\TV\<HASH>e615401.txt
Here is the snippet of log when I downloaded exact same file again. again, it's 41bc1b5.mkv

Code: Select all

2021-04-22 11:26:12,298::DEBUG::[deobfuscate_filenames:182] Deobfuscate inspecting \\?\z:\dls\nzb\TV\<HASH>41bc1b5.mkv
2021-04-22 11:26:12,298::DEBUG::[deobfuscate_filenames:84] Checking: <HASH>41bc1b5
2021-04-22 11:26:12,298::DEBUG::[deobfuscate_filenames:88] Obfuscated: 32 hex digit
2021-04-22 11:26:12,298::INFO::[deobfuscate_filenames:194] Deobfuscate renaming \\?\z:\dls\nzb\TV\<HASH>41bc1b5.mkv to \\?\z:\dls\nzb\TV\TVShow.S02E06.episode.name.1080p.WEB-DL.AAC2.0.H.264.1-NTb-Obfuscated.mkv
2021-04-22 11:26:12,298::DEBUG::[filesystem:833] Renaming "\\?\z:\dls\nzb\TV\<HASH>41bc1b5.mkv" to "\\?\z:\dls\nzb\TV\TVShow.S02E06.episode.name.1080p.WEB-DL.AAC2.0.H.264.1-NTb-Obfuscated.mkv"
2021-04-22 11:26:12,299::DEBUG::[deobfuscate_filenames:182] Deobfuscate inspecting \\?\z:\dls\nzb\TV\<HASH>b8dba0c.txt
2021-04-22 11:26:12,299::DEBUG::[deobfuscate_filenames:182] Deobfuscate inspecting \\?\z:\dls\nzb\TV\<HASH>fe5f697.txt
2021-04-22 11:26:12,300::DEBUG::[deobfuscate_filenames:182] Deobfuscate inspecting \\?\z:\dls\nzb\TV\<HASH>53adbc2.txt
User avatar
sander
Release Testers
Release Testers
Posts: 8812
Joined: January 22nd, 2008, 2:22 pm

Re: obfuscated names

Post by sander »

So for exact same download, once it got not renamed, and the once it got renamed?! Weird.

What is the size of <HASH>41bc1b5.mkv in the first download?

Can you mail the NZB to [email protected] with in subject "freds / still obfuscated names (a.o. sander)"
freds
Newbie
Newbie
Posts: 27
Joined: December 4th, 2020, 3:02 pm

Re: obfuscated names

Post by freds »

sander wrote: April 22nd, 2021, 1:47 pm So for exact same download, once it got not renamed, and the once it got renamed?! Weird.

What is the size of <HASH>41bc1b5.mkv in the first download?

Can you mail the NZB to [email protected] with in subject "freds / still obfuscated names (a.o. sander)"
Correct. Same file. same nzb in fact. first time NOT renamed, second time renamed. agreed, it's weird. It very well could (probably) is a problem on my end. Like I mentioned earlier, this has been happening for awhile now. The mkv is about 1.2 GB.

Yes, I'll send the nzb file to that address. My guess is it will work fine for you. It's gotta be me that's the problem or you'd have hundreds of folks complaining. I downloaded about 30 episodes of a different show a few days ago, and all but one were NOT renamed.

Thanks,
User avatar
sander
Release Testers
Release Testers
Posts: 8812
Joined: January 22nd, 2008, 2:22 pm

Re: obfuscated names

Post by sander »

Which version of SABnzbd are you running? If not the newest SABnzbd = 3.2.1, upgrade, and retry, please.
User avatar
sander
Release Testers
Release Testers
Posts: 8812
Joined: January 22nd, 2008, 2:22 pm

Re: obfuscated names

Post by sander »

Oh, and:

Windows & Intermittent file problems ... are you running a virus scanner? Did you exclude the SAB download directories? If not, please do so. Or disable your virusscanner completely for the test.

Because maybe your virusscanner is blocking access to the file resulting the os.path.getsize(filename) in the code below to be 0 or something like that ... ? #longshot

Code: Select all

            logging.debug("Deobfuscate inspecting %s", filename)
            # Do we need to rename this file?
            # Criteria: big, not-excluded extension, obfuscated (in that order)
            if (
                os.path.getsize(filename) > MIN_FILE_SIZE
                and get_ext(filename) not in excluded_file_exts
                and is_probably_obfuscated(filename)  # this as last test to avoid unnecessary analysis
            ):
                 # Rename and make sure the new filename is unique
                path, file = os.path.split(filename)
                # construct new_name: <path><usefulname><extension>
                new_name = get_unique_filename("%s%s" % (os.path.join(path, usefulname), get_ext(filename)))
                logging.info("Deobfuscate renaming %s to %s", filename, new_name)
                
... because you see the first logging but not the next, but no Traceback.

OH WAIT: scan your sabnzbd.log for "traceback"!!!
freds
Newbie
Newbie
Posts: 27
Joined: December 4th, 2020, 3:02 pm

Re: obfuscated names

Post by freds »

sander wrote: April 22nd, 2021, 2:06 pm Which version of SABnzbd are you running? If not the newest SABnzbd = 3.2.1, upgrade, and retry, please.
Version: 3.2.1 [0542c25]
freds
Newbie
Newbie
Posts: 27
Joined: December 4th, 2020, 3:02 pm

Re: obfuscated names

Post by freds »

sander wrote: April 22nd, 2021, 2:09 pm Oh, and:

Windows & Intermittent file problems ... are you running a virus scanner? Did you exclude the SAB download directories? If not, please do so. Or disable your virusscanner completely for the test.

Because maybe your virusscanner is blocking access to the file resulting the os.path.getsize(filename) in the code below to be 0 or something like that ... ? #longshot

Code: Select all

            logging.debug("Deobfuscate inspecting %s", filename)
            # Do we need to rename this file?
            # Criteria: big, not-excluded extension, obfuscated (in that order)
            if (
                os.path.getsize(filename) > MIN_FILE_SIZE
                and get_ext(filename) not in excluded_file_exts
                and is_probably_obfuscated(filename)  # this as last test to avoid unnecessary analysis
            ):
                 # Rename and make sure the new filename is unique
                path, file = os.path.split(filename)
                # construct new_name: <path><usefulname><extension>
                new_name = get_unique_filename("%s%s" % (os.path.join(path, usefulname), get_ext(filename)))
                logging.info("Deobfuscate renaming %s to %s", filename, new_name)
                
... because you see the first logging but not the next, but no Traceback.

OH WAIT: scan your sabnzbd.log for "traceback"!!!
Thanks again!
Last night several episodes and a couple movies downloaded. None were renamed correctly. The problem is becoming more consistent.

The only virus scanner I have is the built-in Microsoft security. I disabled it this morning and redownloaded one of the episodes that had downloaded overnight. Exact same file. It was not renamed last night, and was not renamed after this morning's test (with virus scan turned off). I don't have any other security on this Windows 10 box.

I searched the log file from this morning's test (with virus off, downloading same episode as last night) and there is no "traceback" in it at all. It's a small mkv, only 138 MB, so easy to test.

I hope this is OK, but I am going to send that log file to the email address from above, along with the nzb file. You will see that the episode in question starts at:
2021-04-23 10:09:37,163::DEBUG::[deobfuscate_filenames:84] Checking: <HASH>0903247

and ends here:
2021-04-23 10:10:18,259


If you look at the log file, you can see that the file is identified as "obfuscated" at the beginning, but when it runs filename_deobfuscate after the download and unpacking completes, it inspects all the files in that folder, but doesn't do anything with them.

I sent the email with the same subject as before
freds / still obfuscated names (a.o. sander)

very confusing!
Thank you for taking the time to help!
Post Reply