Search found 160 matches

by Puzzled
June 1st, 2019, 7:06 am
Forum: Beta Releases
Topic: py3 - Won't run on Arm because only sabyenc-3.4.0 is available
Replies: 5
Views: 4245

Re: py3 - Won't run on Arm because only sabyenc-3.4.0 is available

No, I wasn't aware of that page. I used INSTALL.txt from the repo. Thanks.
by Puzzled
May 31st, 2019, 12:32 pm
Forum: Beta Releases
Topic: py3 - Won't run on Arm because only sabyenc-3.4.0 is available
Replies: 5
Views: 4245

py3 - Won't run on Arm because only sabyenc-3.4.0 is available

I think that's all that's stopping it from running on my Raspberry Pi 3. I had to install this manually to make it start: aptitude install par2 unrar 7zip libssl-dev libffi-dev python3-pip python3-openssl pip3 install cryptography pip3 install sabyenc pip3 install cheetah3 pip3 install feedparser pi...
by Puzzled
May 30th, 2019, 3:35 pm
Forum: Beta Releases
Topic: Optimizing SABnzbd
Replies: 17
Views: 13664

Re: Optimizing SABnzbd

I have put the changes for fetching multiple articles and putting them in a server queue here: https://github.com/puzzledsab/sabnzbd/tree/py3-multifetch This will mostly be an advantage for low power servers and/or high bandwidth. It also makes the sleep patch more efficient because the time consumi...
by Puzzled
May 29th, 2019, 10:10 am
Forum: Beta Releases
Topic: py3-branch - Exception when nzb filename is short number
Replies: 1
Views: 2343

py3-branch - Exception when nzb filename is short number

2019-05-29 12:50:21,483::INFO::[postproc:328] Starting Post-Processing on 1000 => Repair:True, Unpack:True, Delete:True, Script:, Cat:* 2019-05-29 12:50:21,520::INFO::[nzbstuff:1548] [sabnzbd.postproc.process_job] Purging data for job 1000 (delete_all_data=False) Exception in thread Thread-9: Trace...
by Puzzled
May 29th, 2019, 8:12 am
Forum: Beta Releases
Topic: Optimizing SABnzbd
Replies: 17
Views: 13664

Re: Optimizing SABnzbd

I've done some experimentation on the impacts of sleeping in the downloader loop in Windows. First, the granularity of sleep using a loop that runs 1 sec and tests how many times it runs with various sleep lengths: time.sleep(0.0001): 516 time.sleep(0.001): 516 time.sleep(0.002): 343 time.sleep(0.00...
by Puzzled
May 28th, 2019, 4:53 pm
Forum: Beta Releases
Topic: py3-branch - Check instance type before using startswith
Replies: 3
Views: 3223

Re: py3-branch - Check instance type before using startswith

I assume that sabyenc doesn't do base64 and doesn't find the filename. The exception is from the decoder: https://github.com/sabnzbd/sabyenc/blob/master/src/sabyenc3.c#L614 Then there is a new exception in the ValueError exception handling because of the byte problem. I'm just downloading all the co...
by Puzzled
May 28th, 2019, 1:49 pm
Forum: Beta Releases
Topic: py3-branch - Check instance type before using startswith
Replies: 3
Views: 3223

py3-branch - Check instance type before using startswith

Apparently in Python 3 the line in line.startswith('X-') can be a byte type, which requires different parameters. The article that caused it contains no metadata , only what seems like base64 encoded content. The header or subject has no encoding info. 2019-05-28 15:12:59,702::INFO::[downloader:302]...
by Puzzled
May 26th, 2019, 3:42 pm
Forum: General Help
Topic: File move incomplete - complete - file name issues
Replies: 8
Views: 2435

Re: File move incomplete - complete - file name issues

Is the file system still FAT or NTFS? If you can control it you could try ext4. If not then check which charset is used to mount the disk.
by Puzzled
May 26th, 2019, 2:55 pm
Forum: Beta Releases
Topic: Optimizing SABnzbd
Replies: 17
Views: 13664

Re: Optimizing SABnzbd

I'm pretty much finished with modifications that reads several articles at once and uses a queue for each server. I will test it some more, clean up the code a bit and then upload it to github. Regarding the age limit I think it's quite useful. Only the Omicron/Highwinds related servers have 3800 da...
by Puzzled
May 24th, 2019, 7:11 am
Forum: Beta Releases
Topic: Optimizing SABnzbd
Replies: 17
Views: 13664

Re: Optimizing SABnzbd

Some more ideas... 1. I've been looking at the trylist. Have you considered using a dictionary or an array instead? That way you won't have to check if it's already there before setting it, and looking it up would probably be faster. Hopefully it would also require less locking. Instead of a list yo...
by Puzzled
May 24th, 2019, 6:16 am
Forum: Beta Releases
Topic: Stalled download in py3
Replies: 3
Views: 2833

Re: Stalled download in py3

It was with my patch and yappi, but the most likely trigger was network problems. The ping time could be up to several seconds. Sorry, I forgot about that because it didn't affect transfer rate much. I have tried the same nzb several time since with no problems. I got the CRC error every time so it ...
by Puzzled
May 23rd, 2019, 11:40 am
Forum: Beta Releases
Topic: Stalled download in py3
Replies: 3
Views: 2833

Stalled download in py3

The nzb was at 100% in the admin. Unfortunately I only had info level logging, but the log said [.. .] some decoding 2019-05-23 14:38:35,088::INFO::[decoder:141] CRC Error in z [.. .] some more decoding 2019-05-23 14:44:29,982::INFO::[assembler:87] Decoding \\?\E:\incomplete\y\x.part24.rar yenc 2019...
by Puzzled
May 21st, 2019, 5:11 pm
Forum: Beta Releases
Topic: Optimizing SABnzbd
Replies: 17
Views: 13664

Re: Optimizing SABnzbd

Using 3 servers with the same priority, a total of 11 connections, downloading 3 different nzbs in the queue (because of retention differences) the load varies between 1.5 and 3.5%, average is probably 2.5. On my setup it's a big improvement no matter what combination of servers and queue size I use...
by Puzzled
May 21st, 2019, 12:15 pm
Forum: Beta Releases
Topic: Optimizing SABnzbd
Replies: 17
Views: 13664

Re: Optimizing SABnzbd

I tried adding a test so that a server would only be tested once every second if it had not had any busy_threads or found any articles the last 4 seconds. With 11 servers, 400 GB in the queue and my sleep fix this reduced the number of calls to NzbQueue.get_article from about 78 000/min to about 115...
by Puzzled
May 20th, 2019, 4:52 pm
Forum: Beta Releases
Topic: Optimizing SABnzbd
Replies: 17
Views: 13664

Re: Optimizing SABnzbd

Only the 2 top priority servers are used at least 99.999% of the time. I think it must be possible to find a way to ignore them when there is nothing to do. Unless all the top priority servers have missed any articles since the last time they checked I don't see why they need to check again. Perhaps...