Search found 47 matches

by Puzzled
May 26th, 2019, 2:55 pm
Forum: Beta Releases
Topic: Optimizing SABnzbd
Replies: 17
Views: 3243

Re: Optimizing SABnzbd

I'm pretty much finished with modifications that reads several articles at once and uses a queue for each server. I will test it some more, clean up the code a bit and then upload it to github. Regarding the age limit I think it's quite useful. Only the Omicron/Highwinds related servers have 3800 da...
by Puzzled
May 24th, 2019, 7:11 am
Forum: Beta Releases
Topic: Optimizing SABnzbd
Replies: 17
Views: 3243

Re: Optimizing SABnzbd

Some more ideas... 1. I've been looking at the trylist. Have you considered using a dictionary or an array instead? That way you won't have to check if it's already there before setting it, and looking it up would probably be faster. Hopefully it would also require less locking. Instead of a list yo...
by Puzzled
May 24th, 2019, 6:16 am
Forum: Beta Releases
Topic: Stalled download in py3
Replies: 3
Views: 683

Re: Stalled download in py3

It was with my patch and yappi, but the most likely trigger was network problems. The ping time could be up to several seconds. Sorry, I forgot about that because it didn't affect transfer rate much. I have tried the same nzb several time since with no problems. I got the CRC error every time so it ...
by Puzzled
May 23rd, 2019, 11:40 am
Forum: Beta Releases
Topic: Stalled download in py3
Replies: 3
Views: 683

Stalled download in py3

The nzb was at 100% in the admin. Unfortunately I only had info level logging, but the log said [.. .] some decoding 2019-05-23 14:38:35,088::INFO::[decoder:141] CRC Error in z [.. .] some more decoding 2019-05-23 14:44:29,982::INFO::[assembler:87] Decoding \\?\E:\incomplete\y\x.part24.rar yenc 2019...
by Puzzled
May 21st, 2019, 5:11 pm
Forum: Beta Releases
Topic: Optimizing SABnzbd
Replies: 17
Views: 3243

Re: Optimizing SABnzbd

Using 3 servers with the same priority, a total of 11 connections, downloading 3 different nzbs in the queue (because of retention differences) the load varies between 1.5 and 3.5%, average is probably 2.5. On my setup it's a big improvement no matter what combination of servers and queue size I use...
by Puzzled
May 21st, 2019, 12:15 pm
Forum: Beta Releases
Topic: Optimizing SABnzbd
Replies: 17
Views: 3243

Re: Optimizing SABnzbd

I tried adding a test so that a server would only be tested once every second if it had not had any busy_threads or found any articles the last 4 seconds. With 11 servers, 400 GB in the queue and my sleep fix this reduced the number of calls to NzbQueue.get_article from about 78 000/min to about 115...
by Puzzled
May 20th, 2019, 4:52 pm
Forum: Beta Releases
Topic: Optimizing SABnzbd
Replies: 17
Views: 3243

Re: Optimizing SABnzbd

Only the 2 top priority servers are used at least 99.999% of the time. I think it must be possible to find a way to ignore them when there is nothing to do. Unless all the top priority servers have missed any articles since the last time they checked I don't see why they need to check again. Perhaps...
by Puzzled
May 20th, 2019, 3:38 am
Forum: Beta Releases
Topic: Optimizing SABnzbd
Replies: 17
Views: 3243

Re: Optimizing SABnzbd

Is the develop branch or the py3 branch going to be the new main branch when you switch to Python 3? I hope you will merge all the fixes done in develop to py3, otherwise it is hard to know if what I'm testing has already been fixed in the other branch. If not it's probably better if I use the devel...
by Puzzled
May 19th, 2019, 4:12 pm
Forum: Beta Releases
Topic: Optimizing SABnzbd
Replies: 17
Views: 3243

Re: Optimizing SABnzbd

I have 11 servers with various different priority levels. When I deactivate all but 1 the number of calls to NzbQueue.get_article is reduced to ~600/minute. The cpu usage is still ~10%, the loop will iterate ~430 times/second, but only 12-13 articles are added every second. Sleeping 0.001 seconds ev...
by Puzzled
May 19th, 2019, 9:17 am
Forum: Beta Releases
Topic: Optimizing SABnzbd
Replies: 17
Views: 3243

Optimizing SABnzbd

Sorry about the tables, I couldn't find a way to get monospaced fonts. I have been trying to understand SABnzbd in order to find ways to reduce the CPU consumption and if possible make it run smoother. I haven't done any Python stuff before, but I've done lots of programming in other languages. My s...
by Puzzled
May 17th, 2019, 10:58 am
Forum: Beta Releases
Topic: py3-branch/Windows sabnzbd API-error
Replies: 2
Views: 676

py3-branch/Windows sabnzbd API-error

I have checked out SABnzbd from Git py3 branch on Windows. I don't have any experience with Python so this may well be a user error. Anyway, when it gets this request: http://localhost:5342/api?mode=history&name=delete&del_files=1&value=SABnzbd_nzo_lnnxc9kp&apikey=(removed)&output=json it fails with...
by Puzzled
May 17th, 2019, 6:30 am
Forum: General Help
Topic: Python 2 or 3 for development?
Replies: 1
Views: 484

Python 2 or 3 for development?

Hi, I've checked out the default branch from git on Windows to see if I can figure out how it works and contribute in any way. I am currently using Python 2.7 but I saw the notice about switching to python3. Does that mean that I can/should update to python3 now, or that it will be prepared for pyth...
by Puzzled
May 7th, 2019, 6:49 am
Forum: Bug Reports
Topic: 1.2.0 Interface Options (Compact and Tabbed)
Replies: 5
Views: 1530

Re: 1.2.0 Interface Options (Compact and Tabbed)

The interface config seem to be forgotten in Firefox even when I just close the tab and open SABnzbd in a new one, possibly because it's running on localhost. It would be very nice if it was possible to set this on the server side.
by Puzzled
September 15th, 2017, 11:55 am
Forum: General Help
Topic: Obscured download not processing correctly
Replies: 13
Views: 1645

Re: Obscured download not processing correctly

There are lots of threads about obfuscated names in the Sonarr forum, maybe you can find something there. https://forums.sonarr.tv/search?q=obfuscated
by Puzzled
September 5th, 2017, 4:36 pm
Forum: Bug Reports
Topic: 2.2.1 uses much more cpu than 2.2.0
Replies: 9
Views: 2291

Re: 2.2.1 uses much more cpu than 2.2.0

I just installed 2.3.0 Alpha 2, and the CPU usage is back to being neglible. Thanks. I tried installing 2.2.1 first just to make sure and it used 25%+ on the same file, so the new version definitely fixed it for me. I have multiple servers but only one was active on the file I was testing.