Troubleshooting High CPU usage

Get help with all aspects of SABnzbd
Forum rules
Help us help you:
  • Are you using the latest stable version of SABnzbd? Downloads page.
  • Tell us what system you run SABnzbd on.
  • Adhere to the forum rules.
  • Do you experience problems during downloading?
    Check your connection in Status and Interface settings window.
    Use Test Server in Config > Servers.
    We will probably ask you to do a test using only basic settings.
  • Do you experience problems during repair or unpacking?
    Enable +Debug logging in the Status and Interface settings window and share the relevant parts of the log here using [ code ] sections.
Post Reply
houkouonchi
Newbie
Newbie
Posts: 14
Joined: October 9th, 2011, 1:40 pm

Troubleshooting High CPU usage

Post by houkouonchi »

Anyway to do this? I am having problems with a 100 GB nzb file in that at first it was going at decent speed (14-18 megabytes/sec) but after its about 70% done its crawling at 2-4 megabytes/sec and python is using 100% cpu.

I moved another file above it and that one is cruising at 30 megabytes/sec. So obviously its a problem with this specific NZB. Does it have to do with its size or something else?

How can I troubleshoot what is causing the CPU bottleneck? This is on a core i7 style xeon 2.4 Ghz so it should be able to go faster than 2-4 megabytes/sec.
User avatar
sander
Release Testers
Release Testers
Posts: 9429
Joined: January 22nd, 2008, 2:22 pm

Re: Troubleshooting High CPU usage

Post by sander »

30 megabytes/sec? So 300 Mbps? Are you on a fiber connection?

Anyway: if you download the 100GB NZB file with another NZB download program (for example NNTPgrab), what happens?
User avatar
shypike
Administrator
Administrator
Posts: 19773
Joined: January 18th, 2008, 12:49 pm

Re: Troubleshooting High CPU usage

Post by shypike »

If it is just this none NZB, it could very well be something at the Usenet server side.
If the behavior is consistent for all large NZB files, then it could be a SABnzbd problem.
houkouonchi
Newbie
Newbie
Posts: 14
Joined: October 9th, 2011, 1:40 pm

Re: Troubleshooting High CPU usage

Post by houkouonchi »

Yes I am on fiber. I ran into it again and no it doesnt happen in other clients. Like it slows down a little but not as much.

Also when this happens its being CPU bottlenecked (python process uses 100% -- or a bit over) of cpu usage.
User avatar
shypike
Administrator
Administrator
Posts: 19773
Joined: January 18th, 2008, 12:49 pm

Re: Troubleshooting High CPU usage

Post by shypike »

SABnzbd doesn't always scale well with very large files,
especially when the poster chose to use smaller articles.
WTH are you downloading that is 100G big?
Post Reply