[1.1.0RC2] Very, very slow initial connexion to Usenet serve

Questions and bug reports for Beta releases should be posted here.
Forum rules
Help us help you:
  • Tell us what system you run SABnzbd on.
  • Adhere to the forum rules.
  • Do you experience problems during downloading?
    Check your connection in Status and Interface settings window.
    Use Test Server in Config > Servers.
    We will probably ask you to do a test using only basic settings.
  • Do you experience problems during repair or unpacking?
    Enable +Debug logging in the Status and Interface settings window and share the relevant parts of the log here using [ code ] sections.
Post Reply
EvilFlanders
Newbie
Newbie
Posts: 23
Joined: May 25th, 2016, 4:02 pm

[1.1.0RC2] Very, very slow initial connexion to Usenet serve

Post by EvilFlanders »

Hi!

As you can see in the pastebin, it takes sab about 20 seconds to establish 30 connexions. Is that normal? I've tried Nzbvortex for a change and will not keep using it but it managed to start downloads almost immediately.

Thanks

http://pastebin.com/Ja7L0BcH

EDIT by Sander:

Code: Select all

2016-08-01 11:43:26,144::INFO::[downloader:446] 21@news.newshosting.com: Initiating connection
2016-08-01 11:43:26,593::INFO::[happyeyeballs:111] Quickest IP address for news-eu.newshosting.com (port 563, ssl True, preferipv6 True) is 81.171.92.224
2016-08-01 11:43:26,596::INFO::[downloader:446] 26@news.newshosting.com: Initiating connection
2016-08-01 11:43:27,515::INFO::[happyeyeballs:111] Quickest IP address for news-eu.newshosting.com (port 563, ssl True, preferipv6 True) is 81.171.92.238
...
2016-08-01 11:43:43,245::INFO::[downloader:446] 23@news.newshosting.com: Initiating connection
2016-08-01 11:43:43,802::INFO::[happyeyeballs:111] Quickest IP address for news-eu.newshosting.com (port 563, ssl True, preferipv6 True) is 81.171.92.224
2016-08-01 11:43:43,803::INFO::[downloader:446] 29@news.newshosting.com: Initiating connection
2016-08-01 11:43:44,288::INFO::[happyeyeballs:111] Quickest IP address for news-eu.newshosting.com (port 563, ssl True, preferipv6 True) is 81.171.92.238
2016-08-01 11:43:44,381::INFO::[downloader:649] Connecting 12@news.newshosting.com finished
2016-08-01 11:43:44,381::INFO::[downloader:649] Connecting 11@news.newshosting.com finished
2016-08-01 11:43:44,382::INFO::[downloader:649] Connecting 3@news.newshosting.com finished
Top
User avatar
sander
Release Testers
Release Testers
Posts: 9429
Joined: January 22nd, 2008, 2:22 pm

Re: [1.1.0RC2] Very, very slow initial connexion to Usenet s

Post by sander »

Do you mean the first download only starts after 20 seconds? Or does the first download start after 1 second?

Anyway:
In SABnzbd: Config -> Switches -> Server load-balancing ... change to the first option "Prevent Load-balancing", and try again. Post back the result.
Top
EvilFlanders
Newbie
Newbie
Posts: 23
Joined: May 25th, 2016, 4:02 pm

Re: [1.1.0RC2] Very, very slow initial connexion to Usenet s

Post by EvilFlanders »

Thanks sander, it solved the problem.
The lag occurred on the first download after sab was disconnected from the server i.e. with 0 active connections.
With the setting you've advised, the download starts immediately after an nzb has been imported.
Top
User avatar
sander
Release Testers
Release Testers
Posts: 9429
Joined: January 22nd, 2008, 2:22 pm

Re: [1.1.0RC2] Very, very slow initial connexion to Usenet s

Post by sander »

Are you on Linux or MacOS? If so, can you do an extra test?
Top
EvilFlanders
Newbie
Newbie
Posts: 23
Joined: May 25th, 2016, 4:02 pm

Re: [1.1.0RC2] Very, very slow initial connexion to Usenet s

Post by EvilFlanders »

Sure! I'm using MacOS v10.11.6 (15G31)
Top
User avatar
sander
Release Testers
Release Testers
Posts: 9429
Joined: January 22nd, 2008, 2:22 pm

Re: [1.1.0RC2] Very, very slow initial connexion to Usenet s

Post by sander »

OK, great. Before the Real Test, can you do this:

In SABnzbd: Config -> Switches -> Server load-balancing ... change to the second option "Allow Load Balancing". Retest and please post the result here.

PS:

Please do this too: click on the Wrench symbol in the upper right corner, and set Logging to +Debug.
Top
EvilFlanders
Newbie
Newbie
Posts: 23
Joined: May 25th, 2016, 4:02 pm

Re: [1.1.0RC2] Very, very slow initial connexion to Usenet s

Post by EvilFlanders »

To summarise, knowing that I press "Force disconnect" between every try:

"Prevent Load-balancing" takes less than a second to start downloading.
"Allow Load Balancing" takes 2 seconds to start downloading.
"Allow Load Balancing with optimisation for IPv6" takes from 15 to 20 seconds to start downloading.
Top
User avatar
sander
Release Testers
Release Testers
Posts: 9429
Joined: January 22nd, 2008, 2:22 pm

Re: [1.1.0RC2] Very, very slow initial connexion to Usenet s

Post by sander »

OK, next step:

I'm assuming that on MacOS you run SABnzbd from source. If so, can you find the directory "sabnzbd" with the file "downloader.py" in it?

If so, open it for editing and find these lines:

Code: Select all

            # RFC6555 / Happy Eyeballs:
            ip = happyeyeballs(self.host, port=self.port, ssl=self.ssl)
and change the second line to:

Code: Select all

            # RFC6555 / Happy Eyeballs:
            ip = happyeyeballs(self.host, port=self.port, ssl=self.ssl, preferipv6=False)
Save and exit and (re)start SABnzbd.

In SABnzbd, select/keep the option "Allow Load Balancing with optimisation for IPv6" and retest.

Please also post the relevant sabnzbd.log
Top
EvilFlanders
Newbie
Newbie
Posts: 23
Joined: May 25th, 2016, 4:02 pm

Re: [1.1.0RC2] Very, very slow initial connexion to Usenet s

Post by EvilFlanders »

Sorry I'm using the packaged app (as in https://github.com/sabnzbd/sabnzbd/rele ... g/1.1.0RC2).
And I can't find the downloader.py file either in the package contents or on my computer. Is it different for the packaged app?
Top
User avatar
sander
Release Testers
Release Testers
Posts: 9429
Joined: January 22nd, 2008, 2:22 pm

Re: [1.1.0RC2] Very, very slow initial connexion to Usenet s

Post by sander »

I see. So that is not possible. Pity.

Something else to test then: did you set Logging to +Debug? And the load balancing to the third option (so: "Allow Load Balancing with optimisation for IPv6" )?
Can you then do a download again, and show the sabnzbd.log lines with happy eyeballs?

What I still don't understand: your experience seems to be that SAB only starts downloading after the last connection has been set up. I find that strange. Hopefully @shypike can say something about this.

EDIT:

PS: I now see news.newshosting.com has only IPv4 addresses and no IPv6 addresses, so IPv6 can't be a reason for what you describe. So my request for "preferIPv6 = False" would probably not have revealed something useful

Code: Select all

news.newshosting.com 563 True True
DEBUG:root:No IPv6 address found for news.newshosting.com
DEBUG:root:Input for thread is 81.171.92.238 563 True
DEBUG:root:Input for thread is 81.171.92.224 563 True
INFO:root:Quickest IP address for news.newshosting.com (port 563, ssl True, preferipv6 True) is 81.171.92.224
DEBUG:root:Happy Eyeballs lookup and port connect took 41 ms
81.171.92.224
Top
EvilFlanders
Newbie
Newbie
Posts: 23
Joined: May 25th, 2016, 4:02 pm

Re: [1.1.0RC2] Very, very slow initial connexion to Usenet s

Post by EvilFlanders »

Sorry but there was lot of "Happy Eyeballs" lines and some others in between. I preffered to make whole extracts for the three alternatives if it's okay with you. Here they are:

Prevent Load Balancing: http://pastebin.com/eeXpKBGi
Allow Load Balancing: http://pastebin.com/W2GbCcfd
Allow Load Balancing with optimisation for IPv6: http://pastebin.com/0w3zyb8r
Top
EvilFlanders
Newbie
Newbie
Posts: 23
Joined: May 25th, 2016, 4:02 pm

Re: [1.1.0RC2] Very, very slow initial connexion to Usenet s

Post by EvilFlanders »

P.S. And, yes, there are issues with newshosting's IPv6. They have newsserver IPv6 addresses but I cannot reach them (see list here).
Apparently, there are known issues with MacOSX and IPv6 reversing since I can't ping Google's IPv6 DNSs nor set them in my DNS settings either.
Top
User avatar
sander
Release Testers
Release Testers
Posts: 9429
Joined: January 22nd, 2008, 2:22 pm

Re: [1.1.0RC2] Very, very slow initial connexion to Usenet s

Post by sander »

I'll investigate further this weekend.
Top
mastyman
Jr. Member
Jr. Member
Posts: 57
Joined: February 27th, 2012, 9:57 pm

Re: [1.1.0RC2] Very, very slow initial connexion to Usenet s

Post by mastyman »

ah, i had the same problem, when i switched from supernews, to newsgroup ninja, about a week ago, it was crazy slow for the download to start on newsgroup ninja- 10-20 seconds, whereas supernews was instant for the many years i used it

i switched to "Allow Load Balancing" instead of "Allow Load Balancing with optimisation for IPv6" and now its almost INSTANT download start on newsgroup ninja.

I dont have IPv6 available on my wan connection.

[1.1.0RC3] on Windows 10x64
Last edited by mastyman on August 20th, 2016, 2:08 am, edited 1 time in total.
Top
User avatar
sander
Release Testers
Release Testers
Posts: 9429
Joined: January 22nd, 2008, 2:22 pm

Re: [1.1.0RC2] Very, very slow initial connexion to Usenet s

Post by sander »

mastyman wrote:ah, i had the same problem, when i switched from supernews, to newsgroup ninja, about a week ago, it was crazy slow for the download to start on newsgroup ninja- 10-20 seconds, whereas supernews was instant for the many years i used it

i switched to "Allow Load Balancing" instead of "Allow Load Balancing with optimisation for IPv6" and now its almost INSTANT download start on newsgroup ninja.

I dont have IPv6 available on my wan connection.

[1.1.0RC3] on Windows 10x64
Mastyman, more info would be nice:

- you use news.newsgroup.ninja ?
- how many connections?
- SSL newsserver connection, or plain connection?
Top
Post Reply

Return to “Beta Releases”