Re: Unable to perform handshake within timeout..

classic Classic list List threaded Threaded
3 messages Options
ilya.kasnacheev ilya.kasnacheev
Reply | Threaded
Open this post in threaded view
|

Re: Unable to perform handshake within timeout..

Hello!

I think that maybe that's your balancer from earlier posts tries to talk HTTP (or some other protocol) to our client port, confusing it.

Regards,
--
Ilya Kasnacheev


вт, 7 апр. 2020 г. в 05:23, kay <[hidden email]>:
I have two nodes at remote server..
I found a log 

[WARN] [grid-timeout-worker-#39][ClientListenerNioListener] Unable to
perform handshake within timeout

Why this logs appear??
and How can i fix it??



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Sanjaya Sanjaya
Reply | Threaded
Open this post in threaded view
|

Re: Unable to perform handshake within timeout..

We are experencing same, We are using apache ignite 2.8.1.

We are experiencing bunch of logs as below, The good things the application
works as expected.

But we did not undetstand why the logs are coming, Request to help on this.

STACK TRACE
==============
[05:08:52,928][WARNING][grid-timeout-worker-#23][ClientListenerNioListener]
Unable to perform handshake within timeout [timeout=10000,
remoteAddr=/10.208.16.66:60529]
[05:08:54,051][WARNING][grid-timeout-worker-#23][ClientListenerNioListener]
Unable to perform handshake within timeout [timeout=10000,
remoteAddr=/10.208.16.128:59150]
[05:08:55,729][WARNING][grid-timeout-worker-#23][ClientListenerNioListener]
Unable to perform handshake within timeout [timeout=10000,
remoteAddr=/10.208.16.190:60622]
[05:08:57,502][WARNING][grid-timeout-worker-#23][ClientListenerNioListener]
Unable to perform handshake within timeout [timeout=10000,
remoteAddr=/10.208.16.35:51873]
[05:08:57,929][WARNING][grid-timeout-worker-#23][ClientListenerNioListener]
Unable to perform handshake within timeout [timeout=10000,
remoteAddr=/10.208.16.66:60649]
[05:08:59,050][WARNING][grid-timeout-worker-#23][ClientListenerNioListener]
Unable to perform handshake within timeout [timeout=10000,
remoteAddr=/10.208.16.128:59209]
[05:09:00,741][WARNING][grid-timeout-worker-#23][ClientListenerNioListener]
Unable to perform handshake within timeout [timeout=10000,
remoteAddr=/10.208.16.190:60733]
[05:09:02,517][WARNING][grid-timeout-worker-#23][ClientListenerNioListener]
Unable to perform handshake within timeout [timeout=10000,
remoteAddr=/10.208.16.35:51931]




--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Alexandr Shapkin Alexandr Shapkin
Reply | Threaded
Open this post in threaded view
|

RE: Unable to perform handshake within timeout..

Hi,

 

Am I right that you are using the Azure Kubernetes cluster?

 

If yes, it’s most likely is about the k8s kube-proxy health check probe pinging all open ports including the default thin client one (port 10800). Because of that, Ignite can’t read the message correctly and the ClientListenerNioListener states that it’s unable to perform a handshake with the remote address within 10 seconds.    

 

I’d suggest you make the following changes for healthCheckNodePort in your LoadBalancer configuration:

 

externalTrafficPolicy: Local

healthCheckNodePort: 30001 (a custom port that’s not in use by Apache Ignite and other apps)

 

More details:

https://kubernetes.io/docs/tasks/access-application-cluster/create-external-load-balancer/#preserving-the-client-source-ip

 

 

 

From: [hidden email]
Sent: Sunday, September 13, 2020 9:08 AM
To: [hidden email]
Subject: Re: Unable to perform handshake within timeout..

 

We are experencing same, We are using apache ignite 2.8.1.

 

We are experiencing bunch of logs as below, The good things the application

works as expected.

 

But we did not undetstand why the logs are coming, Request to help on this.

 

STACK TRACE

==============

[05:08:52,928][WARNING][grid-timeout-worker-#23][ClientListenerNioListener]

Unable to perform handshake within timeout [timeout=10000,

remoteAddr=/10.208.16.66:60529]

[05:08:54,051][WARNING][grid-timeout-worker-#23][ClientListenerNioListener]

Unable to perform handshake within timeout [timeout=10000,

remoteAddr=/10.208.16.128:59150]

[05:08:55,729][WARNING][grid-timeout-worker-#23][ClientListenerNioListener]

Unable to perform handshake within timeout [timeout=10000,

remoteAddr=/10.208.16.190:60622]

[05:08:57,502][WARNING][grid-timeout-worker-#23][ClientListenerNioListener]

Unable to perform handshake within timeout [timeout=10000,

remoteAddr=/10.208.16.35:51873]

[05:08:57,929][WARNING][grid-timeout-worker-#23][ClientListenerNioListener]

Unable to perform handshake within timeout [timeout=10000,

remoteAddr=/10.208.16.66:60649]

[05:08:59,050][WARNING][grid-timeout-worker-#23][ClientListenerNioListener]

Unable to perform handshake within timeout [timeout=10000,

remoteAddr=/10.208.16.128:59209]

[05:09:00,741][WARNING][grid-timeout-worker-#23][ClientListenerNioListener]

Unable to perform handshake within timeout [timeout=10000,

remoteAddr=/10.208.16.190:60733]

[05:09:02,517][WARNING][grid-timeout-worker-#23][ClientListenerNioListener]

Unable to perform handshake within timeout [timeout=10000,

remoteAddr=/10.208.16.35:51931]

 

 

 

 

--

Sent from: http://apache-ignite-users.70518.x6.nabble.com/

 

Alex Shapkin