Loading data to cache using a data streamer

classic Classic list List threaded Threaded
5 messages Options
Josh Katz Josh Katz
Reply | Threaded
Open this post in threaded view
|

Loading data to cache using a data streamer

Client node gets disconnected while trying to load data to cache using a data streamer…

 

How can we overcome this issue and load data to cache reliably?

 

See Exception call stack:

 

Apache.Ignite.Core.Common.ClientDisconnectedException: Client node disconnected: ignite-instance-dab0a266-a4fb-403f-863c-289d3ed18ab7 ---> Apache.Ignite.Core.Common.JavaException: class org.apache.ignite.IgniteClientDisconnectedException: Client node disconnected: ignite-instance-dab0a266-a4fb-403f-863c-289d3ed18ab7   at org.apache.ignite.internal.GridKernalGatewayImpl.readLock(GridKernalGatewayImpl.java:93)   at org.apache.ignite.internal.cluster.ClusterGroupAdapter.guard(ClusterGroupAdapter.java:175)   at org.apache.ignite.internal.cluster.ClusterGroupAdapter.forPredicate(ClusterGroupAdapter.java:379)   at org.apache.ignite.internal.cluster.ClusterGroupAdapter.forCacheNodes(ClusterGroupAdapter.java:593)   at org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.allowOverwrite(DataStreamerImpl.java:496)   at org.apache.ignite.internal.processors.platform.datastreamer.PlatformDataStreamer.processInLongOutLong(PlatformDataStreamer.java:187)   at org.apache.ignite.internal.processors.platform.PlatformTargetProxyImpl.inLongOutLong(PlatformTargetProxyImpl.java:55)       at Apache.Ignite.Core.Impl.Unmanaged.Jni.Env.ExceptionCheck()     at Apache.Ignite.Core.Impl.Unmanaged.Jni.Env.CallLongMethod(GlobalRef obj, IntPtr methodId, Int64* argsPtr)     at Apache.Ignite.Core.Impl.Unmanaged.UnmanagedUtils.TargetInLongOutLong(GlobalRef target, Int32 opType, Int64 memPtr)     at Apache.Ignite.Core.Impl.PlatformJniTarget.InLongOutLong(Int32 type, Int64 val)     --- End of inner exception stack trace ---     at Apache.Ignite.Core.Impl.PlatformJniTarget.InLongOutLong(Int32 type, Int64 val)     at Apache.Ignite.Core.Impl.Datastream.DataStreamerImpl`2.set_AllowOverwrite(Boolean value)     at PopulateCache(String accountStyle, DateTime startDate, DateTime endDate)

 

Thanks,

Josh Katz


Please follow the hyperlink to important disclosures.
https://www.dodgeandcox.com/disclosures/email_disclosure_funds.html

ptupitsyn ptupitsyn
Reply | Threaded
Open this post in threaded view
|

Re: Loading data to cache using a data streamer

Josh,

Do you have a reproducer for this issue?
Can you please attach logs from all nodes?

On Sat, Mar 6, 2021 at 12:59 AM Josh Katz <[hidden email]> wrote:

Client node gets disconnected while trying to load data to cache using a data streamer…

 

How can we overcome this issue and load data to cache reliably?

 

See Exception call stack:

 

Apache.Ignite.Core.Common.ClientDisconnectedException: Client node disconnected: ignite-instance-dab0a266-a4fb-403f-863c-289d3ed18ab7 ---> Apache.Ignite.Core.Common.JavaException: class org.apache.ignite.IgniteClientDisconnectedException: Client node disconnected: ignite-instance-dab0a266-a4fb-403f-863c-289d3ed18ab7   at org.apache.ignite.internal.GridKernalGatewayImpl.readLock(GridKernalGatewayImpl.java:93)   at org.apache.ignite.internal.cluster.ClusterGroupAdapter.guard(ClusterGroupAdapter.java:175)   at org.apache.ignite.internal.cluster.ClusterGroupAdapter.forPredicate(ClusterGroupAdapter.java:379)   at org.apache.ignite.internal.cluster.ClusterGroupAdapter.forCacheNodes(ClusterGroupAdapter.java:593)   at org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.allowOverwrite(DataStreamerImpl.java:496)   at org.apache.ignite.internal.processors.platform.datastreamer.PlatformDataStreamer.processInLongOutLong(PlatformDataStreamer.java:187)   at org.apache.ignite.internal.processors.platform.PlatformTargetProxyImpl.inLongOutLong(PlatformTargetProxyImpl.java:55)       at Apache.Ignite.Core.Impl.Unmanaged.Jni.Env.ExceptionCheck()     at Apache.Ignite.Core.Impl.Unmanaged.Jni.Env.CallLongMethod(GlobalRef obj, IntPtr methodId, Int64* argsPtr)     at Apache.Ignite.Core.Impl.Unmanaged.UnmanagedUtils.TargetInLongOutLong(GlobalRef target, Int32 opType, Int64 memPtr)     at Apache.Ignite.Core.Impl.PlatformJniTarget.InLongOutLong(Int32 type, Int64 val)     --- End of inner exception stack trace ---     at Apache.Ignite.Core.Impl.PlatformJniTarget.InLongOutLong(Int32 type, Int64 val)     at Apache.Ignite.Core.Impl.Datastream.DataStreamerImpl`2.set_AllowOverwrite(Boolean value)     at PopulateCache(String accountStyle, DateTime startDate, DateTime endDate)

 

Thanks,

Josh Katz


Please follow the hyperlink to important disclosures.
https://www.dodgeandcox.com/disclosures/email_disclosure_funds.html

ilya.kasnacheev ilya.kasnacheev
Reply | Threaded
Open this post in threaded view
|

Re: Loading data to cache using a data streamer

In reply to this post by Josh Katz
Hello!

Does it work with a smaller batch? My guess is that you end up consuming too much resources and then the cluster falls apart.

Regards,
--
Ilya Kasnacheev


сб, 6 мар. 2021 г. в 00:59, Josh Katz <[hidden email]>:

Client node gets disconnected while trying to load data to cache using a data streamer…

 

How can we overcome this issue and load data to cache reliably?

 

See Exception call stack:

 

Apache.Ignite.Core.Common.ClientDisconnectedException: Client node disconnected: ignite-instance-dab0a266-a4fb-403f-863c-289d3ed18ab7 ---> Apache.Ignite.Core.Common.JavaException: class org.apache.ignite.IgniteClientDisconnectedException: Client node disconnected: ignite-instance-dab0a266-a4fb-403f-863c-289d3ed18ab7   at org.apache.ignite.internal.GridKernalGatewayImpl.readLock(GridKernalGatewayImpl.java:93)   at org.apache.ignite.internal.cluster.ClusterGroupAdapter.guard(ClusterGroupAdapter.java:175)   at org.apache.ignite.internal.cluster.ClusterGroupAdapter.forPredicate(ClusterGroupAdapter.java:379)   at org.apache.ignite.internal.cluster.ClusterGroupAdapter.forCacheNodes(ClusterGroupAdapter.java:593)   at org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.allowOverwrite(DataStreamerImpl.java:496)   at org.apache.ignite.internal.processors.platform.datastreamer.PlatformDataStreamer.processInLongOutLong(PlatformDataStreamer.java:187)   at org.apache.ignite.internal.processors.platform.PlatformTargetProxyImpl.inLongOutLong(PlatformTargetProxyImpl.java:55)       at Apache.Ignite.Core.Impl.Unmanaged.Jni.Env.ExceptionCheck()     at Apache.Ignite.Core.Impl.Unmanaged.Jni.Env.CallLongMethod(GlobalRef obj, IntPtr methodId, Int64* argsPtr)     at Apache.Ignite.Core.Impl.Unmanaged.UnmanagedUtils.TargetInLongOutLong(GlobalRef target, Int32 opType, Int64 memPtr)     at Apache.Ignite.Core.Impl.PlatformJniTarget.InLongOutLong(Int32 type, Int64 val)     --- End of inner exception stack trace ---     at Apache.Ignite.Core.Impl.PlatformJniTarget.InLongOutLong(Int32 type, Int64 val)     at Apache.Ignite.Core.Impl.Datastream.DataStreamerImpl`2.set_AllowOverwrite(Boolean value)     at PopulateCache(String accountStyle, DateTime startDate, DateTime endDate)

 

Thanks,

Josh Katz


Please follow the hyperlink to important disclosures.
https://www.dodgeandcox.com/disclosures/email_disclosure_funds.html

facundo.maldonado facundo.maldonado
Reply | Threaded
Open this post in threaded view
|

Re: Loading data to cache using a data streamer

Take a look at the data node. If the data node has restarted you might see a client disconnected exception.

On Tue, Mar 9, 2021 at 1:12 PM Ilya Kasnacheev <[hidden email]> wrote:
Hello!

Does it work with a smaller batch? My guess is that you end up consuming too much resources and then the cluster falls apart.

Regards,
--
Ilya Kasnacheev


сб, 6 мар. 2021 г. в 00:59, Josh Katz <[hidden email]>:

Client node gets disconnected while trying to load data to cache using a data streamer…

 

How can we overcome this issue and load data to cache reliably?

 

See Exception call stack:

 

Apache.Ignite.Core.Common.ClientDisconnectedException: Client node disconnected: ignite-instance-dab0a266-a4fb-403f-863c-289d3ed18ab7 ---> Apache.Ignite.Core.Common.JavaException: class org.apache.ignite.IgniteClientDisconnectedException: Client node disconnected: ignite-instance-dab0a266-a4fb-403f-863c-289d3ed18ab7   at org.apache.ignite.internal.GridKernalGatewayImpl.readLock(GridKernalGatewayImpl.java:93)   at org.apache.ignite.internal.cluster.ClusterGroupAdapter.guard(ClusterGroupAdapter.java:175)   at org.apache.ignite.internal.cluster.ClusterGroupAdapter.forPredicate(ClusterGroupAdapter.java:379)   at org.apache.ignite.internal.cluster.ClusterGroupAdapter.forCacheNodes(ClusterGroupAdapter.java:593)   at org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.allowOverwrite(DataStreamerImpl.java:496)   at org.apache.ignite.internal.processors.platform.datastreamer.PlatformDataStreamer.processInLongOutLong(PlatformDataStreamer.java:187)   at org.apache.ignite.internal.processors.platform.PlatformTargetProxyImpl.inLongOutLong(PlatformTargetProxyImpl.java:55)       at Apache.Ignite.Core.Impl.Unmanaged.Jni.Env.ExceptionCheck()     at Apache.Ignite.Core.Impl.Unmanaged.Jni.Env.CallLongMethod(GlobalRef obj, IntPtr methodId, Int64* argsPtr)     at Apache.Ignite.Core.Impl.Unmanaged.UnmanagedUtils.TargetInLongOutLong(GlobalRef target, Int32 opType, Int64 memPtr)     at Apache.Ignite.Core.Impl.PlatformJniTarget.InLongOutLong(Int32 type, Int64 val)     --- End of inner exception stack trace ---     at Apache.Ignite.Core.Impl.PlatformJniTarget.InLongOutLong(Int32 type, Int64 val)     at Apache.Ignite.Core.Impl.Datastream.DataStreamerImpl`2.set_AllowOverwrite(Boolean value)     at PopulateCache(String accountStyle, DateTime startDate, DateTime endDate)

 

Thanks,

Josh Katz


Please follow the hyperlink to important disclosures.
https://www.dodgeandcox.com/disclosures/email_disclosure_funds.html



--
Facundo Maldonado
ilya.kasnacheev ilya.kasnacheev
Reply | Threaded
Open this post in threaded view
|

Re: Loading data to cache using a data streamer

Hello!

Unfortunately, the exception snippet that you have pasted is not sufficient to understand what's going on.

Regards,
--
Ilya Kasnacheev


ср, 10 мар. 2021 г. в 19:35, Pelado <[hidden email]>:
Take a look at the data node. If the data node has restarted you might see a client disconnected exception.

On Tue, Mar 9, 2021 at 1:12 PM Ilya Kasnacheev <[hidden email]> wrote:
Hello!

Does it work with a smaller batch? My guess is that you end up consuming too much resources and then the cluster falls apart.

Regards,
--
Ilya Kasnacheev


сб, 6 мар. 2021 г. в 00:59, Josh Katz <[hidden email]>:

Client node gets disconnected while trying to load data to cache using a data streamer…

 

How can we overcome this issue and load data to cache reliably?

 

See Exception call stack:

 

Apache.Ignite.Core.Common.ClientDisconnectedException: Client node disconnected: ignite-instance-dab0a266-a4fb-403f-863c-289d3ed18ab7 ---> Apache.Ignite.Core.Common.JavaException: class org.apache.ignite.IgniteClientDisconnectedException: Client node disconnected: ignite-instance-dab0a266-a4fb-403f-863c-289d3ed18ab7   at org.apache.ignite.internal.GridKernalGatewayImpl.readLock(GridKernalGatewayImpl.java:93)   at org.apache.ignite.internal.cluster.ClusterGroupAdapter.guard(ClusterGroupAdapter.java:175)   at org.apache.ignite.internal.cluster.ClusterGroupAdapter.forPredicate(ClusterGroupAdapter.java:379)   at org.apache.ignite.internal.cluster.ClusterGroupAdapter.forCacheNodes(ClusterGroupAdapter.java:593)   at org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.allowOverwrite(DataStreamerImpl.java:496)   at org.apache.ignite.internal.processors.platform.datastreamer.PlatformDataStreamer.processInLongOutLong(PlatformDataStreamer.java:187)   at org.apache.ignite.internal.processors.platform.PlatformTargetProxyImpl.inLongOutLong(PlatformTargetProxyImpl.java:55)       at Apache.Ignite.Core.Impl.Unmanaged.Jni.Env.ExceptionCheck()     at Apache.Ignite.Core.Impl.Unmanaged.Jni.Env.CallLongMethod(GlobalRef obj, IntPtr methodId, Int64* argsPtr)     at Apache.Ignite.Core.Impl.Unmanaged.UnmanagedUtils.TargetInLongOutLong(GlobalRef target, Int32 opType, Int64 memPtr)     at Apache.Ignite.Core.Impl.PlatformJniTarget.InLongOutLong(Int32 type, Int64 val)     --- End of inner exception stack trace ---     at Apache.Ignite.Core.Impl.PlatformJniTarget.InLongOutLong(Int32 type, Int64 val)     at Apache.Ignite.Core.Impl.Datastream.DataStreamerImpl`2.set_AllowOverwrite(Boolean value)     at PopulateCache(String accountStyle, DateTime startDate, DateTime endDate)

 

Thanks,

Josh Katz


Please follow the hyperlink to important disclosures.
https://www.dodgeandcox.com/disclosures/email_disclosure_funds.html



--
Facundo Maldonado