Data Streamer API issues to load data into cache

classic Classic list List threaded Threaded
2 messages Options
vinod.jv vinod.jv
Reply | Threaded
Open this post in threaded view
|

Data Streamer API issues to load data into cache

Hi,

I am using Data Streamer API to load the data into ignite cache in embedded
mode.
But i am seeing intermittent issues. Below is the exception. Sometimes job
run successfully and sometimes jobs are hung and the log shows too many of
the below exceptions.

I tried upgrading form Ignite 2.7 to 2.7.5 version and removed
allowOverwrite(true) which was added.
I also tried setting autoFlushFrequency(100) to 100 ms. Still i am seeing
the issue.

ERROR : Critical system error detected. Will be handled accordingly to
configured handler [hnd=StopNodeOrHaltFailureHandler [tryStop=false,
timeout=0, super=AbstractFailureHandler
[ignoredFailureTypes=[SYSTEM_WORKER_BLOCKED]]], failureCtx=FailureContext
[type=SYSTEM_WORKER_BLOCKED, err=class o.a.i.IgniteException: GridWorker
[name=data-streamer-stripe-19, igniteInstanceName=null, finished=false,
heartbeatTs=1568896033931]]]
class org.apache.ignite.IgniteException: GridWorker
[name=data-streamer-stripe-19, igniteInstanceName=null, finished=false,
heartbeatTs=1568896033931]
19/09/19 07:29:53 ERROR : Critical system error detected. Will be handled
accordingly to configured handler [hnd=StopNodeOrHaltFailureHandler
[tryStop=false, timeout=0, super=AbstractFailureHandler
[ignoredFailureTypes=[SYSTEM_WORKER_BLOCKED]]], failureCtx=FailureContext
[type=SYSTEM_WORKER_BLOCKED, err=class o.a.i.IgniteException: GridWorker
[name=data-streamer-stripe-41, igniteInstanceName=null, finished=false,
heartbeatTs=1568896023252]]]



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
ilya.kasnacheev ilya.kasnacheev
Reply | Threaded
Open this post in threaded view
|

Re: Data Streamer API issues to load data into cache

Hello!

Unfortunately it's hard to say what's going on. Can you please share the stack trace? Furthermore, my recommendation will be to either disable failure detection altogether, or increase failureDetectionTimeout.

Regards,
--
Ilya Kasnacheev


пт, 4 окт. 2019 г. в 09:07, vinod.jv <[hidden email]>:
Hi,

I am using Data Streamer API to load the data into ignite cache in embedded
mode.
But i am seeing intermittent issues. Below is the exception. Sometimes job
run successfully and sometimes jobs are hung and the log shows too many of
the below exceptions.

I tried upgrading form Ignite 2.7 to 2.7.5 version and removed
allowOverwrite(true) which was added.
I also tried setting autoFlushFrequency(100) to 100 ms. Still i am seeing
the issue.

ERROR : Critical system error detected. Will be handled accordingly to
configured handler [hnd=StopNodeOrHaltFailureHandler [tryStop=false,
timeout=0, super=AbstractFailureHandler
[ignoredFailureTypes=[SYSTEM_WORKER_BLOCKED]]], failureCtx=FailureContext
[type=SYSTEM_WORKER_BLOCKED, err=class o.a.i.IgniteException: GridWorker
[name=data-streamer-stripe-19, igniteInstanceName=null, finished=false,
heartbeatTs=1568896033931]]]
class org.apache.ignite.IgniteException: GridWorker
[name=data-streamer-stripe-19, igniteInstanceName=null, finished=false,
heartbeatTs=1568896033931]
19/09/19 07:29:53 ERROR : Critical system error detected. Will be handled
accordingly to configured handler [hnd=StopNodeOrHaltFailureHandler
[tryStop=false, timeout=0, super=AbstractFailureHandler
[ignoredFailureTypes=[SYSTEM_WORKER_BLOCKED]]], failureCtx=FailureContext
[type=SYSTEM_WORKER_BLOCKED, err=class o.a.i.IgniteException: GridWorker
[name=data-streamer-stripe-41, igniteInstanceName=null, finished=false,
heartbeatTs=1568896023252]]]



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/