Ignite Node shutdown..

classic Classic list List threaded Threaded
2 messages Options
kay kay
Reply | Threaded
Open this post in threaded view
|

Ignite Node shutdown..

Hello, I test if i use max heap size..

I got this error and node was shut down..

rmtAddr's client socket port is allocated by OS and it is randomized.

 
 

[2020.09.08 14:27:04.251] [ERROR] [] Critical system error detected.
Will be handled accordingly to configured handler
[hnd=StopNodeOrHaltFailureHandler [tryStop=false, timeout=0,
super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet
[SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]],
failureCtx=FailureContext [type=CRITICAL_ERROR, err=class
o.a.i.i.mem.IgniteOutOfMemoryException: Out of memory in data region
[name=FW_PSF_REGION, initSize=15.0 MiB, maxSize=100.0 MiB,
persistenceEnabled=false] Try the following:
   ^-- Increase maximum off-heap memory size
(DataRegionConfiguration.maxSize)
   ^-- Enable Ignite persistence
(DataRegionConfiguration.persistenceEnabled)
   ^-- Enable eviction or expiration policies]]
  org.apache.ignite.internal.mem.IgniteOutOfMemoryException: Out of
memory in data region [name=FW_PSF_REGION, initSize=15.0 MiB, maxSize=100.0
MiB, persistenceEnabled=false] Try the following:
   ^-- Increase maximum off-heap memory size
(DataRegionConfiguration.maxSize)
   ^-- Enable Ignite persistence
(DataRegionConfiguration.persistenceEnabled)
   ^-- Enable eviction or expiration policies
  at
org.apache.ignite.internal.processors.cache.persistence.IgniteCacheDatabaseSharedManager.ensureFreeSpaceForInsert(IgniteCacheDatabaseSharedManager.java:1063)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.persistence.RowStore.addRow(RowStore.java:106)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.createRow(IgniteCacheOffheapManagerImpl.java:1746)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.GridCacheMapEntry$AtomicCacheUpdateClosure.update(GridCacheMapEntry.java:6409)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.GridCacheMapEntry$AtomicCacheUpdateClosure.call(GridCacheMapEntry.java:6160)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.GridCacheMapEntry$AtomicCacheUpdateClosure.call(GridCacheMapEntry.java:5849)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$Invoke.invokeClosure(BPlusTree.java:3817)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$Invoke.access$5700(BPlusTree.java:3711)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.invokeDown(BPlusTree.java:1955)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.invoke(BPlusTree.java:1839)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.invoke0(IgniteCacheOffheapManagerImpl.java:1696)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.invoke(IgniteCacheOffheapManagerImpl.java:1679)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl.invoke(IgniteCacheOffheapManagerImpl.java:441)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.GridCacheMapEntry.innerUpdate(GridCacheMapEntry.java:2314)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.updateSingle(GridDhtAtomicCache.java:2636)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.update(GridDhtAtomicCache.java:2097)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.updateAllAsyncInternal0(GridDhtAtomicCache.java:1914)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.updateAllAsyncInternal(GridDhtAtomicCache.java:1714)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridNearAtomicAbstractUpdateFuture.sendSingleRequest(GridNearAtomicAbstractUpdateFuture.java:300)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridNearAtomicSingleUpdateFuture.map(GridNearAtomicSingleUpdateFuture.java:486)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridNearAtomicSingleUpdateFuture.mapOnTopology(GridNearAtomicSingleUpdateFuture.java:446)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridNearAtomicAbstractUpdateFuture.map(GridNearAtomicAbstractUpdateFuture.java:249)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.update0(GridDhtAtomicCache.java:1164)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.put0(GridDhtAtomicCache.java:624)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.GridCacheAdapter.put(GridCacheAdapter.java:2575)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.GridCacheAdapter.put(GridCacheAdapter.java:2552)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.IgniteCacheProxyImpl.put(IgniteCacheProxyImpl.java:1302)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.GatewayProtectedCacheProxy.put(GatewayProtectedCacheProxy.java:856)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.platform.client.cache.ClientCachePutRequest.process(ClientCachePutRequest.java:40)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.platform.client.ClientRequestHandler.handle(ClientRequestHandler.java:98)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.odbc.ClientListenerNioListener.onMessage(ClientListenerNioListener.java:195)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.odbc.ClientListenerNioListener.onMessage(ClientListenerNioListener.java:49)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.util.nio.GridNioFilterChain$TailFilter.onMessageReceived(GridNioFilterChain.java:279)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.util.nio.GridNioFilterAdapter.proceedMessageReceived(GridNioFilterAdapter.java:109)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.util.nio.GridNioAsyncNotifyFilter$3.body(GridNioAsyncNotifyFilter.java:97)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.util.worker.GridWorkerPool$1.run(GridWorkerPool.java:70)
[ignite-core-2.8.0.jar:2.8.0]
  at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[?:1.8.0_181]
  at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[?:1.8.0_181]
  at java.lang.Thread.run(Thread.java:748) [?:1.8.0_181]
 [2020.09.08 14:27:04.259] [ERROR] [] JVM will be halted immediately
due to the failure: [failureCtx=FailureContext [type=CRITICAL_ERROR,
err=class o.a.i.i.mem.IgniteOutOfMemoryException: Out of memory in data
region [name=FW_PSF_REGION, initSize=15.0 MiB, maxSize=100.0 MiB,
persistenceEnabled=false] Try the following:
   ^-- Increase maximum off-heap memory size
(DataRegionConfiguration.maxSize)
   ^-- Enable Ignite persistence
(DataRegionConfiguration.persistenceEnabled)
  ^-- Enable eviction or expiration policies]]

 
 


Is there any way i get only exception and node will not be shutdown??

I will wait for reply
Thank you so much.



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Mikhail Mikhail
Reply | Threaded
Open this post in threaded view
|

Re: Ignite Node shutdown..

Hi, you don't have enough off heap space for your data, so I wondering, what kind of tests do you try to do?
Might be you can enable persistence?

пн, 7 сент. 2020 г. в 23:26, kay <[hidden email]>:
Hello, I test if i use max heap size..

I got this error and node was shut down..

rmtAddr's client socket port is allocated by OS and it is randomized.




 [1;31m[2020.09.08 14:27:04.251] [ERROR] [] Critical system error detected.
Will be handled accordingly to configured handler
[hnd=StopNodeOrHaltFailureHandler [tryStop=false, timeout=0,
super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet
[SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]],
failureCtx=FailureContext [type=CRITICAL_ERROR, err=class
o.a.i.i.mem.IgniteOutOfMemoryException: Out of memory in data region
[name=FW_PSF_REGION, initSize=15.0 MiB, maxSize=100.0 MiB,
persistenceEnabled=false] Try the following:
   ^-- Increase maximum off-heap memory size
(DataRegionConfiguration.maxSize)
   ^-- Enable Ignite persistence
(DataRegionConfiguration.persistenceEnabled)
   ^-- Enable eviction or expiration policies]]
  [m org.apache.ignite.internal.mem.IgniteOutOfMemoryException: Out of
memory in data region [name=FW_PSF_REGION, initSize=15.0 MiB, maxSize=100.0
MiB, persistenceEnabled=false] Try the following:
   ^-- Increase maximum off-heap memory size
(DataRegionConfiguration.maxSize)
   ^-- Enable Ignite persistence
(DataRegionConfiguration.persistenceEnabled)
   ^-- Enable eviction or expiration policies
  at
org.apache.ignite.internal.processors.cache.persistence.IgniteCacheDatabaseSharedManager.ensureFreeSpaceForInsert(IgniteCacheDatabaseSharedManager.java:1063)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.persistence.RowStore.addRow(RowStore.java:106)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.createRow(IgniteCacheOffheapManagerImpl.java:1746)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.GridCacheMapEntry$AtomicCacheUpdateClosure.update(GridCacheMapEntry.java:6409)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.GridCacheMapEntry$AtomicCacheUpdateClosure.call(GridCacheMapEntry.java:6160)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.GridCacheMapEntry$AtomicCacheUpdateClosure.call(GridCacheMapEntry.java:5849)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$Invoke.invokeClosure(BPlusTree.java:3817)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$Invoke.access$5700(BPlusTree.java:3711)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.invokeDown(BPlusTree.java:1955)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.invoke(BPlusTree.java:1839)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.invoke0(IgniteCacheOffheapManagerImpl.java:1696)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.invoke(IgniteCacheOffheapManagerImpl.java:1679)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl.invoke(IgniteCacheOffheapManagerImpl.java:441)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.GridCacheMapEntry.innerUpdate(GridCacheMapEntry.java:2314)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.updateSingle(GridDhtAtomicCache.java:2636)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.update(GridDhtAtomicCache.java:2097)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.updateAllAsyncInternal0(GridDhtAtomicCache.java:1914)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.updateAllAsyncInternal(GridDhtAtomicCache.java:1714)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridNearAtomicAbstractUpdateFuture.sendSingleRequest(GridNearAtomicAbstractUpdateFuture.java:300)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridNearAtomicSingleUpdateFuture.map(GridNearAtomicSingleUpdateFuture.java:486)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridNearAtomicSingleUpdateFuture.mapOnTopology(GridNearAtomicSingleUpdateFuture.java:446)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridNearAtomicAbstractUpdateFuture.map(GridNearAtomicAbstractUpdateFuture.java:249)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.update0(GridDhtAtomicCache.java:1164)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.put0(GridDhtAtomicCache.java:624)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.GridCacheAdapter.put(GridCacheAdapter.java:2575)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.GridCacheAdapter.put(GridCacheAdapter.java:2552)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.IgniteCacheProxyImpl.put(IgniteCacheProxyImpl.java:1302)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.cache.GatewayProtectedCacheProxy.put(GatewayProtectedCacheProxy.java:856)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.platform.client.cache.ClientCachePutRequest.process(ClientCachePutRequest.java:40)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.platform.client.ClientRequestHandler.handle(ClientRequestHandler.java:98)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.odbc.ClientListenerNioListener.onMessage(ClientListenerNioListener.java:195)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.processors.odbc.ClientListenerNioListener.onMessage(ClientListenerNioListener.java:49)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.util.nio.GridNioFilterChain$TailFilter.onMessageReceived(GridNioFilterChain.java:279)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.util.nio.GridNioFilterAdapter.proceedMessageReceived(GridNioFilterAdapter.java:109)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.util.nio.GridNioAsyncNotifyFilter$3.body(GridNioAsyncNotifyFilter.java:97)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120)
[ignite-core-2.8.0.jar:2.8.0]
  at
org.apache.ignite.internal.util.worker.GridWorkerPool$1.run(GridWorkerPool.java:70)
[ignite-core-2.8.0.jar:2.8.0]
  at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[?:1.8.0_181]
  at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[?:1.8.0_181]
  at java.lang.Thread.run(Thread.java:748) [?:1.8.0_181]
  [1;31m[2020.09.08 14:27:04.259] [ERROR] [] JVM will be halted immediately
due to the failure: [failureCtx=FailureContext [type=CRITICAL_ERROR,
err=class o.a.i.i.mem.IgniteOutOfMemoryException: Out of memory in data
region [name=FW_PSF_REGION, initSize=15.0 MiB, maxSize=100.0 MiB,
persistenceEnabled=false] Try the following:
   ^-- Increase maximum off-heap memory size
(DataRegionConfiguration.maxSize)
   ^-- Enable Ignite persistence
(DataRegionConfiguration.persistenceEnabled)
  ^-- Enable eviction or expiration policies]]





Is there any way i get only exception and node will not be shutdown??

I will wait for reply
Thank you so much.



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/