How possible we can get the reason why the ignite shut down itself?

classic Classic list List threaded Threaded
3 messages Options
aaron@tophold.com aaron@tophold.com
Reply | Threaded
Open this post in threaded view
|

How possible we can get the reason why the ignite shut down itself?

Hi All, 

We have cache node(only one node not cluster), with native persistence enable, update of this cache will be frequently.

But not so frequent, we use this cache to aggregate the open close and high low price.  now only have about <1000 updates per seconds. 

we use the cache#invoke to update the price according to key every time. 

But but every one hour the cache just shut down by itself.  we got the CacheStoppedException: Fail to perform cache operation (cache is stopped)

The underling server in fact have 64 memory still 30G+ cache left there..  the GC is normal no full GC triggered.

the exception stack include no specific reason  why it shut down by itself, I not sure wherever any place to print this reason why the node shutdown itself?



Regards
Aaron
<bean class="org.apache.ignite.configuration.DataStorageConfiguration" id="dataStorageConfiguration">

<property name="pageSize" value="4096"/>

<property name="storagePath" value="${persistent.store.path:/var/tmp/market/store}"/>
<property name="walArchivePath" value="${wal.archive.path:/var/tmp/market/store/wal/archive}"/>
<property name="walPath" value="${wal.store.path:/var/tmp/market/store/wal}"/>

<property name="defaultDataRegionConfiguration">
<bean class="org.apache.ignite.configuration.DataRegionConfiguration">
<property name="name" value="Default_Region"/>
<property name="initialSize" value="#{1024L * 1024L * 1024L}"/>
<property name="maxSize" value="#{4L * 1024L * 1024L * 1024L}"/>
<property name="persistenceEnabled" value="true"/>
<property name="pageEvictionMode" value="RANDOM_2_LRU"/>
</bean>
</property>
</bean>





Denis Mekhanikov Denis Mekhanikov
Reply | Threaded
Open this post in threaded view
|

Re: How possible we can get the reason why the ignite shut down itself?

Hi Aaron!

Does the whole node stop, or only a single cache?

Make sure, that you don't call Ignite.close() or IgniteCache.close() anywhere or use it as a resource in a try-with-resources block.

Logs may contain useful information about the node failure. Try analysing it or attach it to the letter (please don't just past it into a body, use file attachment).
You may need to enable INFO/DEBUG logging. Here is documentation on Ignite logging: https://apacheignite.readme.io/docs/logging

Denis

ср, 10 янв. 2018 г. в 7:21, [hidden email] <[hidden email]>:
Hi All, 

We have cache node(only one node not cluster), with native persistence enable, update of this cache will be frequently.

But not so frequent, we use this cache to aggregate the open close and high low price.  now only have about <1000 updates per seconds. 

we use the cache#invoke to update the price according to key every time. 

But but every one hour the cache just shut down by itself.  we got the CacheStoppedException: Fail to perform cache operation (cache is stopped)

The underling server in fact have 64 memory still 30G+ cache left there..  the GC is normal no full GC triggered.

the exception stack include no specific reason  why it shut down by itself, I not sure wherever any place to print this reason why the node shutdown itself?



Regards
Aaron
<bean class="org.apache.ignite.configuration.DataStorageConfiguration" id="dataStorageConfiguration">

<property name="pageSize" value="4096"/>

<property name="storagePath" value="${persistent.store.path:/var/tmp/market/store}"/>
<property name="walArchivePath" value="${wal.archive.path:/var/tmp/market/store/wal/archive}"/>
<property name="walPath" value="${wal.store.path:/var/tmp/market/store/wal}"/>

<property name="defaultDataRegionConfiguration">
<bean class="org.apache.ignite.configuration.DataRegionConfiguration">
<property name="name" value="Default_Region"/>
<property name="initialSize" value="#{1024L * 1024L * 1024L}"/>
<property name="maxSize" value="#{4L * 1024L * 1024L * 1024L}"/>
<property name="persistenceEnabled" value="true"/>
<property name="pageEvictionMode" value="RANDOM_2_LRU"/>
</bean>
</property>
</bean>





aaron@tophold.com aaron@tophold.com
Reply | Threaded
Open this post in threaded view
|

Re: How possible we can get the reason why the ignite shut down itself?

In reply to this post by aaron@tophold.com
hi All,

Mistake, someone include the enterprise jar in class path by mistake, so auto shutdown, find from log eventually!



Regards
Aaron

 
Date: 2018-01-10 12:21
Subject: How possible we can get the reason why the ignite shut down itself?
Hi All, 

We have cache node(only one node not cluster), with native persistence enable, update of this cache will be frequently.

But not so frequent, we use this cache to aggregate the open close and high low price.  now only have about <1000 updates per seconds. 

we use the cache#invoke to update the price according to key every time. 

But but every one hour the cache just shut down by itself.  we got the CacheStoppedException: Fail to perform cache operation (cache is stopped)

The underling server in fact have 64 memory still 30G+ cache left there..  the GC is normal no full GC triggered.

the exception stack include no specific reason  why it shut down by itself, I not sure wherever any place to print this reason why the node shutdown itself?



Regards
Aaron
<bean class="org.apache.ignite.configuration.DataStorageConfiguration" id="dataStorageConfiguration">

<property name="pageSize" value="4096"/>

<property name="storagePath" value="${persistent.store.path:/var/tmp/market/store}"/>
<property name="walArchivePath" value="${wal.archive.path:/var/tmp/market/store/wal/archive}"/>
<property name="walPath" value="${wal.store.path:/var/tmp/market/store/wal}"/>

<property name="defaultDataRegionConfiguration">
<bean class="org.apache.ignite.configuration.DataRegionConfiguration">
<property name="name" value="Default_Region"/>
<property name="initialSize" value="#{1024L * 1024L * 1024L}"/>
<property name="maxSize" value="#{4L * 1024L * 1024L * 1024L}"/>
<property name="persistenceEnabled" value="true"/>
<property name="pageEvictionMode" value="RANDOM_2_LRU"/>
</bean>
</property>
</bean>