Persistent dataregion config

classic Classic list List threaded Threaded
4 messages Options
Andrey Davydov Andrey Davydov
Reply | Threaded
Open this post in threaded view
|

Persistent dataregion config

Hello,

 

Please help me to setup data region properly.

 

I would like to have region which can store up to ${config.node.total.memory.max} bytes, but only  small part of data in RAM.

 

My current config (Ignite 2.7.6):

 

                        <bean class="org.apache.ignite.configuration.DataRegionConfiguration">

                            <property name="name" value="MyPersistDataRegion"/>

                            <property name="persistenceEnabled" value="true"/>

                           

                            <property name="initialSize" value="${config.node.memory.initial}"/>

                            <property name="maxSize" value="${config.node.memory.max}"/>                           

            

                            <property name="pageEvictionMode" value="RANDOM_2_LRU"/>

                            <property name="evictionThreshold" value="${config.node.memory.eviction.threshold}"/>

                           

                            <property name="metricsEnabled" value="true"/>

                        </bean>

 

Please confirm three points:

 

  1. Total size will be ${config.node.memory.max}
  2. Total used ram size will be approximately ${config.node.memory.max}*${config.node.memory.eviction.threshold}
  3. Data will not be evicted from disk, only from RAM

 

Thanks.

Andrey.

 

ezhuravlev ezhuravlev
Reply | Threaded
Open this post in threaded view
|

Re: Persistent dataregion config

Hi Andrey,

After enabling persistence, Ignite itself will be responsible for data eviction from memory to disk and eviction mode or threshold can't be changed for it. Parameters pageEvictionMode and evictionThreshold related to the complete data eviction from Ignite(not from memory to disk) and more designed for in memory cases.

1. Total memory, that will be used in offheap for this persistence region.
2. No, for offheap, for this region, will be used ${config.node.memory.max}. Also, don't forget about heap and checkpoint buffer size.
3. With enabled pageEvictionMode, data will be evicted from disk too. 

Evgenii

вт, 24 мар. 2020 г. в 10:23, Andrey Davydov <[hidden email]>:

Hello,

 

Please help me to setup data region properly.

 

I would like to have region which can store up to ${config.node.total.memory.max} bytes, but only  small part of data in RAM.

 

My current config (Ignite 2.7.6):

 

                        <bean class="org.apache.ignite.configuration.DataRegionConfiguration">

                            <property name="name" value="MyPersistDataRegion"/>

                            <property name="persistenceEnabled" value="true"/>

                           

                            <property name="initialSize" value="${config.node.memory.initial}"/>

                            <property name="maxSize" value="${config.node.memory.max}"/>                           

            

                            <property name="pageEvictionMode" value="RANDOM_2_LRU"/>

                            <property name="evictionThreshold" value="${config.node.memory.eviction.threshold}"/>

                           

                            <property name="metricsEnabled" value="true"/>

                        </bean>

 

Please confirm three points:

 

  1. Total size will be ${config.node.memory.max}
  2. Total used ram size will be approximately ${config.node.memory.max}*${config.node.memory.eviction.threshold}
  3. Data will not be evicted from disk, only from RAM

 

Thanks.

Andrey.

 

Andrey Davydov Andrey Davydov
Reply | Threaded
Open this post in threaded view
|

Re: Persistent dataregion config

Thanks a lot. What size recommended for checkpoint buffer size?




On Wed, Mar 25, 2020 at 12:14 AM Evgenii Zhuravlev <[hidden email]> wrote:
Hi Andrey,

After enabling persistence, Ignite itself will be responsible for data eviction from memory to disk and eviction mode or threshold can't be changed for it. Parameters pageEvictionMode and evictionThreshold related to the complete data eviction from Ignite(not from memory to disk) and more designed for in memory cases.

1. Total memory, that will be used in offheap for this persistence region.
2. No, for offheap, for this region, will be used ${config.node.memory.max}. Also, don't forget about heap and checkpoint buffer size.
3. With enabled pageEvictionMode, data will be evicted from disk too. 

Evgenii

вт, 24 мар. 2020 г. в 10:23, Andrey Davydov <[hidden email]>:

Hello,

 

Please help me to setup data region properly.

 

I would like to have region which can store up to ${config.node.total.memory.max} bytes, but only  small part of data in RAM.

 

My current config (Ignite 2.7.6):

 

                        <bean class="org.apache.ignite.configuration.DataRegionConfiguration">

                            <property name="name" value="MyPersistDataRegion"/>

                            <property name="persistenceEnabled" value="true"/>

                           

                            <property name="initialSize" value="${config.node.memory.initial}"/>

                            <property name="maxSize" value="${config.node.memory.max}"/>                           

            

                            <property name="pageEvictionMode" value="RANDOM_2_LRU"/>

                            <property name="evictionThreshold" value="${config.node.memory.eviction.threshold}"/>

                           

                            <property name="metricsEnabled" value="true"/>

                        </bean>

 

Please confirm three points:

 

  1. Total size will be ${config.node.memory.max}
  2. Total used ram size will be approximately ${config.node.memory.max}*${config.node.memory.eviction.threshold}
  3. Data will not be evicted from disk, only from RAM

 

Thanks.

Andrey.

 

ezhuravlev ezhuravlev
Reply | Threaded
Open this post in threaded view
|

Re: Persistent dataregion config


чт, 26 мар. 2020 г. в 04:20, Andrey Davydov <[hidden email]>:
Thanks a lot. What size recommended for checkpoint buffer size?




On Wed, Mar 25, 2020 at 12:14 AM Evgenii Zhuravlev <[hidden email]> wrote:
Hi Andrey,

After enabling persistence, Ignite itself will be responsible for data eviction from memory to disk and eviction mode or threshold can't be changed for it. Parameters pageEvictionMode and evictionThreshold related to the complete data eviction from Ignite(not from memory to disk) and more designed for in memory cases.

1. Total memory, that will be used in offheap for this persistence region.
2. No, for offheap, for this region, will be used ${config.node.memory.max}. Also, don't forget about heap and checkpoint buffer size.
3. With enabled pageEvictionMode, data will be evicted from disk too. 

Evgenii

вт, 24 мар. 2020 г. в 10:23, Andrey Davydov <[hidden email]>:

Hello,

 

Please help me to setup data region properly.

 

I would like to have region which can store up to ${config.node.total.memory.max} bytes, but only  small part of data in RAM.

 

My current config (Ignite 2.7.6):

 

                        <bean class="org.apache.ignite.configuration.DataRegionConfiguration">

                            <property name="name" value="MyPersistDataRegion"/>

                            <property name="persistenceEnabled" value="true"/>

                           

                            <property name="initialSize" value="${config.node.memory.initial}"/>

                            <property name="maxSize" value="${config.node.memory.max}"/>                           

            

                            <property name="pageEvictionMode" value="RANDOM_2_LRU"/>

                            <property name="evictionThreshold" value="${config.node.memory.eviction.threshold}"/>

                           

                            <property name="metricsEnabled" value="true"/>

                        </bean>

 

Please confirm three points:

 

  1. Total size will be ${config.node.memory.max}
  2. Total used ram size will be approximately ${config.node.memory.max}*${config.node.memory.eviction.threshold}
  3. Data will not be evicted from disk, only from RAM

 

Thanks.

Andrey.