Runtime error caught during grid runnable execution: DirectNioClientWorker.....heap memory

classic Classic list List threaded Threaded
6 messages Options
siva siva
Reply | Threaded
Open this post in threaded view
|

Runtime error caught during grid runnable execution: DirectNioClientWorker.....heap memory

This post was updated on .
Hi,
I have .net core Application as Server and Client using Apache Ignite
v2.7.5.

I have loaded around 20 thousand records in cache and after that whenever
performing any operation on getting server down.

If i have trying to load bulk data around 40 thousand,application console
stucking and getting most of the time server down.

And i have system configuration
Windows
CPU:16
RAM:60GB
HeapSize:50GB

Even After getting heap out of memory issue.
*Server config:*
----------------------
server-config.xml
<http://apache-ignite-users.70518.x6.nabble.com/file/t1379/server-config.xml

*Cache config:*
-------------------------
   
var queryList = await _queryEntities.CreateQueryEntitiesListAsync();
                cacheCfg = new CacheConfiguration
                {
                    Name = tenantId,
                    CacheStoreFactory = new TenantCacheStoreFactory(_logger, connectionString),
                    KeepBinaryInStore = false,  // Cache store works with deserialized data.
                    ReadThrough = true,
                    WriteThrough = true,
                    WriteBehindEnabled = true,
                    QueryEntities = queryList,
                    CacheMode = CacheMode.Partitioned,
                    Backups = 0,
                    DataRegionName = "IgniteDataRegion",
                    EvictionPolicy = new LruEvictionPolicy
                    {
                        MaxSize = 100000
                    }
                }; 
           
*log file*
--------
ignite-beba43a5.log
<http://apache-ignite-users.70518.x6.nabble.com/file/t1379/ignite-beba43a5.log

Any other configuration need configure.Please help.



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
ilya.kasnacheev ilya.kasnacheev
Reply | Threaded
Open this post in threaded view
|

Re: Runtime error caught during grid runnable execution: DirectNioClientWorker.....heap memory

Hello!

It seems that you have run out of heap.

Why do you need that much heap, btw? You have 45G when 4G is considered generous allowance. What's in that heap?

Regards,
--
Ilya Kasnacheev


пт, 5 июл. 2019 г. в 09:07, siva <[hidden email]>:
Hi,
I have .net core Application as Server and Client using Apache Ignite
v2.7.5.

I have loaded around 20 thousand records in cache and after that whenever
performing any operation on getting server down.

If i have trying to load bulk data around 40 thousand,application console
stucking and getting most of the time server down.

And i have system configuration
Windows
CPU:16
RAM:60GB
HeapSize:50GB

Even After getting heap out of memory issue.
*Server config:*
----------------------
server-config.xml
<http://apache-ignite-users.70518.x6.nabble.com/file/t1379/server-config.xml

*Cache config:*
-------------------------


*
log file*
--------
ignite-beba43a5.log
<http://apache-ignite-users.70518.x6.nabble.com/file/t1379/ignite-beba43a5.log

Any other configuration need configure.Please help.



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
siva siva
Reply | Threaded
Open this post in threaded view
|

Re: Runtime error caught during grid runnable execution: DirectNioClientWorker.....heap memory

ilya.kasnacheev ilya.kasnacheev
Reply | Threaded
Open this post in threaded view
|

Re: Runtime error caught during grid runnable execution: DirectNioClientWorker.....heap memory

Hello!

I don't think it is related in any way to the structure of your model classes. Ignite stores data in off-heap so OutOfMemoryError is not usually caused by data storage.

Please collect a heap dump off of your running node, analyze it with e.g. Memory Analyzer Tool to understand the structure of your heap consumption.

Regards,
--
Ilya Kasnacheev


пт, 5 июл. 2019 г. в 15:03, siva <[hidden email]>:
Hi,
I have attached one model class,what kind of records are putting into
cache.Same like around 100 models class/tables records are there,that one
keeping in single cache store.

please find the github class link
https://github.com/CP-Ram/ApacheIgniteClientServerTestDotNetCoreConsoleApp/blob/master/IngiteClientServerNetCoreConsoleApp/Model/Records/ProductionDayRecords.cs
<https://github.com/CP-Ram/ApacheIgniteClientServerTestDotNetCoreConsoleApp/blob/master/IngiteClientServerNetCoreConsoleApp/Model/Records/ProductionDayRecords.cs



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
ilya.kasnacheev ilya.kasnacheev
Reply | Threaded
Open this post in threaded view
|

Re: Runtime error caught during grid runnable execution: DirectNioClientWorker.....heap memory

In reply to this post by siva
Hello!

You can also try adding “-XX:+HeapDumpOnOutOfMemoryError” to your java start command.

In case .Net node is used, it should be added to JvmArgs.

Make sure you have enough disk space ready to actually dump 45G.

Regards,
--
Ilya Kasnacheev


пт, 5 июл. 2019 г. в 15:03, siva <[hidden email]>:
Hi,
I have attached one model class,what kind of records are putting into
cache.Same like around 100 models class/tables records are there,that one
keeping in single cache store.

please find the github class link
https://github.com/CP-Ram/ApacheIgniteClientServerTestDotNetCoreConsoleApp/blob/master/IngiteClientServerNetCoreConsoleApp/Model/Records/ProductionDayRecords.cs
<https://github.com/CP-Ram/ApacheIgniteClientServerTestDotNetCoreConsoleApp/blob/master/IngiteClientServerNetCoreConsoleApp/Model/Records/ProductionDayRecords.cs



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
siva siva
Reply | Threaded
Open this post in threaded view
|

Re: Runtime error caught during grid runnable execution: DirectNioClientWorker.....heap memory

In reply to this post by ilya.kasnacheev
Ok, I will take heap dump and analyze it.

Thanks
Siva



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/