apache ignite in client mode - memory leak?

classic Classic list List threaded Threaded
7 messages Options
maheshkr76private maheshkr76private
Reply | Threaded
Open this post in threaded view
|

apache ignite in client mode - memory leak?

Hi,

When Ignite is in client mode, it constantly seems to consume 20MB.
See the below metric, ignite spews out. Please explain.


Metrics for local node (to disable set 'metricsLogFrequency' to 0)
    ^-- Node [id=dba51c3c, uptime=00:56:00.345]
    ^-- H/N/C [hosts=5, nodes=6, CPUs=40]
    ^-- CPU [cur=0.23%, avg=0.65%, GC=0%]
    ^-- PageMemory [pages=0]
    ^-- Heap [used=*1755MB*, free=57.14%, comm=1824MB]
    ^-- Off-heap [used=0MB, free=-1%, comm=0MB]
    ^-- Outbound messages queue [size=0]
    ^-- Public thread pool [active=0, idle=0, qSize=0]
    ^-- System thread pool [active=0, idle=0, qSize=0]
2019-05-23 15:22:06.886  INFO 33 --- [eout-worker-#23]
org.apache.ignite.internal.IgniteKernal  :
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
    ^-- Node [id=dba51c3c, uptime=00:57:00.348]
    ^-- H/N/C [hosts=5, nodes=6, CPUs=40]
    ^-- CPU [cur=0.27%, avg=0.64%, GC=0%]
    ^-- PageMemory [pages=0]
    ^-- Heap [used=*1774MB*, free=56.68%, comm=1824MB]
    ^-- Off-heap [used=0MB, free=-1%, comm=0MB]
    ^-- Outbound messages queue [size=0]
    ^-- Public thread pool [active=0, idle=0, qSize=0]
    ^-- System thread pool [active=0, idle=0, qSize=0]
2019-05-23 15:23:07.019  INFO 33 --- [eout-worker-#23]
org.apache.ignite.internal.IgniteKernal  :
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
    ^-- Node [id=dba51c3c, uptime=00:58:00.350]
    ^-- H/N/C [hosts=5, nodes=6, CPUs=40]
    ^-- CPU [cur=0.23%, avg=0.63%, GC=0%]
    ^-- PageMemory [pages=0]
    ^-- Heap [used=*1793MB*, free=56.21%, comm=1824MB]
    ^-- Off-heap [used=0MB, free=-1%, comm=0MB]
    ^-- Outbound messages queue [size=0]
    ^-- Public thread pool [active=0, idle=0, qSize=0]
    ^-- System thread pool [active=0, idle=0, qSize=0]




--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
ilya.kasnacheev ilya.kasnacheev
Reply | Threaded
Open this post in threaded view
|

Re: apache ignite in client mode - memory leak?

Hello!

Do you have GC logs? What happens if you trigger garbage collection?

Regards,
--
Ilya Kasnacheev


чт, 23 мая 2019 г. в 18:25, mahesh76private <[hidden email]>:
Hi,

When Ignite is in client mode, it constantly seems to consume 20MB.
See the below metric, ignite spews out. Please explain.


Metrics for local node (to disable set 'metricsLogFrequency' to 0)
    ^-- Node [id=dba51c3c, uptime=00:56:00.345]
    ^-- H/N/C [hosts=5, nodes=6, CPUs=40]
    ^-- CPU [cur=0.23%, avg=0.65%, GC=0%]
    ^-- PageMemory [pages=0]
    ^-- Heap [used=*1755MB*, free=57.14%, comm=1824MB]
    ^-- Off-heap [used=0MB, free=-1%, comm=0MB]
    ^-- Outbound messages queue [size=0]
    ^-- Public thread pool [active=0, idle=0, qSize=0]
    ^-- System thread pool [active=0, idle=0, qSize=0]
2019-05-23 15:22:06.886  INFO 33 --- [eout-worker-#23]
org.apache.ignite.internal.IgniteKernal  :
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
    ^-- Node [id=dba51c3c, uptime=00:57:00.348]
    ^-- H/N/C [hosts=5, nodes=6, CPUs=40]
    ^-- CPU [cur=0.27%, avg=0.64%, GC=0%]
    ^-- PageMemory [pages=0]
    ^-- Heap [used=*1774MB*, free=56.68%, comm=1824MB]
    ^-- Off-heap [used=0MB, free=-1%, comm=0MB]
    ^-- Outbound messages queue [size=0]
    ^-- Public thread pool [active=0, idle=0, qSize=0]
    ^-- System thread pool [active=0, idle=0, qSize=0]
2019-05-23 15:23:07.019  INFO 33 --- [eout-worker-#23]
org.apache.ignite.internal.IgniteKernal  :
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
    ^-- Node [id=dba51c3c, uptime=00:58:00.350]
    ^-- H/N/C [hosts=5, nodes=6, CPUs=40]
    ^-- CPU [cur=0.23%, avg=0.63%, GC=0%]
    ^-- PageMemory [pages=0]
    ^-- Heap [used=*1793MB*, free=56.21%, comm=1824MB]
    ^-- Off-heap [used=0MB, free=-1%, comm=0MB]
    ^-- Outbound messages queue [size=0]
    ^-- Public thread pool [active=0, idle=0, qSize=0]
    ^-- System thread pool [active=0, idle=0, qSize=0]




--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
maheshkr76private maheshkr76private
Reply | Threaded
Open this post in threaded view
|

Re: apache ignite in client mode - memory leak?

>>What happens if you trigger garbage collection?
It frees up some amount of memory then continues to increase (as shown in
earlier message)


Haven't taken GC logs. is there a quick way to take these?






--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
ilya.kasnacheev ilya.kasnacheev
Reply | Threaded
Open this post in threaded view
|

Re: apache ignite in client mode - memory leak?

Hello!

https://gceasy.io/ - please refer to "How it works?" section.

Regards,
--
Ilya Kasnacheev


чт, 23 мая 2019 г. в 18:33, mahesh76private <[hidden email]>:
>>What happens if you trigger garbage collection?
It frees up some amount of memory then continues to increase (as shown in
earlier message)


Haven't taken GC logs. is there a quick way to take these?






--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
dmagda dmagda
Reply | Threaded
Open this post in threaded view
|

Re: apache ignite in client mode - memory leak?

In reply to this post by maheshkr76private
Is it a big deal? Ignite might use extra space for internal needs to optimize performance and response time. As long as the memory consumption is low and that's not a memory leak, I wouldn't pay much attention to this.


-
Denis


On Thu, May 23, 2019 at 8:33 AM mahesh76private <[hidden email]> wrote:
>>What happens if you trigger garbage collection?
It frees up some amount of memory then continues to increase (as shown in
earlier message)


Haven't taken GC logs. is there a quick way to take these?






--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
maheshkr76private maheshkr76private
Reply | Threaded
Open this post in threaded view
|

Re: apache ignite in client mode - memory leak?

This doesn't look like a ignite memory optimization. A steady consumption of
20MB till it exhausts the memory allocated via -XMX, followed by a GC, is
continuously happening. Doesn't feel like you should ignore it, unless
ignite has a good reason behind it.

Moreover, this is happening on a node, configured as a client.

I will take GC logs

regards
mahesh







--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
ilya.kasnacheev ilya.kasnacheev
Reply | Threaded
Open this post in threaded view
|

Re: apache ignite in client mode - memory leak?

Hello!

Please also collect heap histogram of classes. It is most likely that leak is outside of Ignite.

Regards,
--
Ilya Kasnacheev


вс, 26 мая 2019 г. в 07:20, mahesh76private <[hidden email]>:
This doesn't look like a ignite memory optimization. A steady consumption of
20MB till it exhausts the memory allocated via -XMX, followed by a GC, is
continuously happening. Doesn't feel like you should ignore it, unless
ignite has a good reason behind it.

Moreover, this is happening on a node, configured as a client.

I will take GC logs

regards
mahesh







--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/