Visor: cache counts are twice of what is expected

classic Classic list List threaded Threaded
2 messages Options
Roger Fischer (CW) Roger Fischer (CW)
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Visor: cache counts are twice of what is expected

Hello,

the cache counts that are shown in Visor seem to be twice the number that is expected.

I am using ver. 2.1.0#20170720-sha1:a6ca5c8a, with native persistence.

For a replicated cache, with 363 objects loaded (select count(*) returns 363):

Nodes for: FabricCache(@c0)
+===============================================================================================================+
|       Node ID8(@), IP       | CPUs | Heap Used | CPU Load |   Up Time    |         Size         | Hi/Mi/Rd/Wr |
+===============================================================================================================+
| E90ED5E1(@n2), 10.24.51.150 | 4    | 20.79 %   | 0.57 %   | 00:22:30:440 | Total: 726           | Hi: 0       |
|                             |      |           |          |              |   Heap: 363          | Mi: 0       |
|                             |      |           |          |              |   Off-Heap: 363      | Rd: 0       |
|                             |      |           |          |              |   Off-Heap Memory: 0 | Wr: 0       |
+-----------------------------+------+-----------+----------+--------------+----------------------+-------------+
| 31CC5BE0(@n1), 10.24.51.187 | 4    | 19.38 %   | 0.33 %   | 00:22:36:115 | Total: 726           | Hi: 0       |
|                             |      |           |          |              |   Heap: 363          | Mi: 0       |
|                             |      |           |          |              |   Off-Heap: 363      | Rd: 0       |
|                             |      |           |          |              |   Off-Heap Memory: 0 | Wr: 0       |
+-----------------------------+------+-----------+----------+--------------+----------------------+-------------+
| 5BB20689(@n0), 10.24.51.190 | 4    | 18.40 %   | 0.40 %   | 00:22:42:711 | Total: 726           | Hi: 0       |
|                             |      |           |          |              |   Heap: 363          | Mi: 0       |
|                             |      |           |          |              |   Off-Heap: 363      | Rd: 0       |
|                             |      |           |          |              |   Off-Heap Memory: 0 | Wr: 0       |
+---------------------------------------------------------------------------------------------------------------+

Each node shows 363 objects on the heap and 363 objects off-heap, for a total of 726 (twice as many as expected).

Similar for a partitioned cache, with one backup. 4.8M objects are loaded (select count(*) ...):

Nodes for: StatsCache(@c1)
+===============================================================================================================+
|       Node ID8(@), IP       | CPUs | Heap Used | CPU Load |   Up Time    |         Size         | Hi/Mi/Rd/Wr |
+===============================================================================================================+
| E90ED5E1(@n2), 10.24.51.150 | 4    | 27.44 %   | 0.67 %   | 01:06:31:092 | Total: 6496068       | Hi: 0       |
|                             |      |           |          |              |   Heap: 3248034      | Mi: 0       |
|                             |      |           |          |              |   Off-Heap: 3248034  | Rd: 0       |
|                             |      |           |          |              |   Off-Heap Memory: 0 | Wr: 0       |
+-----------------------------+------+-----------+----------+--------------+----------------------+-------------+
| 31CC5BE0(@n1), 10.24.51.187 | 4    | 33.12 %   | 0.33 %   | 01:06:36:770 | Total: 6236714       | Hi: 0       |
|                             |      |           |          |              |   Heap: 3118357      | Mi: 0       |
|                             |      |           |          |              |   Off-Heap: 3118357  | Rd: 0       |
|                             |      |           |          |              |   Off-Heap Memory: 0 | Wr: 0       |
+-----------------------------+------+-----------+----------+--------------+----------------------+-------------+
| 5BB20689(@n0), 10.24.51.190 | 4    | 20.17 %   | 0.43 %   | 01:06:43:367 | Total: 6467218       | Hi: 0       |
|                             |      |           |          |              |   Heap: 3233609      | Mi: 0       |
|                             |      |           |          |              |   Off-Heap: 3233609  | Rd: 0       |
|                             |      |           |          |              |   Off-Heap Memory: 0 | Wr: 0       |
+---------------------------------------------------------------------------------------------------------------+

The expectation is that each node would have 2/3 of the objects (1/3 as primary and another 1/3 as backup). That would be 3.2M objects.

But each node has about 6.4M objects, twice as many as expected. Again it seems that each objects is both on and off heap.

Is Visor reporting incorrectly, or are objects stored twice?

Thanks...

Roger

vkulichenko vkulichenko
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Visor: cache counts are twice of what is expected

Hi Roger,

It's a known issue and fixed in master. You can try to build from there or check the latest nightly build: https://builds.apache.org/view/H-L/view/Ignite/job/Ignite-nightly/lastSuccessfulBuild/

-Val
Loading...