Load balancing ignite get requests

classic Classic list List threaded Threaded
5 messages Options
Anirudha Jadhav Anirudha Jadhav
Reply | Threaded
Open this post in threaded view
|

Load balancing ignite get requests

Ignite 2.5 - fully replicated 8 node cluster

When running load tests with 1 unique key, only one of the servers gets all the requests. 

Is there something to be enabled in configuration for balancing load between all machines. 


Thanks 
--
Anirudha P. Jadhav
dkarachentsev dkarachentsev
Reply | Threaded
Open this post in threaded view
|

Re: Load balancing ignite get requests

Hi,

get() operation from client always go to the primary node. If you run
compute task on other nodes, where each will do get() request for that key,
it will read local value. REPLICATED has many other optimizations, for
example for SQL queries.

Thanks!
-Dmitry



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
luqmanahmad luqmanahmad
Reply | Threaded
Open this post in threaded view
|

Re: Load balancing ignite get requests

In reply to this post by Anirudha Jadhav
Anirudha, also see [1] for built-in load balancing which could be useful

[1]  AdaptiveLoadProbe
<https://ignite.apache.org/releases/latest/javadoc/org/apache/ignite/spi/loadbalancing/adaptive/AdaptiveLoadProbe.html>  



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Anirudha Jadhav Anirudha Jadhav
Reply | Threaded
Open this post in threaded view
|

Re: Load balancing ignite get requests

In reply to this post by dkarachentsev
Thanks, Dmitry,

we seem to have maxed out the performance we can get out of a single ignite node on a DL380 / whats the best option to scale out and make all replicas also serve data over get requests?

-Ani

On Fri, Aug 31, 2018 at 12:34 PM dkarachentsev <[hidden email]> wrote:
Hi,

get() operation from client always go to the primary node. If you run
compute task on other nodes, where each will do get() request for that key,
it will read local value. REPLICATED has many other optimizations, for
example for SQL queries.

Thanks!
-Dmitry



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/


--
Anirudha P. Jadhav
ezhuravlev ezhuravlev
Reply | Threaded
Open this post in threaded view
|

Re: Load balancing ignite get requests

Hi,

Well, it depends on a lot of things - if you have small amount of the data,
which can easily fit in memory on each node, then, you can use Replicated
cache.

On the other hand, if you have quite big dataset, you may consider using
Partitioned cache and executing affinity runs.

Evgenii



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/