Failed to execute compound future reducer: GridCompoundFuture......Caused by: java.lang.IllegalArgumentException: Record is too long [capacity=67108864, size=73790598]

classic Classic list List threaded Threaded
2 messages Options
siva siva
Reply | Threaded
Open this post in threaded view
|

Failed to execute compound future reducer: GridCompoundFuture......Caused by: java.lang.IllegalArgumentException: Record is too long [capacity=67108864, size=73790598]

This post was updated on .
Hi,
I have .Net core Ignite Server and client Application.

I have cache records with string as key and value as model object.Almost
records are get added into cache but some of records are missing and getting
the exception.

*Adding recording into caching by Streamer:
*
using (var ldr = _ignite.GetDataStreamer<string, Employee>(cacheName))
{
	 ldr.AutoFlushFrequency = 0;
	 
	 string key=...
	 Employee emp=new Employee(){
	 ...
	 ...
	 };
	 ldr.AddData(key, emp);
}
When adding data into cache using getDataStreamer getting the following
error:
(err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=0, done=false, cancelled=false, err=null, futs=[true]]class org.apache.ignite.IgniteCheckedException: DataStreamer request failed [node=0f93f017-baca-4396-bc9f-fc09d8fc362a]
        at org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl$Buffer.onResponse(DataStreamerImpl.java:2055)
        at org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl$3.onMessage(DataStreamerImpl.java:356)
        at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1569)
        at org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:1197)
        at org.apache.ignite.internal.managers.communication.GridIoManager.access$4200(GridIoManager.java:127)
        at org.apache.ignite.internal.managers.communication.GridIoManager$9.run(GridIoManager.java:1093)
        at org.apache.ignite.internal.util.StripedExecutor$Stripe.body(StripedExecutor.java:505)
        at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.IllegalArgumentException: Record is too long [capacity=67108864, size=73790598]
        at org.apache.ignite.internal.processors.cache.persistence.wal.SegmentedRingByteBuffer.offer0(SegmentedRingByteBuffer.java:214)
        at org.apache.ignite.internal.processors.cache.persistence.wal.SegmentedRingByteBuffer.offer(SegmentedRingByteBuffer.java:193)
        at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$FileWriteHandle.addRecord(FileWriteAheadLogManager.java:2546)
        at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$FileWriteHandle.access$1600(FileWriteAheadLogManager.java:2451)
        at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:823)
        at org.apache.ignite.internal.processors.cache.GridCacheMapEntry.initialValue(GridCacheMapEntry.java:3428)
        at org.apache.ignite.internal.processors.cache.GridCacheEntryEx.initialValue(GridCacheEntryEx.java:766)
        at org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl$IsolatedUpdater.receive(DataStreamerImpl.java:2265)
        at org.apache.ignite.internal.processors.datastreamer.DataStreamerUpdateJob.call(DataStreamerUpdateJob.java:140)
        at org.apache.ignite.internal.processors.datastreamer.DataStreamProcessor.localUpdate(DataStreamProcessor.java:400)
        at org.apache.ignite.internal.processors.datastreamer.DataStreamProcessor.processRequest(DataStreamProcessor.java:305)
        at org.apache.ignite.internal.processors.datastreamer.DataStreamProcessor.access$000(DataStreamProcessor.java:60)
        at org.apache.ignite.internal.processors.datastreamer.DataStreamProcessor$1.onMessage(DataStreamProcessor.java:90)
        ... 7 more


what might be the cause behind this exception?

Thanks.



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
ilya.kasnacheev ilya.kasnacheev
Reply | Threaded
Open this post in threaded view
|

Re: Failed to execute compound future reducer: GridCompoundFuture......Caused by: java.lang.IllegalArgumentException: Record is too long [capacity=67108864, size=73790598]

Hello!

Looks like your cache entry (or anything else that goes in to WAL record) is larger than your WAL segment size.

Increase WAL segment size if you plan to work with very large entries.

Regards,
--
Ilya Kasnacheev


пт, 5 июл. 2019 г. в 16:26, siva <[hidden email]>:
Hi,
I have .Net core Ignite Server and client Application.

I have cache records with string as key and value as model object.Almost
records are get added into cache but some of records are missing and getting
the exception.

*Adding recording into caching by Streamer:
*

When adding data into cache using getDataStreamer getting the following
error:



what might be the cause behind this exception?

Thanks.



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/