too many dirty pages

classic Classic list List threaded Threaded
3 messages Options
KR Kumar KR Kumar
Reply | Threaded
Open this post in threaded view
|

too many dirty pages

Hi - I have ignite persistence enabled cache that has about 100 cache tables
that i created using Ignite SQL. When I am writing data ( lot of data ) in
these tables, I see these warnings in the logs and writes hang for some time
and then resume.

[2019-06-23 10:12:47,647][INFO
][db-checkpoint-thread-#144][GridCacheDatabaseSharedManager] Checkpoint
started [checkpointId=d067e58d-d62d-4914-9ce8-531369e08c33,
startPtr=FileWALPointer [idx=214, fileOff=1199995119, len=2123305],
checkpointLockWait=0ms, checkpointLockHoldTime=1727ms,
walCpRecordFsyncDuration=2305ms, pages=304819, reason='too many dirty
pages']

Any pointers, please let me know ??

Thanx and Regards,
KR Kumar



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
ezhuravlev ezhuravlev
Reply | Threaded
Open this post in threaded view
|

Re: too many dirty pages

Hi,

It's not a warning, it's just an INFO message about writing checkpoint to the disk. The reason for this checkpoint was that there were "too many dirty pages". Here is how Ignite persistence works: https://cwiki.apache.org/confluence/display/IGNITE/Ignite+Persistent+Store+-+under+the+hood

Best Regards,
Evgenii

вс, 23 июн. 2019 г. в 13:36, KR Kumar <[hidden email]>:
Hi - I have ignite persistence enabled cache that has about 100 cache tables
that i created using Ignite SQL. When I am writing data ( lot of data ) in
these tables, I see these warnings in the logs and writes hang for some time
and then resume.

[2019-06-23 10:12:47,647][INFO
][db-checkpoint-thread-#144][GridCacheDatabaseSharedManager] Checkpoint
started [checkpointId=d067e58d-d62d-4914-9ce8-531369e08c33,
startPtr=FileWALPointer [idx=214, fileOff=1199995119, len=2123305],
checkpointLockWait=0ms, checkpointLockHoldTime=1727ms,
walCpRecordFsyncDuration=2305ms, pages=304819, reason='too many dirty
pages']

Any pointers, please let me know ??

Thanx and Regards,
KR Kumar



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
ilya.kasnacheev ilya.kasnacheev
Reply | Threaded
Open this post in threaded view
|

Re: too many dirty pages

In reply to this post by KR Kumar
Hello!

If you see writes hang after seeing this message, it means that your checkpoint page buffer gets exhaused. Consider increasing it:

Regards,
--
Ilya Kasnacheev


вс, 23 июн. 2019 г. в 13:36, KR Kumar <[hidden email]>:
Hi - I have ignite persistence enabled cache that has about 100 cache tables
that i created using Ignite SQL. When I am writing data ( lot of data ) in
these tables, I see these warnings in the logs and writes hang for some time
and then resume.

[2019-06-23 10:12:47,647][INFO
][db-checkpoint-thread-#144][GridCacheDatabaseSharedManager] Checkpoint
started [checkpointId=d067e58d-d62d-4914-9ce8-531369e08c33,
startPtr=FileWALPointer [idx=214, fileOff=1199995119, len=2123305],
checkpointLockWait=0ms, checkpointLockHoldTime=1727ms,
walCpRecordFsyncDuration=2305ms, pages=304819, reason='too many dirty
pages']

Any pointers, please let me know ??

Thanx and Regards,
KR Kumar



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/