Hello everyone. I was wonder about increase the thread pool for the write queue size.
My error was:
EsThreadPoolExecutor[name = es-data-node/write, queue capacity = 200, org.elasticsearch.common.util.concurrent.EsThreadPoolExecutor@18e72b5a[Running, pool size = 16, active threads = 16, queued tasks = 201, completed tasks = 111090581]]]"},"status":429}
Those errors above can relate to many things: disk slow, low queue…
This data node has 16 core CPUs and 32Gb Ram.
Queued task original was 200, I increased it to a little higher to prevent this error appear
as long time I do at google but I still not find my answer at all about change thread write pool size. Original is 16 thread pool for write ( as I understand it based CPU core, but at the time it used full 16 threads, my CPU usage seem like used 20% only. )
So I think to change it to a little higher will not affect at all.
But i want to discuss about this first. Anyone have done this before?