ELK Deployment; CPU,Memory,Disk

I would like to deploy Elasticsearch, logstash and kibana in 3 different flavors, the characteristics of each one:
o 32vCPU, 384Go RAM et 900Go HDD

I would like to supervise 100 servers so approximately 33 servers in each flavors.

Do you think it's a good idea to use this configuration? and it's not a problem to use this huge capacity of memory?
Another question how many nodes should I use?

1 Answer
1

without details its hard to give you global advice but Elasticsearch recommend to never cross 31Gb for RAM. Here are the reasons why

You should read all the page, they explain why it is generally far better to have a lot of small/medium hosts instead of a few big ones.

I also recommend you to read this post, it will give you some insight on how to design an Elastic Cluster especially the distinction between roles in a cluster and the difference in hardware needed.

For your question :

Another question how many nodes should I use?

There is no good answer without knowing the volume of data, read/write etc etc...

And last, I hardly doubt that using the same configuration for kibana / logstash / elastic hosts is a good idea. They just don't do the same sort of processing. You should start with small configuration and update it incrementally when you will have real data.

Thanks for contributing an answer to Stack Overflow!

But avoid …

To learn more, see our tips on writing great answers.

Required, but never shown

Required, but never shown

By clicking "Post Your Answer", you acknowledge that you have read our updated terms of service, privacy policy and cookie policy, and that your continued use of the website is subject to these policies.