Geek asks and answers

Does Logstash installer scale?

I am using logstash shipper -> redis -> logstash indexer -> elastricsearch -> kibana

I understand that redis and elastricsearch are designed to scale. What about the logstash indexer, I see only the main logstash site to show an example of using only one log indexer.

Will it be enough to handle all the logs? and what is your suggestion for having multiple instances of the journal indexer?

+3
source share
2 answers

If your indexer is really the bottleneck of such an installation, you can easily add a second Logstash indexer on a second computer with the same configuration, where you only change the source redis host and the destination elasticsearch host. When they read the same instance of redis, they use blocking reads to ensure that a single redis record is read by a single index.

Like all components, they are especially good at horizontal scaling (more machines), but the indexer can also be scaled to a larger machine.

, . , , ( Logstash) , JSON "" .

+2

" " , . , .

: http://logstash.net/docs/1.4.2/flags

-w, --filterworkers COUNT COUNT ( : 1)

, , , . .

0

More articles:


All Articles