elasticsearch - What's the good architecture for ELK? -

-

i trying use elk build log analysis system. see lot of architecture use elk in different way. 1 of them

logstash->redis->logstash->elasticseach->kibana

the first logstash used collecting logs, second logstash used filter logs.

i not clear redis, have use it? why not using kafka?

the redis between 2 logstash instances buffer, there in case elasticsearch or logstash indexer goes down.

depending on you're processing logstash, may not need it. if you're reading log files, logstash (the shipper) stop sending logs when logstash (the indexer) overwhelmed. way, distributed cache (in log files!).

if you're using one-time events (e.g. traps or syslogs network devices), buffer redis or rabbitmq important store them until logstash (indexer) available.


Comments

Post a Comment

Popular posts from this blog

Fail to load namespace Spring Security http://www.springframework.org/security/tags -

-
i have problem namespace of spring security on xhtml page. don't understand why can't load uri, , have following issue: whitelabel error page application has no explicit mapping /error, seeing fallback. tue jul 21 16:58:12 utc 2015 there unexpected error (type=not found, status=404). please need help! possible uri has been changed? best regards you using incorrect namespace url. correct url http://www.springframework.org/schema/security the error page seeing spring source website since not recognize url. try visiting http://www.springsource.org/security/tags in browser update : spring security tags used in jsp page correct tag lib declaration is: <%@ taglib prefix="sec" uri="http://www.springframework.org/security/tags" %>
Read more

c++ - Using Gtest how return different values in ON_CALL? -

-
is possible return different values using on_call willbydefault? example class foomock { mock_method0(foo, int()); } void bar() { foomock mock; int f = 0; on_call(mock, foo()).willbydefault(return(f)); expect_true(f==mock.foo()); // correct f++; expect_true(f==mock.foo()); // failed, because on_call returns f=0 } does exists way return new value of variable? yes there way, change code to: on_call(mock, foo()) .willbydefault(returnpointee(&f)); read more returnpointee in link (in returning live values mock methods section)
Read more

asp.net core mvc - How important is the global.json and src folder? -

-
in vs 2015, when create new mvc 6.0 application using approach: file-->new-->project-->asp.net web application-->asp.net 5 preview templates you end have following file structure on disk: artifacts src myproject.sln global.json instead if decide create blank solution first so: file-->new-->project-->other project types-->visual studio solutions-->blank solution and start adding new asp.net web application project solution; end having file structure doesn’t have global.json file , no src folder. according documentation , the global.json file used configure solution whole. includes 2 sections, projects , sdk default. the projects property designates folders contain source code solution. default project structure places source files in src folder, allowing build artifacts placed in sibling folder, making easier exclude such things source control. the sdk property specifies version of dnx (.net execution environment) visual studio...
Read more