Fluentd is an open source log aggregator.

learn more… | top users | synonyms

1
vote
0answers
14 views

fluentd missing region error

i want to fetch cloudwatch logs. I installed cloudwatch input plugin and configured the config file of td-agent. but im getting the error as "unexpected error error_class=aws::errors::...
4
votes
0answers
44 views

How to maximize utilization of fluentd server?

I have a fluentd server that is processing an average of 1000 req/s. This server is composed by 32 cpus. In this server are running 32 fluentd docker containers with the same configuration. The entry ...
4
votes
1answer
97 views

logstash-forward equivalent for fluentd?

Is there something equivalent to logstash-forwarder that can ship logfiles to fluentd? I am trying to send log files from an application to a remote fluentd but have not seen whether this is ...
0
votes
0answers
215 views

Fluentd : How to add custom tags to log entries sent to elasticsearch

I am quite new to Fluentd and I was wondering if there was a way to get the following logstash configuration applied to fluentd filter { grok { patterns_dir => [ "/etc/...
0
votes
0answers
223 views

Where does elasticsearch store graylog2 logs?

I've setup fluentd to stream docker container logs to a centralized graylog2 server. I'm hoping to setup log rotate for these logs. From what I understand, graylog stores these logs in elasticsearch,...
2
votes
0answers
121 views

fluentd modular configuration

Is there any way to setup fluentd/td-agent in a way that it's configuration will be modular? I know there is @include directive but this works only if every time I add something new I modify main td-...
1
vote
1answer
324 views

Fluentd not writing apache access log to mongodb

I'm following the instructions from this link to write apache access logs to mongo db- http://docs.fluentd.org/articles/apache-to-mongodb. But nothing is getting written to mongo DB. I'm checking ...
2
votes
2answers
102 views

How to collect logs for statistics in site?

I want to collect logs from nginx ( several servers, 1 000 000 lines in logs for minute for all servers ) to central stat server for statistics processing. I see 2 variants: write logs to local ...
0
votes
1answer
1k views

Configuring Logrotate for Fluentd files. Necessary?

I have the following fluent.conf <source> type forward </source> <source> type monitor_agent port 24220 </source> # Listen DRb for debug <source> type ...
2
votes
1answer
2k views

Forward linux logs to fluentd on linux

On one VM I have this in /etc/rsyslog.d/50-default.conf *.* @192.168.29.1:42185 # Default rules for rsyslog. On the vm with fluentd I have this: I have this in /etc/td-agent/td-agent.conf <...
0
votes
1answer
2k views

fluent configuration not working

I have setup fluent with elasticsearch and Kibana with nginx. I followed the instruction and when I go to http:/192.168.10.25:8888 I get the following message 400 Bad Request 'json' or 'msgpack' ...
1
vote
1answer
1k views

Installing fluentd / Kibana / Elastic Search on Suse Enterprise Linux 11

I have successfully installed the recommended fluentd stack ( fluentd, Kibana, Elastic Search ) on a Centos 6 virtual machine. But our production environment is all Suse Enterprise Linux 11. I am ...