I am using rsyslog for sending data from nginx to kafka. Pipeline looks like following:
nginx -> unix_socket -> rsyslog -> omkafka module -> kafka
Omkafka module for rsyslog uses tcp for transferring messages, so I can easily count bytes of dataflow sent to kafka and number of tcp packets, but these metrics are not enough representative for me. Seems that I should use some application level solution for precise counting of messages.
I know that 'impstats' module able to count rsyslog messages, but it doesn't support omkafka module.
Looking for any advice to grab statistics for my case. Thanks!