Helm chart to run fluentd on kubernetes and connect to an AWS Elasticsearch domain protected by IAM.
This specialized chart covers the case where:
- your Kubernetes cluster has RBAC enabled
- you are using
kiam to assign IAM roles to pods
- you have an AWS Elasticsearch
- you have created an IAM role that has access to Elasticsearch
- you want Fluentd to collect logs from your Kubernetes cluster and forward them to Elasticsearch.
This chart is based on fluentd-daemonset-elasticsearch-rbac.yaml
helm install incubator/fluentd-kubernetes-aws \ --set elasticsearch.endpoint=<elasticsearch_domain_endpoint> \ --set role=<IAM role>
This chart installs the fluentd-kubernetes-daemonset that is specialied to forward logs to Elasticsearch. That installation is entirely configured with environment variables which are not specifcially documented, but are well named and can be found by inspecting the templates at https://github.com/fluent/fluentd-kubernetes-daemonset/tree/8c76f51/templates
Those values can be set using
image: repository: fluent/fluentd-kubernetes-daemonset tag: v1.3.3-debian-elasticsearch-1.8 role: elasticsearch-user elasticsearch: endpoint: my-elasticsearch-jivhavxbcd5dvcbjzrac7j42rm.us-west-2.es.amazonaws.com env: FLUENT_ELASTICSEARCH_RELOAD_CONNECTIONS: false FLUENT_ELASTICSEARCH_BUFFER_FLUSH_INTERVAL: 10s