Fluentd Input plugins

Tagging logs

Fluentd output file plugin

Collecting logs

Starting the Docker Compose app

Filtering logs

Collecting logs from containers

Sending logs to Elasticsearch

Restarting Fluentd

Future video preview

Intro

Why we actually need log data?

Challenges of collecting and consuming logs

Solution - a unified logging layer

How does Fluentd work

How to configure Fluentd?

Built-In Reliability

Other Use Cases

Introduction

Welcome

Presentation of Fluentd

How to parse a file

How to deploy Fluentd in k8s

Tutorial - Configuration of Dynatrace

Tutorial - Creating a custom Fluentd Docker container

Tutorial - Deploy Fluentd to forward log streams to Dynatrace

Tutorial - How to visualize logs in Dynatrace

Tutorial - How to build a pipeline using Fluentbit and Fluentd

Conclusion

Objectives of this video

What is Fluentd?

The Fluentd Lifecycle

Fluentd Setup

Filters

Match element

Fluentd plugins

What is Fluentbit

Summary

Outro

Intro

Why we need log data?

Challenges of Logging

Challenges of Logging in Kubernetes

How does Fluent Bit work?

Fluent Bit in Kubernetes

Advantages of Fluent Bit

Fluent Bit vs. Fluentd

Intro

fluentd intro and installation

How fluentd works

Collecting Apache logs with fluentd

Sending logs to Better Stack with fluentd

Redacting keys from log events with fluentd

Searching log entries on Better Stack

Intro

Why do we need log data?

How do applications log data?

Challenges of collecting and consuming logs in complex applications

How does Fluentd work?

Routing in Fluentd

How to configure Fluentd?

Fluentd Output

Fluentd Reliability

Conclusion

Application development challenges

Why does data collection matter?

Fluentd architecture

Outputting data to an external system

What is a Docker Logging Driver?

Matching events with a tag

Fluentd -tag option

How do you avoid premature optimization?

Why did we abandon Docker?

Event Log Collector and Router

Intro

Forwarding events with Fluentd

Setting up ElasticSearch

Setting up FluentD

Viewing events in LogStash

episode intro

Fluentd and Fluent Bit background

Should I choose FluentD or Fluent Bit?

developing an active engaged OSS community

enterprise needs and building commercial offering with Calyptia

Fluent Bit v2 updates

plugins, filters and processors in Fluent Bit

A sneak peak into the planned announcements for KubeCon Chicago

where to follow the community and Eduardo

Prometheus now supports OTLP

PromCon will take place in Berlin, 28-29 Sept.

OpenTelemetry Semantic Conventions is separated from the Specification

New in Kubernetes 1.27: Query node logs using the kubelet API

Kelemetry: global tracing for Kubernetes control plane

episode outro

Introduction

Welcome

Introduction

The Fluentd plugins for our pipeline

Tutorial - Introduction

Tutorial - Nginx logging format

Tutorial - Setup of the requirements

Tutorial - Create the Fluentd docker image

Tutorial - Dynatrace Access tokens

Tutorial deployment of Fluentd and the active gate

Tutorial Connect the active gate to your Dynatrace tenant

Tutorial the Fluentd pipeline

Tutorial Create the Prometheus ServiceMonitor

Tutorial Create the Grafana dashboard

Tutorial Create a Dynatrace Graph

Tutorial Update the Fluentd Log stream pipeline

Tutorial Consume the logs ingested by Dynatrace

Tutorial Create a Dynatrace metric from logs

Conclusion

What is Fluentd?

Fluentd destinations

Flow of monitoring information

Fluentd vs Logstash

Inserting calculated fields

Inserting calculated values

Demo

Fluentd configuration

Fluentd record transformer

Conclusion

Intro

Running Fluentd

How does Fluentd improve performance?

Fluentd configuration

What are the mechanisms in fluentd?

How to limit data traffic?

What is Fluentd?

Fluentd plugins

Fluentd source code

Conclusion