Exception Detector 🔗︎

Overview 🔗︎

This filter plugin consumes a log stream of JSON objects which contain single-line log messages. If a consecutive sequence of log messages form an exception stack trace, they forwarded as a single, combined JSON object. Otherwise, the input log data is forwarded as is. More info at https://github.com/GoogleCloudPlatform/fluent-plugin-detect-exceptions

Note: As Tag management is not supported yet, this Plugin is mutually exclusive with Tag normaliser

Example output configurations 🔗︎

filters:
 - detectExceptions:
     languages: java, python
     multiline_flush_interval: 0.1

Configuration 🔗︎

DetectExceptions 🔗︎

message (string, optional) 🔗︎

The field which contains the raw message text in the input JSON data.

Default: "”

remove_tag_prefix (string, optional) 🔗︎

The prefix to be removed from the input tag when outputting a record.

Default: kubernetes

multiline_flush_interval (string, optional) 🔗︎

The interval of flushing the buffer for multiline format.

Default: nil

languages ([]string, optional) 🔗︎

Programming languages for which to detect exceptions.

Default: []

max_lines (int, optional) 🔗︎

Maximum number of lines to flush (0 means no limit)

Default: 1000

max_bytes (int, optional) 🔗︎

Maximum number of bytes to flush (0 means no limit)

Default: 0

stream (string, optional) 🔗︎

Separate log streams by this field in the input JSON data.

Default: "”

force_line_breaks (bool, optional) 🔗︎

Force line breaks between each lines when comibining exception stacks.

Default: false

match_tag (string, optional) 🔗︎

Tag used in match directive.

Default: kubernetes.**

Example Exception Detector filter configurations 🔗︎

apiVersion: logging.banzaicloud.io/v1beta1
kind: Flow
metadata:
 name: demo-flow
spec:
 filters:
   - detectExceptions:
       multiline_flush_interval: 0.1
       languages:
         - java
         - python
 selectors: {}
 localOutputRefs:
   - demo-output

Fluentd Config Result 🔗︎

<match kubernetes.**>
 @type detect_exceptions
 @id test_detect_exceptions
 languages ["java","python"]
 multiline_flush_interval 0.1
 remove_tag_prefix kubernetes
</match>