Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added Dissect Processor Functionality #3090

Conversation

vishalboin
Copy link
Contributor

Description

Implemented Dissect processor functionality.

Design overview:

For each pattern in map -

  1. Breakdown the pattern into 2 groups:
    • List of fields
    • List of delimiters
  2. Assign the properties of prefix and suffix notations.

(Used regex for above 2 steps. These are executed only once to process the dissect pattern, before processing the logs)

  1. For an incoming log, check if the dissect_when expression satisfies

For each mapped field's value if present -

  1. Split the string with the help of delimiters and assign the the text beween the delimiters to the fields.
  2. Perform the operations on the fields, with the help of the suffix and prefix properties.
  3. Convert the field types based on the target_types map provided in the config.
  4. Populate the output Json with the fields and their assigned values

Issues Resolved

[None]

Check List

  • New functionality includes testing.
  • New functionality has been documented.
  • New functionality has javadoc added
  • Commits are signed with a real name per the DCO

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Signed-off-by: Vishal Boinapalli <[email protected]>
Signed-off-by: Vishal Boinapalli <[email protected]>
@oeyh oeyh mentioned this pull request Sep 19, 2023
4 tasks
@oeyh
Copy link
Collaborator

oeyh commented Sep 26, 2023

Closing in favor of #3363

@oeyh oeyh closed this Sep 26, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants