Skip to content
This repository has been archived by the owner on Apr 20, 2023. It is now read-only.

parseablehq/collector

Folders and files

NameName
Last commit message
Last commit date

Latest commit

d58aabb · Dec 2, 2022

History

65 Commits
Sep 12, 2022
Nov 24, 2022
Dec 2, 2022
Nov 24, 2022
Sep 10, 2022
Aug 12, 2022
May 7, 2022
Aug 12, 2022
May 7, 2022
Jun 18, 2022
Apr 15, 2022
Aug 17, 2022
Sep 12, 2022
Aug 12, 2022
May 18, 2022
Nov 24, 2022

Repository files navigation

Parseable

website status contributors commits activity monthly Github stars License Twitter

Parseable Collector is an automatic log collection system for Parseable. Collector is designed to pull application logs from specific containers (using Kubernetes API). Collector sends collected logs to Parseable server for storage, querying and further analysis.

Parseable Overview Parseable Overview

Why another logging agent?

Log collection has been traditionally done with agents installed on each Kubernetes node. This is too much of installation and compute overhead for most of the use cases. In reality, developers simply want to plug their applications to logging and move on. Collector is designed keeping this in mind.

With Collector we set out to achieve the shortest path between application generating logs and developer analysing those logs.

Get Started

Collector is designed to run on Kubernetes only. We recommend installing Collector via the official helm chart available in this repository. Before deploying the collector, make sure you understand the configuration.

Configuration

Collector takes configuration input in yaml format.

logStreams:
  - name: backend
    collectionInterval: 3s
    collectFrom: 
      namespace: streaming
      podSelector: 
        app: kafka
    labels: 
      app: kafka
      namespace: streaming