Data Ingestion - Logs, Metrics & Traces Collection

Collect logs, metrics, and traces into OpenObserve from a variety of data sources for unified observability. This data ingestion guide describes how to ingest observability data from log forwarders, monitoring agents, OpenTelemetry Collector, APIs, and programmatic methods.

Logs

Ship application and infrastructure logs to OpenObserve through agents, HTTP APIs, or your own code.

Log forwarders

1. OTEL Collector
2. Vector
3. Filebeat
4. Fluent Bit
5. Fluentd
6. Amazon Kinesis Firehose
7. Syslog
8. Python
9. Go
10. Curl

APIs

Logs can also be ingested into OpenObserve Cloud / OpenObserve through one of the 3 HTTP APIs.

1. _json
2. _multi
3. _bulk
4. syslog

You can call the above APIs directly in your code to ingest data.

From Code

Here are 2 examples on how you can do it programmatically:

1. Go
2. Python

Curl

You can also use curl command to ingest logs:

1. curl

Metrics

Send time-series metrics from Prometheus, Telegraf, or the OpenTelemetry Collector.

1. OTEL Collector
2. Prometheus
3. Telegraf

Traces

Send distributed traces using OpenTelemetry SDKs or the Collector.

1. OTEL Collector
2. OpenTelemetry
3. TypeScript
4. Node.js
5. Python
6. Go

Need some help?

• Join our Community Slack
• Or Contact support