Data Ingestion - Logs, Metrics & Traces Collection

Collect logs, metrics, and traces into OpenObserve from a variety of data sources for unified observability. This data ingestion guide describes how to ingest observability data from log forwarders, monitoring agents, OpenTelemetry Collector, APIs, and programmatic methods.

Logs

Log forwarders

1. OTEL Collector
2. Vector
3. Filebeat
4. Fluent-bit
5. Fluentd
6. Amazon Kinesis Firehose
7. Syslog
8. Python
9. Go
10. Curl

APIs

Logs can also be ingested into OpenObserve Cloud / OpenObserve through one of the 3 HTTP APIs.

1. _json
2. _multi
3. _bulk
4. syslog

You can call the above APIs directly in your code to ingest data.

From Code

Here are 2 examples on how you can do it programmatically:

1. Go
2. Python

Curl

You can also use curl command to ingest logs:

1. curl

Metrics

1. OTEL Collector
2. Prometheus
3. Telegraf

Traces

1. OTEL Collector
2. OpenTelemetry
3. Typescript
4. Node.js
5. Python
6. Go