| ZO_ROOT_USER_EMAIL |
- |
On first run |
Email of first/root user |
| ZO_ROOT_USER_PASSWORD |
- |
On first run |
Password for first/root user |
| ZO_LOCAL_MODE |
true |
No |
If local mode is set to true ,OpenObserve becomes single node deployment, false indicates cluster mode deployment which supports multiple nodes with different roles. For local mode one needs to configure sqlite db, for cluster mode one needs to config etcd. |
| ZO_LOCAL_MODE_STORAGE |
disk |
No |
disk or s3, Applicable only for local mode , by default local disk is used as storage, we also support s3 in local mode. |
| ZO_NODE_ROLE |
all |
No |
Possible values are : all, ingester, querier, router, compactor, alertmanager, A single node can have multiple roles id desired. Specify roles separated by comma. e.g. compactor,alertmanager |
| ZO_HTTP_PORT |
5080 |
No |
openobserve server listen HTTP port |
| ZO_HTTP_ADDR |
|
No |
openobserve server listen HTTP ip address |
| ZO_HTTP_IPV6_ENABLED |
false |
No |
enable ipv6 support for HTTP |
| ZO_GRPC_PORT |
5081 |
No |
openobserve server listen gRPC port |
| ZO_GRPC_ADDR |
|
No |
openobserve server listen gRPC ip address |
| ZO_GRPC_ORG_HEADER_KEY |
openobserve-org-id |
No |
header key for sending organization information for traces using OTLP over grpc |
| ZO_GRPC_STREAM_HEADER_KEY |
stream-name |
No |
header key for sending stream-name information for traces using OTLP over grpc |
| ZO_ROUTE_TIMEOUT |
600 |
No |
timeout for router node. |
| ZO_INSTANCE_NAME |
- |
No |
in the cluster mode, each node has a instance name, default is instance hostname. |
| ZO_DATA_DIR |
./data/openobserve/ |
No |
Defaults to "data" folder in current working directory if not provided. |
| ZO_DATA_DB_DIR |
./data/openobserve/db/ |
No |
metadata database local storage directory. |
| ZO_DATA_WAL_DIR |
./data/openobserve/wal/ |
No |
local WAL data directory. |
| ZO_DATA_STREAM_DIR |
./data/openobserve/stream/ |
No |
streams local data storage directory ,applicable only for local mode. |
| ZO_META_STORE |
- |
No |
Default is sqlite for local mode, etcd for cluster mode. and supported values are: sqlite, etcd, postgres, mysql. sqlite only supports for local mode. etcd is deprecated. |
| ZO_META_POSTGRES_DSN |
- |
No |
If you enable postgres as meta store, you need configure the database source address, like this: postgres://postgres:12345678@localhost:5432/openobserve |
| ZO_META_CONNECTION_POOL_MIN_SIZE |
- |
No |
Minimum number of connections created in the connection pool size for postgres, sqlite, and mysql. Defaults to cpu_limits |
| ZO_META_CONNECTION_POOL_MAX_SIZE |
- |
No |
Maximum number of connections created in the connection pool size for postgres, sqlite, and mysql. Defaults to cpu_limits * 2 |
| ZO_COLUMN_TIMESTAMP |
_timestamp |
No |
for each log line, if not present with this key , we add a timestamp with this key, used for queries with time range. |
| ZO_COLS_PER_RECORD_LIMIT |
1000 |
No |
number of fields allowed per records during ingestion , records having more fields than configured value will be discarded |
| ZO_WIDENING_SCHEMA_EVOLUTION |
true |
No |
if set to false user can add new columns to data being ingested but changes to existing data for data type are not supported . |
| ZO_SKIP_SCHEMA_VALIDATION |
false |
No |
Default we check ingested every record for schema validation, but if your schema is fixed, you can skip it, this will increase 2x ingestion performance. |
| ZO_FEATURE_PER_THREAD_LOCK |
false |
No |
default we share a lock for each thread for WAL, enable this option to create one lock for per thread, it improves ingest performance, but results in more small data files, which will be merged by compactor to create larger merged files. This is particularly helpful when you are ingesting high speed data in a single stream. |
| ZO_FEATURE_FULLTEXT_ON_ALL_FIELDS |
false |
No |
default full text search uses log, message, msg, content, data, events, json or selected stream fields. Enabling this option will perform full text search on each field, may hamper full text search performance |
| ZO_FEATURE_FULLTEXT_EXTRA_FIELDS |
- |
No |
default full text search uses log, message, msg, content, data, events, json as global setting, but you can add more fields as global full text search fields. eg: field1,field2 |
| ZO_WAL_MEMORY_MODE_ENABLED |
false |
No |
For performance, we can write WAL file into memory instead of write into disk, this will increase ingestion performance, but it has data lose risk when the system crashed. |
| ZO_WAL_LINE_MODE_ENABLED |
true |
No |
Default we write WAL file line by line, it is a bit slow but it safety, you can disable it to increase a bit performance, but it increase WAL file incorrect risk. |
| ZO_PARQUET_COMPRESSION |
zstd |
No |
Default we use zstd as the parquet file compress algorithm. but you can choose: snappy, gzip, brotli, lz4, zstd. |
| ZO_UI_ENABLED |
true |
No |
default we enable embed UI, one can disable it. |
| ZO_UI_SQL_BASE64_ENABLED |
false |
No |
Enable base64 encoding for SQL in UI. |
| ZO_WEB_URL |
- |
No |
UI access URL, eg: http://localhost:5080, used for redirect url and alert url. |
| ZO_BASE_URI |
- |
No |
If you set OpenObserve with a prefix in k8s nginx ingress, you can set the prefix path. |
| ZO_BLOOM_FILTER_ENABLED |
true |
No |
Enable by default, but only enabled for trace_id field |
| ZO_BLOOM_FILTER_DEFAULT_FIELDS |
- |
No |
Add more fields support by bloomfilter, will add UI setting later |
| ZO_FEATURE_INGEST_BUFFER_ENABLED |
false |
No |
enable it to enqueue ingestion requests for background processing, used to improve responsiveness of ingestion endpoitns |
| ZO_INGEST_BUFFER_QUEUE_NUM |
5 |
No |
number of queues to buffer ingestion requests. ZO_FEATURE_INGEST_BUFFER_ENABLED must be true |
| ZO_JSON_LIMIT |
209715200 |
No |
The max payload size of json. |
| ZO_PAYLOAD_LIMIT |
209715200 |
No |
The max payload size of http request body. |
| ZO_MAX_FILE_SIZE_ON_DISK |
64 |
No |
max WAL log file size before creating a new log file, default is 64MB, unit: MB, we created WAL log file by organization/stream_type |
| ZO_MAX_FILE_SIZE_IN_MEMORY |
256 |
No |
max memtable size before moving to immutable and then write to disk, default is 256MB, unit: MB |
| ZO_MAX_FILE_RETENTION_TIME |
600 |
No |
max retention time for WAL log and memtable, default is 600s (10m), unit: second, Whether it's the log file or the corresponding memtable that reaches this time limit, a new log file will be created and the memtable will be written to disk. |
| ZO_FILE_PUSH_INTERVAL |
60 |
No |
interval at which job moves files from WAL to storage, default 60s, unit: second |
| ZO_FILE_MOVE_THREAD_NUM |
- |
No |
number of threads for job to move WAL to storage, default equal to cpu_num. |
| ZO_MEM_TABLE_MAX_SIZE |
- |
No |
The total size limit of memory tables, we have multiple memtable for different organization/stream_types. The maximum value of each memtable is ZO_MAX_FILE_SIZE_IN_MEMORY, but the sum of all memtable cannot exceed this limit. Otherwise, an error will be returned: MemoryTableOverflowError to protect the system from OOM. default 50% of the total memory. |
| ZO_MEM_PERSIST_INTERVAL |
5 |
No |
interval at which job persist immutable from memory to disk, default 5s, unit: second |
| ZO_QUERY_THREAD_NUM |
- |
No |
number of threads for searching in data files. |
| ZO_QUERY_TIMEOUT |
600 |
No |
Default timeout of query, unit: seconds |
| ZO_HTTP_WORKER_NUM |
0 |
No |
number of threads for http services, default equal to cpu_num. |
| ZO_HTTP_WORKER_MAX_BLOCKING |
1024 |
No |
number of per http thread blocking connection in queue |
| ZO_INGEST_ALLOWED_UPTO |
5 |
No |
allow historical data ingest up to now - 5 hours data, default 5 hours, unit: hours |
| ZO_COMPACT_ENABLED |
true |
No |
enable compact for small files. |
| ZO_COMPACT_INTERVAL |
60 |
No |
interval at which job compacts small files into larger files. default is 60s, unit: second |
| ZO_COMPACT_MAX_FILE_SIZE |
256 |
No |
max file size for a single compacted file, after compaction all files will be below this value. default is 256MB, unit: MB |
| ZO_COMPACT_DATA_RETENTION_DAYS |
3650 |
No |
Data retention days, default is 10 years. Minimal 3. eg: 30, it means will auto delete the data older than 30 days. You also can set data retention for stream in the UI. |
| ZO_TELEMETRY |
true |
No |
Send anonymous telemetry info for improving OpenObserve. You can disable by set it to false |
| ZO_TELEMETRY_URL |
https://e1.zinclabs.dev |
No |
OpenTelemetry report URL. You can report to your own server. |
| ZO_HEARTBEAT_INTERVAL |
30 |
No |
OpenTelemetry report frequency. unit is: minutes, default is 30m |
| ZO_PROMETHEUS_ENABLED |
false |
No |
Enables prometheus metrics on /metrics endpoint |
| ZO_LOGS_FILE_RETENTION |
hourly |
No |
log streams default time partition level: hourly, supported: hourly, daily |
| ZO_TRACES_FILE_RETENTION |
hourly |
No |
traces streams default time partition level: hourly, supported: hourly, daily |
| ZO_METRICS_FILE_RETENTION |
daily |
No |
metrics streams default time partition level: daily, supported: hourly, daily |
| ZO_METRICS_DEDUP_ENABLED |
true |
No |
enable de-duplication for metrics |
| ZO_METRICS_LEADER_PUSH_INTERVAL |
15 |
No |
interval at which current leader information is updated to metadata store , default 15s, unit: second |
| ZO_METRICS_LEADER_ELECTION_INTERVAL |
30 |
No |
interval after which new leader for metrics will be elected , when data isn't received from current leader, default 30s, unit: second |
| ZO_PROMETHEUS_HA_CLUSTER |
cluster |
|
No |
| ZO_PROMETHEUS_HA_REPLICA |
__replica__ |
No |
for Prometheus cluster deduplication |
| ZO_PRINT_KEY_CONFIG |
false |
No |
Print key config information in logs |
| ZO_PRINT_KEY_SQL |
false |
No |
Print key sql in logs |
| ZO_USAGE_REPORTING_ENABLED |
false |
No |
Enable usage reporting. This will start capturing how much data has been ingested across each org/stream. You can use this info to enable charge back for internal teams. |
| ZO_USAGE_ORG |
meta |
No |
To which org the usage data should be sent |
| ZO_USAGE_BATCH_SIZE |
2000 |
No |
How many requests should be batched before flushing the usage data from memory to disk |
| RUST_LOG |
info |
No |
log level, default is info, supports: error, warn, info, debug, trace |
| ZO_INSTANCE_NAME |
"" |
no |
|
| ZO_BASE_URI |
"" |
no |
|
| ZO_BULK_RESPONSE_INCLUDE_ERRORS_ONLY |
false |
no |
|
| ZO_ALLOW_USER_DEFINED_SCHEMAS |
false |
no |
|
| ZO_SKIP_FORMAT_BULK_STREAM_NAME |
false |
no |
|
| ZO_GRPC_CONNECT_TIMEOUT |
5 (seconds) |
no |
|
| ZO_SKIP_FORMAT_BULK_STREAM_NAME |
false |
no |
|
| ZO_COMPACT_DATA_RETENTION_HISTORY |
false |
no |
|
| ZO_COMPACT_BLOCKED_ORGS |
"" |
no |
Use comma to split multiple orgs |
| ZO_CONCATENATED_SCHEMA_FIELD_NAME |
_all |
no |
|
| ZO_STARTING_EXPECT_QUERIER_NUM |
0 |
no |
|
| ZO_QUERY_OPTIMIZATION_NUM_FIELDS |
1000 |
no |
|
| ZO_USAGE_REPORTING_COMPRESSED_SIZE |
false |
no |
|
| ZO_QUERY_FULL_MODE_LIMIT |
1000 |
no |
|
| ZO_QUERY_PARTITION_BY_SECS |
10 (seconds) |
no |
|
| ZO_QUERY_PARTITION_MIN_SECS |
600 (seconds) |
no |
|
| ZO_QUERY_GROUP_BASE_SPEED |
|
no |
|
| ZO_FILE_PUSH_LIMIT |
0 |
no |
|
| ZO_FILE_MOVE_FIELDS_LIMIT |
2000 |
no |
|
| ZO_FILE_MOVE_THREAD_NUM |
0 |
no |
|
| ZO_QUERY_THREAD_NUM |
0 |
no |
|
| ZO_INVERTED_INDEX_SPLIT_CHARS |
".,;: |
/#_ =-+*^&%$@!~`" |
no |
| ZO_META_TRANSACTION_RETRIES |
|
no |
|
| ZO_INGEST_FLATTEN_LEVEL |
|
no |
|
| ZO_IGNORE_FILE_RETENTION_BY_STREAM |
|
no |
|
| ZO_ACTIX_REQ_TIMEOUT |
|
no |
|
| ZO_ACTIX_KEEP_ALIVE |
|
no |
|
| ZO_COOKIE_SAME_SITE_LAX |
|
no |
|
| ZO_COOKIE_SECURE_ONLY |
|
no |
|
| ZO_USAGE_REPORTING_MODE |
|
no |
|
| ZO_USAGE_REPORTING_URL |
|
no |
|
| ZO_USAGE_REPORTING_CREDS |
|
no |
|
| ZO_USAGE_BATCH_SIZE |
|
no |
|
| ZO_QUERY_ON_STREAM_SELECTION |
|
no |
|
| ZO_META_TRANSACTION_RETRIES |
|
no |
|
| ZO_META_TRANSACTION_LOCK_TIMEOUT |
|
no |
|
| ZO_DISTINCT_VALUES_INTERVAL |
|
no |
|
| ZO_DISTINCT_VALUES_HOURLY |
|
no |
|
| ZO_ROUTE_MAX_CONNECTIONS |
|
no |
|
| ZO_INGESTER_SERVICE_URL |
|
no |
|
| ZO_INGEST_BLOCKED_STREAMS |
|
no |
|
| ZO_INGEST_INFER_SCHEMA_PER_REQUEST |
|
no |
|
| ZO_FILE_PUSH_LIMIT |
|
no |
|
| ZO_ACTIX_SHUTDOWN_TIMEOUT |
|
no |
|
| ZO_ENTRY_PER_SCHEMA_VERSION_ENABLED |
|
no |
|
| ZO_FEATURE_DISTINCT_EXTRA_FIELDS |
|
no |
|
| ZO_FEATURE_QUICK_MODE_FIELDS |
|
no |
|
| ZO_FEATURE_FILELIST_DEDUP_ENABLED |
|
no |
|
| ZO_FEATURE_QUERY_QUEUE_ENABLED |
|
no |
|
| ZO_CLUSTER_COORDINATOR |
etcd |
no |
|
| ZO_QUEUE_STORE |
|
no |
|
| ZO_GRPC_MAX_MESSAGE_SIZE |
|
no |
|
| ZO_NODE_HEARTBEAT_TTL |
|
no |
|
| ZO_SHOW_STREAM_DATES_DOCS_NUM |
|
no |
|
| ZO_PARQUET_MAX_ROW_GROUP_SIZE |
|
no |
|
| ZO_DATA_IDX_DIR |
|
no |
|
| ZO_ENABLE_INVERTED_INDEX |
false |
no |
|
| ZO_FEATURE_QUERY_INFER_SCHEMA |
|
no |
|
| ZO_FEATURE_QUERY_INFER_SCHEMA_IF_FIELDS_MORE_THAN |
|
no |
|
| ZO_FEATURE_QUERY_PARTITION_STRATEGY |
|
no |
|
| ZO_RESTRICTED_ROUTES_ON_EMPTY_DATA |
|
no |
|
| ZO_BLOOM_FILTER_DISABLED_ON_SEARCH |
|
no |
|
| ZO_BLOOM_FILTER_ON_ALL_FIELDS |
|
no |
|
| ZO_BLOOM_FILTER_FORCE_DISABLED |
|
no |
|
| ZO_ALERT_SCHEDULE_INTERVAL |
|
no |
|
| ZO_COMPACT_SYNC_TO_DB_INTERVAL |
|
no |
|
| ZO_COMPACT_DELETE_FILES_DELAY_HOURS |
|
no |
|
| ZO_NODE_QUERY_ALLOCATION_STRATEGY |
|
no |
|
| ZO_TCP_PORT |
|
no |
|
| ZO_UDP_PORT |
|
no |
|
| ZO_APP_NAME |
|
no |
|
| ZO_META_MYSQL_DSN |
|
no |
|
| ZO_DEFAULT_SCRAPE_INTERVAL |
|
no |
|
| ZO_CIRCUIT_BREAKER_ENABLE |
|
no |
|
| ZO_CIRCUIT_BREAKER_RATIO |
|
no |
|
| ZO_CALCULATE_STATS_INTERVAL |
|
no |
|
| ZO_ENRICHMENT_TABLE_LIMIT |
|
no |
|