Changelog

What's Changed

• Fix enrichmentTable cache when append=false
• Add time_lru strategy for file cache
• Optimize cache latest files
• Fix invalid trace_id
• Add CLI for parse-id
• Add ZO_INGEST_ALLOWED_IN_FUTURE=24
• Fix panic when there is no background querier group

New ENVs

ZO_INGEST_ALLOWED_IN_FUTURE=24

only for ingester Default is 24, the events in the future over 24 hours will be drop.

deprecated

ZO_MEMORY_CACHE_CACHE_LATEST_FILES

Please use this group of new ENVs

ZO_CACHE_LATEST_FILES_ENABLED=false
ZO_CACHE_LATEST_FILES_PARQUET=true
ZO_CACHE_LATEST_FILES_INDEX=true
ZO_CACHE_LATEST_FILES_DELETE_MERGE_FILES=false

this for ingester & compactor & querier If we want only cache the latest tantivy file we can disable ZO_CACHE_LATEST_FILES_PARQUET=false. If we want to delete merged small files we can enable ZO_CACHE_LATEST_FILES_DELETE_MERGE_FILES=true.

ZO_MEMORY_CACHE_STRATEGY=lru/fifo/time_lru
ZO_DISK_CACHE_STRATEGY=lru/fifo/time_lru

With new strategy time_lru we will try to evict the files in the oldest day first, within the same day, we will evict file by LRU.

CommitID: 0a19760f52c938d402cc1bb6513b248f41cdf50e