OpenObserve / DOCS
  • Platform
    01
    Collect
    Signals
    Logs
    Logs
    Petabyte-scale ingest & search
    Metrics
    Metrics
    Prometheus-native time series
    Traces
    Traces
    Distributed tracing & spans
    Frontend Monitoring
    Frontend Monitoring
    RUM, Core Web Vitals & replays
    02
    Analyze
    Make sense
    Dashboards
    Dashboards
    Visualize anything in seconds
    Pipelines
    Pipelines
    Parse, enrich & route at ingest
    03
    Respond
    When it matters
    Alerts
    Alerts
    Thresholds, anomalies & routing
    Incidents
    IncidentsPreview
    Triage, on-call & postmortems
    Integrations
    Integrations
    Slack, PagerDuty, Jira & 60+ more
    04
    O11y 3.0
    Preview
    LLM Observability
    LLM Observability
    Tokens, cost & prompt traces
    AI Assistant
    AI Assistant
    Ask anything about your telemetry
    AI SRE
    AI SRE
    Autonomous triage & root-cause
    MCP Server
    MCP Server
    Bring your agents to your data
    What's new → Architecture Open source Docs
    Compare to Datadog, Grafana, & More →
  • Solutions

    Cloud & Infrastructure

    Cloud Monitoring

    AWSAWS Monitoring GCPGCP Monitoring AzureAzure Monitoring

    Infrastructure Monitoring

    KubernetesKubernetes Monitoring

    Apps & Services

    Network
    Network Monitoring
    Flow logs, latency & DNS
    Database
    Database Monitoring
    Queries, locks & replication lag

    AI & Telemetry

    OpenTelemetry
    OpenTelemetry
    Vendor-neutral metrics & traces
    Unified observability

    One backend for logs, metrics, traces & RUM.

    Extremely Efficient
    Up to
    140X
    Lower storage cost*
    Highly Performant
    Up to
    30X
    More performant*
    Petabyte-scale
    2.5 PB/day
    Largest customer ingestion
    Get Started Free Talk to a Human
    Don't see your stack? OpenObserve ingests any OTel signal. Browse all solutions →
  • Resources

    Learn

    Documentation Documentation Guides, references & quickstarts Blog Blog Engineering & product deep-dives FAQ FAQ Quick answers to common questions What's New What's New Changelog Latest releases & features

    Watch & Connect

    Webinars & Videos Webinars & Videos Live sessions & on-demand demos Events Events Meet us at conferences & meetups Customer Stories Customer Stories Success with O2 Partners Partner Become a partner

    Evaluate & Tools

    OpenObserve vs. Others OpenObserve vs. Others Compare with alternatives Datadog Bill Analyzer Datadog Bill Analyzer See your savings in minutes Downloads Downloads Run Enterprise/OSS Binaries, Docker, K8s Startup Program Startup Program Credits & perks for startups
    Upcoming Webinar

    Troubleshooting Kubernetes with OpenObserve

    Jun 30 · 3:00 PM IST · 45 min

    Live walkthrough of debugging noisy K8s clusters — with Q&A.

    Register All events →
    Documentation → Community Slack GitHub Status
    Get a guided demo →
  • Pricing
Get Demo
AWS US East-2cloud.openobserve.aiOhio, USA · AWS Azure US West 2us2.openobserve.aiCalifornia, USA · Azure AWS EU Central-1eu1.openobserve.aiFrankfurt, Germany · AWS AWS Asia Pacific South-1ap1.openobserve.aiMumbai, India · AWS
Star
OpenObserve / DOCS
Get Demo

Full Stack Observability Platform

View Platform →
01Collect
LogsLogs MetricsMetrics TracesTraces Frontend MonitoringFrontend Monitoring
02Analyze
DashboardsDashboards PipelinesPipelines
03Respond
AlertsAlerts IncidentsIncidents Preview IntegrationsIntegrations
04O11y 3.0
LLM ObservabilityLLM Observability AI AssistantAI Assistant AI SREAI SRE MCP ServerMCP Server
What's new Architecture Open source Docs
Compare to Datadog, Grafana, & More →

Full Stack Observability Solutions

View Solutions →

Cloud & Infrastructure

Cloud Monitoring

AWSAWS Monitoring GCPGCP Monitoring AzureAzure Monitoring

Infrastructure Monitoring

KubernetesKubernetes Monitoring

Apps & Services

NetworkNetwork Monitoring DatabaseDatabase Monitoring

AI & Telemetry

OpenTelemetryOpenTelemetry

Explore All Resources

View Resources →

Learn

Documentation Blog FAQ What's New Changelog

Watch & Connect

Webinars & Videos Events Customer Stories Partner

Evaluate & Tools

OpenObserve vs. Others Datadog Bill Analyzer Downloads Startup Program
Pricing
Get Demo Log In
Initializing search
      • Introduction
      • Our Principles
        • OpenObserve vs Elasticsearch
        • OpenObserve vs Splunk
        • OpenObserve vs New Relic
        • OpenObserve vs Datadog
    • Architecture
    • Quickstart
      • Overview
      • Amazon EKS
      • Azure AKS
      • Google GKE
      • Terraform
      • SRE Agent Setup
      • Enterprise Features
      • License and Pricing
      • Capacity Planning
      • Performance
      • Log Management
      • Metric Monitoring
      • Distributed Tracing
      • Frontend Observability
      • Enterprise Features
      • What's next
    • Releases
        • Auto Run
        • Cross-Linking
        • OpenObserve Query Examples | OpenObserve
        • Telemetry
          • Federated Search Overview
          • How to Use Federated Search
          • Federated Search Architecture
          • Logs Overview
          • Logs in OpenObserve
          • Refresh Cache Run Query
          • Search Around
          • Insights
          • Quick Mode and Interesting Fields
          • Log Patterns
          • Explain and Analyze Query
          • Metrics Overview
          • File Access Time
          • Downsampling Metrics
          • Overview
            • RUM Overview
            • Setup Guide
            • Performance Monitoring
            • Session Tracking
            • Error Tracking
            • Session Replay
            • Metrics Reference
            • Advanced Features
            • Use Cases
            • Best Practices
            • Troubleshooting
          • Traces Overview
          • Traces in OpenObserve
          • Service Graph
          • Service Catalog
          • Actions Overview
          • Actions in OpenObserve
          • Create and Use Real-time Actions
          • Create and Use Scheduled Actions
          • Declare Python Dependencies in Actions
          • Environment Variables in Actions
          • Enrichment Tables Overview
          • Create and Use Enrichment Tables
          • Upload, Caching, and Restart Behavior
          • Functions Overview
          • Functions in OpenObserve
          • OpenObserve Python SDK
          • Pipelines Overview
          • Pipelines in OpenObserve
          • Create and Use Real-time Pipeline
          • Create and Use Scheduled Pipeline
          • Remote Destination
          • Import and Export Pipelines
          • Manage Pipelines
          • Configurable Delay in Scheduled Pipelines
          • Streams Overview
          • Streams in OpenObserve
          • Stream Details
          • Schema Settings
          • Extended Retention
          • Summary Streams
          • Field and Index Types in Streams
          • Query Recommendations Stream
          • Distinct Values
          • Alerts Overview
          • Scheduled Alerts
          • Real-time Alerts
          • Alert Conditions and Filters
          • Alert History
          • Anomaly Detection
          • Import and Export Alerts
          • Dashboards Overview
          • Dashboards in OpenObserve
          • Manage Dashboards
          • Move and Export Dashboards in Bulk
            • Panels Overview
            • Manage Panels
            • Troubleshooting
            • Config Overview
            • Trellis Layout
            • Show Symbol
            • Show Field as JSON
            • Pivot Table
            • Variables Overview
            • Variables in OpenObserve
            • Variable Types
            • Variable Dependencies
            • Filters
          • Comparison Against in Dashboards
            • Custom Charts Overview
            • What Are Custom Charts
            • Custom Charts with Flat Data
            • Custom Charts with Nested Data
            • Event Handlers and Custom Functions
            • Custom Charts for Metrics Using PromQL
            • Custom Charts for Metrics Using Multiple PromQL Queries
          • Histogram Caching
          • Incident Management
          • Reports Overview
          • Reports FAQ
        • AI Credits (Cloud)
        • Work group v2
        • Work group
          • Identity and Access Management Overview
          • Role-Based Access Control (RBAC)
          • Enable Role-Based Access Control (RBAC) in Enterprise Edition
          • Single Sign-On (SSO)
          • Organizations
            • Quotas Overview
            • Quotas
            • How Quotas Work
          • Manage Users & Passwords
          • General Settings
          • Management Overview
          • Streaming Search
          • Streaming Aggregation
          • Query Management
          • Alert Destinations
          • Templates
          • Audit trail
          • Cipher Keys
          • Nodes in OpenObserve
          • SSO Domain Restrictions
          • Sensitive Data Redaction
          • Correlation Settings
          • License Management
          • Profile Overview
          • UI Languages in OpenObserve
        • SIEM Platform - Security Information and Event Management Solution | OpenObserve
          • Best Practices
          • Prevent UI Crashes From Large Queries
          • Ensure the S3 Configuration is Correct
          • Performance Overview
          • Download Manager
          • Result Cache
          • Monitor Download Queue Size and Disk Cache Metrics
          • Configure Disk Cache Eviction Strategy
          • Tantivy Index
          • Broadcast Join
      • Ingestion Overview
        • otel-collector
        • Vector
        • Filebeat
        • Fluent-bit
        • Fluentd
        • Kinesis Firehose
        • Syslog
        • Python
        • Go
        • Curl
        • Index
        • Prometheus
        • OTEL Collector
        • Telegraf
        • Index
        • OpenTelemetry
        • Typescript
        • Node.js
        • Python
        • Go
        • Rust
      • Integrations Overview
        • LLM Applications
        • LLM Evaluations
        • Claude Code Tracing
          • Amazon Bedrock AgentCore
          • Amazon Bedrock Agents
          • Agno
          • AutoGen
          • BeeAI
          • Claude Agent SDK
          • CrewAI
          • DSPy
          • Google ADK
          • Haystack
          • Instructor
          • Koog
          • LangChain
          • LangChain DeepAgents
          • LangGraph
          • LangServe
          • LiteLLM
          • LiveKit
          • LlamaIndex
          • LlamaIndex Workflows
          • Mastra
          • Microsoft Agent Framework
          • Mirascope
          • OpenAI Agents
          • Pipecat
          • Pydantic AI
          • Quarkus LangChain4j
          • Ragas
          • Restate
          • Semantic Kernel
          • SmolAgents
          • Spring AI
          • Strands Agents
          • Swiftide
          • Temporal
          • Vercel AI SDK
          • VoltAgent
          • Amazon Bedrock
          • Anthropic (JS/TS)
          • Anthropic (Python)
          • BytePlus ModelArk
          • Cerebras
          • Cohere
          • CometAPI
          • Databricks
          • DeepSeek
          • Fireworks AI
          • Google Gemini
          • Groq
          • HuggingFace
          • Mistral
          • Novita AI
          • Ollama
          • OpenAI (JS/TS)
          • OpenAI (Python)
          • OpenAI Assistants API
          • Together AI
          • vLLM
          • xAI Grok
          • Anannas
          • Kong Gateway
          • LiteLLM Proxy
          • OpenRouter
          • Portkey
          • Vercel AI Gateway
          • Codename Goose
          • LobeChat
          • Vapi
          • Flowise
          • Langflow
          • n8n
          • Open WebUI
          • Cognee
          • Exa
          • Firecrawl
          • Gradio
          • LibreChat
          • mcp-use
          • Milvus
          • Mixpanel
          • Parallel
          • PostHog
          • Promptfoo
          • Trubrics
          • Zapier
          • MCP Overview
          • Claude code CLI
        • Model Pricing
        • Custom AI Toolsets
        • Integration with Cloudflare
        • Heroku Application Logs Integration Guide
        • Vercel Application Logs Integration Guide
          • AWS Integrations Overview
          • Complete AWS Integration (Quick Setup)
          • Amazon EC2
          • Application Load Balancer(ALB)
          • Amazon Virtual Private Cloud
          • Amazon Cognito
          • AWS Network Firewall
          • AWS Cloudwatch logs
          • AWS Cloudwatch metrics
          • Amazon Relational Database Service (RDS)
          • Amazon Lambda Function
          • Amazon Elastic Container Service (ECS)
          • AWS Route 53
          • AWS Web Application Firewall (WAF)
          • API Gateway logs
          • Amazon CloudFront
          • Amazon EventBridge
          • Azure Integrations Overview
          • Azure Activity Logs
          • GCP Integrations Overview
          • GCP Logs
          • Google Cloud Run
        • Apache Airflow Integration Guide
        • Cribl Integration Guide
        • MuleSoft AMC Logs Integration Guide
        • Database Integrations Overview
        • PostgreSQL
        • Oracle Database
        • Snowflake
        • MySQL
        • MongoDB
        • Redis
        • Amazon DynamoDB
        • Apache Zookeeper
        • Cassandra
        • Aerospike
        • DevOps Integrations Overview
        • Jenkins
        • Ansible
        • Terraform
        • Github Actions
        • Message Queues
        • Kafka
        • RabbitMQ
        • NATS
        • Security Integraions
        • Microsoft 365
        • Servers Integrations Overview
        • Nginx
        • Oracle Weblogic
        • Kubernetes Monitoring - K8s Cluster Monitoring and Container Observability | OpenObserve
        • Linux Server Monitoring - System Logs and Performance Metrics | OpenObserve
        • Windows Server Monitoring - Event Logs and Performance Metrics | OpenObserve
        • High Availability Deployment Guide - HA Setup on Kubernetes | OpenObserve
        • Environment Variables Reference | OpenObserve
          • OpenObserve CLI
          • K8s Operator Overview
          • Deployment Script
          • Manual Deployment
          • Features
          • Troubleshooting Guide
        • Monitoring OpenObserve
          • Operator Guide Overview
          • Systemd
          • SIMD
          • Mimalloc
          • Grafana plugin
          • Etcd maintenance
          • Etcd restore
          • Nginx proxy
          • Configuration Management
          • CLI Commands
          • Storage Management Overview
          • Storage Configuration
          • Configure Multiple Object Storage Accounts
          • Bring Your Own Bucket
        • Overview
          • Schema
          • Settings
          • List
          • Delete
            • JSON
            • Bulk
            • Multi
            • Loki
            • Otlp
            • Prometheus
            • JSON
            • OTLP
          • Search
          • Around
          • Value
          • Profile
          • Create
          • Update
          • Delete
          • List
          • Examples
          • Create
          • Update
          • Add to org
          • Remove from org
          • List
          • Cluster Info API
          • Traces API Overview
          • Search Traces
          • Dashboards API | OpenObserve
          • Reports API | OpenObserve
        • SQL Functions Overview
        • Full-Text Search Functions
        • Secondary Index Functions
        • Array Functions
        • Aggregate Functions
          • Approximate Aggregate Overview
          • approx_topk
          • approx-topk-distinct
      • SQL Reference
      • Migrate database
      • Migrate file list partition
        • Overview
        • Architecture & Terminology
        • Migrating Metrics
        • Migrating Traces
        • Migrating Logs
        • Migrating Dashboards & Alerts

    Pipelines Overview

    In OpenObserve, pipelines are data processing workflows used to transform logs, metrics, or traces during ingestion or before storage.

    Learn more:

    • Pipelines in OpenObserve
    • Create and Use Real-time Pipeline
    • Create and Use Scheduled Pipeline
    • Import and Export Pipelines
    • Manage Pipelines
    • Configurable Delay in Scheduled Pipelines
    Was this page helpful?
    Thank you for your feedback.
    Thank you, we will review this page.
    Stay Updated

    Get the latest OpenObserve insights

    By subscribing, you agree to receive product and marketing related updates from OpenObserve.

    ISO 27001 Certified
    Official AICPA SOC badge

    SOC2 Type II

    Certified

    Star
    Upcoming Webinar:

    Troubleshooting Kubernetes: From Alert to Root Cause

    June 30, 2026
    03:00 PM IST
    Register

    OpenObserve Inc. ©

    3000 Sand Hill Rd Building 1, Suite 260, Menlo Park, CA 94025

    • Terms of Service
    • Privacy Policy
    • Subprocessors
    • Security & Compliance
    • slack
    • twitter
    • linkedin
    • github
    • youtube