Filter logs at source in otel collector
There are times when you would like to filter logs at source. This blog post shows how to do that when capturing logs using otel-collector.
Prabhat Sharma
December 7, 2023Recent Posts
Tags
- >kube-prometheus-stack 2
- >openobserve 15
- >metrics 5
- >opentelemetry 10
- >observability 21
- >performance 4
- >okta 1
- >logs 17
- >security 6
- >netflow 1
- >network traffic 1
- >github actions 1
- >CICD 1
- >build 1
- >DevOps 2
- >AWS 4
- >Route53 1
- >AWS Logs 1
- >AWS Kinesis 1
- >AWS Cloudwatch 1
- >AWS IAM 1
- >AWS Data Firehose 2
- >AWS Policy 1
- >AWS Role 1
- >Distributed Tracing 2
- >Observability 9
- >Microservices Architecture 1
- >Application Performance Monitoring (APM) 1
- >End-to-End Monitoring 1
- >E-commerce Performance 1
- >elk 2
- >migration 2
- >fluentbit 5
- >streams 2
- >ottl 1
- >otel-collector 4
- >cost reduction 1
- >Python 2
- >Ansible 1
- >Logging 4
- >FluentBit 2
- >Monitoring 7
- >Infrastructure 4
- >Troubleshooting 6
- >Auditing 6
- >Compliance 6
- >configuration management 1
- >gcp 2
- >google workspaces 1
- >pubsub 2
- >networking 1
- >vpc 1
- >aws 3
- >OpenObserve 8
- >Email Alerts 1
- >SMTP Configuration 1
- >Gmail SMTP Setup 1
- >Open Source Monitoring 1
- >Alert Notifications 1
- >Log Management 4
- >Real-Time Monitoring 4
- >DNS 1
- >VRL 1
- >Security 4
- >Logs 1
- >Kinesis 3
- >CloudWatch 1
- >Analytics 1
- >Enrichment 1
- >Lookup 1
- >Insights 1
- >Firehose 1
- >Network 1
- >Resolution 1
- >Traffic 1
- >Reverse 1
- >Example 1
- >Practices 1
- >Terraform 1
- >Infrastructure as code 1
- >api 1
- >monitoring 5
- >AWS WAF 1
- >Bot control 1
- >AWS S3 4
- >AWS Lambda 4
- >API Gateway 1
- >Cloudfront 1
- >AWS ALB 1
- >dynamodb 1
- >nginx 2
- >Real-time 1
- >audit logs 1
- >Azure 1
- >Microsoft 1
- >Microsoft Entra 1
- >Mircosoft Audit Logs 1
- >Mircosoft Signin Logs 1
- >Azure functions 1
- >Aure Eventhub 1
- >Microsoft GraphAPI 1
- >Microsoft Logs 1
- >database 2
- >postgreSQL 1
- >AWS CloudWatch Logs 3
- >Amazon Kinesis Firehose 3
- >AWS Kinesis Firehose 5
- >Firehose Delivery Stream 3
- >Amazon S3 1
- >fluent-bit 2
- >log forwarding 3
- >kubernetes 2
- >pino 2
- >NodeJS 1
- >traces 2
- >journald 3
- >configuration 1
- >linux 3
- >syslog 3
- >centralized logging 2
- >json 1
- >logging 4
- >launch 1
- >cost 1
- >windows iis 1
- >iis logs 1
- >fluent bit 1
- >log management 2
- >vrl 2
- >web server monitoring 1
- >IIS Log Analysis 1
- >Log Parsing in IIS 1
- >Distributed Systems 1
- >SRE 1
- >Microservices 2
- >Data Volume Management 1
- >Context Propagation 1
- >Logs Metrics Traces 1
- >Peak Traffic Debugging 1
- >Implementation Patterns 1
- >AWS EC2 Logs 1
- >AWS EC2 Metrics 1
- >AWS EC2 Monitoring 1
- >OpenTelemetry 5
- >Dashboards 1
- >OpenObserve Collector 1
- >Amazon EventBridge 1
- >CloudWatch Events 1
- >AWS Event Monitoring 1
- >Event-Driven Architecture 1
- >AWS Monitoring 2
- >Kinesis Firehose 1
- >AWS Lambda Logs 1
- >AWS CloudWatch 1
- >AWS Lambda Functions 1
- >AWS Performance Tracking 1
- >Cloudwatch 2
- >AWS RDS 2
- >Postgres 2
- >AWS RDS Logs 1
- >Amazon Data Firehose 3
- >AWS RDS Metrics 1
- >Metrics 1
- >CloudFront Access Logs 1
- >AWS Kinesis Data Streams 1
- >AWS Real-Time Log Processing 1
- >CDN Performance Optimization 1
- >AWS Security Monitoring 1
- >Cloud Logging and Visualization 1
- >AWS Infrastructure Monitoring 1
- >Jenkins 2
- >CICD pipeline 2
- >redis 1
- >dashboards 2
- >tutorial 1
- >FastAPI 1
- >vector 1
- >full-stack-observability 1
- >azure 1
- >cloud 1
- >visualization 1
- >grafana 1
- >OpenVPN 1
- >OpenVPN Connect 1
- >Audit Logs 2
- >AWS SNS 1
- >OpenVPN Client 1
- >osquery 1
- >Linux 1
- >ubuntu 1
- >regex 2
- >mikrotik 1
- >parsing 2
- >windows 1
- >iis 1
- >Real User Monitoring (RUM) 1
- >Performance Metrics 1
- >Frontend Monitoring 1
- >JavaScript Error Tracking 1
- >Web Application Performance 1
- >Frontend Performance Tools 1
- >OpenObserve Logs 1
- >User Experience Optimization 1
- >Session Replay 1
- >GitHub Demo 1
- >RUM for React Apps 1
- >1-click RUM Setup 1
- >Dashboard Creation 1
- >User Interaction Tracking 1
- >Performance Optimization 2
- >Real-time Monitoring 1
- >redaction 1
- >PII 1
- >SaaS Monitoring 1
- >Business Intelligence 1
- >IT Operations 1
- >SaaS 1
- >Tech Optimization 1
- >Tech Strategy 1
- >Tech ROI 1
- >prometheus 1
- >nodejs 1
- >Serilog 1
- >C# 1
- >.Net 1
- >programming 1
- >sso 1
- >enterprise 1
- >Jaeger 1
- >Tracing Tools 1
- >HotROD 1
- >rust 1
- >containers 1
- >cgroups 1
- >open source 1
- >agpl 1
- >gpl 1
- >apache 1
- >license 1
- >AWS Cloudtrail 1
- >AWS Organizations 1
- >JumpCloud 1
- >Directory Insights 1
- >SSO 1
- >Active Directory 1
- >release 1
- >echarts 1
- >plotly 1
- >data visualization 1
OpenObserve Inc. © 2024