How to redact sensitive / PII data in your logs
There are times when you would like to filter logs at source. This blog post shows how to do that when capturing logs using otel-collector.
Prabhat Sharma
December 17, 2024Recent Posts
Tags
- >kube-prometheus-stack 2
- >openobserve 20
- >metrics 8
- >opentelemetry 16
- >observability 22
- >performance 5
- >okta 1
- >logs 18
- >security 6
- >netflow 1
- >network traffic 1
- >github actions 1
- >CICD 1
- >build 1
- >DevOps 2
- >AWS 4
- >Route53 1
- >AWS Logs 1
- >AWS Kinesis 1
- >AWS Cloudwatch 1
- >AWS IAM 1
- >AWS Data Firehose 2
- >AWS Policy 1
- >AWS Role 1
- >Distributed Tracing 2
- >Observability 11
- >Microservices Architecture 1
- >Application Performance Monitoring (APM) 1
- >End-to-End Monitoring 1
- >E-commerce Performance 1
- >elk 2
- >migration 2
- >fluentbit 5
- >streams 2
- >ottl 1
- >otel-collector 4
- >cost reduction 1
- >Python 2
- >Ansible 1
- >Logging 4
- >FluentBit 2
- >Monitoring 9
- >Infrastructure 5
- >Troubleshooting 7
- >Auditing 6
- >Compliance 6
- >configuration management 1
- >gcp 2
- >google workspaces 1
- >pubsub 2
- >networking 1
- >vpc 1
- >aws 4
- >OpenObserve 8
- >Email Alerts 1
- >SMTP Configuration 1
- >Gmail SMTP Setup 1
- >Open Source Monitoring 1
- >Alert Notifications 1
- >Log Management 4
- >Real-Time Monitoring 4
- >DNS 1
- >VRL 1
- >Security 5
- >Logs 1
- >Kinesis 3
- >CloudWatch 1
- >Analytics 1
- >Enrichment 1
- >Lookup 1
- >Insights 1
- >Firehose 1
- >Network 1
- >Resolution 1
- >Traffic 1
- >Reverse 1
- >Example 1
- >Practices 1
- >Terraform 1
- >Infrastructure as code 1
- >aerospike 1
- >nosql 1
- >ubuntu 4
- >otel contrib 3
- >database 6
- >cloudwatch 1
- >OpenTelemetry 7
- >rds 1
- >redis 2
- >kinesis 1
- >firehose 1
- >api 1
- >monitoring 7
- >AWS WAF 1
- >Bot control 1
- >AWS S3 4
- >AWS Lambda 4
- >API Gateway 1
- >Cloudfront 1
- >AWS ALB 1
- >dynamodb 1
- >nginx 2
- >Real-time 1
- >audit logs 1
- >Azure 1
- >Microsoft 1
- >Microsoft Entra 1
- >Mircosoft Audit Logs 1
- >Mircosoft Signin Logs 1
- >Azure functions 1
- >Aure Eventhub 1
- >Microsoft GraphAPI 1
- >Microsoft Logs 1
- >postgreSQL 1
- >snowflake 1
- >snowpipe 1
- >datawarehouse 1
- >snowpark 1
- >sql 1
- >Uptime 1
- >SSL 1
- >Uptime Monitoring 1
- >SSL Check 1
- >Application Uptime 1
- >URL status 1
- >apache 2
- >zookeeper 1
- >AWS CloudWatch Logs 3
- >Amazon Kinesis Firehose 3
- >AWS Kinesis Firehose 5
- >Firehose Delivery Stream 3
- >Amazon S3 1
- >fluent-bit 2
- >log forwarding 3
- >kubernetes 3
- >pino 2
- >NodeJS 1
- >Falco Security 1
- >Kubernetes 1
- >Quick setup 1
- >Security logs 1
- >traces 3
- >journald 3
- >configuration 1
- >linux 3
- >syslog 3
- >centralized logging 2
- >json 1
- >logging 4
- >launch 1
- >cost 1
- >windows iis 1
- >iis logs 1
- >fluent bit 1
- >log management 2
- >vrl 2
- >web server monitoring 1
- >IIS Log Analysis 1
- >Log Parsing in IIS 1
- >Distributed Systems 1
- >SRE 1
- >Microservices 2
- >Data Volume Management 1
- >Context Propagation 1
- >Logs Metrics Traces 1
- >Peak Traffic Debugging 1
- >Implementation Patterns 1
- >AWS EC2 Logs 1
- >AWS EC2 Metrics 1
- >AWS EC2 Monitoring 1
- >Dashboards 1
- >OpenObserve Collector 1
- >Amazon EventBridge 1
- >CloudWatch Events 1
- >AWS Event Monitoring 1
- >Event-Driven Architecture 1
- >AWS Monitoring 2
- >Kinesis Firehose 1
- >AWS Lambda Logs 1
- >AWS CloudWatch 1
- >AWS Lambda Functions 1
- >AWS Performance Tracking 1
- >Cloudwatch 2
- >AWS RDS 2
- >Postgres 2
- >AWS RDS Logs 1
- >Amazon Data Firehose 3
- >AWS RDS Metrics 1
- >Metrics 1
- >CloudFront Access Logs 1
- >AWS Kinesis Data Streams 1
- >AWS Real-Time Log Processing 1
- >CDN Performance Optimization 1
- >AWS Security Monitoring 1
- >Cloud Logging and Visualization 1
- >AWS Infrastructure Monitoring 1
- >Jenkins 2
- >CICD pipeline 2
- >MySQL 1
- >sqlserver 1
- >dashboards 2
- >tutorial 1
- >FastAPI 1
- >vector 1
- >full-stack-observability 1
- >azure 1
- >cloud 1
- >visualization 1
- >grafana 1
- >OpenVPN 1
- >OpenVPN Connect 1
- >Audit Logs 2
- >AWS SNS 1
- >OpenVPN Client 1
- >osquery 1
- >Linux 1
- >regex 2
- >mikrotik 1
- >parsing 2
- >windows 1
- >iis 1
- >Real User Monitoring (RUM) 1
- >Performance Metrics 1
- >Frontend Monitoring 1
- >JavaScript Error Tracking 1
- >Web Application Performance 1
- >Frontend Performance Tools 1
- >OpenObserve Logs 1
- >User Experience Optimization 1
- >Session Replay 1
- >GitHub Demo 1
- >RUM for React Apps 1
- >1-click RUM Setup 1
- >Dashboard Creation 1
- >User Interaction Tracking 1
- >Performance Optimization 2
- >Real-time Monitoring 1
- >redaction 1
- >PII 1
- >SaaS Monitoring 1
- >Business Intelligence 1
- >IT Operations 1
- >SaaS 1
- >Tech Optimization 1
- >Tech Strategy 1
- >Tech ROI 1
- >prometheus 1
- >nodejs 1
- >Serilog 1
- >C# 1
- >.Net 1
- >programming 1
- >sso 1
- >enterprise 1
- >Jaeger 1
- >Tracing Tools 1
- >HotROD 1
- >rust 1
- >containers 1
- >cgroups 1
- >open source 1
- >agpl 1
- >gpl 1
- >license 1
- >AWS Cloudtrail 1
- >AWS Organizations 1
- >JumpCloud 1
- >Directory Insights 1
- >SSO 1
- >Active Directory 1
- >release 1
- >echarts 1
- >plotly 1
- >data visualization 1
OpenObserve Inc. © 2024