Monitoring AWS RDS metrics is critical for ensuring the reliability, performance, and scalability of your database systems, especially when managing multiple AWS accounts with multiple RDS instances. This guide walks you through the end-to-end process of using AWS CloudWatch and OpenTelemetry (Otel) 1.0 to collect, stream, and visualize RDS metrics efficiently.

Why Monitor AWS RDS Metrics?

RDS metrics provide essential insights into your database health and performance, enabling you to:

• Optimize Resource Utilization: Monitor CPU, memory, and storage usage to prevent bottlenecks.
• Improve Query Performance: Analyze read and write latencies to optimize database queries.
• Ensure Availability: Track replication lag and connection counts to detect issues proactively.
• Centralize Observability: Consolidate metrics from multiple AWS accounts into a single pane of glass for streamlined monitoring.

Prerequisites

Before starting, ensure:

1. You have access to AWS CloudWatch.
2. Running OpenObserve Cluster.
3. Familiarity with AWS Kinesis is recommended.

Step 1: Configure Kinesis Data Stream

CloudWatch streams metrics via Kinesis, which acts as a transport mechanism. Follow these steps:

1. Create a Kinesis Data Stream:
   • Navigate to Kinesis > Data Streams in the AWS Management Console.
   • Click Create data stream and name it appropriately (e.g., RDSMetricsStream).
2. Connect the Metric Stream to Kinesis:
   • In the metric stream configuration, select Kinesis Data Stream as the destination.
   • Choose the stream you created.
     

Refer to this guide for detailed Kinesis configuration steps.

Step 2: Create a Metric Stream

A metric stream in AWS CloudWatch allows you to stream selected metrics to a destination for analysis. Follow these steps:

1. Log into the AWS Management Console.
2. Navigate to CloudWatch > Metric Streams.
3. Select Custom setup with Firehose

Step 3: Configure a Metric Stream

Select the metrics you want to stream:

1. Click on Select Metrics.
2. Select Include > AWS/RDS.
3. Provide metric stream name

Step 4: Verify the metrics in OpenObserve

Go to OpenObserve dashboard and select logs and search for the stream that you have created while providing HTTP endpoint in kinesis.

Metrics are ingested as logs within OpenObserve in OpenTelemetry 1.0 format that will allow you to use SQL to create dashboards.

Step 5: Import the Prebuilt RDS Monitoring Dashboard

To visualize the ingested metrics effectively, use the prebuilt RDS monitoring dashboard available in the OpenObserve Dashboards repository:

1. Download the RDS Monitoring Dashboard JSON:
   • Locate the JSON file for the RDS monitoring dashboard in the repository.
2. Import the Dashboard:
   • Navigate to your observability platform and import the JSON file.
   • Verify that panels display metrics such as CPU usage, latency, throughput, and replication lag.

Key Panels Included:

• CPU Utilization: Monitor instance performance.
• Connection Trends: Analyze active database connections.
• Disk Usage: Track available and used storage.
• Query Performance: Visualize latency and throughput.
• Error Analysis: Identify and resolve database issues.

Conclusion

By following these steps, you can set up an end-to-end monitoring solution for AWS RDS metrics using CloudWatch and OpenTelemetry. This approach ensures:

• Proactive Database Monitoring: Detect and resolve issues before they impact users.
• Centralized Observability: Gain a unified view of RDS instances across accounts.
• Scalable Insights: Monitor growing workloads efficiently.

Ready to optimize your database performance and simplify your observability workflows? Visit our website to learn more details about how the platform works.