Sending Okta Logs to OpenObserve using Amazon Eventbridge

In today's cloud-centric world, monitoring and analyzing logs is crucial for maintaining security, ensuring compliance, and troubleshooting issues. Okta, a leading identity and access management service, offers streaming logs that can be sent to various destinations for further analysis. This blog will guide you through the process of sending Okta logs to Amazon EventBridge, which will then send them to Kinesis Firehose, ultimately forwarding them to OpenObserve.

Prerequisites

Before we start, ensure you have the following:

1. An Okta account with administrative privileges.
2. An AWS account with appropriate permissions to create and manage EventBridge, Kinesis Firehose, and other related services.
3. An OpenObserve instance or cloud account ready to receive logs.

Step 1: Configure Kinesis Firehose

1.1 Create a Kinesis Firehose Delivery Stream

1. Open the AWS Management Console and navigate to Kinesis Firehose.
2. Click Create delivery stream.
3. Choose Direct PUT or other sources as the source and click Next.
4. Name your delivery stream (e.g., OktaLogsFirehose).
5. In the Destination section, select your desired destination. For this, we will use HTTP.
6. Configure the HTTP endpoint to forward logs to OpenObserve by getting values from OpenObserve ingestion page.
7. Click Next.

Step 2: Configure Okta Streaming Logs

2.1 Enable System Log Streaming in Okta

1. Log in to your Okta admin console.
2. Navigate to Reports > Log Streaming.
3. Click on Settings (gear icon) in the top right corner.
4. In the Log Streaming section, click Add Log Stream.
5. Select Amazon EventBridge as the destination and click Next.

2.2 Configure Amazon EventBridge in Okta

1. Name
2. AWS Event source name
3. Enter your AWS account ID and region.
4. Click Create IAM Role. This will take you to the AWS Management Console to create an IAM role with the necessary permissions.
5. Once the role is created, go back to the Okta admin console and click Save.

Step 3: Set Up Amazon EventBridge

At this point you should have an entry in your Eventbridge that you must accept.

At this point you will have a custom event bus created in your AWS account.

You can now create a rule to capture Okta events.

3.1 Create a Rule to Capture Okta Events

1. In the EventBridge console, click on Rules in the left navigation pane.
2. Click Create rule.
3. Enter a name for your rule (e.g., CaptureOktaLogs) and select your event bus.
4. In the Define pattern section, choose Event source and enter the source as aws.partner/okta.com.
5. Click Next.

If all the configurations are correct, you should start seeing logs in OpenObserve in a few minutes.

3.2 Set Up Amazon EventBridge to Forward Logs to Kinesis Firehose

1. In the EventBridge console, click on Targets in the left navigation pane.
2. Click Create target.
3. Select Kinesis Firehose as the target type.
4. Choose the Kinesis Firehose delivery stream you created earlier.
5. Click Create.

If all the configurations are correct, you should start seeing logs in OpenObserve in a few minutes.

Conclusion

By following these steps, you have successfully set up a pipeline to send Okta logs to Amazon EventBridge, which then sends them to Kinesis Firehose, and finally forwards them to OpenObserve. This setup ensures that your logs are captured, processed, and available for analysis in a centralized location, helping you maintain security and compliance in your organization.

Feel free to adjust the configuration based on your specific requirements and use cases. Happy logging!