Support automatic log group and stream creation in CloudWatch Logs sink

Is your feature request related to a problem? Please describe.

The CloudWatch Logs sink requires the log group and log stream to exist beforehand. If they don't, events fail and go to DLQ or retry indefinitely. This makes initial setup error-prone and prevents self-bootstrapping pipelines.

Describe the solution you'd like

A create_log_group_and_stream boolean config option (default false). When enabled, the sink creates the log group and log stream if they don't already exist.

sink:
  - cloudwatch_logs:
      log_group: /my/service/logs
      log_stream: my-stream
      create_log_group_and_stream: true

Additional context

Requires logs:CreateLogGroup and logs:CreateLogStream IAM permissions when enabled.

Should these be different configurations - create_log_group and create_stream? I could see some users having the ability to create the stream, but not the group. Also, I tend to think that creating the stream should be the default behavior. And we could even support dynamic streams in the future with this.

Create log group and stream in CloudWatch Logs sink (#6863)

Create log group and stream in CloudWatch Logs sink (opensearch-proje…

Navigation Menu

Repository navigation

Support automatic log group and stream creation in CloudWatch Logs sink #6861

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Support automatic log group and stream creation in CloudWatch Logs sink #6861

Description

Activity

dlvenable commented on May 18, 2026

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions