Skip to content

Support Entity attributes in CloudWatch Logs sink #6860

Closed

Description

@bagmarnikhil

Is your feature request related to a problem? Please describe.

There is no way to attach Entity metadata to PutLogEvents requests in the CloudWatch Logs sink. This is needed for CloudWatch entity-based correlation features.

Describe the solution you'd like

An entity config block with key_attributes and attributes (both free-form Map<String, String>). When configured, the entity is attached to every PutLogEvents
request.

sink:
  - cloudwatch_logs:
      log_group: /my/service/logs
      log_stream: my-stream
      entity:
        key_attributes:
          Type: "RemoteService"
          Name: "okta_auth0"
        attributes:
          AWS.ServiceNameSource: "UserConfiguration"

Additional context

Entity rejection by CloudWatch is non-fatal and should be logged as a warning.

Activity

  1. dlvenable commented on May 18, 2026

    @dlvenable
    Member

    @bagmarnikhil ,

    Is there a reason you don't use YAML maps for both? I see you use this for attributes, but it appears that you use a different form for key_attributes.

  2. added this to the v2.16 milestone on May 19, 2026
  3. bagmarnikhil commented on May 19, 2026

    @bagmarnikhil
    ContributorAuthor

    @bagmarnikhil ,

    Is there a reason you don't use YAML maps for both? I see you use this for attributes, but it appears that you use a different form for key_attributes.

    Both key_attributes and attributes are YAML maps Map<String, String> — they use the same form in the config. The only difference is that key_attributes is required @NotEmpty since CloudWatch needs at least one key attribute for entity identification, while attributes is optional and defaults to an empty map.

    Happy to clarify further if I'm misunderstanding the question!

  4. dlvenable commented on May 19, 2026

    @dlvenable
    Member

    @bagmarnikhil , This looks good. I may have misread it.

  5. moved this from Unplanned to In review in Data Prepper Tracking Boardon May 26, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions