Skip to content

[exporter/kafka] Configure partitioner for exporter's batching #41775

@lahsivjar

Description

@lahsivjar

Component(s)

exporter/kafka

Is your feature request related to a problem? Please describe.

exporterhelper can now be configured to partition the export data based on custom partitioner. The partitioner requires the new QueueBatchSettings. The partitioner can be defined based on the include_metadata_keys config and will be enabled with sending_queue::batch being defined.

NOTE that the partitioner is different from kafka partition.

Describe the solution you'd like

Migrate WithQueue to WithQueueBatch and define a custom Partitioner to partition export data by defined metadata keys.

Describe alternatives you've considered

No response

Additional context

No response

Tip

React with 👍 to help prioritize this issue. Please use comments to provide useful context, avoiding +1 or me too, to help us triage it. Learn more here.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions