Skip to content

[Feature][transform-v2] Add a 'RegexParseTransform' plugin in Apache SeaTunnel to parse irregular logs into structured logs #9308

Closed
@ShiDSheng

Description

@ShiDSheng

Search before asking

  • I had searched in the feature and found no similar feature requirement.

Description

Provide a Transform plugin named RegexParseTransform for parsing irregular logs into structured logs.


  1. Support for parsing irregular logs
  2. Support multiple key information extraction.
  3. Support retaining original logs.
  4. Support one configuration to parse an entire irregular log.
  5. Compatible with both BATCH and STREAMING job modes.
  6. Transparent integration with all connector-v2 pipelines (no need to modify source/sink plugins).

Usage Scenario

Analyze the following irregular logs for security analysis such as abnormal user behavior, as well as data statistics and display:

  1. Apache/Nginx access logs
  2. Linux Host logs
  3. system syslogs
  4. custom program print logs

Related issues

not have

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct

  • I agree to follow this project's Code of Conduct

Activity

davidzollo

davidzollo commented on May 13, 2025

@davidzollo
Contributor

@ShiDSheng , I have assigend this feature to you and looking forward to your PR ^_^

moved this from Todo to Doing in SeaTunnel RoadMapon May 13, 2025
github-actions

github-actions commented on Jun 13, 2025

@github-actions

This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

github-actions

github-actions commented on Jun 20, 2025

@github-actions

This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

Status

Doing

Milestone

No milestone

Relationships

None yet

    Participants

    @davidzollo@ShiDSheng

    Issue actions

      [Feature][transform-v2] Add a 'RegexParseTransform' plugin in Apache SeaTunnel to parse irregular logs into structured logs · Issue #9308 · apache/seatunnel