Skip to content

[postgres] fix when backfill will scan all table schame which match config #3985

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 6 commits into
base: master
Choose a base branch
from

Conversation

hql0312
Copy link

@hql0312 hql0312 commented Apr 10, 2025

copy pr #3979

@hql0312
Copy link
Author

hql0312 commented Apr 10, 2025

@joyCurry30 i add new pr from #3979

StreamSplit streamSplit = (StreamSplit) sourceSplitBase;
// when backfilled, will send specified table schema.
return !StreamSplit.STREAM_SPLIT_ID.equalsIgnoreCase(streamSplit.splitId())
&& streamSplit.getTableSchemas() != null
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is streamSplit.getTableSchemas() != null && streamSplit.getTableSchemas().size() == 1; needed? Whether !StreamSplit.STREAM_SPLIT_ID.equalsIgnoreCase(streamSplit.splitId()) is enough?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it can be simple, done.
@loserwang1024

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@loserwang1024 please review again.

Copy link
Contributor

@loserwang1024 loserwang1024 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, @leonardBang @ruanhang1993 , WDYT?

Copy link
Contributor

@leonardBang leonardBang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@hql0312
Copy link
Author

hql0312 commented Apr 25, 2025

@leonardBang how to fix the CI test, the code which have problem is not changed by me

@leonardBang
Copy link
Contributor

@leonardBang how to fix the CI test, the code which have problem is not changed by me

you can try to rebase to latest master to fix the failed ci tests

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants