Skip to content

Commit a258f92

Browse files
committed
[SPARK-52441][INFRA] Skip testing sql/pipelines module in the Maven daily test when the input branch is branch-4.0
### What changes were proposed in this pull request? This pr aims to skip testing `sql/pipelines` module in the Maven daily test when the input branch is branch-4.0 because branch-4.0 doesn't have this module ### Why are the changes needed? Fix branch-4.0 maven daily test: - https://github.com/apache/spark/actions/runs/15561695563/job/43815397047 ![image](https://github.com/user-attachments/assets/583289f0-0fbf-4ff2-b45d-97de9e59bacf) ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? - Monitor the Maven daily tests for branch-4.0 after merged ### Was this patch authored or co-authored using generative AI tooling? No Closes #51151 from LuciferYang/SPARK-52441. Authored-by: yangjie01 <[email protected]> Signed-off-by: yangjie01 <[email protected]>
1 parent 46de57b commit a258f92

File tree

1 file changed

+5
-0
lines changed

1 file changed

+5
-0
lines changed

.github/workflows/maven_test.yml

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -190,6 +190,7 @@ jobs:
190190
export MAVEN_OPTS="-Xss64m -Xmx4g -Xms4g -XX:ReservedCodeCacheSize=128m -Dorg.slf4j.simpleLogger.defaultLogLevel=WARN"
191191
export MAVEN_CLI_OPTS="--no-transfer-progress"
192192
export JAVA_VERSION=${{ matrix.java }}
193+
export INPUT_BRANCH=${{ inputs.branch }}
193194
export ENABLE_KINESIS_TESTS=0
194195
# Replace with the real module name, for example, connector#kafka-0-10 -> connector/kafka-0-10
195196
export TEST_MODULES=`echo "$MODULES_TO_TEST" | sed -e "s%#%/%g"`
@@ -209,6 +210,10 @@ jobs:
209210
elif [[ "$MODULES_TO_TEST" == *"sql#hive-thriftserver"* ]]; then
210211
# To avoid a compilation loop, for the `sql/hive-thriftserver` module, run `clean install` instead
211212
./build/mvn $MAVEN_CLI_OPTS -pl "$TEST_MODULES" -Pyarn -Pkubernetes -Pvolcano -Phive -Phive-thriftserver -Phadoop-cloud -Pjvm-profiler -Pspark-ganglia-lgpl -Pkinesis-asl -Djava.version=${JAVA_VERSION/-ea} clean install -fae
213+
elif [[ "$MODULES_TO_TEST" == *"sql#pipelines"* && "$INPUT_BRANCH" == "branch-4.0" ]]; then
214+
# SPARK-52441: Remove sql/pipelines from TEST_MODULES for branch-4.0, this branch can be deleted after the EOL of branch-4.0.
215+
TEST_MODULES=${TEST_MODULES/,sql\/pipelines/}
216+
./build/mvn $MAVEN_CLI_OPTS -pl "$TEST_MODULES" -Pyarn -Pkubernetes -Pvolcano -Phive -Phive-thriftserver -Pspark-ganglia-lgpl -Phadoop-cloud -Pjvm-profiler -Pkinesis-asl -Djava.version=${JAVA_VERSION/-ea} test -fae
212217
else
213218
./build/mvn $MAVEN_CLI_OPTS -pl "$TEST_MODULES" -Pyarn -Pkubernetes -Pvolcano -Phive -Phive-thriftserver -Pspark-ganglia-lgpl -Phadoop-cloud -Pjvm-profiler -Pkinesis-asl -Djava.version=${JAVA_VERSION/-ea} test -fae
214219
fi

0 commit comments

Comments
 (0)