Search results

[WIP][SPARK-52449][CONNECT] Make datatypes for Expression.Literal.Map/Array optional

CONNECT

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51473

#51473 In apache/spark;

· heyihong opened on Jul 14, 2025

[SPARK-52770][CONNECT] Support TIME type in connect proto

CONNECT

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51464

#51464 In apache/spark;

· peter-toth opened on Jul 13, 2025

[SPARK-52779][SQL][CONNECT] Support TimeType literal in Connect

CONNECT

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51462

#51462 In apache/spark;

· dengziming opened on Jul 12, 2025

[SPARK-52777][SQL] Enable shuffle cleanup mode configuration in Spark SQL

CONNECT

SQL

Status: Open (in progress).

apache/sparknumber 51458

#51458 In apache/spark;

· karuppayya opened on Jul 12, 2025

[SPARK-52759][SDP][SQL] Throw exception if pipeline has no tables or persisted views

CONNECT

SQL

Status: Open (in progress).

apache/sparknumber 51445

#51445 In apache/spark;

· JiaqiWang18 opened on Jul 10, 2025

[SPARK-52751][PYTHON][CONNECT] Don't eagerly validate column name in dataframe['col_name']

CONNECT

DOCS

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51400

#51400 In apache/spark;

· zhengruifeng opened on Jul 8, 2025

[SPARK-52640][SDP] Propagate Python Source Code Location

CONNECT

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51344

#51344 In apache/spark;

· AnishMahto opened on Jul 1, 2025

[WIP][SQL][TESTS] Disable stable column aliases in tests if assumed

AVRO

CONNECT

SQL

Status: Draft (not ready).

apache/sparknumber 51337

#51337 In apache/spark;

· MaxGekk opened on Jul 1, 2025

[SPARK-51051][SQL]Add an optional parameter for array_position function to specify starting index for matching.

CONNECT

PYTHON

SQL

Status: Draft (not ready).

apache/sparknumber 51317

#51317 In apache/spark;

· konjac opened on Jun 29, 2025

[WIP][PYTHON] Arrow UDF for aggregation

BUILD

CONNECT

CORE

PYTHON

SQL

Status: Draft (not ready).

apache/sparknumber 51292

#51292 In apache/spark;

· zhengruifeng opened on Jun 26, 2025

[Test]

CONNECT

DOCS

ML

MLLIB

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51221

#51221 In apache/spark;

· WeichenXu123 opened on Jun 19, 2025

[SPARK-52444][SQL][CONNECT] Add support for Variant/Char/Varchar Literal

CONNECT

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51215

#51215 In apache/spark;

· dengziming opened on Jun 18, 2025

[SPARK-52088][CORE] Refactor the ClosureCleaner#clean and avoid using the -Djdk.reflect.useDirectMethodHandle=false

BUILD

CONNECT

INFRA

SQL

Status: Open (in progress).

apache/sparknumber 51028

#51028 In apache/spark;

· yuexing opened on May 27, 2025

[SPARK-52104][CONNECT][SCALA] Validate column name eagerly in Spark Connect Scala Client

CONNECT

SQL

Status: Open (in progress).

apache/sparknumber 50873

#50873 In apache/spark;

· xi-db opened on May 13, 2025

[SPARK-51949][CONNECT] Bump up the default value of CONNECT_GRPC_MARSHALLER_RECURSION_LIMIT

CONNECT

SQL

Status: Draft (not ready).

apache/sparknumber 50756

#50756 In apache/spark;

· vicennial opened on Apr 29, 2025

Enable -Xsource:3 compiler flag

BUILD

CONNECT

CORE

DSTREAM

EXAMPLES

GRAPHX

KUBERNETES

ML

MLLIB

PROTOBUF

PYTHON

R

SQL

STRUCTURED STREAMING

WEB UI

Status: Open (in progress).

apache/sparknumber 50474

#50474 In apache/spark;

· joan38 opened on Apr 1, 2025

[SPARK-51644][BUILD][CONNECT] fix for spark shells

BUILD

CONNECT

SQL

Status: Open (in progress).

apache/sparknumber 50437

#50437 In apache/spark;

· vrozov opened on Mar 27, 2025

[SPARK-50903][CONNECT] Cache logical plans after analysis

CONNECT

SQL

Status: Open (in progress).

apache/sparknumber 49584

#49584 In apache/spark;

· ghost opened on Jan 21, 2025

[SPARK-48359][SQL] Built-in functions for Zstd compression and decompression

CONNECT

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 46672

#46672 In apache/spark;

· xi-db opened on May 20, 2024